2023-12-05T12:48:37.459 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T12:48:37.459 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738 --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi --owner scheduled_gabrioux@teuthology --verbose -- /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/orig.config.yaml 2023-12-05T12:48:37.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T12:48:37.603 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738 branch: wip-guits-testing-2023-12-05-0857 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7477738' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-guits-testing-2023-12-05-0857 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-testing-2023-12-05-0857 sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 6586 sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-testing-2023-12-05-0857 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8u5Xufgsj8kse/lSzXjFlxRJUe03SS4csCqrrA4wscfGtg1jNWu3FFT+BT4Joerd0rPaAmHMx39hENIANfhPw= smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVRz/esdz98leH1DXsUIhaPR9E13ph7Aa69IvrLLJi2ulcizaNi4zYjElgIHaBcuHZGUcXKT9jOcXKPjlCA/0g= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-05_12:39:43 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-05T12:48:37.603 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa; will attempt to use it 2023-12-05T12:48:37.604 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks 2023-12-05T12:48:37.604 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-05T12:48:37.605 INFO:teuthology.task.internal:Checking packages... 2023-12-05T12:48:37.628 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e6605fb8725c25c4838cef6a39f30df73f1ed149' 2023-12-05T12:48:37.628 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T12:48:37.628 INFO:teuthology.packaging:ref: None 2023-12-05T12:48:37.629 INFO:teuthology.packaging:tag: None 2023-12-05T12:48:37.629 INFO:teuthology.packaging:branch: wip-guits-testing-2023-12-05-0857 2023-12-05T12:48:37.629 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T12:48:37.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-guits-testing-2023-12-05-0857 2023-12-05T12:48:37.850 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-13.ge6605fb8 2023-12-05T12:48:37.850 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-05T12:48:37.856 INFO:teuthology.task.internal:no buildpackages task found 2023-12-05T12:48:37.857 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-05T12:48:37.876 INFO:teuthology.task.internal:Saving configuration 2023-12-05T12:48:37.898 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-05T12:48:37.904 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T12:48:37.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 12:41:15.499889', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8u5Xufgsj8kse/lSzXjFlxRJUe03SS4csCqrrA4wscfGtg1jNWu3FFT+BT4Joerd0rPaAmHMx39hENIANfhPw='} 2023-12-05T12:48:37.950 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 12:41:15.501394', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVRz/esdz98leH1DXsUIhaPR9E13ph7Aa69IvrLLJi2ulcizaNi4zYjElgIHaBcuHZGUcXKT9jOcXKPjlCA/0g='} 2023-12-05T12:48:37.950 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-05T12:48:37.956 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-05T12:48:37.956 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-05T12:48:37.956 INFO:teuthology.run_tasks:Running task console_log... 2023-12-05T12:48:38.035 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fae8a7699d0>, signals=[15]) 2023-12-05T12:48:38.036 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-05T12:48:38.044 INFO:teuthology.task.internal:Opening connections... 2023-12-05T12:48:38.044 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T12:48:38.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:48:38.118 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2023-12-05T12:48:38.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:48:38.188 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-05T12:48:38.195 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-12-05T12:48:38.218 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-12-05T12:48:38.218 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-12-05T12:48:38.281 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-12-05T12:48:38.281 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2023-12-05T12:48:38.281 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-12-05T12:48:38.281 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-12-05T12:48:38.282 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T12:48:38.283 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T12:48:38.283 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T12:48:38.284 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-12-05T12:48:38.305 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-12-05T12:48:38.329 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-12-05T12:48:38.329 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-12-05T12:48:38.391 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-12-05T12:48:38.392 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T12:48:38.393 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T12:48:38.393 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T12:48:38.393 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-12-05T12:48:38.421 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-05T12:48:38.431 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-05T12:48:38.436 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-05T12:48:38.436 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2023-12-05T12:48:38.439 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2023-12-05T12:48:38.458 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-05T12:48:38.524 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-05T12:48:38.524 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2023-12-05T12:48:38.527 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2023-12-05T12:48:38.562 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-05T12:48:38.615 INFO:teuthology.run_tasks:Running task kernel... 2023-12-05T12:48:38.629 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-05T12:48:38.629 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-05T12:48:38.629 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-05T12:48:38.630 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-05T12:48:38.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T12:48:38.651 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-12-05T12:48:38.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T12:48:38.652 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-12-05T12:48:38.713 INFO:teuthology.orchestra.run.smithi052.stdout:4.18.0-489.el8.x86_64 2023-12-05T12:48:38.714 INFO:teuthology.task.kernel:Running kernel on smithi052: 4.18.0-489.el8.x86_64 2023-12-05T12:48:38.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2023-12-05T12:48:38.715 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-489.el8.x86_64 2023-12-05T12:48:38.715 INFO:teuthology.task.kernel:Running kernel on smithi029: 4.18.0-489.el8.x86_64 2023-12-05T12:48:38.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2023-12-05T12:48:57.296 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - AppStream 2.1 MB/s | 34 MB 00:16 2023-12-05T12:48:58.152 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - AppStream 2.3 MB/s | 34 MB 00:15 2023-12-05T12:49:05.682 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - BaseOS 31 MB/s | 55 MB 00:01 2023-12-05T12:49:07.672 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 55 MB 00:02 2023-12-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - Extras 23 kB/s | 18 kB 00:00 2023-12-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.9 kB 00:00 2023-12-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras 14 kB/s | 18 kB 00:01 2023-12-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2023-12-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.9 kB 00:00 2023-12-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-05T12:49:21.618 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 428 kB/s | 24 kB 00:00 2023-12-05T12:49:21.891 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 16 MB 00:03 2023-12-05T12:49:25.392 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-05T12:49:25.392 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-05T12:49:25.690 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T12:49:25.691 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:Install 3 Packages 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T12:49:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 90 M 2023-12-05T12:49:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 96 M 2023-12-05T12:49:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T12:49:25.881 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 548 kB/s | 24 kB 00:00 2023-12-05T12:49:26.886 INFO:teuthology.orchestra.run.smithi052.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 10 MB/s | 10 MB 00:00 2023-12-05T12:49:28.094 INFO:teuthology.orchestra.run.smithi052.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2023-12-05T12:49:28.961 INFO:teuthology.orchestra.run.smithi052.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 14 MB/s | 43 MB 00:03 2023-12-05T12:49:28.961 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T12:49:28.961 INFO:teuthology.orchestra.run.smithi052.stdout:Total 27 MB/s | 90 MB 00:03 2023-12-05T12:49:29.666 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T12:49:29.748 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-05T12:49:29.749 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-05T12:49:30.074 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T12:49:30.074 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T12:49:30.074 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2023-12-05T12:49:30.074 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T12:49:30.074 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T12:49:30.074 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:Install 3 Packages 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 90 M 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 96 M 2023-12-05T12:49:30.075 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T12:49:30.122 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T12:49:30.122 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T12:49:31.109 INFO:teuthology.orchestra.run.smithi029.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 12 MB/s | 10 MB 00:00 2023-12-05T12:49:31.423 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T12:49:31.447 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T12:49:32.322 INFO:teuthology.orchestra.run.smithi029.stdout:(2/3): kernel-core-4.18.0-526.el8.x86_64.rpm 21 MB/s | 43 MB 00:02 2023-12-05T12:49:32.926 INFO:teuthology.orchestra.run.smithi029.stdout:(3/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 14 MB/s | 36 MB 00:02 2023-12-05T12:49:32.927 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T12:49:32.927 INFO:teuthology.orchestra.run.smithi029.stdout:Total 31 MB/s | 90 MB 00:02 2023-12-05T12:49:33.637 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T12:49:34.127 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T12:49:34.127 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T12:49:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T12:49:34.963 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-05T12:49:35.417 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T12:49:35.698 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T12:49:38.683 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-05T12:49:38.759 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T12:49:39.071 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-05T12:49:39.410 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-05T12:49:42.742 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-05T12:49:43.047 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:49:43.114 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-05T12:49:43.610 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-05T12:49:47.286 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-05T12:49:47.628 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:06.482 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:06.507 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:06.872 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:06.872 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-05T12:50:06.872 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-05T12:50:07.684 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:07.685 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T12:50:07.685 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T12:50:07.685 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-05T12:50:07.685 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-05T12:50:07.685 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T12:50:07.685 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T12:50:07.835 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2023-12-05T12:50:08.061 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-05T12:50:08.061 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-05T12:50:08.061 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-05T12:50:08.061 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-05T12:50:08.061 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-05T12:50:08.062 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-05T12:50:08.062 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2023-12-05T12:50:08.062 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2023-12-05T12:50:08.280 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-05T12:50:08.281 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-05T12:50:08.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2023-12-05T12:50:08.315 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.02 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 129.el8 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Group : System Environment/Base 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 9265586 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-05T12:50:08.316 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:Relocations : (not relocatable) 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : CentOS BuildSystem 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T12:50:08.317 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2023-12-05T12:50:08.318 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-05T12:50:08.318 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 4.18.0-526.el8.x86_64 2023-12-05T12:50:08.318 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-05T12:50:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2023-12-05T12:50:11.384 INFO:teuthology.orchestra.run.smithi052.stderr:done 2023-12-05T12:50:11.386 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2023-12-05T12:50:11.407 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.WGTKSKdoaR 2023-12-05T12:50:11.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WGTKSKdoaR 2023-12-05T12:50:11.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.WGTKSKdoaR 2023-12-05T12:50:11.631 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.WGTKSKdoaR is 6KB 2023-12-05T12:50:11.680 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.WGTKSKdoaR 2023-12-05T12:50:11.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2023-12-05T12:50:11.764 INFO:teuthology.orchestra.run.smithi052.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-05T12:50:11.764 INFO:teuthology.orchestra.run.smithi052.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-05T12:50:11.764 INFO:teuthology.orchestra.run.smithi052.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-05T12:50:11.765 INFO:teuthology.orchestra.run.smithi052.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-05T12:50:11.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-05T12:50:11.830 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:11.856 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:11.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2023-12-05T12:50:12.221 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:12.222 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-05T12:50:12.222 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-05T12:50:13.052 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-05T12:50:13.053 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T12:50:13.053 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T12:50:13.053 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-05T12:50:13.053 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-05T12:50:13.053 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T12:50:13.053 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T12:50:13.202 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-12-05T12:50:13.457 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-05T12:50:13.458 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-05T12:50:13.458 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-05T12:50:13.458 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-05T12:50:13.458 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-05T12:50:13.458 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-05T12:50:13.458 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2023-12-05T12:50:13.458 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2023-12-05T12:50:13.676 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-05T12:50:13.676 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-05T12:50:13.677 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2023-12-05T12:50:13.712 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.02 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 129.el8 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Group : System Environment/Base 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 9265586 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-05T12:50:13.713 INFO:teuthology.orchestra.run.smithi029.stdout:Relocations : (not relocatable) 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : CentOS BuildSystem 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T12:50:13.714 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2023-12-05T12:50:13.715 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-05T12:50:13.715 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 4.18.0-526.el8.x86_64 2023-12-05T12:50:13.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-05T12:50:15.818 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2023-12-05T12:50:18.461 INFO:teuthology.orchestra.run.smithi029.stderr:done 2023-12-05T12:50:18.463 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-12-05T12:50:18.503 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.8vJFZ8B68n 2023-12-05T12:50:18.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8vJFZ8B68n 2023-12-05T12:50:18.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.8vJFZ8B68n 2023-12-05T12:50:18.721 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.8vJFZ8B68n is 6KB 2023-12-05T12:50:18.769 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.8vJFZ8B68n 2023-12-05T12:50:18.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2023-12-05T12:50:18.861 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-05T12:50:18.861 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-05T12:50:18.861 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-05T12:50:18.862 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-05T12:50:18.863 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-05T12:50:19.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2023-12-05T12:50:41.954 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-05T12:50:41.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-05T12:50:41.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:50:49.046 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-05T12:50:49.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-05T12:50:49.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:51:00.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-12-05T12:51:07.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-12-05T12:51:09.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-05T12:51:09.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:51:16.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-05T12:51:16.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:52:09.387 DEBUG:teuthology.orchestra.remote:timed out 2023-12-05T12:52:16.510 DEBUG:teuthology.orchestra.remote:timed out 2023-12-05T12:52:21.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-05T12:52:21.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:52:21.674 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-12-05T12:52:21.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-05T12:52:21.975 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-526.el8.x86_64"... 2023-12-05T12:52:21.975 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2023-12-05T12:52:21.997 INFO:teuthology.orchestra.run.smithi052.stdout:4.18.0-526.el8.x86_64 2023-12-05T12:52:21.998 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-05T12:52:21.998 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-05T12:52:21.998 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-05T12:52:22.999 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-05T12:52:22.999 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-05T12:52:23.074 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2023-12-05T12:52:23.090 DEBUG:teuthology.parallel:result is None 2023-12-05T12:52:28.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-05T12:52:28.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T12:52:28.936 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-12-05T12:52:29.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-05T12:52:29.311 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-526.el8.x86_64"... 2023-12-05T12:52:29.311 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-12-05T12:52:29.335 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-526.el8.x86_64 2023-12-05T12:52:29.335 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-05T12:52:29.335 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-05T12:52:29.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-05T12:52:30.337 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-05T12:52:30.338 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-05T12:52:30.456 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2023-12-05T12:52:30.473 DEBUG:teuthology.parallel:result is None 2023-12-05T12:52:30.473 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-05T12:52:30.485 INFO:teuthology.task.internal:Creating test directory... 2023-12-05T12:52:30.486 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-05T12:52:30.491 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-05T12:52:30.514 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-05T12:52:30.521 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-05T12:52:30.528 INFO:teuthology.task.internal:Creating archive directory... 2023-12-05T12:52:30.528 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-05T12:52:30.558 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-05T12:52:30.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-05T12:52:30.607 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-05T12:52:30.607 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-05T12:52:30.634 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-05T12:52:30.675 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T12:52:30.680 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T12:52:30.688 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T12:52:30.692 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T12:52:30.693 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-05T12:52:30.708 INFO:teuthology.task.internal:Configuring sudo... 2023-12-05T12:52:30.709 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-05T12:52:30.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-05T12:52:30.779 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-05T12:52:30.807 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-05T12:52:30.807 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-05T12:52:30.818 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-05T12:52:30.845 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T12:52:30.931 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T12:52:30.984 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T12:52:31.079 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T12:52:31.126 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T12:52:31.126 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-05T12:52:31.206 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T12:52:31.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T12:52:31.315 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T12:52:31.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T12:52:31.463 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T12:52:31.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-05T12:52:31.537 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2023-12-05T12:52:31.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2023-12-05T12:52:31.604 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T12:52:31.642 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T12:52:31.985 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-05T12:52:31.993 INFO:teuthology.task.internal:Starting timer... 2023-12-05T12:52:31.993 INFO:teuthology.run_tasks:Running task pcp... 2023-12-05T12:52:32.005 INFO:teuthology.run_tasks:Running task selinux... 2023-12-05T12:52:32.015 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-05T12:52:32.015 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2023-12-05T12:52:32.113 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2023-12-05T12:52:32.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2023-12-05T12:52:32.210 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2023-12-05T12:52:32.212 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-05T12:52:32.212 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2023-12-05T12:52:32.254 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2023-12-05T12:52:32.255 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2023-12-05T12:52:32.329 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2023-12-05T12:52:32.329 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi052.front.sepia.ceph.com': 'permissive'} 2023-12-05T12:52:32.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T12:52:32.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T12:52:32.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T12:52:32.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T12:52:32.404 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-05T12:52:32.404 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2023-12-05T12:52:32.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2023-12-05T12:52:32.498 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-05T12:52:32.514 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-05T12:52:32.514 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-05T12:52:32.553 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-05T12:52:32.561 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi052.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-05T13:09:21.358 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi052.front.sepia.ceph.com')] 2023-12-05T13:09:21.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-05T13:09:21.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T13:09:21.433 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-12-05T13:09:21.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-12-05T13:09:21.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-05T13:09:21.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T13:09:21.581 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-12-05T13:09:21.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-12-05T13:09:21.661 INFO:teuthology.run_tasks:Running task clock... 2023-12-05T13:09:21.671 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-05T13:09:21.671 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-05T13:09:21.672 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T13:09:21.674 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-05T13:09:21.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T13:09:21.711 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-05T13:09:21.729 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-05T13:09:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-05T13:09:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-05T13:09:21.802 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2023-12-05T13:09:21.813 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2023-12-05T13:09:21.830 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-05T13:09:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2023-12-05T13:09:21.846 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-05T13:09:21.848 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2023-12-05T13:09:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-05T13:09:21.880 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-05T13:09:21.915 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-12-05T13:09:21.919 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T13:09:21.919 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-12-05T13:09:21.919 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.919 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.919 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.919 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:bash: ntpq: command not found 2023-12-05T13:09:21.974 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T13:09:21.974 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-12-05T13:09:21.974 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.974 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.974 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.975 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:09:21.976 INFO:teuthology.run_tasks:Running task pexec... 2023-12-05T13:09:21.985 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-05T13:09:21.986 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:09:21.986 DEBUG:teuthology.orchestra.run.smithi029:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-05T13:09:21.986 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi052.front.sepia.ceph.com 2023-12-05T13:09:21.986 DEBUG:teuthology.orchestra.run.smithi052:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-05T13:09:22.996 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:53 ago on Tue 05 Dec 2023 01:07:29 PM UTC. 2023-12-05T13:09:23.025 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:57 ago on Tue 05 Dec 2023 01:07:25 PM UTC. 2023-12-05T13:09:25.381 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout:Resetting modules: 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout: container-tools 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:09:25.382 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:25.418 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:09:25.419 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:09:25.419 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-12-05T13:09:25.419 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:09:25.419 INFO:teuthology.orchestra.run.smithi052.stdout:Resetting modules: 2023-12-05T13:09:25.420 INFO:teuthology.orchestra.run.smithi052.stdout: container-tools 2023-12-05T13:09:25.420 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:25.420 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:09:25.420 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:09:25.420 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:25.659 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:09:25.721 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:09:26.750 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:57 ago on Tue 05 Dec 2023 01:07:29 PM UTC. 2023-12-05T13:09:26.837 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:01 ago on Tue 05 Dec 2023 01:07:25 PM UTC. 2023-12-05T13:09:29.122 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:09:29.186 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:09:29.328 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:09:29.328 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:09:29.328 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:09:29.328 INFO:teuthology.orchestra.run.smithi029.stdout:Installing group/module packages: 2023-12-05T13:09:29.328 INFO:teuthology.orchestra.run.smithi029.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-05T13:09:29.328 INFO:teuthology.orchestra.run.smithi029.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-05T13:09:29.329 INFO:teuthology.orchestra.run.smithi029.stdout:Installing module profiles: 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout: container-tools/common 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling module streams: 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout: container-tools rhel8 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout:Install 13 Packages 2023-12-05T13:09:29.330 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:29.331 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 27 M 2023-12-05T13:09:29.331 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 89 M 2023-12-05T13:09:29.331 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout:Installing group/module packages: 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-05T13:09:29.391 INFO:teuthology.orchestra.run.smithi052.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout:Installing module profiles: 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: container-tools/common 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout:Enabling module streams: 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: container-tools rhel8 2023-12-05T13:09:29.392 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout:Install 13 Packages 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 27 M 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 89 M 2023-12-05T13:09:29.393 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:09:30.718 INFO:teuthology.orchestra.run.smithi052.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 611 kB/s | 750 kB 00:01 2023-12-05T13:09:30.927 INFO:teuthology.orchestra.run.smithi052.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 715 kB/s | 1.0 MB 00:01 2023-12-05T13:09:30.952 INFO:teuthology.orchestra.run.smithi052.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 162 kB/s | 38 kB 00:00 2023-12-05T13:09:31.160 INFO:teuthology.orchestra.run.smithi052.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 1.0 MB/s | 241 kB 00:00 2023-12-05T13:09:31.378 INFO:teuthology.orchestra.run.smithi052.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 819 kB/s | 178 kB 00:00 2023-12-05T13:09:31.453 INFO:teuthology.orchestra.run.smithi052.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 331 kB/s | 25 kB 00:00 2023-12-05T13:09:31.587 INFO:teuthology.orchestra.run.smithi052.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 705 kB/s | 94 kB 00:00 2023-12-05T13:09:32.149 INFO:teuthology.orchestra.run.smithi029.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 293 kB/s | 750 kB 00:02 2023-12-05T13:09:32.258 INFO:teuthology.orchestra.run.smithi029.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 349 kB/s | 38 kB 00:00 2023-12-05T13:09:32.834 INFO:teuthology.orchestra.run.smithi029.stdout:(3/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 419 kB/s | 241 kB 00:00 2023-12-05T13:09:32.876 INFO:teuthology.orchestra.run.smithi029.stdout:(4/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 313 kB/s | 1.0 MB 00:03 2023-12-05T13:09:33.184 INFO:teuthology.orchestra.run.smithi029.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 576 kB/s | 178 kB 00:00 2023-12-05T13:09:33.260 INFO:teuthology.orchestra.run.smithi029.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 329 kB/s | 25 kB 00:00 2023-12-05T13:09:33.337 INFO:teuthology.orchestra.run.smithi052.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 1.6 MB/s | 3.9 MB 00:02 2023-12-05T13:09:33.411 INFO:teuthology.orchestra.run.smithi029.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 625 kB/s | 94 kB 00:00 2023-12-05T13:09:34.462 INFO:teuthology.orchestra.run.smithi052.stdout:(9/13): toolbox-0.0.99.4-6.module_el8+712+4cd1b 2.3 MB/s | 2.5 MB 00:01 2023-12-05T13:09:34.520 INFO:teuthology.orchestra.run.smithi052.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 905 kB/s | 53 kB 00:00 2023-12-05T13:09:34.579 INFO:teuthology.orchestra.run.smithi052.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 702 kB/s | 41 kB 00:00 2023-12-05T13:09:35.944 INFO:teuthology.orchestra.run.smithi029.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 1.3 MB/s | 3.9 MB 00:03 2023-12-05T13:09:36.879 INFO:teuthology.orchestra.run.smithi052.stdout:(12/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 1.5 MB/s | 8.1 MB 00:05 2023-12-05T13:09:37.196 INFO:teuthology.orchestra.run.smithi029.stdout:(9/13): toolbox-0.0.99.4-6.module_el8+712+4cd1b 2.0 MB/s | 2.5 MB 00:01 2023-12-05T13:09:37.272 INFO:teuthology.orchestra.run.smithi029.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 701 kB/s | 53 kB 00:00 2023-12-05T13:09:37.347 INFO:teuthology.orchestra.run.smithi029.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 545 kB/s | 41 kB 00:00 2023-12-05T13:09:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:(13/13): buildah-1.32.0-1.module_el8+712+4cd1bd 1.2 MB/s | 9.6 MB 00:07 2023-12-05T13:09:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:09:37.463 INFO:teuthology.orchestra.run.smithi052.stdout:Total 3.3 MB/s | 27 MB 00:08 2023-12-05T13:09:37.753 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:09:37.777 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:09:37.777 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:09:37.831 INFO:teuthology.orchestra.run.smithi029.stdout:(12/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 1.8 MB/s | 8.1 MB 00:04 2023-12-05T13:09:38.064 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:09:38.067 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:09:38.099 INFO:teuthology.orchestra.run.smithi029.stdout:(13/13): buildah-1.32.0-1.module_el8+712+4cd1bd 1.1 MB/s | 9.6 MB 00:08 2023-12-05T13:09:38.100 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:09:38.100 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.0 MB/s | 27 MB 00:08 2023-12-05T13:09:38.392 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:09:38.417 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:09:38.417 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:09:38.698 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:09:38.701 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:09:38.816 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:09:39.060 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-05T13:09:39.235 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-05T13:09:39.445 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:09:39.579 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-05T13:09:39.654 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-05T13:09:39.821 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-05T13:09:39.845 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T13:09:40.030 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-05T13:09:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T13:09:40.416 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-05T13:09:40.935 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-05T13:09:41.472 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T13:09:41.730 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-05T13:09:41.961 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-05T13:09:42.012 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T13:09:42.207 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-05T13:09:42.267 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-05T13:09:42.495 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-05T13:09:42.643 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-05T13:09:42.801 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-05T13:09:43.246 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-05T13:09:43.654 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T13:09:43.903 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-05T13:09:44.075 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T13:09:44.199 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T13:09:44.466 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-05T13:09:44.596 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-05T13:09:44.597 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-05T13:09:44.597 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T13:09:44.597 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-05T13:09:44.660 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T13:09:45.151 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T13:09:45.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-05T13:09:45.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-05T13:09:45.151 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T13:09:45.152 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-05T13:09:45.519 INFO:teuthology.orchestra.run.smithi052.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:09:45.520 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:09:45.799 DEBUG:teuthology.parallel:result is None 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-05T13:09:46.040 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:09:46.041 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:09:46.282 DEBUG:teuthology.parallel:result is None 2023-12-05T13:09:46.282 INFO:teuthology.run_tasks:Running task install... 2023-12-05T13:09:46.291 DEBUG:teuthology.task.install:project ceph 2023-12-05T13:09:46.291 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149'}} 2023-12-05T13:09:46.291 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149'} 2023-12-05T13:09:46.291 INFO:teuthology.task.install:Using flavor: default 2023-12-05T13:09:46.297 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-05T13:09:46.297 INFO:teuthology.task.install:extra packages: [] 2023-12-05T13:09:46.297 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149', 'tag': None, 'wait_for_package': False} 2023-12-05T13:09:46.298 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T13:09:46.298 INFO:teuthology.packaging:ref: None 2023-12-05T13:09:46.298 INFO:teuthology.packaging:tag: None 2023-12-05T13:09:46.298 INFO:teuthology.packaging:branch: quincy 2023-12-05T13:09:46.298 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:09:46.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T13:09:46.300 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149', 'tag': None, 'wait_for_package': False} 2023-12-05T13:09:46.300 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T13:09:46.300 INFO:teuthology.packaging:ref: None 2023-12-05T13:09:46.301 INFO:teuthology.packaging:tag: None 2023-12-05T13:09:46.301 INFO:teuthology.packaging:branch: quincy 2023-12-05T13:09:46.301 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:09:46.301 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T13:09:46.518 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/ 2023-12-05T13:09:46.519 INFO:teuthology.task.install.rpm:Package version is 17.2.7-109.g1fd3ca3c 2023-12-05T13:09:46.549 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/ 2023-12-05T13:09:46.550 INFO:teuthology.task.install.rpm:Package version is 17.2.7-109.g1fd3ca3c 2023-12-05T13:09:46.892 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-05T13:09:46.893 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:09:46.893 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-05T13:09:46.905 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-05T13:09:46.905 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:09:46.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-05T13:09:46.929 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-05T13:09:46.929 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T13:09:46.930 INFO:teuthology.packaging:ref: None 2023-12-05T13:09:46.930 INFO:teuthology.packaging:tag: None 2023-12-05T13:09:46.930 INFO:teuthology.packaging:branch: quincy 2023-12-05T13:09:46.930 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:09:46.930 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-05T13:09:46.941 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-05T13:09:46.941 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T13:09:46.941 INFO:teuthology.packaging:ref: None 2023-12-05T13:09:46.941 INFO:teuthology.packaging:tag: None 2023-12-05T13:09:46.942 INFO:teuthology.packaging:branch: quincy 2023-12-05T13:09:46.942 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:09:46.942 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-05T13:09:47.006 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-05T13:09:47.017 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-05T13:09:47.093 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-05T13:09:47.103 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-05T13:09:47.126 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2023-12-05T13:09:47.128 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2023-12-05T13:09:47.135 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2023-12-05T13:09:47.136 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2023-12-05T13:09:47.438 INFO:teuthology.orchestra.run.smithi052.stdout:76 files removed 2023-12-05T13:09:47.446 INFO:teuthology.orchestra.run.smithi029.stdout:76 files removed 2023-12-05T13:09:47.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw 2023-12-05T13:09:47.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw 2023-12-05T13:09:49.071 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 70 kB/s | 78 kB 00:01 2023-12-05T13:09:49.087 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 68 kB/s | 78 kB 00:01 2023-12-05T13:09:49.907 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 12 kB/s | 9.1 kB 00:00 2023-12-05T13:09:50.089 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 9.4 kB/s | 9.1 kB 00:00 2023-12-05T13:09:50.658 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-12-05T13:09:51.033 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 1.6 kB/s | 1.5 kB 00:00 2023-12-05T13:10:00.357 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - AppStream 3.5 MB/s | 34 MB 00:09 2023-12-05T13:10:02.192 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - AppStream 3.1 MB/s | 34 MB 00:11 2023-12-05T13:10:09.842 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 55 MB 00:02 2023-12-05T13:10:11.361 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 55 MB 00:02 2023-12-05T13:10:19.034 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-12-05T13:10:19.584 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.9 kB 00:00 2023-12-05T13:10:21.549 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras 13 kB/s | 18 kB 00:01 2023-12-05T13:10:22.200 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-12-05T13:10:23.352 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - PowerTools 1.8 MB/s | 6.6 MB 00:03 2023-12-05T13:10:23.427 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - PowerTools 6.3 MB/s | 6.6 MB 00:01 2023-12-05T13:10:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-05T13:10:25.046 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-05T13:10:26.240 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-12-05T13:10:27.358 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 16 MB 00:02 2023-12-05T13:10:30.579 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 374 kB/s | 24 kB 00:00 2023-12-05T13:10:31.742 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 363 kB/s | 24 kB 00:00 2023-12-05T13:10:35.613 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.6 M 2023-12-05T13:10:35.616 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.2 M 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 23 M 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 24 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 796 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 506 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.6 M 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 45 k 2023-12-05T13:10:35.617 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 115 k 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 190 k 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 372 k 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 358 k 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 107 k 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout:Install 21 Packages 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2023-12-05T13:10:35.618 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:10:35.619 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 63 M 2023-12-05T13:10:35.619 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:10:36.848 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.6 M 2023-12-05T13:10:36.851 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.2 M 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 23 M 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 24 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 796 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 506 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.6 M 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-05T13:10:36.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 45 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 115 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 190 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 372 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 358 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 107 k 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout:Install 21 Packages 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 2 Packages 2023-12-05T13:10:36.853 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:10:36.854 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 63 M 2023-12-05T13:10:36.854 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:10:39.546 INFO:teuthology.orchestra.run.smithi052.stdout:(1/23): ceph-base-17.2.7-109.g1fd3ca3c.el8.x86_ 1.5 MB/s | 5.2 MB 00:03 2023-12-05T13:10:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:(2/23): ceph-selinux-17.2.7-109.g1fd3ca3c.el8.x 154 kB/s | 24 kB 00:00 2023-12-05T13:10:40.303 INFO:teuthology.orchestra.run.smithi029.stdout:(1/23): ceph-base-17.2.7-109.g1fd3ca3c.el8.x86_ 1.7 MB/s | 5.2 MB 00:03 2023-12-05T13:10:40.395 INFO:teuthology.orchestra.run.smithi029.stdout:(2/23): ceph-selinux-17.2.7-109.g1fd3ca3c.el8.x 265 kB/s | 24 kB 00:00 2023-12-05T13:10:40.621 INFO:teuthology.orchestra.run.smithi052.stdout:(3/23): libcephfs2-17.2.7-109.g1fd3ca3c.el8.x86 869 kB/s | 796 kB 00:00 2023-12-05T13:10:41.098 INFO:teuthology.orchestra.run.smithi029.stdout:(3/23): libcephfs2-17.2.7-109.g1fd3ca3c.el8.x86 1.1 MB/s | 796 kB 00:00 2023-12-05T13:10:41.197 INFO:teuthology.orchestra.run.smithi052.stdout:(4/23): libradosstriper1-17.2.7-109.g1fd3ca3c.e 880 kB/s | 506 kB 00:00 2023-12-05T13:10:41.265 INFO:teuthology.orchestra.run.smithi029.stdout:(4/23): libradosstriper1-17.2.7-109.g1fd3ca3c.e 3.0 MB/s | 506 kB 00:00 2023-12-05T13:10:42.182 INFO:teuthology.orchestra.run.smithi029.stdout:(5/23): librgw2-17.2.7-109.g1fd3ca3c.el8.x86_64 6.1 MB/s | 5.6 MB 00:00 2023-12-05T13:10:42.249 INFO:teuthology.orchestra.run.smithi029.stdout:(6/23): python3-ceph-argparse-17.2.7-109.g1fd3c 669 kB/s | 45 kB 00:00 2023-12-05T13:10:42.334 INFO:teuthology.orchestra.run.smithi029.stdout:(7/23): python3-ceph-common-17.2.7-109.g1fd3ca3 1.3 MB/s | 115 kB 00:00 2023-12-05T13:10:42.347 INFO:teuthology.orchestra.run.smithi052.stdout:(5/23): ceph-common-17.2.7-109.g1fd3ca3c.el8.x8 3.8 MB/s | 23 MB 00:06 2023-12-05T13:10:42.423 INFO:teuthology.orchestra.run.smithi052.stdout:(6/23): python3-ceph-argparse-17.2.7-109.g1fd3c 599 kB/s | 45 kB 00:00 2023-12-05T13:10:42.426 INFO:teuthology.orchestra.run.smithi029.stdout:(8/23): python3-cephfs-17.2.7-109.g1fd3ca3c.el8 2.0 MB/s | 190 kB 00:00 2023-12-05T13:10:42.523 INFO:teuthology.orchestra.run.smithi052.stdout:(7/23): python3-ceph-common-17.2.7-109.g1fd3ca3 1.1 MB/s | 115 kB 00:00 2023-12-05T13:10:42.526 INFO:teuthology.orchestra.run.smithi029.stdout:(9/23): python3-rados-17.2.7-109.g1fd3ca3c.el8. 3.6 MB/s | 372 kB 00:00 2023-12-05T13:10:42.627 INFO:teuthology.orchestra.run.smithi029.stdout:(10/23): python3-rbd-17.2.7-109.g1fd3ca3c.el8.x 3.5 MB/s | 358 kB 00:00 2023-12-05T13:10:42.673 INFO:teuthology.orchestra.run.smithi052.stdout:(8/23): python3-cephfs-17.2.7-109.g1fd3ca3c.el8 1.2 MB/s | 190 kB 00:00 2023-12-05T13:10:42.727 INFO:teuthology.orchestra.run.smithi029.stdout:(11/23): python3-rgw-17.2.7-109.g1fd3ca3c.el8.x 1.0 MB/s | 107 kB 00:00 2023-12-05T13:10:42.848 INFO:teuthology.orchestra.run.smithi052.stdout:(9/23): python3-rados-17.2.7-109.g1fd3ca3c.el8. 2.1 MB/s | 372 kB 00:00 2023-12-05T13:10:42.953 INFO:teuthology.orchestra.run.smithi029.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.5 MB/s | 354 kB 00:00 2023-12-05T13:10:43.032 INFO:teuthology.orchestra.run.smithi052.stdout:(10/23): python3-rbd-17.2.7-109.g1fd3ca3c.el8.x 1.9 MB/s | 358 kB 00:00 2023-12-05T13:10:43.062 INFO:teuthology.orchestra.run.smithi029.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-12-05T13:10:43.121 INFO:teuthology.orchestra.run.smithi029.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 752 kB/s | 44 kB 00:00 2023-12-05T13:10:43.157 INFO:teuthology.orchestra.run.smithi052.stdout:(11/23): python3-rgw-17.2.7-109.g1fd3ca3c.el8.x 856 kB/s | 107 kB 00:00 2023-12-05T13:10:43.255 INFO:teuthology.orchestra.run.smithi029.stdout:(15/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 351 kB/s | 47 kB 00:00 2023-12-05T13:10:43.382 INFO:teuthology.orchestra.run.smithi052.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.5 MB/s | 354 kB 00:00 2023-12-05T13:10:43.525 INFO:teuthology.orchestra.run.smithi052.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-12-05T13:10:43.625 INFO:teuthology.orchestra.run.smithi052.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 439 kB/s | 44 kB 00:00 2023-12-05T13:10:43.808 INFO:teuthology.orchestra.run.smithi052.stdout:(15/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 256 kB/s | 47 kB 00:00 2023-12-05T13:10:44.023 INFO:teuthology.orchestra.run.smithi029.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 398 kB/s | 306 kB 00:00 2023-12-05T13:10:44.132 INFO:teuthology.orchestra.run.smithi029.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 541 kB/s | 59 kB 00:00 2023-12-05T13:10:44.134 INFO:teuthology.orchestra.run.smithi052.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 942 kB/s | 306 kB 00:00 2023-12-05T13:10:44.184 INFO:teuthology.orchestra.run.smithi052.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2023-12-05T13:10:44.226 INFO:teuthology.orchestra.run.smithi052.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-12-05T13:10:44.250 INFO:teuthology.orchestra.run.smithi029.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 643 kB/s | 75 kB 00:00 2023-12-05T13:10:44.351 INFO:teuthology.orchestra.run.smithi052.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-12-05T13:10:44.683 INFO:teuthology.orchestra.run.smithi029.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 4.0 MB/s | 1.7 MB 00:00 2023-12-05T13:10:45.485 INFO:teuthology.orchestra.run.smithi052.stdout:(20/23): librados2-17.2.7-109.g1fd3ca3c.el8.x86 3.1 MB/s | 3.5 MB 00:01 2023-12-05T13:10:45.601 INFO:teuthology.orchestra.run.smithi029.stdout:(20/23): librados2-17.2.7-109.g1fd3ca3c.el8.x86 3.8 MB/s | 3.5 MB 00:00 2023-12-05T13:10:46.143 INFO:teuthology.orchestra.run.smithi029.stdout:(21/23): librbd1-17.2.7-109.g1fd3ca3c.el8.x86_6 6.6 MB/s | 3.6 MB 00:00 2023-12-05T13:10:46.393 INFO:teuthology.orchestra.run.smithi052.stdout:(21/23): librbd1-17.2.7-109.g1fd3ca3c.el8.x86_6 3.9 MB/s | 3.6 MB 00:00 2023-12-05T13:10:49.018 INFO:teuthology.orchestra.run.smithi052.stdout:(22/23): librgw2-17.2.7-109.g1fd3ca3c.el8.x86_6 729 kB/s | 5.6 MB 00:07 2023-12-05T13:10:50.951 INFO:teuthology.orchestra.run.smithi029.stdout:(22/23): ceph-radosgw-17.2.7-109.g1fd3ca3c.el8. 1.2 MB/s | 17 MB 00:13 2023-12-05T13:10:53.594 INFO:teuthology.orchestra.run.smithi029.stdout:(23/23): ceph-common-17.2.7-109.g1fd3ca3c.el8.x 1.4 MB/s | 23 MB 00:16 2023-12-05T13:10:53.597 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:10:53.597 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.8 MB/s | 63 MB 00:16 2023-12-05T13:10:53.641 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:10:53.692 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:10:53.692 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:10:54.089 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:10:54.091 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:10:55.127 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:10:55.343 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-05T13:10:55.560 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T13:10:55.981 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T13:10:56.185 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T13:10:56.287 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T13:10:56.626 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T13:10:56.818 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T13:10:57.255 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T13:10:57.460 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T13:10:57.706 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T13:10:57.924 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-05T13:10:58.122 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-05T13:10:58.293 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T13:10:58.931 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T13:10:59.092 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T13:10:59.162 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T13:10:59.331 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 11/25 2023-12-05T13:10:59.523 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T13:10:59.732 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T13:10:59.959 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 14/25 2023-12-05T13:11:00.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T13:11:00.239 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T13:11:00.440 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-05T13:11:00.627 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-05T13:11:00.810 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-05T13:11:01.011 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 19/25 2023-12-05T13:11:04.064 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T13:11:04.368 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T13:11:05.007 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T13:11:05.283 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T13:11:05.401 INFO:teuthology.orchestra.run.smithi052.stdout:(23/23): ceph-radosgw-17.2.7-109.g1fd3ca3c.el8. 589 kB/s | 17 MB 00:29 2023-12-05T13:11:05.404 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:11:05.404 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.1 MB/s | 63 MB 00:29 2023-12-05T13:11:05.408 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T13:11:05.449 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:11:05.500 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:11:05.501 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:11:05.625 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T13:11:05.904 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:11:05.908 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:11:07.007 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:11:07.203 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-05T13:11:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T13:11:07.809 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T13:11:08.005 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T13:11:08.105 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T13:11:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T13:11:08.522 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T13:11:08.939 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T13:11:09.114 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T13:11:09.383 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T13:11:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-05T13:11:09.733 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-05T13:11:09.863 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T13:11:10.485 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T13:11:10.672 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T13:11:10.754 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T13:11:10.918 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 11/25 2023-12-05T13:11:11.127 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T13:11:11.327 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T13:11:11.572 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 14/25 2023-12-05T13:11:11.705 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T13:11:11.768 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T13:11:12.010 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-05T13:11:12.190 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-05T13:11:12.423 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-05T13:11:12.606 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 19/25 2023-12-05T13:11:15.560 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T13:11:15.797 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T13:11:16.435 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T13:11:16.664 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T13:11:16.813 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T13:11:16.963 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /run 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2023-12-05T13:11:28.501 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2023-12-05T13:11:28.502 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-12-05T13:11:28.502 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:30.380 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T13:11:30.461 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T13:11:30.461 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T13:11:30.692 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T13:11:30.692 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T13:11:31.453 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T13:11:31.453 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/25 2023-12-05T13:11:31.453 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/25 2023-12-05T13:11:31.453 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T13:11:31.453 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T13:11:31.453 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 7/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 8/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 9/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 11/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-05T13:11:31.454 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-05T13:11:31.455 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-05T13:11:31.455 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-05T13:11:31.455 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T13:11:31.455 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-05T13:11:31.455 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 24/25 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.709 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.710 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-05T13:11:32.711 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.711 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.711 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:32.711 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-05T13:11:32.711 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:32.711 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:11:32.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-test 2023-12-05T13:11:33.958 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:02 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:11:35.831 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:11:35.832 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:11:35.832 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:11:35.832 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:11:35.832 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:11:35.832 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 52 M 2023-12-05T13:11:35.832 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 174 k 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout:Install 6 Packages 2023-12-05T13:11:35.833 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:35.834 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 53 M 2023-12-05T13:11:35.834 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 234 M 2023-12-05T13:11:35.834 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:11:36.215 INFO:teuthology.orchestra.run.smithi029.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.1 MB/s | 203 kB 00:00 2023-12-05T13:11:36.267 INFO:teuthology.orchestra.run.smithi029.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-12-05T13:11:36.360 INFO:teuthology.orchestra.run.smithi029.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-12-05T13:11:36.419 INFO:teuthology.orchestra.run.smithi029.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-12-05T13:11:36.460 INFO:teuthology.orchestra.run.smithi029.stdout:(5/6): libcephsqlite-17.2.7-109.g1fd3ca3c.el8.x 405 kB/s | 174 kB 00:00 2023-12-05T13:11:38.243 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T13:11:38.243 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /run 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2023-12-05T13:11:38.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:11:40.077 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T13:11:40.156 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T13:11:40.156 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T13:11:40.413 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T13:11:40.413 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T13:11:41.184 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T13:11:41.184 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 7/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 8/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 9/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 11/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-05T13:11:41.185 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-05T13:11:41.186 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 24/25 2023-12-05T13:11:42.474 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T13:11:42.474 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:11:42.474 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2023-12-05T13:11:42.474 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.474 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.474 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.475 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:11:42.476 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:11:42.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-test 2023-12-05T13:11:43.136 INFO:teuthology.orchestra.run.smithi029.stdout:(6/6): ceph-test-17.2.7-109.g1fd3ca3c.el8.x86_6 7.3 MB/s | 52 MB 00:07 2023-12-05T13:11:43.138 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:11:43.138 INFO:teuthology.orchestra.run.smithi029.stdout:Total 7.2 MB/s | 53 MB 00:07 2023-12-05T13:11:43.184 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:11:43.207 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:11:43.207 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:11:43.523 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:11:43.527 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:11:43.742 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:13 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:11:44.024 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:11:44.274 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-05T13:11:44.535 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-05T13:11:44.688 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T13:11:44.771 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T13:11:44.984 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-05T13:11:45.154 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T13:11:45.624 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 52 M 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 174 k 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-05T13:11:45.626 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 53 M 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 234 M 2023-12-05T13:11:45.627 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:11:46.243 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 527 kB/s | 203 kB 00:00 2023-12-05T13:11:46.343 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-05T13:11:46.452 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): libcephsqlite-17.2.7-109.g1fd3ca3c.el8.x 293 kB/s | 174 kB 00:00 2023-12-05T13:11:46.519 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2023-12-05T13:11:46.653 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 353 kB/s | 71 kB 00:00 2023-12-05T13:11:50.697 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T13:11:50.962 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T13:11:51.282 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T13:11:51.282 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/6 2023-12-05T13:11:51.282 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/6 2023-12-05T13:11:51.282 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-05T13:11:51.282 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-05T13:11:51.282 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.6-8.el8.x86_64 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:11:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-05T13:11:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-05T13:11:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-05T13:11:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:52.114 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:11:52.315 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph 2023-12-05T13:11:53.302 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:22 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:11:55.154 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 6.4 k 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 2.3 M 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 1.6 M 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 238 k 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.9 M 2023-12-05T13:11:55.158 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-05T13:11:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-05T13:11:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout:Install 32 Packages 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:11:55.161 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 28 M 2023-12-05T13:11:55.162 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 110 M 2023-12-05T13:11:55.162 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:11:55.737 INFO:teuthology.orchestra.run.smithi029.stdout:(1/32): ceph-17.2.7-109.g1fd3ca3c.el8.x86_64.rp 34 kB/s | 6.4 kB 00:00 2023-12-05T13:11:55.904 INFO:teuthology.orchestra.run.smithi029.stdout:(2/32): ceph-mgr-17.2.7-109.g1fd3ca3c.el8.x86_6 4.4 MB/s | 1.6 MB 00:00 2023-12-05T13:11:56.948 INFO:teuthology.orchestra.run.smithi029.stdout:(3/32): ceph-osd-17.2.7-109.g1fd3ca3c.el8.x86_6 16 MB/s | 17 MB 00:01 2023-12-05T13:11:57.040 INFO:teuthology.orchestra.run.smithi029.stdout:(4/32): ceph-mon-17.2.7-109.g1fd3ca3c.el8.x86_6 3.0 MB/s | 3.9 MB 00:01 2023-12-05T13:11:57.115 INFO:teuthology.orchestra.run.smithi029.stdout:(5/32): ceph-mgr-modules-core-17.2.7-109.g1fd3c 1.4 MB/s | 238 kB 00:00 2023-12-05T13:11:57.283 INFO:teuthology.orchestra.run.smithi029.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 231 kB/s | 39 kB 00:00 2023-12-05T13:11:57.325 INFO:teuthology.orchestra.run.smithi029.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 551 kB/s | 157 kB 00:00 2023-12-05T13:11:57.393 INFO:teuthology.orchestra.run.smithi029.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 948 kB/s | 103 kB 00:00 2023-12-05T13:11:57.418 INFO:teuthology.orchestra.run.smithi029.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 617 kB/s | 57 kB 00:00 2023-12-05T13:11:57.677 INFO:teuthology.orchestra.run.smithi029.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 961 kB/s | 249 kB 00:00 2023-12-05T13:11:57.727 INFO:teuthology.orchestra.run.smithi029.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.3 MB/s | 457 kB 00:00 2023-12-05T13:11:57.837 INFO:teuthology.orchestra.run.smithi029.stdout:(12/32): python3-cryptography-3.2.1-6.el8.x86_6 3.9 MB/s | 641 kB 00:00 2023-12-05T13:11:57.970 INFO:teuthology.orchestra.run.smithi029.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 450 kB/s | 109 kB 00:00 2023-12-05T13:11:58.171 INFO:teuthology.orchestra.run.smithi029.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 131 kB/s | 44 kB 00:00 2023-12-05T13:11:58.422 INFO:teuthology.orchestra.run.smithi029.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 411 kB/s | 185 kB 00:00 2023-12-05T13:11:58.447 INFO:teuthology.orchestra.run.smithi029.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 625 kB/s | 173 kB 00:00 2023-12-05T13:11:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): ceph-test-17.2.7-109.g1fd3ca3c.el8.x86_6 4.1 MB/s | 52 MB 00:12 2023-12-05T13:11:58.512 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:11:58.513 INFO:teuthology.orchestra.run.smithi052.stdout:Total 4.1 MB/s | 53 MB 00:12 2023-12-05T13:11:58.549 INFO:teuthology.orchestra.run.smithi029.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 109 kB/s | 11 kB 00:00 2023-12-05T13:11:58.558 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:11:58.582 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:11:58.582 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:11:58.616 INFO:teuthology.orchestra.run.smithi029.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.9 MB/s | 384 kB 00:00 2023-12-05T13:11:58.650 INFO:teuthology.orchestra.run.smithi029.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 174 kB/s | 18 kB 00:00 2023-12-05T13:11:58.726 INFO:teuthology.orchestra.run.smithi029.stdout:(20/32): ceph-mds-17.2.7-109.g1fd3ca3c.el8.x86_ 742 kB/s | 2.3 MB 00:03 2023-12-05T13:11:58.752 INFO:teuthology.orchestra.run.smithi029.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 361 kB/s | 49 kB 00:00 2023-12-05T13:11:58.777 INFO:teuthology.orchestra.run.smithi029.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 464 kB/s | 59 kB 00:00 2023-12-05T13:11:58.853 INFO:teuthology.orchestra.run.smithi029.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-12-05T13:11:58.878 INFO:teuthology.orchestra.run.smithi029.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 186 kB/s | 19 kB 00:00 2023-12-05T13:11:58.898 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:11:58.901 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:11:58.962 INFO:teuthology.orchestra.run.smithi029.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 219 kB/s | 24 kB 00:00 2023-12-05T13:11:58.987 INFO:teuthology.orchestra.run.smithi029.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 268 kB/s | 29 kB 00:00 2023-12-05T13:11:59.097 INFO:teuthology.orchestra.run.smithi029.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 205 kB/s | 27 kB 00:00 2023-12-05T13:11:59.197 INFO:teuthology.orchestra.run.smithi029.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.2 MB/s | 255 kB 00:00 2023-12-05T13:11:59.223 INFO:teuthology.orchestra.run.smithi029.stdout:(29/32): python3-pecan-1.3.2-9.el8.noarch.rpm 570 kB/s | 283 kB 00:00 2023-12-05T13:11:59.256 INFO:teuthology.orchestra.run.smithi029.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.5 MB/s | 251 kB 00:00 2023-12-05T13:11:59.298 INFO:teuthology.orchestra.run.smithi029.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 844 kB/s | 85 kB 00:00 2023-12-05T13:11:59.333 INFO:teuthology.orchestra.run.smithi029.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 207 kB/s | 23 kB 00:00 2023-12-05T13:11:59.335 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:11:59.335 INFO:teuthology.orchestra.run.smithi029.stdout:Total 6.8 MB/s | 28 MB 00:04 2023-12-05T13:11:59.427 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:11:59.443 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:11:59.469 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:11:59.469 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:11:59.674 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-05T13:11:59.841 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:11:59.844 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:11:59.888 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-05T13:12:00.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T13:12:00.109 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T13:12:00.325 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-05T13:12:00.474 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T13:12:00.936 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:12:01.202 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-05T13:12:01.429 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-05T13:12:01.690 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-05T13:12:01.943 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-05T13:12:02.157 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-05T13:12:02.424 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-05T13:12:02.639 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-05T13:12:02.850 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-05T13:12:03.080 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-05T13:12:03.307 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-05T13:12:04.471 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-05T13:12:04.962 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-05T13:12:05.391 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-05T13:12:05.651 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-05T13:12:05.858 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-05T13:12:05.988 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T13:12:06.203 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-05T13:12:06.239 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T13:12:06.438 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T13:12:06.552 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T13:12:06.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/6 2023-12-05T13:12:06.552 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/6 2023-12-05T13:12:06.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-05T13:12:06.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-05T13:12:06.553 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-05T13:12:06.783 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-05T13:12:07.028 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-05T13:12:07.207 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.6-8.el8.x86_64 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:07.453 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-05T13:12:07.454 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-05T13:12:07.454 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-05T13:12:07.454 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:07.454 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:07.491 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-05T13:12:07.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph 2023-12-05T13:12:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-05T13:12:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-05T13:12:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-05T13:12:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-05T13:12:08.664 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:38 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-05T13:12:09.350 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 27/32 2023-12-05T13:12:09.592 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T13:12:10.526 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 6.4 k 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:12:10.530 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 2.3 M 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 1.6 M 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 238 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.9 M 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-05T13:12:10.531 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-05T13:12:10.532 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout:Install 32 Packages 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 28 M 2023-12-05T13:12:10.533 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 110 M 2023-12-05T13:12:10.534 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:12:11.246 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T13:12:11.308 INFO:teuthology.orchestra.run.smithi052.stdout:(1/32): ceph-17.2.7-109.g1fd3ca3c.el8.x86_64.rp 39 kB/s | 6.4 kB 00:00 2023-12-05T13:12:11.466 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T13:12:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:(2/32): ceph-mgr-17.2.7-109.g1fd3ca3c.el8.x86_6 4.8 MB/s | 1.6 MB 00:00 2023-12-05T13:12:11.862 INFO:teuthology.orchestra.run.smithi052.stdout:(3/32): ceph-mon-17.2.7-109.g1fd3ca3c.el8.x86_6 7.1 MB/s | 3.9 MB 00:00 2023-12-05T13:12:11.911 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T13:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:(4/32): ceph-mds-17.2.7-109.g1fd3ca3c.el8.x86_6 3.0 MB/s | 2.3 MB 00:00 2023-12-05T13:12:11.938 INFO:teuthology.orchestra.run.smithi052.stdout:(5/32): ceph-mgr-modules-core-17.2.7-109.g1fd3c 3.1 MB/s | 238 kB 00:00 2023-12-05T13:12:12.088 INFO:teuthology.orchestra.run.smithi052.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 258 kB/s | 39 kB 00:00 2023-12-05T13:12:12.113 INFO:teuthology.orchestra.run.smithi052.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 782 kB/s | 157 kB 00:00 2023-12-05T13:12:12.118 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T13:12:12.164 INFO:teuthology.orchestra.run.smithi052.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-12-05T13:12:12.214 INFO:teuthology.orchestra.run.smithi052.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 825 kB/s | 103 kB 00:00 2023-12-05T13:12:12.323 INFO:teuthology.orchestra.run.smithi052.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.8 MB/s | 457 kB 00:00 2023-12-05T13:12:12.359 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T13:12:12.548 INFO:teuthology.orchestra.run.smithi052.stdout:(11/32): ceph-osd-17.2.7-109.g1fd3ca3c.el8.x86_ 16 MB/s | 17 MB 00:01 2023-12-05T13:12:12.573 INFO:teuthology.orchestra.run.smithi052.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 693 kB/s | 249 kB 00:00 2023-12-05T13:12:12.610 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T13:12:12.632 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T13:12:12.690 INFO:teuthology.orchestra.run.smithi052.stdout:(13/32): python3-cryptography-3.2.1-6.el8.x86_6 1.7 MB/s | 641 kB 00:00 2023-12-05T13:12:12.715 INFO:teuthology.orchestra.run.smithi052.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 654 kB/s | 109 kB 00:00 2023-12-05T13:12:12.732 INFO:teuthology.orchestra.run.smithi052.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 275 kB/s | 44 kB 00:00 2023-12-05T13:12:12.760 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T13:12:13.051 INFO:teuthology.orchestra.run.smithi052.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 515 kB/s | 173 kB 00:00 2023-12-05T13:12:13.236 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 6/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-05T13:12:13.237 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-05T13:12:13.238 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-05T13:12:13.239 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-05T13:12:13.239 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-05T13:12:13.239 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-05T13:12:13.239 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-05T13:12:13.239 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-05T13:12:13.239 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-05T13:12:13.308 INFO:teuthology.orchestra.run.smithi052.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 300 kB/s | 185 kB 00:00 2023-12-05T13:12:13.508 INFO:teuthology.orchestra.run.smithi052.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 24 kB/s | 11 kB 00:00 2023-12-05T13:12:13.534 INFO:teuthology.orchestra.run.smithi052.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 78 kB/s | 18 kB 00:00 2023-12-05T13:12:13.592 INFO:teuthology.orchestra.run.smithi052.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 447 kB/s | 384 kB 00:00 2023-12-05T13:12:13.618 INFO:teuthology.orchestra.run.smithi052.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 447 kB/s | 49 kB 00:00 2023-12-05T13:12:13.643 INFO:teuthology.orchestra.run.smithi052.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 540 kB/s | 59 kB 00:00 2023-12-05T13:12:13.702 INFO:teuthology.orchestra.run.smithi052.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-12-05T13:12:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 225 kB/s | 19 kB 00:00 2023-12-05T13:12:13.752 INFO:teuthology.orchestra.run.smithi052.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-12-05T13:12:13.777 INFO:teuthology.orchestra.run.smithi052.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2023-12-05T13:12:13.803 INFO:teuthology.orchestra.run.smithi052.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2023-12-05T13:12:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2023-12-05T13:12:13.870 INFO:teuthology.orchestra.run.smithi052.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.7 MB/s | 255 kB 00:00 2023-12-05T13:12:13.895 INFO:teuthology.orchestra.run.smithi052.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.7 MB/s | 251 kB 00:00 2023-12-05T13:12:13.912 INFO:teuthology.orchestra.run.smithi052.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-12-05T13:12:13.937 INFO:teuthology.orchestra.run.smithi052.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2023-12-05T13:12:13.939 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:13.939 INFO:teuthology.orchestra.run.smithi052.stdout:Total 8.3 MB/s | 28 MB 00:03 2023-12-05T13:12:14.029 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:12:14.070 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:12:14.070 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:12:14.393 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:12:14.396 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:12:14.613 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-05T13:12:14.614 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-2.6-1.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-05T13:12:14.615 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:14.616 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:14.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-base 2023-12-05T13:12:15.564 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:12:15.758 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:44 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:15.812 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-05T13:12:16.032 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-05T13:12:16.334 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-05T13:12:16.571 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-05T13:12:16.819 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-05T13:12:17.002 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-05T13:12:17.192 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-05T13:12:17.345 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-05T13:12:17.373 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:12:17.540 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-05T13:12:17.627 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:12:17.629 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:12:17.629 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:17.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install cephadm 2023-12-05T13:12:17.776 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-05T13:12:18.022 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-05T13:12:18.307 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-05T13:12:18.742 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:47 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:18.957 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-05T13:12:19.203 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-05T13:12:19.435 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-05T13:12:19.680 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-05T13:12:19.933 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T13:12:20.244 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-05T13:12:20.497 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-05T13:12:20.616 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:12:20.617 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:20.617 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:12:20.617 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:20.617 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:12:20.617 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 80 k 2023-12-05T13:12:20.617 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 80 k 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 364 k 2023-12-05T13:12:20.618 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:12:20.660 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-05T13:12:20.886 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-05T13:12:21.131 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-05T13:12:21.247 INFO:teuthology.orchestra.run.smithi029.stdout:cephadm-17.2.7-109.g1fd3ca3c.el8.noarch.rpm 128 kB/s | 80 kB 00:00 2023-12-05T13:12:21.247 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:21.248 INFO:teuthology.orchestra.run.smithi029.stdout:Total 127 kB/s | 80 kB 00:00 2023-12-05T13:12:21.248 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:12:21.258 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:12:21.258 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:12:21.261 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:12:21.264 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:12:21.395 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-05T13:12:21.645 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-05T13:12:21.968 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-05T13:12:22.319 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-05T13:12:22.463 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:12:22.726 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 27/32 2023-12-05T13:12:22.972 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T13:12:24.444 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:24.609 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T13:12:24.636 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T13:12:24.896 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:25.281 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T13:12:25.463 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T13:12:25.629 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:25.629 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:25.629 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:12:25.629 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:25.629 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:25.630 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:25.704 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T13:12:25.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-immutable-object-cache 2023-12-05T13:12:25.862 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T13:12:25.885 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T13:12:25.997 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T13:12:26.499 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 6/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-05T13:12:26.500 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-05T13:12:26.501 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-05T13:12:26.502 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-05T13:12:26.502 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-05T13:12:26.502 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-05T13:12:26.502 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-05T13:12:26.842 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:01:55 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:27.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-05T13:12:27.836 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-2.6-1.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-05T13:12:27.837 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:27.838 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:28.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base 2023-12-05T13:12:28.715 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:12:28.715 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:28.715 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 162 k 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:28.716 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 162 k 2023-12-05T13:12:28.717 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 490 k 2023-12-05T13:12:28.717 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:12:29.010 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:59 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:29.651 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-immutable-object-cache-17.2.7-109.g1fd3ca3 173 kB/s | 162 kB 00:00 2023-12-05T13:12:29.652 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:29.652 INFO:teuthology.orchestra.run.smithi029.stdout:Total 173 kB/s | 162 kB 00:00 2023-12-05T13:12:29.653 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:12:29.667 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:12:29.667 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:12:29.724 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:12:29.727 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:12:29.857 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:12:30.066 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T13:12:30.539 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T13:12:30.622 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:12:30.869 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:30.871 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:12:30.871 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:30.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install cephadm 2023-12-05T13:12:31.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T13:12:31.342 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:31.342 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:12:31.343 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:31.343 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:31.343 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:31.579 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr 2023-12-05T13:12:31.975 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:01 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:32.565 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:01 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:33.855 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 80 k 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:12:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:33.857 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 80 k 2023-12-05T13:12:33.857 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 364 k 2023-12-05T13:12:33.857 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:12:34.047 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm-17.2.7-109.g1fd3ca3c.el8.noarch.rpm 423 kB/s | 80 kB 00:00 2023-12-05T13:12:34.048 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:34.048 INFO:teuthology.orchestra.run.smithi052.stdout:Total 420 kB/s | 80 kB 00:00 2023-12-05T13:12:34.048 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:12:34.058 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:12:34.058 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:12:34.060 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:12:34.064 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:12:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:12:34.197 INFO:teuthology.orchestra.run.smithi029.stdout:Package ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:12:34.450 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:12:34.451 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:12:34.451 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:34.565 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-dashboard 2023-12-05T13:12:35.535 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:04 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:36.843 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:37.008 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:37.270 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:37.407 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 1.7 M 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 23 k 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 14 k 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-05T13:12:37.409 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout:Install 6 Packages 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 2.0 M 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 8.0 M 2023-12-05T13:12:37.410 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:12:37.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T13:12:37.991 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:37.991 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:12:37.991 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:37.991 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:37.991 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:38.018 INFO:teuthology.orchestra.run.smithi029.stdout:(1/6): ceph-grafana-dashboards-17.2.7-109.g1fd3 94 kB/s | 23 kB 00:00 2023-12-05T13:12:38.044 INFO:teuthology.orchestra.run.smithi029.stdout:(2/6): ceph-prometheus-alerts-17.2.7-109.g1fd3c 54 kB/s | 14 kB 00:00 2023-12-05T13:12:38.171 INFO:teuthology.orchestra.run.smithi029.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 280 kB/s | 43 kB 00:00 2023-12-05T13:12:38.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-immutable-object-cache 2023-12-05T13:12:38.230 INFO:teuthology.orchestra.run.smithi029.stdout:(4/6): ceph-mgr-dashboard-17.2.7-109.g1fd3ca3c. 3.7 MB/s | 1.7 MB 00:00 2023-12-05T13:12:38.664 INFO:teuthology.orchestra.run.smithi029.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 54 kB/s | 34 kB 00:00 2023-12-05T13:12:38.847 INFO:teuthology.orchestra.run.smithi029.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 291 kB/s | 196 kB 00:00 2023-12-05T13:12:38.850 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:38.851 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2023-12-05T13:12:38.863 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:12:38.874 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:12:38.874 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:12:38.961 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:12:38.964 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:12:39.205 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:09 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:39.241 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:12:39.933 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-05T13:12:40.753 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-05T13:12:41.025 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-05T13:12:41.104 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 162 k 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:12:41.105 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:41.106 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:12:41.106 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:41.106 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 162 k 2023-12-05T13:12:41.106 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 490 k 2023-12-05T13:12:41.106 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:12:41.155 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 4/6 2023-12-05T13:12:41.515 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-immutable-object-cache-17.2.7-109.g1fd3ca3 396 kB/s | 162 kB 00:00 2023-12-05T13:12:41.516 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:41.517 INFO:teuthology.orchestra.run.smithi052.stdout:Total 394 kB/s | 162 kB 00:00 2023-12-05T13:12:41.517 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:12:41.526 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 5/6 2023-12-05T13:12:41.531 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:12:41.531 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:12:41.589 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:12:41.593 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:12:41.720 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:12:41.737 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T13:12:41.911 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T13:12:42.062 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T13:12:42.062 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 1/6 2023-12-05T13:12:42.063 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2/6 2023-12-05T13:12:42.063 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 3/6 2023-12-05T13:12:42.063 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-05T13:12:42.063 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-05T13:12:42.389 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T13:12:42.835 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-05T13:12:42.835 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:42.835 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:12:42.835 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:42.835 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:42.836 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:42.836 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-05T13:12:42.836 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-05T13:12:42.836 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-05T13:12:42.836 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:42.836 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:42.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-05T13:12:43.155 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T13:12:43.155 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:43.155 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:12:43.155 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:12:43.155 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:43.155 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:43.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr 2023-12-05T13:12:43.957 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:12 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:44.400 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:14 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:45.831 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:12:45.832 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================================ 2023-12-05T13:12:45.832 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:12:45.832 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================================ 2023-12-05T13:12:45.832 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:12:45.832 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 7.4 M 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================================ 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout:Install 8 Packages 2023-12-05T13:12:45.833 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:45.834 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 35 M 2023-12-05T13:12:45.834 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 210 M 2023-12-05T13:12:45.834 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:12:46.036 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:12:46.288 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:46.289 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:12:46.289 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:46.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-dashboard 2023-12-05T13:12:46.818 INFO:teuthology.orchestra.run.smithi029.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-109 9.9 MB/s | 7.4 MB 00:00 2023-12-05T13:12:47.002 INFO:teuthology.orchestra.run.smithi029.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 5.1 MB/s | 4.7 MB 00:00 2023-12-05T13:12:47.102 INFO:teuthology.orchestra.run.smithi029.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 4.7 MB/s | 4.9 MB 00:01 2023-12-05T13:12:47.128 INFO:teuthology.orchestra.run.smithi029.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.8 MB/s | 225 kB 00:00 2023-12-05T13:12:47.387 INFO:teuthology.orchestra.run.smithi029.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.4 MB/s | 645 kB 00:00 2023-12-05T13:12:47.396 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:17 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:47.483 INFO:teuthology.orchestra.run.smithi029.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2023-12-05T13:12:47.988 INFO:teuthology.orchestra.run.smithi029.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.2 MB/s | 3.7 MB 00:01 2023-12-05T13:12:48.388 INFO:teuthology.orchestra.run.smithi029.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 11 MB/s | 14 MB 00:01 2023-12-05T13:12:48.388 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:48.389 INFO:teuthology.orchestra.run.smithi029.stdout:Total 14 MB/s | 35 MB 00:02 2023-12-05T13:12:48.641 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:12:48.661 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:12:48.662 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:12:49.100 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:12:49.103 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:12:49.302 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:49.303 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:49.303 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:12:49.303 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 1.7 M 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 23 k 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 14 k 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-05T13:12:49.304 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-05T13:12:49.305 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-05T13:12:49.305 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:49.305 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:12:49.305 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:12:49.305 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2023-12-05T13:12:49.305 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:49.306 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 2.0 M 2023-12-05T13:12:49.306 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 8.0 M 2023-12-05T13:12:49.306 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:12:49.683 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:12:49.794 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): ceph-prometheus-alerts-17.2.7-109.g1fd3c 91 kB/s | 14 kB 00:00 2023-12-05T13:12:49.863 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T13:12:49.936 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): ceph-grafana-dashboards-17.2.7-109.g1fd3 77 kB/s | 23 kB 00:00 2023-12-05T13:12:49.986 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 222 kB/s | 43 kB 00:00 2023-12-05T13:12:50.006 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T13:12:50.161 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 149 kB/s | 34 kB 00:00 2023-12-05T13:12:50.191 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T13:12:50.287 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 655 kB/s | 196 kB 00:00 2023-12-05T13:12:50.612 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): ceph-mgr-dashboard-17.2.7-109.g1fd3ca3c. 1.7 MB/s | 1.7 MB 00:00 2023-12-05T13:12:50.616 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:12:50.616 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2023-12-05T13:12:50.629 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:12:50.640 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:12:50.640 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:12:50.729 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:12:50.732 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:12:50.850 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T13:12:51.046 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T13:12:51.051 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:12:51.304 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-05T13:12:51.531 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-05T13:12:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T13:12:51.747 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-05T13:12:51.867 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 4/6 2023-12-05T13:12:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T13:12:52.228 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 5/6 2023-12-05T13:12:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T13:12:53.042 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T13:12:53.136 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T13:12:53.375 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T13:12:53.409 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T13:12:53.409 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 1/6 2023-12-05T13:12:53.409 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2/6 2023-12-05T13:12:53.410 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 3/6 2023-12-05T13:12:53.410 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-05T13:12:53.410 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-05T13:12:54.173 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-05T13:12:54.174 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:54.175 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:12:54.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-05T13:12:55.308 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:25 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:12:55.382 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T13:12:56.753 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-05T13:12:56.987 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T13:12:57.176 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================================ 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================================ 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 7.4 M 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-05T13:12:57.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================================ 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout:Install 8 Packages 2023-12-05T13:12:57.179 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:12:57.180 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 35 M 2023-12-05T13:12:57.180 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 210 M 2023-12-05T13:12:57.180 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 1/8 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T13:12:57.373 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-05T13:12:57.374 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-05T13:12:58.195 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-05T13:12:58.195 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:58.195 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:12:58.196 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:12:58.320 INFO:teuthology.orchestra.run.smithi052.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-109 8.2 MB/s | 7.4 MB 00:00 2023-12-05T13:12:58.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-rook 2023-12-05T13:12:59.054 INFO:teuthology.orchestra.run.smithi052.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 2.9 MB/s | 4.7 MB 00:01 2023-12-05T13:12:59.246 INFO:teuthology.orchestra.run.smithi052.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 2.7 MB/s | 4.9 MB 00:01 2023-12-05T13:12:59.271 INFO:teuthology.orchestra.run.smithi052.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.0 MB/s | 225 kB 00:00 2023-12-05T13:12:59.320 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:28 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:12:59.505 INFO:teuthology.orchestra.run.smithi052.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.7 MB/s | 645 kB 00:00 2023-12-05T13:12:59.563 INFO:teuthology.orchestra.run.smithi052.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2023-12-05T13:12:59.880 INFO:teuthology.orchestra.run.smithi052.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 2.4 MB/s | 3.7 MB 00:01 2023-12-05T13:13:00.606 INFO:teuthology.orchestra.run.smithi052.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 10 MB/s | 14 MB 00:01 2023-12-05T13:13:00.606 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:00.607 INFO:teuthology.orchestra.run.smithi052.stdout:Total 10 MB/s | 35 MB 00:03 2023-12-05T13:13:00.859 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:13:00.879 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:13:00.879 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:13:01.187 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 47 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-05T13:13:01.189 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout:Install 13 Packages 2023-12-05T13:13:01.190 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:01.191 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 1.9 M 2023-12-05T13:13:01.191 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 25 M 2023-12-05T13:13:01.191 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:13:01.301 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:13:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:13:01.741 INFO:teuthology.orchestra.run.smithi029.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 156 kB/s | 27 kB 00:00 2023-12-05T13:13:01.766 INFO:teuthology.orchestra.run.smithi029.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 102 kB/s | 20 kB 00:00 2023-12-05T13:13:01.910 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:13:01.925 INFO:teuthology.orchestra.run.smithi029.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 796 kB/s | 126 kB 00:00 2023-12-05T13:13:01.951 INFO:teuthology.orchestra.run.smithi029.stdout:(4/13): ceph-mgr-rook-17.2.7-109.g1fd3ca3c.el8. 124 kB/s | 47 kB 00:00 2023-12-05T13:13:01.976 INFO:teuthology.orchestra.run.smithi029.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 525 kB/s | 110 kB 00:00 2023-12-05T13:13:02.099 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T13:13:02.218 INFO:teuthology.orchestra.run.smithi029.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 176 kB/s | 43 kB 00:00 2023-12-05T13:13:02.242 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T13:13:02.243 INFO:teuthology.orchestra.run.smithi029.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 123 kB/s | 33 kB 00:00 2023-12-05T13:13:02.286 INFO:teuthology.orchestra.run.smithi029.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 430 kB/s | 155 kB 00:00 2023-12-05T13:13:02.328 INFO:teuthology.orchestra.run.smithi029.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.0 MB/s | 81 kB 00:00 2023-12-05T13:13:02.370 INFO:teuthology.orchestra.run.smithi029.stdout:(10/13): python3-certifi-2018.10.15-7.el8.noarc 107 kB/s | 16 kB 00:00 2023-12-05T13:13:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T13:13:02.405 INFO:teuthology.orchestra.run.smithi029.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 907 kB/s | 64 kB 00:00 2023-12-05T13:13:02.438 INFO:teuthology.orchestra.run.smithi029.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 924 kB/s | 61 kB 00:00 2023-12-05T13:13:03.083 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T13:13:03.122 INFO:teuthology.orchestra.run.smithi029.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.4 MB/s | 1.2 MB 00:00 2023-12-05T13:13:03.124 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:03.125 INFO:teuthology.orchestra.run.smithi029.stdout:Total 1.0 MB/s | 1.9 MB 00:01 2023-12-05T13:13:03.188 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:13:03.206 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:13:03.206 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:13:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T13:13:03.306 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:13:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:13:03.908 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:13:03.918 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T13:13:04.057 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T13:13:04.213 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-05T13:13:04.425 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-05T13:13:04.662 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-05T13:13:04.830 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T13:13:04.886 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-05T13:13:05.120 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-05T13:13:05.197 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T13:13:05.372 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-05T13:13:05.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T13:13:05.702 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-05T13:13:05.945 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-05T13:13:07.083 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-05T13:13:07.400 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T13:13:07.411 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-05T13:13:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-05T13:13:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-05T13:13:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T13:13:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T13:13:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/13 2023-12-05T13:13:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-05T13:13:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-05T13:13:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-05T13:13:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-05T13:13:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-05T13:13:08.711 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-05T13:13:08.924 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T13:13:09.263 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-05T13:13:09.263 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:09.263 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:13:09.263 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:13:09.263 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:09.264 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 1/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-05T13:13:09.287 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-05T13:13:09.396 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-mgr-cephadm 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-05T13:13:10.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-05T13:13:10.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-05T13:13:10.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-05T13:13:10.075 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:10.075 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:10.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-rook 2023-12-05T13:13:10.396 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:39 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:11.217 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:41 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:12.286 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:12.287 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:13:12.287 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:12.287 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:13:12.287 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 121 k 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout:Install 5 Packages 2023-12-05T13:13:12.288 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:12.289 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 6.0 M 2023-12-05T13:13:12.289 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 26 M 2023-12-05T13:13:12.289 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:13:12.593 INFO:teuthology.orchestra.run.smithi029.stdout:(1/5): ceph-mgr-cephadm-17.2.7-109.g1fd3ca3c.el 633 kB/s | 121 kB 00:00 2023-12-05T13:13:12.652 INFO:teuthology.orchestra.run.smithi029.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.1 MB/s | 538 kB 00:00 2023-12-05T13:13:12.812 INFO:teuthology.orchestra.run.smithi029.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 376 kB/s | 60 kB 00:00 2023-12-05T13:13:12.879 INFO:teuthology.orchestra.run.smithi029.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.6 MB/s | 476 kB 00:00 2023-12-05T13:13:13.091 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 47 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-05T13:13:13.093 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout:Install 13 Packages 2023-12-05T13:13:13.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:13.095 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 1.9 M 2023-12-05T13:13:13.095 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 25 M 2023-12-05T13:13:13.095 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:13:13.172 INFO:teuthology.orchestra.run.smithi029.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 6.2 MB/s | 4.8 MB 00:00 2023-12-05T13:13:13.173 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:13.173 INFO:teuthology.orchestra.run.smithi029.stdout:Total 6.7 MB/s | 6.0 MB 00:00 2023-12-05T13:13:13.231 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:13:13.244 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:13:13.244 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:13:13.355 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:13:13.359 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:13:13.633 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:13:13.744 INFO:teuthology.orchestra.run.smithi052.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 222 kB/s | 27 kB 00:00 2023-12-05T13:13:13.769 INFO:teuthology.orchestra.run.smithi052.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 138 kB/s | 20 kB 00:00 2023-12-05T13:13:13.877 INFO:teuthology.orchestra.run.smithi052.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-12-05T13:13:13.902 INFO:teuthology.orchestra.run.smithi052.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 826 kB/s | 110 kB 00:00 2023-12-05T13:13:13.961 INFO:teuthology.orchestra.run.smithi052.stdout:(5/13): ceph-mgr-rook-17.2.7-109.g1fd3ca3c.el8. 140 kB/s | 47 kB 00:00 2023-12-05T13:13:13.987 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-05T13:13:14.170 INFO:teuthology.orchestra.run.smithi052.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 160 kB/s | 43 kB 00:00 2023-12-05T13:13:14.195 INFO:teuthology.orchestra.run.smithi052.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 141 kB/s | 33 kB 00:00 2023-12-05T13:13:14.220 INFO:teuthology.orchestra.run.smithi052.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 488 kB/s | 155 kB 00:00 2023-12-05T13:13:14.312 INFO:teuthology.orchestra.run.smithi052.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 695 kB/s | 81 kB 00:00 2023-12-05T13:13:14.337 INFO:teuthology.orchestra.run.smithi052.stdout:(10/13): python3-certifi-2018.10.15-7.el8.noarc 97 kB/s | 16 kB 00:00 2023-12-05T13:13:14.396 INFO:teuthology.orchestra.run.smithi052.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 769 kB/s | 64 kB 00:00 2023-12-05T13:13:14.455 INFO:teuthology.orchestra.run.smithi052.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 524 kB/s | 61 kB 00:00 2023-12-05T13:13:14.547 INFO:teuthology.orchestra.run.smithi052.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.6 MB/s | 1.2 MB 00:00 2023-12-05T13:13:14.547 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:14.547 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.3 MB/s | 1.9 MB 00:01 2023-12-05T13:13:14.611 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:13:14.628 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:13:14.628 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:13:14.727 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:13:14.730 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:13:15.055 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-05T13:13:15.418 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:13:15.452 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-05T13:13:15.649 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-05T13:13:15.771 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-05T13:13:15.887 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-05T13:13:15.985 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T13:13:16.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-05T13:13:16.309 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T13:13:16.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/5 2023-12-05T13:13:16.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-05T13:13:16.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-05T13:13:16.310 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-05T13:13:16.364 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-05T13:13:16.565 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-05T13:13:16.833 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-05T13:13:17.078 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-05T13:13:17.078 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:17.078 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:17.079 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:17.179 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-05T13:13:17.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-fuse 2023-12-05T13:13:17.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-05T13:13:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:47 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:18.605 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-05T13:13:18.897 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-05T13:13:19.089 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-05T13:13:19.293 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-05T13:13:19.505 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T13:13:19.842 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T13:13:19.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/13 2023-12-05T13:13:19.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-05T13:13:19.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-05T13:13:20.077 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:20.078 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:20.078 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-12-05T13:13:20.078 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:20.078 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:13:20.078 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 875 k 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:Install 2 Packages 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 958 k 2023-12-05T13:13:20.079 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 3.0 M 2023-12-05T13:13:20.080 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:13:20.283 INFO:teuthology.orchestra.run.smithi029.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 512 kB/s | 83 kB 00:00 2023-12-05T13:13:20.425 INFO:teuthology.orchestra.run.smithi029.stdout:(2/2): ceph-fuse-17.2.7-109.g1fd3ca3c.el8.x86_6 2.8 MB/s | 875 kB 00:00 2023-12-05T13:13:20.425 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:20.426 INFO:teuthology.orchestra.run.smithi029.stdout:Total 2.7 MB/s | 958 kB 00:00 2023-12-05T13:13:20.438 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:13:20.462 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:13:20.463 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:13:20.563 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:13:20.567 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:13:20.695 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-05T13:13:20.695 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:20.695 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:13:20.695 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:13:20.695 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-05T13:13:20.695 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:20.696 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:20.749 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:13:20.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-cephadm 2023-12-05T13:13:21.069 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-05T13:13:21.268 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T13:13:21.715 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T13:13:21.715 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/2 2023-12-05T13:13:21.804 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:02:51 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:22.509 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-05T13:13:22.509 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:22.510 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:13:22.510 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-05T13:13:22.510 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:22.510 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:23.669 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:23.670 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:23.670 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 121 k 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:Install 5 Packages 2023-12-05T13:13:23.672 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:23.672 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 6.0 M 2023-12-05T13:13:23.672 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 26 M 2023-12-05T13:13:23.672 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:13:24.281 INFO:teuthology.orchestra.run.smithi052.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.2 MB/s | 538 kB 00:00 2023-12-05T13:13:24.322 INFO:teuthology.orchestra.run.smithi052.stdout:(2/5): ceph-mgr-cephadm-17.2.7-109.g1fd3ca3c.el 426 kB/s | 121 kB 00:00 2023-12-05T13:13:24.490 INFO:teuthology.orchestra.run.smithi052.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-12-05T13:13:24.506 INFO:teuthology.orchestra.run.smithi052.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 328 kB/s | 60 kB 00:00 2023-12-05T13:13:24.582 INFO:teuthology.orchestra.run.smithi052.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.5 MB/s | 476 kB 00:00 2023-12-05T13:13:24.584 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:24.585 INFO:teuthology.orchestra.run.smithi052.stdout:Total 6.5 MB/s | 6.0 MB 00:00 2023-12-05T13:13:24.643 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:13:24.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados-devel 2023-12-05T13:13:24.655 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:13:24.655 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:13:24.773 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:13:24.777 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:13:25.056 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:13:25.751 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:54 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:25.856 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-05T13:13:26.912 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-05T13:13:27.343 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-05T13:13:27.638 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-05T13:13:27.663 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 130 k 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 130 k 2023-12-05T13:13:27.665 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 464 k 2023-12-05T13:13:27.666 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:13:27.821 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T13:13:27.870 INFO:teuthology.orchestra.run.smithi029.stdout:librados-devel-17.2.7-109.g1fd3ca3c.el8.x86_64. 635 kB/s | 130 kB 00:00 2023-12-05T13:13:27.871 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:27.871 INFO:teuthology.orchestra.run.smithi029.stdout:Total 630 kB/s | 130 kB 00:00 2023-12-05T13:13:27.872 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:13:27.878 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:13:27.878 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:13:27.939 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:13:27.942 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:13:28.066 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:13:28.166 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T13:13:28.166 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/5 2023-12-05T13:13:28.167 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-05T13:13:28.167 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-05T13:13:28.167 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-05T13:13:28.317 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:28.657 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:28.918 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-05T13:13:28.918 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:28.918 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:28.919 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:29.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-fuse 2023-12-05T13:13:29.473 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:29.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:29.473 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:13:29.473 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:13:29.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:29.473 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:29.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs2 2023-12-05T13:13:30.058 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:00 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:30.694 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:59 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:31.960 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 875 k 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:31.961 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:13:31.962 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:31.962 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2023-12-05T13:13:31.962 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:31.962 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 958 k 2023-12-05T13:13:31.962 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 3.0 M 2023-12-05T13:13:31.962 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:13:32.306 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 523 kB/s | 83 kB 00:00 2023-12-05T13:13:32.313 INFO:teuthology.orchestra.run.smithi029.stdout:Package libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:32.423 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): ceph-fuse-17.2.7-109.g1fd3ca3c.el8.x86_6 3.1 MB/s | 875 kB 00:00 2023-12-05T13:13:32.424 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:32.424 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.0 MB/s | 958 kB 00:00 2023-12-05T13:13:32.438 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:13:32.462 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:13:32.462 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:13:32.561 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:32.563 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:32.563 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:32.565 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:13:32.568 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:13:32.681 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install libcephfs-devel 2023-12-05T13:13:32.754 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:13:33.030 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-05T13:13:33.247 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T13:13:33.661 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:02 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T13:13:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/2 2023-12-05T13:13:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-05T13:13:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:34.445 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:13:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-05T13:13:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:34.445 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:34.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados-devel 2023-12-05T13:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 25 k 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 25 k 2023-12-05T13:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 109 k 2023-12-05T13:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:13:35.715 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:05 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:35.754 INFO:teuthology.orchestra.run.smithi029.stdout:libcephfs-devel-17.2.7-109.g1fd3ca3c.el8.x86_64 115 kB/s | 25 kB 00:00 2023-12-05T13:13:35.754 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:35.755 INFO:teuthology.orchestra.run.smithi029.stdout:Total 114 kB/s | 25 kB 00:00 2023-12-05T13:13:35.755 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:13:35.759 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:13:35.759 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:13:35.762 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:13:35.765 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:13:35.814 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:13:36.007 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:36.314 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:37.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:37.049 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:37.049 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:13:37.050 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:13:37.050 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:37.050 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:37.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librados2 2023-12-05T13:13:37.619 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:37.619 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-12-05T13:13:37.619 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:37.619 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:13:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 130 k 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 130 k 2023-12-05T13:13:37.620 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 464 k 2023-12-05T13:13:37.621 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:13:37.813 INFO:teuthology.orchestra.run.smithi052.stdout:librados-devel-17.2.7-109.g1fd3ca3c.el8.x86_64. 677 kB/s | 130 kB 00:00 2023-12-05T13:13:37.813 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:37.814 INFO:teuthology.orchestra.run.smithi052.stdout:Total 671 kB/s | 130 kB 00:00 2023-12-05T13:13:37.814 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:13:37.820 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:13:37.820 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:13:37.881 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:13:37.883 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:13:38.012 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:13:38.176 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:07 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:38.278 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:38.605 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:39.355 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:39.355 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:39.355 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:13:39.355 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:13:39.355 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:39.355 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:39.628 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs2 2023-12-05T13:13:39.798 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:40.047 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:40.049 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:40.049 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:40.164 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install librbd1 2023-12-05T13:13:40.634 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:10 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:41.167 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:10 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:42.272 INFO:teuthology.orchestra.run.smithi052.stdout:Package libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:42.524 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:42.526 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:13:42.526 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:42.778 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:42.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs-devel 2023-12-05T13:13:43.027 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:43.028 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:43.028 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:43.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rados 2023-12-05T13:13:43.754 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:13 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:44.133 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:13 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:45.634 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 25 k 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:13:45.635 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:45.636 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 25 k 2023-12-05T13:13:45.636 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 109 k 2023-12-05T13:13:45.636 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:13:45.746 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:45.994 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:45.995 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:45.995 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:46.016 INFO:teuthology.orchestra.run.smithi052.stdout:libcephfs-devel-17.2.7-109.g1fd3ca3c.el8.x86_64 65 kB/s | 25 kB 00:00 2023-12-05T13:13:46.017 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:46.017 INFO:teuthology.orchestra.run.smithi052.stdout:Total 65 kB/s | 25 kB 00:00 2023-12-05T13:13:46.018 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:13:46.022 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:13:46.022 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:13:46.025 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:13:46.029 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:13:46.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rgw 2023-12-05T13:13:46.108 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:13:46.294 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:46.598 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:47.080 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:16 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:47.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:47.313 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:47.313 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:13:47.313 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:13:47.313 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:13:47.313 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:47.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados2 2023-12-05T13:13:48.437 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:18 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:48.768 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:49.017 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:49.019 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:49.019 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:49.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-cephfs 2023-12-05T13:13:50.057 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:50.117 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:19 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:50.305 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:50.307 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:13:50.307 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:50.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librbd1 2023-12-05T13:13:51.400 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:21 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:51.754 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:52.002 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:52.004 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:52.004 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:52.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install python3-rbd 2023-12-05T13:13:53.017 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:53.100 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:22 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:53.264 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:53.266 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:13:53.266 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:53.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rados 2023-12-05T13:13:54.356 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:24 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:54.733 INFO:teuthology.orchestra.run.smithi029.stdout:Package python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:54.980 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:54.981 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-12-05T13:13:54.981 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:13:55.097 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-fuse 2023-12-05T13:13:55.998 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:56.087 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:25 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:13:56.248 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:56.249 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:13:56.250 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:56.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rgw 2023-12-05T13:13:57.346 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:27 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:13:57.936 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:13:57.937 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:57.937 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 90 k 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 90 k 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 264 k 2023-12-05T13:13:57.938 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:13:58.162 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-fuse-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 403 kB/s | 90 kB 00:00 2023-12-05T13:13:58.162 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:13:58.162 INFO:teuthology.orchestra.run.smithi029.stdout:Total 400 kB/s | 90 kB 00:00 2023-12-05T13:13:58.163 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:13:58.175 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:13:58.175 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:13:58.234 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:13:58.238 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:13:58.507 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:13:58.746 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:59.033 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:13:59.078 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:59.282 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:13:59.284 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:13:59.284 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:13:59.398 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-cephfs 2023-12-05T13:13:59.872 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:13:59.872 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:59.872 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:13:59.872 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:13:59.872 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:13:59.872 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:14:00.084 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-mirror 2023-12-05T13:14:00.385 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:30 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:14:01.073 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:30 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:14:02.015 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:14:02.266 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:14:02.267 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:14:02.267 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:14:02.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rbd 2023-12-05T13:14:02.948 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:14:02.948 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:14:02.948 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repo Size 2023-12-05T13:14:02.948 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:14:02.949 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:02.950 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 3.5 M 2023-12-05T13:14:02.950 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 16 M 2023-12-05T13:14:02.950 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:14:03.380 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:33 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:14:03.848 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-mirror-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 3.8 MB/s | 3.5 MB 00:00 2023-12-05T13:14:03.849 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:14:03.849 INFO:teuthology.orchestra.run.smithi029.stdout:Total 3.8 MB/s | 3.5 MB 00:00 2023-12-05T13:14:03.849 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:14:03.864 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:14:03.864 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:14:03.936 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:14:03.940 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:14:04.420 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:14:04.646 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:04.996 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T13:14:05.124 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:05.245 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:14:05.247 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2023-12-05T13:14:05.247 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:14:05.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-fuse 2023-12-05T13:14:05.885 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:05.885 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:05.885 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:14:05.885 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:14:05.885 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:05.885 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:14:06.103 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install rbd-nbd 2023-12-05T13:14:06.343 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:36 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:14:07.097 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:03:36 ago on Tue 05 Dec 2023 01:10:31 PM UTC. 2023-12-05T13:14:08.214 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:14:08.214 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 90 k 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:14:08.215 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:08.216 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 90 k 2023-12-05T13:14:08.216 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 264 k 2023-12-05T13:14:08.216 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:14:08.481 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-fuse-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 340 kB/s | 90 kB 00:00 2023-12-05T13:14:08.482 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:14:08.482 INFO:teuthology.orchestra.run.smithi052.stdout:Total 338 kB/s | 90 kB 00:00 2023-12-05T13:14:08.482 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:14:08.494 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:14:08.495 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:14:08.554 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:14:08.557 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:14:08.673 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:14:08.969 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-12-05T13:14:08.969 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:14:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2023-12-05T13:14:08.969 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 173 k 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout:Install 1 Package 2023-12-05T13:14:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:08.971 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 173 k 2023-12-05T13:14:08.971 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 552 k 2023-12-05T13:14:08.971 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-12-05T13:14:09.041 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:09.299 INFO:teuthology.orchestra.run.smithi029.stdout:rbd-nbd-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 526 kB/s | 173 kB 00:00 2023-12-05T13:14:09.300 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:14:09.300 INFO:teuthology.orchestra.run.smithi029.stdout:Total 524 kB/s | 173 kB 00:00 2023-12-05T13:14:09.301 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-12-05T13:14:09.314 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-12-05T13:14:09.314 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-12-05T13:14:09.373 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:09.376 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-12-05T13:14:09.379 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-12-05T13:14:09.500 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-12-05T13:14:09.745 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:10.089 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:10.098 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:10.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:10.098 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:14:10.098 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:14:10.098 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:10.098 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:14:10.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-mirror 2023-12-05T13:14:10.894 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:10.894 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:10.894 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-12-05T13:14:10.895 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:14:10.895 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:14:10.895 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-12-05T13:14:11.170 DEBUG:teuthology.parallel:result is None 2023-12-05T13:14:11.278 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:41 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:14:13.149 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:14:13.151 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:13.151 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 3.5 M 2023-12-05T13:14:13.151 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 16 M 2023-12-05T13:14:13.151 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:14:14.425 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-mirror-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 2.7 MB/s | 3.5 MB 00:01 2023-12-05T13:14:14.426 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:14:14.427 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.7 MB/s | 3.5 MB 00:01 2023-12-05T13:14:14.427 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:14:14.442 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:14:14.442 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:14:14.516 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:14:14.520 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:14:14.998 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:14:15.198 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:15.686 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:16.419 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:16.419 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:16.419 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:14:16.419 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:14:16.419 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:16.420 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:14:16.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-nbd 2023-12-05T13:14:17.656 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:03:47 ago on Tue 05 Dec 2023 01:10:30 PM UTC. 2023-12-05T13:14:19.583 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 173 k 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-12-05T13:14:19.584 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2023-12-05T13:14:19.585 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2023-12-05T13:14:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:19.585 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 173 k 2023-12-05T13:14:19.585 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 552 k 2023-12-05T13:14:19.585 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-12-05T13:14:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-nbd-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 592 kB/s | 173 kB 00:00 2023-12-05T13:14:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:14:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:Total 589 kB/s | 173 kB 00:00 2023-12-05T13:14:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-12-05T13:14:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-12-05T13:14:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-12-05T13:14:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-12-05T13:14:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-12-05T13:14:20.082 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-12-05T13:14:20.289 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:20.607 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:21.390 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T13:14:21.391 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:21.391 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-12-05T13:14:21.391 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T13:14:21.391 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:14:21.391 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-12-05T13:14:21.571 DEBUG:teuthology.parallel:result is None 2023-12-05T13:14:21.572 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T13:14:21.572 INFO:teuthology.packaging:ref: None 2023-12-05T13:14:21.572 INFO:teuthology.packaging:tag: None 2023-12-05T13:14:21.572 INFO:teuthology.packaging:branch: quincy 2023-12-05T13:14:21.572 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:14:21.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T13:14:21.789 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-05T13:14:21.818 INFO:teuthology.orchestra.run.smithi029.stdout:17.2.7-109.g1fd3ca3c.el8 2023-12-05T13:14:21.819 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-109.g1fd3ca3c.el8 2023-12-05T13:14:21.819 INFO:teuthology.task.install:The correct ceph version 17.2.7-109.g1fd3ca3c is installed. 2023-12-05T13:14:21.819 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T13:14:21.819 INFO:teuthology.packaging:ref: None 2023-12-05T13:14:21.820 INFO:teuthology.packaging:tag: None 2023-12-05T13:14:21.820 INFO:teuthology.packaging:branch: quincy 2023-12-05T13:14:21.820 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:14:21.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T13:14:22.041 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-05T13:14:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:17.2.7-109.g1fd3ca3c.el8 2023-12-05T13:14:22.072 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-109.g1fd3ca3c.el8 2023-12-05T13:14:22.072 INFO:teuthology.task.install:The correct ceph version 17.2.7-109.g1fd3ca3c is installed. 2023-12-05T13:14:22.072 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-05T13:14:22.073 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:14:22.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-05T13:14:22.110 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:14:22.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-05T13:14:22.149 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-05T13:14:22.149 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:14:22.149 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2023-12-05T13:14:22.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-05T13:14:22.259 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:14:22.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2023-12-05T13:14:22.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-05T13:14:22.369 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-05T13:14:22.369 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:14:22.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-05T13:14:22.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-05T13:14:22.477 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:14:22.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-05T13:14:22.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-05T13:14:22.586 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-05T13:14:22.586 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:14:22.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2023-12-05T13:14:22.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-05T13:14:22.696 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:14:22.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2023-12-05T13:14:22.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-05T13:14:22.805 INFO:teuthology.run_tasks:Running task print... 2023-12-05T13:14:22.814 INFO:teuthology.task.print:**** done install task... 2023-12-05T13:14:22.815 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-05T13:14:22.914 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149'} 2023-12-05T13:14:22.914 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-05T13:14:22.915 INFO:tasks.cephadm:Cluster fsid is 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:14:22.915 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-05T13:14:22.915 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-05T13:14:22.915 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi029': '172.21.15.29', 'mon.smithi052': '172.21.15.52'} 2023-12-05T13:14:22.915 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-05T13:14:22.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname $(hostname -s) 2023-12-05T13:14:22.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname $(hostname -s) 2023-12-05T13:14:22.987 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-05T13:14:22.987 DEBUG:teuthology.orchestra.run.smithi029:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-05T13:14:23.131 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 5 13:14 /home/ubuntu/cephtest/cephadm 2023-12-05T13:14:23.132 DEBUG:teuthology.orchestra.run.smithi052:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-05T13:14:23.280 INFO:teuthology.orchestra.run.smithi052.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 5 13:14 /home/ubuntu/cephtest/cephadm 2023-12-05T13:14:23.280 DEBUG:teuthology.orchestra.run.smithi029:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-05T13:14:23.304 DEBUG:teuthology.orchestra.run.smithi052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-05T13:14:23.338 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-05T13:14:23.339 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-05T13:14:23.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-05T13:14:24.649 INFO:teuthology.orchestra.run.smithi029.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T13:14:24.680 INFO:teuthology.orchestra.run.smithi052.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T13:16:25.304 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:16:25.305 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)", 2023-12-05T13:16:25.305 INFO:teuthology.orchestra.run.smithi029.stdout: "image_id": "e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d", 2023-12-05T13:16:25.305 INFO:teuthology.orchestra.run.smithi029.stdout: "repo_digests": [ 2023-12-05T13:16:25.305 INFO:teuthology.orchestra.run.smithi029.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:0d4f01deeba216c15211c4d6aff905005feecdc02196b3d83cd04ba900a424d3" 2023-12-05T13:16:25.305 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2023-12-05T13:16:25.305 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:17:29.556 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-12-05T13:17:29.556 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)", 2023-12-05T13:17:29.557 INFO:teuthology.orchestra.run.smithi052.stdout: "image_id": "e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d", 2023-12-05T13:17:29.557 INFO:teuthology.orchestra.run.smithi052.stdout: "repo_digests": [ 2023-12-05T13:17:29.557 INFO:teuthology.orchestra.run.smithi052.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:0d4f01deeba216c15211c4d6aff905005feecdc02196b3d83cd04ba900a424d3" 2023-12-05T13:17:29.557 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-12-05T13:17:29.557 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-12-05T13:17:29.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph 2023-12-05T13:17:29.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph 2023-12-05T13:17:29.664 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /etc/ceph 2023-12-05T13:17:29.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /etc/ceph 2023-12-05T13:17:29.740 INFO:tasks.cephadm:Writing seed config... 2023-12-05T13:17:29.741 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-05T13:17:29.742 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-05T13:17:29.743 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-05T13:17:29.743 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-05T13:17:29.743 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-05T13:17:29.743 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-05T13:17:29.743 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-05T13:17:29.744 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-05T13:17:29.745 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-05T13:17:29.745 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-05T13:17:29.745 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-05T13:17:29.745 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-05T13:17:29.745 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-05T13:17:29.746 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-05T13:17:29.746 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-05T13:17:29.746 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-05T13:17:29.747 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-05T13:17:29.748 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-05T13:17:29.748 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-05T13:17:29.748 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:17:29.748 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-05T13:17:29.771 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 34f4f484-9370-11ee-95a2-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-05T13:17:29.772 DEBUG:teuthology.orchestra.run.smithi029:mon.smithi029> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service 2023-12-05T13:17:29.813 INFO:tasks.cephadm:Bootstrapping... 2023-12-05T13:17:29.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 34f4f484-9370-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.29 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:17:29.848 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:-- Logs begin at Tue 2023-12-05 12:51:39 UTC. -- 2023-12-05T13:17:30.049 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-12-05T13:17:30.050 INFO:teuthology.orchestra.run.smithi029.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '34f4f484-9370-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.29', '--skip-admin-label'] 2023-12-05T13:17:30.088 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 4.6.1 2023-12-05T13:17:30.088 INFO:teuthology.orchestra.run.smithi029.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-05T13:17:30.088 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying podman|docker is present... 2023-12-05T13:17:30.122 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 4.6.1 2023-12-05T13:17:30.122 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying lvm2 is present... 2023-12-05T13:17:30.122 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying time synchronization is in place... 2023-12-05T13:17:30.130 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-05T13:17:30.130 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-05T13:17:30.136 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-05T13:17:30.136 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2023-12-05T13:17:30.143 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout enabled 2023-12-05T13:17:30.150 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout active 2023-12-05T13:17:30.150 INFO:teuthology.orchestra.run.smithi029.stdout:Unit chronyd.service is enabled and running 2023-12-05T13:17:30.150 INFO:teuthology.orchestra.run.smithi029.stdout:Repeating the final host check... 2023-12-05T13:17:30.185 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 4.6.1 2023-12-05T13:17:30.185 INFO:teuthology.orchestra.run.smithi029.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-05T13:17:30.185 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl is present 2023-12-05T13:17:30.185 INFO:teuthology.orchestra.run.smithi029.stdout:lvcreate is present 2023-12-05T13:17:30.191 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-05T13:17:30.191 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-05T13:17:30.198 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-05T13:17:30.198 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2023-12-05T13:17:30.204 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout enabled 2023-12-05T13:17:30.210 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout active 2023-12-05T13:17:30.210 INFO:teuthology.orchestra.run.smithi029.stdout:Unit chronyd.service is enabled and running 2023-12-05T13:17:30.211 INFO:teuthology.orchestra.run.smithi029.stdout:Host looks OK 2023-12-05T13:17:30.211 INFO:teuthology.orchestra.run.smithi029.stdout:Cluster fsid: 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:30.211 INFO:teuthology.orchestra.run.smithi029.stdout:Acquiring lock 139675428817384 on /run/cephadm/34f4f484-9370-11ee-95a2-87774f69a715.lock 2023-12-05T13:17:30.211 INFO:teuthology.orchestra.run.smithi029.stdout:Lock 139675428817384 acquired on /run/cephadm/34f4f484-9370-11ee-95a2-87774f69a715.lock 2023-12-05T13:17:30.211 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying IP 172.21.15.29 port 3300 ... 2023-12-05T13:17:30.212 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying IP 172.21.15.29 port 6789 ... 2023-12-05T13:17:30.212 INFO:teuthology.orchestra.run.smithi029.stdout:Base mon IP(s) is [172.21.15.29:3300, 172.21.15.29:6789], mon addrv is [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2023-12-05T13:17:30.216 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.29 metric 100 2023-12-05T13:17:30.216 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.29 metric 100 2023-12-05T13:17:30.219 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-05T13:17:30.219 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-05T13:17:30.219 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2023-12-05T13:17:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-05T13:17:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-05T13:17:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-05T13:17:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-05T13:17:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-12-05T13:17:30.223 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-05T13:17:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:Mon IP `172.21.15.29` is in CIDR network `172.21.0.0/20` 2023-12-05T13:17:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:Mon IP `172.21.15.29` is in CIDR network `172.21.0.0/20` 2023-12-05T13:17:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-05T13:17:30.224 INFO:teuthology.orchestra.run.smithi029.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-05T13:17:30.225 INFO:teuthology.orchestra.run.smithi029.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T13:17:30.568 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d 2023-12-05T13:17:30.569 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T13:17:30.569 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Getting image source signatures 2023-12-05T13:17:30.569 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying blob sha256:f8d912e8e8635896f84e43426bf9a1ea53664c8ccfe5796c31e0716d111e3afa 2023-12-05T13:17:30.569 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-05T13:17:30.569 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying config sha256:e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d 2023-12-05T13:17:30.569 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-05T13:17:31.300 INFO:teuthology.orchestra.run.smithi029.stdout:ceph: stdout ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable) 2023-12-05T13:17:31.300 INFO:teuthology.orchestra.run.smithi029.stdout:Ceph version: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable) 2023-12-05T13:17:31.300 INFO:teuthology.orchestra.run.smithi029.stdout:Extracting ceph user uid/gid from container image... 2023-12-05T13:17:31.899 INFO:teuthology.orchestra.run.smithi029.stdout:stat: stdout 167 167 2023-12-05T13:17:31.900 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial keys... 2023-12-05T13:17:32.516 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQDsIm9l5bdXChAA5j1WuBpY+v3bAgL9K1OrJg== 2023-12-05T13:17:33.126 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQDsIm9lExXmLRAAWRXMznk2nyDpvChs6itsLQ== 2023-12-05T13:17:33.769 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQDtIm9lEZotGRAAaXJga6Yap8gecuSJzfWxbg== 2023-12-05T13:17:33.770 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial monmap... 2023-12-05T13:17:34.400 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-05T13:17:34.400 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-05T13:17:34.400 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool for smithi029 [v2:172.21.15.29:3300,v1:172.21.15.29:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = octopus 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: set fsid to 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:17:34.401 INFO:teuthology.orchestra.run.smithi029.stdout:Creating mon... 2023-12-05T13:17:35.035 INFO:teuthology.orchestra.run.smithi029.stdout:create mon.smithi029 on 2023-12-05T13:17:35.146 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-05T13:17:35.239 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-05T13:17:35.340 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-34f4f484-9370-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-34f4f484-9370-11ee-95a2-87774f69a715.target. 2023-12-05T13:17:35.340 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-34f4f484-9370-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-34f4f484-9370-11ee-95a2-87774f69a715.target. 2023-12-05T13:17:35.476 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029 2023-12-05T13:17:35.476 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to reset failed state of unit ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service: Unit ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service not loaded. 2023-12-05T13:17:35.578 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-34f4f484-9370-11ee-95a2-87774f69a715.target.wants/ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service → /etc/systemd/system/ceph-34f4f484-9370-11ee-95a2-87774f69a715@.service. 2023-12-05T13:17:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:35 smithi029 systemd[1]: Starting Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:17:36.025 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T13:17:36.025 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2023-12-05T13:17:36.035 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T13:17:36.035 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2023-12-05T13:17:36.035 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2023-12-05T13:17:36.035 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to enable service . firewalld.service is not available 2023-12-05T13:17:36.035 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mon to start... 2023-12-05T13:17:36.036 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mon... 2023-12-05T13:17:36.258 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:36 smithi029 bash[111606]: 517f2802eee22deefd1b530f006df6a213d9f55d75a3b954467de62e200a7949 2023-12-05T13:17:36.258 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:36 smithi029 systemd[1]: Started Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:17:36.258 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:36 smithi029 ceph-mon[111644]: mkfs 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:36.258 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:36 smithi029 ceph-mon[111644]: mon.smithi029 is new leader, mons smithi029 in quorum (ranks 0) 2023-12-05T13:17:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout cluster: 2023-12-05T13:17:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout id: 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-05T13:17:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout services: 2023-12-05T13:17:36.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi029 (age 0.504439s) 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout data: 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout pgs: 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.464+0000 7f31e2217700 1 Processor -- start 2023-12-05T13:17:36.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.464+0000 7f31e2217700 1 -- start start 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.464+0000 7f31e2217700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.464+0000 7f31e2217700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc077770 con 0x7f31dc078e20 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59368/0 (socket says 172.21.15.29:59368) 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31db7fe700 1 -- 172.21.15.29:0/52710777 learned_addr learned my addr 172.21.15.29:0/52710777 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31db7fe700 1 -- 172.21.15.29:0/52710777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0778b0 con 0x7f31dc078e20 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31db7fe700 1 --2- 172.21.15.29:0/52710777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0098e0 tx=0x7f31cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d469240f363082 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31da7fc700 1 -- 172.21.15.29:0/52710777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31cc00b860 con 0x7f31dc078e20 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31da7fc700 1 -- 172.21.15.29:0/52710777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00b9c0 con 0x7f31dc078e20 2023-12-05T13:17:36.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.465+0000 7f31da7fc700 1 -- 172.21.15.29:0/52710777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31cc00bc90 con 0x7f31dc078e20 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 -- 172.21.15.29:0/52710777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 msgr2=0x7f31dc077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 --2- 172.21.15.29:0/52710777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0098e0 tx=0x7f31cc009250 comp rx=0 tx=0).stop 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 -- 172.21.15.29:0/52710777 shutdown_connections 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 --2- 172.21.15.29:0/52710777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc077230 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 -- 172.21.15.29:0/52710777 >> 172.21.15.29:0/52710777 conn(0x7f31dc0fda40 msgr2=0x7f31dc0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 -- 172.21.15.29:0/52710777 shutdown_connections 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.466+0000 7f31e2217700 1 -- 172.21.15.29:0/52710777 wait complete. 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31e2217700 1 Processor -- start 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31e2217700 1 -- start start 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31e2217700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31e2217700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1130f0 con 0x7f31dc078e20 2023-12-05T13:17:36.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59372/0 (socket says 172.21.15.29:59372) 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.467+0000 7f31db7fe700 1 -- 172.21.15.29:0/224634551 learned_addr learned my addr 172.21.15.29:0/224634551 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31db7fe700 1 -- 172.21.15.29:0/224634551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0094f0 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31db7fe700 1 --2- 172.21.15.29:0/224634551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc112bb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009290 tx=0x7f31cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31cc01c5c0 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc01c740 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc1132f0 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31cc01ca50 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc113700 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f31cc01a450 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.468+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f31cc02e790 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.469+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc077bc0 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.471+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f31cc01ce30 con 0x7f31dc078e20 2023-12-05T13:17:36.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.547+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f31dc10bf00 con 0x7f31dc078e20 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.548+0000 7f31d3fff700 1 -- 172.21.15.29:0/224634551 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f31cc01a890 con 0x7f31dc078e20 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.548+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 msgr2=0x7f31dc112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.548+0000 7f31e2217700 1 --2- 172.21.15.29:0/224634551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc112bb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009290 tx=0x7f31cc016000 comp rx=0 tx=0).stop 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.548+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 shutdown_connections 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.548+0000 7f31e2217700 1 --2- 172.21.15.29:0/224634551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31dc078e20 0x7f31dc112bb0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.548+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 >> 172.21.15.29:0/224634551 conn(0x7f31dc0fda40 msgr2=0x7f31dc107040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.549+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 shutdown_connections 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:36.549+0000 7f31e2217700 1 -- 172.21.15.29:0/224634551 wait complete. 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:mon is available 2023-12-05T13:17:36.913 INFO:teuthology.orchestra.run.smithi029.stdout:Assimilating anything we can from ceph.conf... 2023-12-05T13:17:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:37 smithi029 ceph-mon[111644]: mon.smithi029 is new leader, mons smithi029 in quorum (ranks 0) 2023-12-05T13:17:37.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:37 smithi029 ceph-mon[111644]: monmap e1: 1 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:17:37.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:37 smithi029 ceph-mon[111644]: fsmap 2023-12-05T13:17:37.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:37 smithi029 ceph-mon[111644]: osdmap e1: 0 total, 0 up, 0 in 2023-12-05T13:17:37.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:37 smithi029 ceph-mon[111644]: mgrmap e1: no daemons active 2023-12-05T13:17:37.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:37 smithi029 ceph-mon[111644]: from='client.? 172.21.15.29:0/224634551' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-05T13:17:37.810 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [global] 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout fsid = 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-05T13:17:37.816 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [osd] 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd817dc5700 1 Processor -- start 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd817dc5700 1 -- start start 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd817dc5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810107340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd817dc5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810102d30 con 0x7fd810070f60 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd815b61700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd815b61700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59388/0 (socket says 172.21.15.29:59388) 2023-12-05T13:17:37.817 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.359+0000 7fd815b61700 1 -- 172.21.15.29:0/3940095618 learned_addr learned my addr 172.21.15.29:0/3940095618 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd815b61700 1 -- 172.21.15.29:0/3940095618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810107880 con 0x7fd810070f60 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd815b61700 1 --2- 172.21.15.29:0/3940095618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810107340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0098e0 tx=0x7fd80c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135f991604f8d7e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd814b5f700 1 -- 172.21.15.29:0/3940095618 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80c00b860 con 0x7fd810070f60 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd814b5f700 1 -- 172.21.15.29:0/3940095618 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c00b9c0 con 0x7fd810070f60 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd814b5f700 1 -- 172.21.15.29:0/3940095618 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80c00bc90 con 0x7fd810070f60 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd817dc5700 1 -- 172.21.15.29:0/3940095618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 msgr2=0x7fd810107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.360+0000 7fd817dc5700 1 --2- 172.21.15.29:0/3940095618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810107340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0098e0 tx=0x7fd80c009250 comp rx=0 tx=0).stop 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.361+0000 7fd817dc5700 1 -- 172.21.15.29:0/3940095618 shutdown_connections 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.361+0000 7fd817dc5700 1 --2- 172.21.15.29:0/3940095618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810107340 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.361+0000 7fd817dc5700 1 -- 172.21.15.29:0/3940095618 >> 172.21.15.29:0/3940095618 conn(0x7fd8100fc970 msgr2=0x7fd8100fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.361+0000 7fd817dc5700 1 -- 172.21.15.29:0/3940095618 shutdown_connections 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.361+0000 7fd817dc5700 1 -- 172.21.15.29:0/3940095618 wait complete. 2023-12-05T13:17:37.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.361+0000 7fd817dc5700 1 Processor -- start 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd817dc5700 1 -- start start 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd817dc5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd817dc5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101130f0 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd815b61700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd815b61700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59392/0 (socket says 172.21.15.29:59392) 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd815b61700 1 -- 172.21.15.29:0/3610379575 learned_addr learned my addr 172.21.15.29:0/3610379575 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd815b61700 1 -- 172.21.15.29:0/3610379575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0094f0 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.362+0000 7fd815b61700 1 --2- 172.21.15.29:0/3610379575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810112bb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009290 tx=0x7fd80c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80c01c5c0 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c01c740 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8101132f0 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80c01ca50 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd810113700 con 0x7fd810070f60 2023-12-05T13:17:37.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd80c01a450 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.363+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd80c02e790 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.364+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81004bb80 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.366+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd80c01ce30 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.439+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd81010c2c0 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.442+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd80c02e9f0 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.442+0000 7fd8067fc700 1 -- 172.21.15.29:0/3610379575 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fd80c0246c0 con 0x7fd810070f60 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.443+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 msgr2=0x7fd810112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.443+0000 7fd817dc5700 1 --2- 172.21.15.29:0/3610379575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810112bb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009290 tx=0x7fd80c016000 comp rx=0 tx=0).stop 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.443+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 shutdown_connections 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.443+0000 7fd817dc5700 1 --2- 172.21.15.29:0/3610379575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810070f60 0x7fd810112bb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.443+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 >> 172.21.15.29:0/3610379575 conn(0x7fd8100fc970 msgr2=0x7fd8100fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.443+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 shutdown_connections 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:37.444+0000 7fd817dc5700 1 -- 172.21.15.29:0/3610379575 wait complete. 2023-12-05T13:17:37.820 INFO:teuthology.orchestra.run.smithi029.stdout:Generating new minimal ceph.conf... 2023-12-05T13:17:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:38 smithi029 ceph-mon[111644]: from='client.? 172.21.15.29:0/3610379575' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-05T13:17:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:38 smithi029 ceph-mon[111644]: from='client.? 172.21.15.29:0/3610379575' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-05T13:17:38.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.179+0000 7f1868cff700 1 Processor -- start 2023-12-05T13:17:38.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.179+0000 7f1868cff700 1 -- start start 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.179+0000 7f1868cff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.179+0000 7f1868cff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864102d10 con 0x7f1864070f80 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59406/0 (socket says 172.21.15.29:59406) 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186259c700 1 -- 172.21.15.29:0/3568366782 learned_addr learned my addr 172.21.15.29:0/3568366782 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186259c700 1 -- 172.21.15.29:0/3568366782 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864107860 con 0x7f1864070f80 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186259c700 1 --2- 172.21.15.29:0/3568366782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f18540098e0 tx=0x7f1854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2faaf814455765 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186159a700 1 -- 172.21.15.29:0/3568366782 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f185400b860 con 0x7f1864070f80 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186159a700 1 -- 172.21.15.29:0/3568366782 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f185400be30 con 0x7f1864070f80 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.180+0000 7f186159a700 1 -- 172.21.15.29:0/3568366782 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1854010380 con 0x7f1864070f80 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 -- 172.21.15.29:0/3568366782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 msgr2=0x7f1864107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 --2- 172.21.15.29:0/3568366782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f18540098e0 tx=0x7f1854009250 comp rx=0 tx=0).stop 2023-12-05T13:17:38.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 -- 172.21.15.29:0/3568366782 shutdown_connections 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 --2- 172.21.15.29:0/3568366782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864107320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 -- 172.21.15.29:0/3568366782 >> 172.21.15.29:0/3568366782 conn(0x7f18640fc970 msgr2=0x7f18640fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 -- 172.21.15.29:0/3568366782 shutdown_connections 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.181+0000 7f1868cff700 1 -- 172.21.15.29:0/3568366782 wait complete. 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f1868cff700 1 Processor -- start 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f1868cff700 1 -- start start 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f1868cff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f1868cff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18641138c0 con 0x7f1864070f80 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f186259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f186259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59422/0 (socket says 172.21.15.29:59422) 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.182+0000 7f186259c700 1 -- 172.21.15.29:0/1099411233 learned_addr learned my addr 172.21.15.29:0/1099411233 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f186259c700 1 -- 172.21.15.29:0/1099411233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540094f0 con 0x7f1864070f80 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f186259c700 1 --2- 172.21.15.29:0/1099411233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1854006d40 tx=0x7f1854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18540109b0 con 0x7f1864070f80 2023-12-05T13:17:38.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1854024440 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1864113ac0 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f185401a5f0 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.183+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1864113ed0 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.184+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1854010d90 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.184+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f185402d740 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.184+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186404bb80 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.186+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1854006d70 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.260+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f18641084f0 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.260+0000 7f185affd700 1 -- 172.21.15.29:0/1099411233 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f1854035090 con 0x7f1864070f80 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 msgr2=0x7f1864113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 --2- 172.21.15.29:0/1099411233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1854006d40 tx=0x7f1854009250 comp rx=0 tx=0).stop 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 shutdown_connections 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 --2- 172.21.15.29:0/1099411233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1864070f80 0x7f1864113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 >> 172.21.15.29:0/1099411233 conn(0x7f18640fc970 msgr2=0x7f18640fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:38.633 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 shutdown_connections 2023-12-05T13:17:38.634 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:38.261+0000 7f1868cff700 1 -- 172.21.15.29:0/1099411233 wait complete. 2023-12-05T13:17:38.634 INFO:teuthology.orchestra.run.smithi029.stdout:Restarting the monitor... 2023-12-05T13:17:38.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:38 smithi029 systemd[1]: Stopping Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:17:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:38 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[111620]: 2023-12-05T13:17:38.831+0000 7f35df64e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi029 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:17:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:38 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[111620]: 2023-12-05T13:17:38.831+0000 7f35df64e700 -1 mon.smithi029@0(leader) e1 *** Got Signal Terminated *** 2023-12-05T13:17:39.452 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 bash[111971]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029 2023-12-05T13:17:39.762 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service: Succeeded. 2023-12-05T13:17:39.763 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 systemd[1]: Stopped Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:17:39.763 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 systemd[1]: Starting Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:17:39.843 INFO:teuthology.orchestra.run.smithi029.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-05T13:17:40.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 bash[112090]: d8b25bc8bb04cca77deb20afdd227a2e3e8a468f8b7f5f3e69ef4b16f7ea8ab4 2023-12-05T13:17:40.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T13:17:40.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable), process ceph-mon, pid 7 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: pidfile_write: ignore empty --pid-file 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 systemd[1]: Started Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: load: jerasure load: lrc 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: RocksDB version: 6.15.5 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Compile date Dec 4 2023 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: DB SUMMARY 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: DB Session ID: H3HI39EAGLDV5CINT6NA 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: CURRENT file: CURRENT 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi029/store.db dir, Total Num: 1, files: 000008.sst 2023-12-05T13:17:40.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi029/store.db: 000010.log size: 95330 ; 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.error_if_exists: 0 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.create_if_missing: 0 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.paranoid_checks: 1 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.env: 0x55ab50098a80 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.fs: Posix File System 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.info_log: 0x55ab50b78780 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.statistics: (nil) 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.use_fsync: 0 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_log_file_size: 0 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T13:17:40.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.allow_fallocate: 1 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.use_direct_reads: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.db_log_dir: 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi029/store.db 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T13:17:40.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.write_buffer_manager: 0x55ab518e89f0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.unordered_write: 0 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T13:17:40.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.row_cache: None 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.wal_filter: None 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.preserve_deletes: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.two_write_queues: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.atomic_flush: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.log_readahead_size: 0 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T13:17:40.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_background_jobs: 2 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_background_compactions: -1 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_subcompactions: 1 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T13:17:40.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_open_files: -1 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_background_flushes: -1 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Compression algorithms supported: 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kZSTD supported: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kXpressCompression supported: 0 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kZlibCompression supported: 1 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kSnappyCompression supported: 1 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kLZ4Compression supported: 1 2023-12-05T13:17:40.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: kBZip2Compression supported: 0 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi029/store.db/MANIFEST-000009 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.merge_operator: 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_filter: None 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ab50bc8f90) 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: cache_index_and_filter_blocks: 1 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T13:17:40.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: pin_top_level_index_and_filter: 1 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: index_type: 0 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: data_block_index_type: 0 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: index_shortening: 1 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: hash_index_allow_collision: 1 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: checksum: 1 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: no_block_cache: 0 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache: 0x55ab50bfb090 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache_name: BinnedLRUCache 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache_options: 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: capacity : 536870912 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: num_shard_bits : 4 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: strict_capacity_limit : 0 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: high_pri_pool_ratio: 0.000 2023-12-05T13:17:40.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache_compressed: (nil) 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: persistent_cache: (nil) 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_size: 4096 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_size_deviation: 10 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_restart_interval: 16 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: index_block_restart_interval: 1 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: metadata_block_size: 4096 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: partition_filters: 0 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: use_delta_encoding: 1 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: whole_key_filtering: 1 2023-12-05T13:17:40.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: verify_compression: 0 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: read_amp_bytes_per_bit: 0 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: format_version: 4 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: enable_index_compression: 1 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_align: 0 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression: NoCompression 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.num_levels: 7 2023-12-05T13:17:40.117 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T13:17:40.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T13:17:40.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.arena_block_size: 4194304 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T13:17:40.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.table_properties_collectors: 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.inplace_update_support: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.bloom_locality: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.max_successive_merges: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T13:17:40.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.ttl: 2592000 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.enable_blob_files: false 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.min_blob_size: 0 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi029/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782259849572, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-05T13:17:40.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782259850557, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90856, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88951, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81729, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701782259, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "ef87cd41-1d1a-46a8-a762-6a69fbb39610", "db_session_id": "H3HI39EAGLDV5CINT6NA"}} 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782259851034, "job": 1, "event": "recovery_finished"} 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi029/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55ab50b8f180 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: DB pointer 0x55ab50c64000 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** DB Stats ** 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T13:17:40.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** Compaction Stats [default] ** 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: L0 2/0 90.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Sum 2/0 90.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** Compaction Stats [default] ** 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:17:40.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative compaction: 0.00 GB write, 21.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval compaction: 0.00 GB write, 21.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** Compaction Stats [default] ** 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: L0 2/0 90.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Sum 2/0 90.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** Compaction Stats [default] ** 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.3 0.00 0.00 1 0.001 0 0 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative compaction: 0.00 GB write, 21.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T13:17:40.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T13:17:40.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: starting mon.smithi029 rank 0 at public addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] at bind addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi029 fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:40.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???) e1 preinit fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:40.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).mds e1 new map 2023-12-05T13:17:40.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).mds e1 print_map 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: e1 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: legacy client fscid: -1 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: No filesystems configured 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mon.smithi029 is new leader, mons smithi029 in quorum (ranks 0) 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: monmap e1: 1 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: fsmap 2023-12-05T13:17:40.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: osdmap e1: 0 total, 0 up, 0 in 2023-12-05T13:17:40.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:39 smithi029 ceph-mon[112128]: mgrmap e1: no daemons active 2023-12-05T13:17:40.684 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.240+0000 7f230ec27700 1 Processor -- start 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.240+0000 7f230ec27700 1 -- start start 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.240+0000 7f230ec27700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308107340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.240+0000 7f230ec27700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308102d30 con 0x7f2308070f60 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f230c9c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f230c9c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36890/0 (socket says 172.21.15.29:36890) 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f230c9c3700 1 -- 172.21.15.29:0/341450536 learned_addr learned my addr 172.21.15.29:0/341450536 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f230c9c3700 1 -- 172.21.15.29:0/341450536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308107880 con 0x7f2308070f60 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f230c9c3700 1 --2- 172.21.15.29:0/341450536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308107340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0098e0 tx=0x7f22fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f3d958ecb87691 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f23077fe700 1 -- 172.21.15.29:0/341450536 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc00b860 con 0x7f2308070f60 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.241+0000 7f23077fe700 1 -- 172.21.15.29:0/341450536 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f22fc00be30 con 0x7f2308070f60 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f23077fe700 1 -- 172.21.15.29:0/341450536 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc010380 con 0x7f2308070f60 2023-12-05T13:17:40.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 -- 172.21.15.29:0/341450536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 msgr2=0x7f2308107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 --2- 172.21.15.29:0/341450536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308107340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0098e0 tx=0x7f22fc009250 comp rx=0 tx=0).stop 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 -- 172.21.15.29:0/341450536 shutdown_connections 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 --2- 172.21.15.29:0/341450536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308107340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 -- 172.21.15.29:0/341450536 >> 172.21.15.29:0/341450536 conn(0x7f23080fc970 msgr2=0x7f23080fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 -- 172.21.15.29:0/341450536 shutdown_connections 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.242+0000 7f230ec27700 1 -- 172.21.15.29:0/341450536 wait complete. 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230ec27700 1 Processor -- start 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230ec27700 1 -- start start 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230ec27700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230ec27700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23081138c0 con 0x7f2308070f60 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230c9c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230c9c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36906/0 (socket says 172.21.15.29:36906) 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.243+0000 7f230c9c3700 1 -- 172.21.15.29:0/3151429888 learned_addr learned my addr 172.21.15.29:0/3151429888 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:40.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f230c9c3700 1 -- 172.21.15.29:0/3151429888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0094f0 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f230c9c3700 1 --2- 172.21.15.29:0/3151429888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308113380 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006d40 tx=0x7f22fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc0109b0 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f22fc024440 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2308113ac0 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22fc01a5f0 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.244+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2308113ed0 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.245+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f22fc01aaf0 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.245+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f22fc02da40 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.245+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230804bb80 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.248+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f22fc006d70 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.320+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f230810cd60 con 0x7f2308070f60 2023-12-05T13:17:40.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.323+0000 7f23057fa700 1 -- 172.21.15.29:0/3151429888 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f22fc024970 con 0x7f2308070f60 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 msgr2=0x7f2308113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 --2- 172.21.15.29:0/3151429888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308113380 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006d40 tx=0x7f22fc009250 comp rx=0 tx=0).stop 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 shutdown_connections 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 --2- 172.21.15.29:0/3151429888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2308070f60 0x7f2308113380 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 >> 172.21.15.29:0/3151429888 conn(0x7f23080fc970 msgr2=0x7f23080fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 shutdown_connections 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:40.324+0000 7f230ec27700 1 -- 172.21.15.29:0/3151429888 wait complete. 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:17:40.693 INFO:teuthology.orchestra.run.smithi029.stdout:Creating mgr... 2023-12-05T13:17:40.694 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying port 9283 ... 2023-12-05T13:17:40.835 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-34f4f484-9370-11ee-95a2-87774f69a715@mgr.smithi029.eekhlu 2023-12-05T13:17:40.835 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to reset failed state of unit ceph-34f4f484-9370-11ee-95a2-87774f69a715@mgr.smithi029.eekhlu.service: Unit ceph-34f4f484-9370-11ee-95a2-87774f69a715@mgr.smithi029.eekhlu.service not loaded. 2023-12-05T13:17:40.936 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-34f4f484-9370-11ee-95a2-87774f69a715.target.wants/ceph-34f4f484-9370-11ee-95a2-87774f69a715@mgr.smithi029.eekhlu.service → /etc/systemd/system/ceph-34f4f484-9370-11ee-95a2-87774f69a715@.service. 2023-12-05T13:17:41.383 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T13:17:41.383 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2023-12-05T13:17:41.393 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T13:17:41.393 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2023-12-05T13:17:41.393 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2023-12-05T13:17:41.393 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to enable service . firewalld.service is not available 2023-12-05T13:17:41.403 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T13:17:41.403 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2023-12-05T13:17:41.412 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T13:17:41.412 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2023-12-05T13:17:41.412 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2023-12-05T13:17:41.412 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-05T13:17:41.412 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr to start... 2023-12-05T13:17:41.412 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr... 2023-12-05T13:17:41.580 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:41 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3151429888' entity='client.admin' 2023-12-05T13:17:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:17:42.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "34f4f484-9370-11ee-95a2-87774f69a715", 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "smithi029" 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T13:17:42.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T13:17:42.278 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T13:17:42.279 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T13:17:36.046250+0000", 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:42.280 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.818+0000 7fe8ffa3c700 1 Processor -- start 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.818+0000 7fe8ffa3c700 1 -- start start 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.818+0000 7fe8ffa3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.818+0000 7fe8ffa3c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81053d0 con 0x7fe8f8076c60 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.819+0000 7fe8fd7d8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.819+0000 7fe8fd7d8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36944/0 (socket says 172.21.15.29:36944) 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.819+0000 7fe8fd7d8700 1 -- 172.21.15.29:0/3360948427 learned_addr learned my addr 172.21.15.29:0/3360948427 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.819+0000 7fe8fd7d8700 1 -- 172.21.15.29:0/3360948427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8105510 con 0x7fe8f8076c60 2023-12-05T13:17:42.281 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.819+0000 7fe8fd7d8700 1 --2- 172.21.15.29:0/3360948427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8104e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80098e0 tx=0x7fe8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe3ce6c227ea2e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.819+0000 7fe8effff700 1 -- 172.21.15.29:0/3360948427 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8e800b860 con 0x7fe8f8076c60 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8effff700 1 -- 172.21.15.29:0/3360948427 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe8e800be30 con 0x7fe8f8076c60 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8effff700 1 -- 172.21.15.29:0/3360948427 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8e8010380 con 0x7fe8f8076c60 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3360948427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 msgr2=0x7fe8f8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 --2- 172.21.15.29:0/3360948427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8104e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80098e0 tx=0x7fe8e8009250 comp rx=0 tx=0).stop 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3360948427 shutdown_connections 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 --2- 172.21.15.29:0/3360948427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8104e90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3360948427 >> 172.21.15.29:0/3360948427 conn(0x7fe8f80fc980 msgr2=0x7fe8f80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3360948427 shutdown_connections 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.820+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3360948427 wait complete. 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.821+0000 7fe8ffa3c700 1 Processor -- start 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.821+0000 7fe8ffa3c700 1 -- start start 2023-12-05T13:17:42.282 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.821+0000 7fe8ffa3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.821+0000 7fe8ffa3c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8113870 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8fd7d8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8fd7d8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36960/0 (socket says 172.21.15.29:36960) 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8fd7d8700 1 -- 172.21.15.29:0/3763608049 learned_addr learned my addr 172.21.15.29:0/3763608049 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8fd7d8700 1 -- 172.21.15.29:0/3763608049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80094f0 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8fd7d8700 1 --2- 172.21.15.29:0/3763608049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8113330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8006d40 tx=0x7fe8e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8e80109b0 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe8e8024440 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f8113a70 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8e801a5f0 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.822+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f8113e80 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.823+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe8e801aaa0 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.823+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe8e802da00 con 0x7fe8f8076c60 2023-12-05T13:17:42.283 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.824+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f804bb80 con 0x7fe8f8076c60 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.826+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe8e8024970 con 0x7fe8f8076c60 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.903+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe8f81062f0 con 0x7fe8f8076c60 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.903+0000 7fe8edffb700 1 -- 172.21.15.29:0/3763608049 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe8e80245b0 con 0x7fe8f8076c60 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.904+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 msgr2=0x7fe8f8113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.904+0000 7fe8ffa3c700 1 --2- 172.21.15.29:0/3763608049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8113330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8006d40 tx=0x7fe8e8009250 comp rx=0 tx=0).stop 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.904+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 shutdown_connections 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.904+0000 7fe8ffa3c700 1 --2- 172.21.15.29:0/3763608049 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f8076c60 0x7fe8f8113330 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.904+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 >> 172.21.15.29:0/3763608049 conn(0x7fe8f80fc980 msgr2=0x7fe8f80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.904+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 shutdown_connections 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:41.905+0000 7fe8ffa3c700 1 -- 172.21.15.29:0/3763608049 wait complete. 2023-12-05T13:17:42.284 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (1/15)... 2023-12-05T13:17:42.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:42 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3763608049' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T13:17:45.046 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:44 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1022265777' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T13:17:45.167 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "34f4f484-9370-11ee-95a2-87774f69a715", 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:45.168 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "smithi029" 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T13:17:45.169 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T13:17:45.170 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T13:17:36.046250+0000", 2023-12-05T13:17:45.171 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.662+0000 7f30ef569700 1 Processor -- start 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.662+0000 7f30ef569700 1 -- start start 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.662+0000 7f30ef569700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.662+0000 7f30ef569700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8077fc0 con 0x7f30e8077bb0 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30ed305700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30ed305700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36964/0 (socket says 172.21.15.29:36964) 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30ed305700 1 -- 172.21.15.29:0/1120439304 learned_addr learned my addr 172.21.15.29:0/1120439304 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30ed305700 1 -- 172.21.15.29:0/1120439304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8076600 con 0x7f30e8077bb0 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30ed305700 1 --2- 172.21.15.29:0/1120439304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e80760c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30e40098e0 tx=0x7f30e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703ba8ff78bb53b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30dffff700 1 -- 172.21.15.29:0/1120439304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30e400b860 con 0x7f30e8077bb0 2023-12-05T13:17:45.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30dffff700 1 -- 172.21.15.29:0/1120439304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f30e400be30 con 0x7f30e8077bb0 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.663+0000 7f30dffff700 1 -- 172.21.15.29:0/1120439304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30e4010380 con 0x7f30e8077bb0 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 -- 172.21.15.29:0/1120439304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 msgr2=0x7f30e80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 --2- 172.21.15.29:0/1120439304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e80760c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30e40098e0 tx=0x7f30e4009250 comp rx=0 tx=0).stop 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 -- 172.21.15.29:0/1120439304 shutdown_connections 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 --2- 172.21.15.29:0/1120439304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e80760c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 -- 172.21.15.29:0/1120439304 >> 172.21.15.29:0/1120439304 conn(0x7f30e80fda50 msgr2=0x7f30e80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 -- 172.21.15.29:0/1120439304 shutdown_connections 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 -- 172.21.15.29:0/1120439304 wait complete. 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.664+0000 7f30ef569700 1 Processor -- start 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ef569700 1 -- start start 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ef569700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ef569700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8113910 con 0x7f30e8077bb0 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ed305700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:45.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ed305700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36966/0 (socket says 172.21.15.29:36966) 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ed305700 1 -- 172.21.15.29:0/1022265777 learned_addr learned my addr 172.21.15.29:0/1022265777 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ed305700 1 -- 172.21.15.29:0/1022265777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40094f0 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.665+0000 7f30ed305700 1 --2- 172.21.15.29:0/1022265777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e81133d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30e4006fd0 tx=0x7f30e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30e4010750 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f30e4010d20 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e8113b10 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30e401ada0 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8113f20 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f30e4024680 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.666+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f30e4019890 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.667+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e804bb80 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.669+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f30e4029060 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.746+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f30e810cdb0 con 0x7f30e8077bb0 2023-12-05T13:17:45.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.746+0000 7f30ddffb700 1 -- 172.21.15.29:0/1022265777 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f30e4020070 con 0x7f30e8077bb0 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.747+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 msgr2=0x7f30e81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.747+0000 7f30ef569700 1 --2- 172.21.15.29:0/1022265777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e81133d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30e4006fd0 tx=0x7f30e4009250 comp rx=0 tx=0).stop 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.748+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 shutdown_connections 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.748+0000 7f30ef569700 1 --2- 172.21.15.29:0/1022265777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30e8077bb0 0x7f30e81133d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.748+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 >> 172.21.15.29:0/1022265777 conn(0x7f30e80fda50 msgr2=0x7f30e80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.748+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 shutdown_connections 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:44.748+0000 7f30ef569700 1 -- 172.21.15.29:0/1022265777 wait complete. 2023-12-05T13:17:45.175 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (2/15)... 2023-12-05T13:17:47.848 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:47 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3346311506' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "34f4f484-9370-11ee-95a2-87774f69a715", 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:48.027 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "smithi029" 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T13:17:48.028 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T13:17:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T13:17:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T13:17:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T13:17:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T13:17:48.039 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.040 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.041 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T13:17:36.046250+0000", 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae32eb9700 1 Processor -- start 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae32eb9700 1 -- start start 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae32eb9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae32eb9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c101b20 con 0x7fae2c1011d0 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae30c55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:48.042 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae30c55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36968/0 (socket says 172.21.15.29:36968) 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.583+0000 7fae30c55700 1 -- 172.21.15.29:0/1481996851 learned_addr learned my addr 172.21.15.29:0/1481996851 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.584+0000 7fae30c55700 1 -- 172.21.15.29:0/1481996851 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c101c60 con 0x7fae2c1011d0 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.584+0000 7fae30c55700 1 --2- 172.21.15.29:0/1481996851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c1015e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae200098e0 tx=0x7fae20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82ca93f97883b8e server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.584+0000 7fae2b7fe700 1 -- 172.21.15.29:0/1481996851 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae2000b860 con 0x7fae2c1011d0 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.584+0000 7fae2b7fe700 1 -- 172.21.15.29:0/1481996851 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fae2000be30 con 0x7fae2c1011d0 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.584+0000 7fae2b7fe700 1 -- 172.21.15.29:0/1481996851 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae20010380 con 0x7fae2c1011d0 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 -- 172.21.15.29:0/1481996851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 msgr2=0x7fae2c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 --2- 172.21.15.29:0/1481996851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c1015e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae200098e0 tx=0x7fae20009250 comp rx=0 tx=0).stop 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 -- 172.21.15.29:0/1481996851 shutdown_connections 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 --2- 172.21.15.29:0/1481996851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c1015e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 -- 172.21.15.29:0/1481996851 >> 172.21.15.29:0/1481996851 conn(0x7fae2c0fc970 msgr2=0x7fae2c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 -- 172.21.15.29:0/1481996851 shutdown_connections 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 -- 172.21.15.29:0/1481996851 wait complete. 2023-12-05T13:17:48.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 Processor -- start 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.585+0000 7fae32eb9700 1 -- start start 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae32eb9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c116250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae32eb9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c111c40 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae30c55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c116250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae30c55700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c116250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36982/0 (socket says 172.21.15.29:36982) 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae30c55700 1 -- 172.21.15.29:0/3346311506 learned_addr learned my addr 172.21.15.29:0/3346311506 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae30c55700 1 -- 172.21.15.29:0/3346311506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200094f0 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.586+0000 7fae30c55700 1 --2- 172.21.15.29:0/3346311506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c116250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae20006b00 tx=0x7fae20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae200109b0 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fae20024440 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae2001a5f0 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c070f90 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c116790 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fae20010d90 con 0x7fae2c1011d0 2023-12-05T13:17:48.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.587+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fae2002d740 con 0x7fae2c1011d0 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.588+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c10a050 con 0x7fae2c1011d0 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.590+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fae20024990 con 0x7fae2c1011d0 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.666+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fae2c102fe0 con 0x7fae2c1011d0 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.667+0000 7fae297fa700 1 -- 172.21.15.29:0/3346311506 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fae20032030 con 0x7fae2c1011d0 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 msgr2=0x7fae2c116250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 --2- 172.21.15.29:0/3346311506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c116250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae20006b00 tx=0x7fae20009250 comp rx=0 tx=0).stop 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 shutdown_connections 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 --2- 172.21.15.29:0/3346311506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae2c1011d0 0x7fae2c116250 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 >> 172.21.15.29:0/3346311506 conn(0x7fae2c0fc970 msgr2=0x7fae2c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 shutdown_connections 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:47.668+0000 7fae32eb9700 1 -- 172.21.15.29:0/3346311506 wait complete. 2023-12-05T13:17:48.045 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (3/15)... 2023-12-05T13:17:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:17:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: mgrmap e2: smithi029.eekhlu(active, starting, since 0.00326103s) 2023-12-05T13:17:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:17:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:17:48.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:17:48.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:17:48.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:48 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:17:50.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:49 smithi029 ceph-mon[112128]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:17:50.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:49 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:17:50.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:49 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:17:50.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:49 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' 2023-12-05T13:17:50.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:49 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' 2023-12-05T13:17:50.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:49 smithi029 ceph-mon[112128]: from='mgr.14100 172.21.15.29:0/94087768' entity='mgr.smithi029.eekhlu' 2023-12-05T13:17:51.002 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:50 smithi029 ceph-mon[112128]: mgrmap e3: smithi029.eekhlu(active, since 1.02689s) 2023-12-05T13:17:51.003 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:50 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2821615425' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T13:17:51.066 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "34f4f484-9370-11ee-95a2-87774f69a715", 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:51.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "smithi029" 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T13:17:51.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:51.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T13:17:36.046250+0000", 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.422+0000 7fd411950700 1 Processor -- start 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.422+0000 7fd411950700 1 -- start start 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.422+0000 7fd411950700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.422+0000 7fd411950700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c101b20 con 0x7fd40c1011d0 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd40affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd40affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42528/0 (socket says 172.21.15.29:42528) 2023-12-05T13:17:51.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd40affd700 1 -- 172.21.15.29:0/4090678347 learned_addr learned my addr 172.21.15.29:0/4090678347 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd40affd700 1 -- 172.21.15.29:0/4090678347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c101c60 con 0x7fd40c1011d0 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd40affd700 1 --2- 172.21.15.29:0/4090678347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c1015e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0098e0 tx=0x7fd3fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c15a71db3038d server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd409ffb700 1 -- 172.21.15.29:0/4090678347 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3fc00b860 con 0x7fd40c1011d0 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd409ffb700 1 -- 172.21.15.29:0/4090678347 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd3fc00be30 con 0x7fd40c1011d0 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.423+0000 7fd409ffb700 1 -- 172.21.15.29:0/4090678347 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3fc010380 con 0x7fd40c1011d0 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 -- 172.21.15.29:0/4090678347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 msgr2=0x7fd40c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 --2- 172.21.15.29:0/4090678347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c1015e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0098e0 tx=0x7fd3fc009250 comp rx=0 tx=0).stop 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 -- 172.21.15.29:0/4090678347 shutdown_connections 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 --2- 172.21.15.29:0/4090678347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c1015e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 -- 172.21.15.29:0/4090678347 >> 172.21.15.29:0/4090678347 conn(0x7fd40c0fc970 msgr2=0x7fd40c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 -- 172.21.15.29:0/4090678347 shutdown_connections 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.424+0000 7fd411950700 1 -- 172.21.15.29:0/4090678347 wait complete. 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd411950700 1 Processor -- start 2023-12-05T13:17:51.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd411950700 1 -- start start 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd411950700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd411950700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c1059f0 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd40affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd40affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c107570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42530/0 (socket says 172.21.15.29:42530) 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd40affd700 1 -- 172.21.15.29:0/2821615425 learned_addr learned my addr 172.21.15.29:0/2821615425 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.425+0000 7fd40affd700 1 -- 172.21.15.29:0/2821615425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0094f0 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.426+0000 7fd40affd700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c107570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006b00 tx=0x7fd3fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.426+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3fc0109b0 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.426+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd3fc024440 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.426+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c105bf0 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.426+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3fc01a5f0 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.426+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c106000 con 0x7fd40c1011d0 2023-12-05T13:17:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.427+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7fd3fc01a8b0 con 0x7fd40c1011d0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.427+0000 7fd3f37fe700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7fd3f4036470 0x7fd3f4038920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.427+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd3fc04b270 con 0x7fd40c1011d0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.427+0000 7fd40a7fc700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7fd3f4036470 0x7fd3f4038920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.427+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c05f270 con 0x7fd40c1011d0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.427+0000 7fd40a7fc700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7fd3f4036470 0x7fd3f4038920 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd400009990 tx=0x7fd400006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.432+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd3fc01ab60 con 0x7fd40c1011d0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.712+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd40c106310 con 0x7fd40c1011d0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.713+0000 7fd3f37fe700 1 -- 172.21.15.29:0/2821615425 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fd3fc018b40 con 0x7fd40c1011d0 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7fd3f4036470 msgr2=0x7fd3f4038920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7fd3f4036470 0x7fd3f4038920 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd400009990 tx=0x7fd400006e40 comp rx=0 tx=0).stop 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 msgr2=0x7fd40c107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c107570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006b00 tx=0x7fd3fc009250 comp rx=0 tx=0).stop 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 shutdown_connections 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7fd3f4036470 0x7fd3f4038920 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:51.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 --2- 172.21.15.29:0/2821615425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd40c1011d0 0x7fd40c107570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:51.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 >> 172.21.15.29:0/2821615425 conn(0x7fd40c0fc970 msgr2=0x7fd40c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:51.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 shutdown_connections 2023-12-05T13:17:51.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:50.715+0000 7fd411950700 1 -- 172.21.15.29:0/2821615425 wait complete. 2023-12-05T13:17:51.085 INFO:teuthology.orchestra.run.smithi029.stdout:mgr is available 2023-12-05T13:17:51.952 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:51 smithi029 ceph-mon[112128]: mgrmap e4: smithi029.eekhlu(active, since 2s) 2023-12-05T13:17:51.953 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:51 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2706713238' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [global] 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout fsid = 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-05T13:17:52.014 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [osd] 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.443+0000 7f4f03e41700 1 Processor -- start 2023-12-05T13:17:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.443+0000 7f4f03e41700 1 -- start start 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.443+0000 7f4f03e41700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f03e41700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc104310 con 0x7f4efc1039c0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f01bdd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f01bdd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42540/0 (socket says 172.21.15.29:42540) 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f01bdd700 1 -- 172.21.15.29:0/3753347777 learned_addr learned my addr 172.21.15.29:0/3753347777 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f01bdd700 1 -- 172.21.15.29:0/3753347777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc101fb0 con 0x7f4efc1039c0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f01bdd700 1 --2- 172.21.15.29:0/3753347777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc103dd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80098e0 tx=0x7f4ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5d517af3ace3e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f00bdb700 1 -- 172.21.15.29:0/3753347777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef800b860 con 0x7f4efc1039c0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f00bdb700 1 -- 172.21.15.29:0/3753347777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4ef800be30 con 0x7f4efc1039c0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.444+0000 7f4f00bdb700 1 -- 172.21.15.29:0/3753347777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef8010380 con 0x7f4efc1039c0 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 -- 172.21.15.29:0/3753347777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 msgr2=0x7f4efc103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 --2- 172.21.15.29:0/3753347777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc103dd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80098e0 tx=0x7f4ef8009250 comp rx=0 tx=0).stop 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 -- 172.21.15.29:0/3753347777 shutdown_connections 2023-12-05T13:17:52.016 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 --2- 172.21.15.29:0/3753347777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc103dd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 -- 172.21.15.29:0/3753347777 >> 172.21.15.29:0/3753347777 conn(0x7f4efc0fda40 msgr2=0x7f4efc0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 -- 172.21.15.29:0/3753347777 shutdown_connections 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.445+0000 7f4f03e41700 1 -- 172.21.15.29:0/3753347777 wait complete. 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f03e41700 1 Processor -- start 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f03e41700 1 -- start start 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f03e41700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc1110f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f03e41700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc111630 con 0x7f4efc1039c0 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f01bdd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc1110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f01bdd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc1110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42550/0 (socket says 172.21.15.29:42550) 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.446+0000 7f4f01bdd700 1 -- 172.21.15.29:0/2706713238 learned_addr learned my addr 172.21.15.29:0/2706713238 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4f01bdd700 1 -- 172.21.15.29:0/2706713238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80094f0 con 0x7f4efc1039c0 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4f01bdd700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc1110f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000c00 tx=0x7f4ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef8010a80 con 0x7f4efc1039c0 2023-12-05T13:17:52.017 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4ef801a430 con 0x7f4efc1039c0 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc111830 con 0x7f4efc1039c0 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef80245b0 con 0x7f4efc1039c0 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.447+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc111c40 con 0x7f4efc1039c0 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.448+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f4ef8024820 con 0x7f4efc1039c0 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.448+0000 7f4ef27fc700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4ee80365f0 0x7f4ee8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.448+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4ef804a580 con 0x7f4efc1039c0 2023-12-05T13:17:52.018 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.448+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc102d60 con 0x7f4efc1039c0 2023-12-05T13:17:52.019 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.448+0000 7f4f013dc700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4ee80365f0 0x7f4ee8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:52.019 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.449+0000 7f4f013dc700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4ee80365f0 0x7f4ee8038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009990 tx=0x7f4eec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.453+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4ef802e440 con 0x7f4efc1039c0 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.652+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f4efc04bb80 con 0x7f4efc1039c0 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.653+0000 7f4ef27fc700 1 -- 172.21.15.29:0/2706713238 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f4ef8048020 con 0x7f4efc1039c0 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4ee80365f0 msgr2=0x7f4ee8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4ee80365f0 0x7f4ee8038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009990 tx=0x7f4eec006e40 comp rx=0 tx=0).stop 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 msgr2=0x7f4efc1110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc1110f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000c00 tx=0x7f4ef8009250 comp rx=0 tx=0).stop 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 shutdown_connections 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4ee80365f0 0x7f4ee8038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 --2- 172.21.15.29:0/2706713238 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4efc1039c0 0x7f4efc1110f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.655+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 >> 172.21.15.29:0/2706713238 conn(0x7f4efc0fda40 msgr2=0x7f4efc0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.656+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 shutdown_connections 2023-12-05T13:17:52.020 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:51.656+0000 7f4f03e41700 1 -- 172.21.15.29:0/2706713238 wait complete. 2023-12-05T13:17:52.021 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling cephadm module... 2023-12-05T13:17:53.181 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:52 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1946047876' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-05T13:17:53.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f682a245700 1 Processor -- start 2023-12-05T13:17:53.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f682a245700 1 -- start start 2023-12-05T13:17:53.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f682a245700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824107340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:53.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f682a245700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824102d30 con 0x7f6824070f60 2023-12-05T13:17:53.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f68237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:53.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f68237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42554/0 (socket says 172.21.15.29:42554) 2023-12-05T13:17:53.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f68237fe700 1 -- 172.21.15.29:0/3299638236 learned_addr learned my addr 172.21.15.29:0/3299638236 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:53.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.380+0000 7f68237fe700 1 -- 172.21.15.29:0/3299638236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824107880 con 0x7f6824070f60 2023-12-05T13:17:53.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.381+0000 7f68237fe700 1 --2- 172.21.15.29:0/3299638236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824107340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f68140098e0 tx=0x7f6814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6c821d9bf565bf server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:53.252 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.381+0000 7f68227fc700 1 -- 172.21.15.29:0/3299638236 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f681400b860 con 0x7f6824070f60 2023-12-05T13:17:53.252 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.381+0000 7f68227fc700 1 -- 172.21.15.29:0/3299638236 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f681400be30 con 0x7f6824070f60 2023-12-05T13:17:53.252 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.381+0000 7f68227fc700 1 -- 172.21.15.29:0/3299638236 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6814010380 con 0x7f6824070f60 2023-12-05T13:17:53.252 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.381+0000 7f682a245700 1 -- 172.21.15.29:0/3299638236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 msgr2=0x7f6824107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:53.252 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.381+0000 7f682a245700 1 --2- 172.21.15.29:0/3299638236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824107340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f68140098e0 tx=0x7f6814009250 comp rx=0 tx=0).stop 2023-12-05T13:17:53.252 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.382+0000 7f682a245700 1 -- 172.21.15.29:0/3299638236 shutdown_connections 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.382+0000 7f682a245700 1 --2- 172.21.15.29:0/3299638236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824107340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.382+0000 7f682a245700 1 -- 172.21.15.29:0/3299638236 >> 172.21.15.29:0/3299638236 conn(0x7f68240fc970 msgr2=0x7f68240fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.382+0000 7f682a245700 1 -- 172.21.15.29:0/3299638236 shutdown_connections 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.382+0000 7f682a245700 1 -- 172.21.15.29:0/3299638236 wait complete. 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.382+0000 7f682a245700 1 Processor -- start 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.383+0000 7f682a245700 1 -- start start 2023-12-05T13:17:53.253 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.383+0000 7f682a245700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:53.254 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.383+0000 7f682a245700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68241138c0 con 0x7f6824070f60 2023-12-05T13:17:53.254 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.383+0000 7f68237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:53.254 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.383+0000 7f68237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42568/0 (socket says 172.21.15.29:42568) 2023-12-05T13:17:53.254 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.383+0000 7f68237fe700 1 -- 172.21.15.29:0/1946047876 learned_addr learned my addr 172.21.15.29:0/1946047876 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:53.254 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f68237fe700 1 -- 172.21.15.29:0/1946047876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140094f0 con 0x7f6824070f60 2023-12-05T13:17:53.254 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f68237fe700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824113380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6814006d40 tx=0x7f6814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68140109b0 con 0x7f6824070f60 2023-12-05T13:17:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6814024440 con 0x7f6824070f60 2023-12-05T13:17:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6824113ac0 con 0x7f6824070f60 2023-12-05T13:17:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f681401a5f0 con 0x7f6824070f60 2023-12-05T13:17:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.384+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6824113ed0 con 0x7f6824070f60 2023-12-05T13:17:53.255 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.385+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f681401a870 con 0x7f6824070f60 2023-12-05T13:17:53.256 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.385+0000 7f680bfff700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f680c0365a0 0x7f680c038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:53.256 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.385+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f681404a410 con 0x7f6824070f60 2023-12-05T13:17:53.256 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.385+0000 7f6822ffd700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f680c0365a0 0x7f680c038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:53.256 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.385+0000 7f6822ffd700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f680c0365a0 0x7f680c038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6818009990 tx=0x7f6818006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:53.256 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.386+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682404bb80 con 0x7f6824070f60 2023-12-05T13:17:53.256 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.391+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f681402d3f0 con 0x7f6824070f60 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.648+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f682410ce60 con 0x7f6824070f60 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.865+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f681402ad20 con 0x7f6824070f60 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.866+0000 7f680bfff700 1 -- 172.21.15.29:0/1946047876 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f6814023ed0 con 0x7f6824070f60 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f680c0365a0 msgr2=0x7f680c038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f680c0365a0 0x7f680c038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6818009990 tx=0x7f6818006e40 comp rx=0 tx=0).stop 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 msgr2=0x7f6824113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824113380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6814006d40 tx=0x7f6814009250 comp rx=0 tx=0).stop 2023-12-05T13:17:53.257 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 shutdown_connections 2023-12-05T13:17:53.258 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f680c0365a0 0x7f680c038a50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:53.258 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 --2- 172.21.15.29:0/1946047876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6824070f60 0x7f6824113380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:53.258 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 >> 172.21.15.29:0/1946047876 conn(0x7f68240fc970 msgr2=0x7f68240fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:53.258 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 shutdown_connections 2023-12-05T13:17:53.258 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:52.869+0000 7f682a245700 1 -- 172.21.15.29:0/1946047876 wait complete. 2023-12-05T13:17:54.187 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:53 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1946047876' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-05T13:17:54.187 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:53 smithi029 ceph-mon[112128]: mgrmap e5: smithi029.eekhlu(active, since 4s) 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "active_name": "smithi029.eekhlu", 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.617+0000 7f4f7cc9e700 1 Processor -- start 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.617+0000 7f4f7cc9e700 1 -- start start 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.617+0000 7f4f7cc9e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f781015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.617+0000 7f4f7cc9e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78101b20 con 0x7f4f781011d0 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f7659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f781015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:54.267 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f7659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f781015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42590/0 (socket says 172.21.15.29:42590) 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f7659c700 1 -- 172.21.15.29:0/2668913607 learned_addr learned my addr 172.21.15.29:0/2668913607 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f7659c700 1 -- 172.21.15.29:0/2668913607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78101c60 con 0x7f4f781011d0 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f7659c700 1 --2- 172.21.15.29:0/2668913607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f781015e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098e0 tx=0x7f4f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c770a26e4c1db4 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f75d9b700 1 -- 172.21.15.29:0/2668913607 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f6800b860 con 0x7f4f781011d0 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f75d9b700 1 -- 172.21.15.29:0/2668913607 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4f6800be30 con 0x7f4f781011d0 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.618+0000 7f4f75d9b700 1 -- 172.21.15.29:0/2668913607 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f68010380 con 0x7f4f781011d0 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/2668913607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 msgr2=0x7f4f781015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 --2- 172.21.15.29:0/2668913607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f781015e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f680098e0 tx=0x7f4f68009250 comp rx=0 tx=0).stop 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/2668913607 shutdown_connections 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 --2- 172.21.15.29:0/2668913607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f781015e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/2668913607 >> 172.21.15.29:0/2668913607 conn(0x7f4f780fc970 msgr2=0x7f4f780fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/2668913607 shutdown_connections 2023-12-05T13:17:54.268 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.619+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/2668913607 wait complete. 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7cc9e700 1 Processor -- start 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7cc9e700 1 -- start start 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7cc9e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f78116250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7cc9e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78111c40 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f78116250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f78116250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42600/0 (socket says 172.21.15.29:42600) 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.620+0000 7f4f7659c700 1 -- 172.21.15.29:0/3519094419 learned_addr learned my addr 172.21.15.29:0/3519094419 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f7659c700 1 -- 172.21.15.29:0/3519094419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680094f0 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f7659c700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f78116250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000c00 tx=0x7f4f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f68010a80 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4f6801a430 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f78070f90 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f680245b0 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.621+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78116790 con 0x7f4f781011d0 2023-12-05T13:17:54.269 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.622+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f4f680247f0 con 0x7f4f781011d0 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.622+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7810a050 con 0x7f4f781011d0 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.622+0000 7f4f6f7fe700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 0x7f4f64038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.623+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4f6804acc0 con 0x7f4f781011d0 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.623+0000 7f4f6dd9b700 1 -- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 msgr2=0x7f4f64038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.623+0000 7f4f6dd9b700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 0x7f4f64038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.627+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4f68051080 con 0x7f4f781011d0 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.824+0000 7f4f6dd9b700 1 -- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 msgr2=0x7f4f64038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.824+0000 7f4f6dd9b700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 0x7f4f64038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.888+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f4f7802b240 con 0x7f4f781011d0 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.888+0000 7f4f6f7fe700 1 -- 172.21.15.29:0/3519094419 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f4f68023570 con 0x7f4f781011d0 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 msgr2=0x7f4f64038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:17:54.270 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 0x7f4f64038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 msgr2=0x7f4f78116250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f78116250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000c00 tx=0x7f4f68009250 comp rx=0 tx=0).stop 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 shutdown_connections 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f4f640365f0 0x7f4f64038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 --2- 172.21.15.29:0/3519094419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f781011d0 0x7f4f78116250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 >> 172.21.15.29:0/3519094419 conn(0x7f4f780fc970 msgr2=0x7f4f780fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 shutdown_connections 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:53.890+0000 7f4f7cc9e700 1 -- 172.21.15.29:0/3519094419 wait complete. 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for the mgr to restart... 2023-12-05T13:17:54.271 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr epoch 5... 2023-12-05T13:17:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:17:54 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3519094419' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: osdmap e2: 0 total, 0 up, 0 in 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: mgrmap e6: smithi029.eekhlu(active, starting, since 0.00368038s) 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:18:01.251 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:18:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:00 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:18:01.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.634+0000 7f1697765700 1 Processor -- start 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.634+0000 7f1697765700 1 -- start start 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.634+0000 7f1697765700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f16901026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.634+0000 7f1697765700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690102c20 con 0x7f16901022d0 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1695501700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f16901026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1695501700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f16901026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42608/0 (socket says 172.21.15.29:42608) 2023-12-05T13:18:01.613 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1695501700 1 -- 172.21.15.29:0/372619345 learned_addr learned my addr 172.21.15.29:0/372619345 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1695501700 1 -- 172.21.15.29:0/372619345 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690102d60 con 0x7f16901022d0 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1695501700 1 --2- 172.21.15.29:0/372619345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f16901026e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f168c0098e0 tx=0x7f168c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700f067094a52935 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1687fff700 1 -- 172.21.15.29:0/372619345 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f168c00b860 con 0x7f16901022d0 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1687fff700 1 -- 172.21.15.29:0/372619345 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f168c00be30 con 0x7f16901022d0 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.635+0000 7f1687fff700 1 -- 172.21.15.29:0/372619345 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f168c010380 con 0x7f16901022d0 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 -- 172.21.15.29:0/372619345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 msgr2=0x7f16901026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 --2- 172.21.15.29:0/372619345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f16901026e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f168c0098e0 tx=0x7f168c009250 comp rx=0 tx=0).stop 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 -- 172.21.15.29:0/372619345 shutdown_connections 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 --2- 172.21.15.29:0/372619345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f16901026e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 -- 172.21.15.29:0/372619345 >> 172.21.15.29:0/372619345 conn(0x7f16900fda50 msgr2=0x7f16900ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 -- 172.21.15.29:0/372619345 shutdown_connections 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.636+0000 7f1697765700 1 -- 172.21.15.29:0/372619345 wait complete. 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1697765700 1 Processor -- start 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1697765700 1 -- start start 2023-12-05T13:18:01.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1697765700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f1690111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1697765700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690111680 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1695501700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f1690111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1695501700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f1690111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42612/0 (socket says 172.21.15.29:42612) 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1695501700 1 -- 172.21.15.29:0/3176604897 learned_addr learned my addr 172.21.15.29:0/3176604897 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.637+0000 7f1695501700 1 -- 172.21.15.29:0/3176604897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0094f0 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.638+0000 7f1695501700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f1690111140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f168c006b00 tx=0x7f168c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.638+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f168c0109b0 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.638+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f168c024440 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.638+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f168c01a5f0 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.638+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1690111880 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.638+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1690111c90 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.639+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f168c024990 con 0x7f16901022d0 2023-12-05T13:18:01.615 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.639+0000 7f1685ffb700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.639+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 --> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f167c039200 con 0x7f167c036640 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.639+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f168c04a560 con 0x7f16901022d0 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.639+0000 7f1694d00700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 msgr2=0x7f167c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.639+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.840+0000 7f1694d00700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 msgr2=0x7f167c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:54.840+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:55.241+0000 7f1694d00700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 msgr2=0x7f167c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:55.241+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:56.042+0000 7f1694d00700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 msgr2=0x7f167c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:56.042+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:57.643+0000 7f1694d00700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 msgr2=0x7f167c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1314397446 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:17:57.643+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:00.217+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f168c0245b0 con 0x7f16901022d0 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:00.217+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 msgr2=0x7f167c038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:18:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:00.217+0000 7f1685ffb700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.218+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f168c023d90 con 0x7f16901022d0 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.219+0000 7f1685ffb700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f167c039f60 0x7f167c03c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.219+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f167c039200 con 0x7f167c039f60 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.219+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f167c039f60 0x7f167c03c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.220+0000 7f1694d00700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f167c039f60 0x7f167c03c340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16800039d0 tx=0x7f1680009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.221+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f167c039200 con 0x7f167c039f60 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.227+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f169004bb80 con 0x7f167c039f60 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.227+0000 7f1685ffb700 1 -- 172.21.15.29:0/3176604897 <== mgr.14120 v2:172.21.15.29:6800/477452197 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f169004bb80 con 0x7f167c039f60 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f167c039f60 msgr2=0x7f167c03c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f167c039f60 0x7f167c03c340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16800039d0 tx=0x7f1680009350 comp rx=0 tx=0).stop 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 msgr2=0x7f1690111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f1690111140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f168c006b00 tx=0x7f168c009250 comp rx=0 tx=0).stop 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 shutdown_connections 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f167c039f60 0x7f167c03c340 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:01.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16901022d0 0x7f1690111140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 --2- 172.21.15.29:0/3176604897 >> [v2:172.21.15.29:6800/1314397446,v1:172.21.15.29:6801/1314397446] conn(0x7f167c036640 0x7f167c038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 >> 172.21.15.29:0/3176604897 conn(0x7f16900fda50 msgr2=0x7f16900ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 shutdown_connections 2023-12-05T13:18:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.228+0000 7f1697765700 1 -- 172.21.15.29:0/3176604897 wait complete. 2023-12-05T13:18:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:mgr epoch 5 is available 2023-12-05T13:18:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:Setting orchestrator backend to cephadm... 2023-12-05T13:18:02.241 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:01 smithi029 ceph-mon[112128]: Found migration_current of "None". Setting to last migration. 2023-12-05T13:18:02.241 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:01 smithi029 ceph-mon[112128]: mgrmap e7: smithi029.eekhlu(active, since 1.00544s) 2023-12-05T13:18:02.578 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.973+0000 7f6937ea0700 1 Processor -- start 2023-12-05T13:18:02.578 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.973+0000 7f6937ea0700 1 -- start start 2023-12-05T13:18:02.578 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.973+0000 7f6937ea0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f69301026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:02.578 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.973+0000 7f6937ea0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930102c20 con 0x7f69301022d0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6935c3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f69301026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6935c3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f69301026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50280/0 (socket says 172.21.15.29:50280) 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6935c3c700 1 -- 172.21.15.29:0/399491455 learned_addr learned my addr 172.21.15.29:0/399491455 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6935c3c700 1 -- 172.21.15.29:0/399491455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6930102d60 con 0x7f69301022d0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6935c3c700 1 --2- 172.21.15.29:0/399491455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f69301026e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6920009e50 tx=0x7f6920009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0c2dfdd70faa70 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6934c3a700 1 -- 172.21.15.29:0/399491455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69200092e0 con 0x7f69301022d0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6934c3a700 1 -- 172.21.15.29:0/399491455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f692000be90 con 0x7f69301022d0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.974+0000 7f6934c3a700 1 -- 172.21.15.29:0/399491455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6920007400 con 0x7f69301022d0 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 -- 172.21.15.29:0/399491455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 msgr2=0x7f69301026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 --2- 172.21.15.29:0/399491455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f69301026e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6920009e50 tx=0x7f6920009840 comp rx=0 tx=0).stop 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 -- 172.21.15.29:0/399491455 shutdown_connections 2023-12-05T13:18:02.579 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 --2- 172.21.15.29:0/399491455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f69301026e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 -- 172.21.15.29:0/399491455 >> 172.21.15.29:0/399491455 conn(0x7f69300fda50 msgr2=0x7f69300ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 -- 172.21.15.29:0/399491455 shutdown_connections 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.975+0000 7f6937ea0700 1 -- 172.21.15.29:0/399491455 wait complete. 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6937ea0700 1 Processor -- start 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6937ea0700 1 -- start start 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6937ea0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f6930111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6937ea0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69301116a0 con 0x7f69301022d0 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6935c3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f6930111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6935c3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f6930111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50284/0 (socket says 172.21.15.29:50284) 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6935c3c700 1 -- 172.21.15.29:0/1121943268 learned_addr learned my addr 172.21.15.29:0/1121943268 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6935c3c700 1 -- 172.21.15.29:0/1121943268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009ae0 con 0x7f69301022d0 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.976+0000 7f6935c3c700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f6930111160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f692000b740 tx=0x7f6920009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.977+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6920007670 con 0x7f69301022d0 2023-12-05T13:18:02.580 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.977+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6920007c40 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.977+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69301118a0 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.977+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f692001cb10 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.977+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6930112540 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.978+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693005f270 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.978+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f6920019070 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.979+0000 7f692e7fc700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f6918036510 0x7f69180389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.979+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f692004a3a0 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.979+0000 7f693543b700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f6918036510 0x7f69180389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.979+0000 7f693543b700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f6918036510 0x7f69180389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6924009990 tx=0x7f6924006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:01.983+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6920019320 con 0x7f69301022d0 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.197+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f6930113060 con 0x7f6918036510 2023-12-05T13:18:02.581 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.203+0000 7f692e7fc700 1 -- 172.21.15.29:0/1121943268 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6930113060 con 0x7f6918036510 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f6918036510 msgr2=0x7f69180389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f6918036510 0x7f69180389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6924009990 tx=0x7f6924006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 msgr2=0x7f6930111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f6930111160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f692000b740 tx=0x7f6920009840 comp rx=0 tx=0).stop 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 shutdown_connections 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f6918036510 0x7f69180389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 --2- 172.21.15.29:0/1121943268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69301022d0 0x7f6930111160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.205+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 >> 172.21.15.29:0/1121943268 conn(0x7f69300fda50 msgr2=0x7f69300ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.206+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 shutdown_connections 2023-12-05T13:18:02.582 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.206+0000 7f6937ea0700 1 -- 172.21.15.29:0/1121943268 wait complete. 2023-12-05T13:18:03.202 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-05T13:18:03.202 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-05T13:18:03.202 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: [05/Dec/2023:13:18:01] ENGINE Bus STARTING 2023-12-05T13:18:03.202 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:03.203 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:03.203 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:03.203 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:02 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:03.554 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-05T13:18:03.555 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.959+0000 7efd9a9de700 1 Processor -- start 2023-12-05T13:18:03.555 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.959+0000 7efd9a9de700 1 -- start start 2023-12-05T13:18:03.555 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.959+0000 7efd9a9de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd941015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:03.555 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.959+0000 7efd9a9de700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94101b20 con 0x7efd941011d0 2023-12-05T13:18:03.555 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.960+0000 7efd93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd941015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:03.556 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.960+0000 7efd93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd941015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50298/0 (socket says 172.21.15.29:50298) 2023-12-05T13:18:03.556 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.960+0000 7efd93fff700 1 -- 172.21.15.29:0/864203135 learned_addr learned my addr 172.21.15.29:0/864203135 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:03.556 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.960+0000 7efd93fff700 1 -- 172.21.15.29:0/864203135 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94101c60 con 0x7efd941011d0 2023-12-05T13:18:03.556 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.960+0000 7efd93fff700 1 --2- 172.21.15.29:0/864203135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd941015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd840098e0 tx=0x7efd84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e581292fef6d356d server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:03.556 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd92ffd700 1 -- 172.21.15.29:0/864203135 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd8400b860 con 0x7efd941011d0 2023-12-05T13:18:03.556 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd92ffd700 1 -- 172.21.15.29:0/864203135 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7efd8400be30 con 0x7efd941011d0 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd92ffd700 1 -- 172.21.15.29:0/864203135 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd84010380 con 0x7efd941011d0 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 -- 172.21.15.29:0/864203135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 msgr2=0x7efd941015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 --2- 172.21.15.29:0/864203135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd941015e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd840098e0 tx=0x7efd84009250 comp rx=0 tx=0).stop 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 -- 172.21.15.29:0/864203135 shutdown_connections 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 --2- 172.21.15.29:0/864203135 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd941015e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 -- 172.21.15.29:0/864203135 >> 172.21.15.29:0/864203135 conn(0x7efd940fc970 msgr2=0x7efd940fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 -- 172.21.15.29:0/864203135 shutdown_connections 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.961+0000 7efd9a9de700 1 -- 172.21.15.29:0/864203135 wait complete. 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd9a9de700 1 Processor -- start 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd9a9de700 1 -- start start 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd9a9de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd94111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd9a9de700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94111690 con 0x7efd941011d0 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd94111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd94111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50306/0 (socket says 172.21.15.29:50306) 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.962+0000 7efd93fff700 1 -- 172.21.15.29:0/3666999223 learned_addr learned my addr 172.21.15.29:0/3666999223 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:03.558 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd93fff700 1 -- 172.21.15.29:0/3666999223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840094f0 con 0x7efd941011d0 2023-12-05T13:18:03.559 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd93fff700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd94111150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd84000c00 tx=0x7efd84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:03.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd84010a80 con 0x7efd941011d0 2023-12-05T13:18:03.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7efd8401a430 con 0x7efd941011d0 2023-12-05T13:18:03.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94111890 con 0x7efd941011d0 2023-12-05T13:18:03.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd840245b0 con 0x7efd941011d0 2023-12-05T13:18:03.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.963+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd94111ca0 con 0x7efd941011d0 2023-12-05T13:18:03.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.964+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7efd840247f0 con 0x7efd941011d0 2023-12-05T13:18:03.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.964+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9404bb80 con 0x7efd941011d0 2023-12-05T13:18:03.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.964+0000 7efd90ff9700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7efd7c0364c0 0x7efd7c038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:03.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.964+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efd8404ab00 con 0x7efd941011d0 2023-12-05T13:18:03.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.965+0000 7efd937fe700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7efd7c0364c0 0x7efd7c038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.965+0000 7efd937fe700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7efd7c0364c0 0x7efd7c038970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd88009990 tx=0x7efd88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:02.969+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efd84023570 con 0x7efd941011d0 2023-12-05T13:18:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.172+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7efd940febe0 con 0x7efd7c0364c0 2023-12-05T13:18:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.173+0000 7efd90ff9700 1 -- 172.21.15.29:0/3666999223 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7efd940febe0 con 0x7efd7c0364c0 2023-12-05T13:18:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.175+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7efd7c0364c0 msgr2=0x7efd7c038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:03.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.175+0000 7efd9a9de700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7efd7c0364c0 0x7efd7c038970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd88009990 tx=0x7efd88006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.175+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 msgr2=0x7efd94111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.175+0000 7efd9a9de700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd94111150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd84000c00 tx=0x7efd84009250 comp rx=0 tx=0).stop 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.176+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 shutdown_connections 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.176+0000 7efd9a9de700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7efd7c0364c0 0x7efd7c038970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.176+0000 7efd9a9de700 1 --2- 172.21.15.29:0/3666999223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd941011d0 0x7efd94111150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.176+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 >> 172.21.15.29:0/3666999223 conn(0x7efd940fc970 msgr2=0x7efd94070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:03.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.176+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 shutdown_connections 2023-12-05T13:18:03.564 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.176+0000 7efd9a9de700 1 -- 172.21.15.29:0/3666999223 wait complete. 2023-12-05T13:18:03.564 INFO:teuthology.orchestra.run.smithi029.stdout:Generating ssh key... 2023-12-05T13:18:04.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:03 smithi029 ceph-mon[112128]: [05/Dec/2023:13:18:01] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:18:04.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:03 smithi029 ceph-mon[112128]: [05/Dec/2023:13:18:01] ENGINE Bus STARTED 2023-12-05T13:18:04.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:03 smithi029 ceph-mon[112128]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:04.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:03 smithi029 ceph-mon[112128]: mgrmap e8: smithi029.eekhlu(active, since 2s) 2023-12-05T13:18:04.836 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.930+0000 7f3b1e445700 1 Processor -- start 2023-12-05T13:18:04.836 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.930+0000 7f3b1e445700 1 -- start start 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b1e445700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18101540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b1e445700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18101a80 con 0x7f3b18101130 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18101540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50322/0 (socket says 172.21.15.29:50322) 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b17fff700 1 -- 172.21.15.29:0/2633850754 learned_addr learned my addr 172.21.15.29:0/2633850754 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b17fff700 1 -- 172.21.15.29:0/2633850754 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18101bc0 con 0x7f3b18101130 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b17fff700 1 --2- 172.21.15.29:0/2633850754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18101540 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b080098e0 tx=0x7f3b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20db22afa250a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.931+0000 7f3b16ffd700 1 -- 172.21.15.29:0/2633850754 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b0800b860 con 0x7f3b18101130 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b16ffd700 1 -- 172.21.15.29:0/2633850754 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3b0800be30 con 0x7f3b18101130 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b16ffd700 1 -- 172.21.15.29:0/2633850754 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b08010380 con 0x7f3b18101130 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 -- 172.21.15.29:0/2633850754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 msgr2=0x7f3b18101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 --2- 172.21.15.29:0/2633850754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18101540 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b080098e0 tx=0x7f3b08009250 comp rx=0 tx=0).stop 2023-12-05T13:18:04.837 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 -- 172.21.15.29:0/2633850754 shutdown_connections 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 --2- 172.21.15.29:0/2633850754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18101540 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 -- 172.21.15.29:0/2633850754 >> 172.21.15.29:0/2633850754 conn(0x7f3b180fc870 msgr2=0x7f3b180fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 -- 172.21.15.29:0/2633850754 shutdown_connections 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.932+0000 7f3b1e445700 1 -- 172.21.15.29:0/2633850754 wait complete. 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b1e445700 1 Processor -- start 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b1e445700 1 -- start start 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b1e445700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b1e445700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18111b30 con 0x7f3b18101130 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50332/0 (socket says 172.21.15.29:50332) 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.933+0000 7f3b17fff700 1 -- 172.21.15.29:0/3937346760 learned_addr learned my addr 172.21.15.29:0/3937346760 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b17fff700 1 -- 172.21.15.29:0/3937346760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080094f0 con 0x7f3b18101130 2023-12-05T13:18:04.838 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b17fff700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18116140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b08006b00 tx=0x7f3b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b080109b0 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3b0801a430 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b18070f90 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b080245b0 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.934+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18116680 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.935+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3b08024830 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.935+0000 7f3b14ff9700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3b000365f0 0x7f3b00038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.935+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3b0804bbb0 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.935+0000 7f3b177fe700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3b000365f0 0x7f3b00038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.935+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1804bb80 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.936+0000 7f3b177fe700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3b000365f0 0x7f3b00038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009990 tx=0x7f3b0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:03.940+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b08018350 con 0x7f3b18101130 2023-12-05T13:18:04.839 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.142+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b18116810 con 0x7f3b000365f0 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.472+0000 7f3b14ff9700 1 -- 172.21.15.29:0/3937346760 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3b18116810 con 0x7f3b000365f0 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.474+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3b000365f0 msgr2=0x7f3b00038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.474+0000 7f3b1e445700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3b000365f0 0x7f3b00038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009990 tx=0x7f3b0c006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.474+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 msgr2=0x7f3b18116140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.474+0000 7f3b1e445700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18116140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b08006b00 tx=0x7f3b08009250 comp rx=0 tx=0).stop 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.475+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 shutdown_connections 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.475+0000 7f3b1e445700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3b000365f0 0x7f3b00038aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.475+0000 7f3b1e445700 1 --2- 172.21.15.29:0/3937346760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b18101130 0x7f3b18116140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.475+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 >> 172.21.15.29:0/3937346760 conn(0x7f3b180fc870 msgr2=0x7f3b180fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.475+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 shutdown_connections 2023-12-05T13:18:04.840 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:04.475+0000 7f3b1e445700 1 -- 172.21.15.29:0/3937346760 wait complete. 2023-12-05T13:18:05.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:04 smithi029 ceph-mon[112128]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:05.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:04 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:05.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:04 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:05.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaQPYjoHwS0I8LF/fVobYDIxmupgizDaeUJ/qhtnKzUk+VaxadKHaqvWzC3fUEm7t9vNZHfWNU0Ex+EZJYGJdhU4kcnrMDbXKzEC9tQ5uIfnbUzVMjEpXV57l1RheznTlJtGRJKHc5FHIqcbfyfeUFcrSu0pu5T5izpc6J7qBnkCJ65tssthpH6fqFj0M2H6qKxEwgmNX0iE2MRp0ry8YGKVU3l6mQCrK+IDM7QLmw3W2tnQZuWk4FFk7B0y1Frqa05NpxRQu9BRxekCUg6WSakaWvhyrgoAL1WieGvv2RX4ycj2r+uQYTgzn8ujo5xmkr8p53pStkwY9hRxZVCzl+I+LWjN2daqu1olozaFxKSO7PKsrq4vEpQK3j1k25yifMB+s+Na8BQ7211vBtOW+H4skeH5+36fnoYK/KxDLCgQXsIiO7hAZKkTsNhewUDVa0M/XSOX/74XE+k0ydc2pP+yzdPvI59h6QPN1av0JxSoihti4AQks2BdlPBh7inD8= ceph-34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:18:05.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf2d59700 1 Processor -- start 2023-12-05T13:18:05.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf2d59700 1 -- start start 2023-12-05T13:18:05.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf2d59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec1072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf2d59700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec102cd0 con 0x7fdaec070fc0 2023-12-05T13:18:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf0af5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec1072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf0af5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec1072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50346/0 (socket says 172.21.15.29:50346) 2023-12-05T13:18:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.190+0000 7fdaf0af5700 1 -- 172.21.15.29:0/1426477007 learned_addr learned my addr 172.21.15.29:0/1426477007 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.191+0000 7fdaf0af5700 1 -- 172.21.15.29:0/1426477007 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec107820 con 0x7fdaec070fc0 2023-12-05T13:18:05.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.191+0000 7fdaf0af5700 1 --2- 172.21.15.29:0/1426477007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec1072e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdae00098e0 tx=0x7fdae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c8212fc0d8a203 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:05.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.191+0000 7fdaeb7fe700 1 -- 172.21.15.29:0/1426477007 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae000b860 con 0x7fdaec070fc0 2023-12-05T13:18:05.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.191+0000 7fdaeb7fe700 1 -- 172.21.15.29:0/1426477007 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdae000be30 con 0x7fdaec070fc0 2023-12-05T13:18:05.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.191+0000 7fdaeb7fe700 1 -- 172.21.15.29:0/1426477007 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae0010380 con 0x7fdaec070fc0 2023-12-05T13:18:05.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 -- 172.21.15.29:0/1426477007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 msgr2=0x7fdaec1072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 --2- 172.21.15.29:0/1426477007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec1072e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdae00098e0 tx=0x7fdae0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 -- 172.21.15.29:0/1426477007 shutdown_connections 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 --2- 172.21.15.29:0/1426477007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec1072e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 -- 172.21.15.29:0/1426477007 >> 172.21.15.29:0/1426477007 conn(0x7fdaec0fc970 msgr2=0x7fdaec0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 -- 172.21.15.29:0/1426477007 shutdown_connections 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 -- 172.21.15.29:0/1426477007 wait complete. 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.192+0000 7fdaf2d59700 1 Processor -- start 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf2d59700 1 -- start start 2023-12-05T13:18:05.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf2d59700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf2d59700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec1138c0 con 0x7fdaec070fc0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf0af5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf0af5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50354/0 (socket says 172.21.15.29:50354) 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf0af5700 1 -- 172.21.15.29:0/357305040 learned_addr learned my addr 172.21.15.29:0/357305040 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf0af5700 1 -- 172.21.15.29:0/357305040 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00094f0 con 0x7fdaec070fc0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.193+0000 7fdaf0af5700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdae0006d40 tx=0x7fdae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.194+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae00109b0 con 0x7fdaec070fc0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.194+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdae0024440 con 0x7fdaec070fc0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.194+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec113ac0 con 0x7fdaec070fc0 2023-12-05T13:18:05.832 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.194+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae001a5f0 con 0x7fdaec070fc0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.194+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaec113ed0 con 0x7fdaec070fc0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.195+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdae001a820 con 0x7fdaec070fc0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.195+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec04bb80 con 0x7fdaec070fc0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.195+0000 7fdae97fa700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fdadc036640 0x7fdadc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.195+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdae004a430 con 0x7fdaec070fc0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.195+0000 7fdaebfff700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fdadc036640 0x7fdadc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.195+0000 7fdaebfff700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fdadc036640 0x7fdadc038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009990 tx=0x7fdad8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.200+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdae001aad0 con 0x7fdaec070fc0 2023-12-05T13:18:05.833 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.402+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaec10d1b0 con 0x7fdadc036640 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.403+0000 7fdae97fa700 1 -- 172.21.15.29:0/357305040 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fdaec10d1b0 con 0x7fdadc036640 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fdadc036640 msgr2=0x7fdadc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fdadc036640 0x7fdadc038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009990 tx=0x7fdad8006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 msgr2=0x7fdaec113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdae0006d40 tx=0x7fdae0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 shutdown_connections 2023-12-05T13:18:05.834 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fdadc036640 0x7fdadc038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 --2- 172.21.15.29:0/357305040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdaec070fc0 0x7fdaec113380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 >> 172.21.15.29:0/357305040 conn(0x7fdaec0fc970 msgr2=0x7fdaec0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 shutdown_connections 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:05.405+0000 7fdaf2d59700 1 -- 172.21.15.29:0/357305040 wait complete. 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:Adding key to root@localhost authorized_keys... 2023-12-05T13:18:05.835 INFO:teuthology.orchestra.run.smithi029.stdout:Adding host smithi029... 2023-12-05T13:18:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:05 smithi029 ceph-mon[112128]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:05 smithi029 ceph-mon[112128]: Generating ssh key... 2023-12-05T13:18:07.020 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:06 smithi029 ceph-mon[112128]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:07 smithi029 ceph-mon[112128]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi029", "addr": "172.21.15.29", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:08.608 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Added host 'smithi029' with addr '172.21.15.29' 2023-12-05T13:18:08.608 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd81a7d2700 1 Processor -- start 2023-12-05T13:18:08.608 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd81a7d2700 1 -- start start 2023-12-05T13:18:08.608 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd81a7d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:08.608 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd81a7d2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814103230 con 0x7fd8141028e0 2023-12-05T13:18:08.608 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd813fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd813fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50368/0 (socket says 172.21.15.29:50368) 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.195+0000 7fd813fff700 1 -- 172.21.15.29:0/55389901 learned_addr learned my addr 172.21.15.29:0/55389901 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.196+0000 7fd813fff700 1 -- 172.21.15.29:0/55389901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd814103370 con 0x7fd8141028e0 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.196+0000 7fd813fff700 1 --2- 172.21.15.29:0/55389901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814102cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd8040098e0 tx=0x7fd804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f12d90a00843299 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.196+0000 7fd812ffd700 1 -- 172.21.15.29:0/55389901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80400b8f0 con 0x7fd8141028e0 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.196+0000 7fd812ffd700 1 -- 172.21.15.29:0/55389901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd804011420 con 0x7fd8141028e0 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.196+0000 7fd812ffd700 1 -- 172.21.15.29:0/55389901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd804010540 con 0x7fd8141028e0 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 -- 172.21.15.29:0/55389901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 msgr2=0x7fd814102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 --2- 172.21.15.29:0/55389901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814102cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd8040098e0 tx=0x7fd804009250 comp rx=0 tx=0).stop 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 -- 172.21.15.29:0/55389901 shutdown_connections 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 --2- 172.21.15.29:0/55389901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814102cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 -- 172.21.15.29:0/55389901 >> 172.21.15.29:0/55389901 conn(0x7fd8140fc0b0 msgr2=0x7fd8140fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 -- 172.21.15.29:0/55389901 shutdown_connections 2023-12-05T13:18:08.609 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 -- 172.21.15.29:0/55389901 wait complete. 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.197+0000 7fd81a7d2700 1 Processor -- start 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd81a7d2700 1 -- start start 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd81a7d2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814113400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd81a7d2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814113940 con 0x7fd8141028e0 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd813fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814113400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd813fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814113400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50384/0 (socket says 172.21.15.29:50384) 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd813fff700 1 -- 172.21.15.29:0/1310672544 learned_addr learned my addr 172.21.15.29:0/1310672544 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd813fff700 1 -- 172.21.15.29:0/1310672544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040094f0 con 0x7fd8141028e0 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd813fff700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814113400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd804011d20 tx=0x7fd804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.198+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd804010910 con 0x7fd8141028e0 2023-12-05T13:18:08.610 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.199+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fd804010ee0 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.199+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd814113b40 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.199+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd80401ae00 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.199+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd814113f50 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.200+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81404bb80 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.200+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd80401a630 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.200+0000 7fd810ff9700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fd7fc036640 0x7fd7fc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.200+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd80404a900 con 0x7fd8141028e0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.200+0000 7fd8137fe700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fd7fc036640 0x7fd7fc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.201+0000 7fd8137fe700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fd7fc036640 0x7fd7fc038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd808009990 tx=0x7fd808006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:08.611 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.205+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd80401a430 con 0x7fd8141028e0 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:06.413+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi029", "addr": "172.21.15.29", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8140008d0 con 0x7fd7fc036640 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.301+0000 7fd810ff9700 1 -- 172.21.15.29:0/1310672544 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd8140008d0 con 0x7fd7fc036640 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fd7fc036640 msgr2=0x7fd7fc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fd7fc036640 0x7fd7fc038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd808009990 tx=0x7fd808006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 msgr2=0x7fd814113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814113400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd804011d20 tx=0x7fd804009250 comp rx=0 tx=0).stop 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 shutdown_connections 2023-12-05T13:18:08.612 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fd7fc036640 0x7fd7fc038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:08.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 --2- 172.21.15.29:0/1310672544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8141028e0 0x7fd814113400 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:08.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.304+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 >> 172.21.15.29:0/1310672544 conn(0x7fd8140fc0b0 msgr2=0x7fd8140fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:08.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.305+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 shutdown_connections 2023-12-05T13:18:08.614 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.305+0000 7fd81a7d2700 1 -- 172.21.15.29:0/1310672544 wait complete. 2023-12-05T13:18:08.614 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying mon service with default placement... 2023-12-05T13:18:09.260 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:08 smithi029 ceph-mon[112128]: Deploying cephadm binary to smithi029 2023-12-05T13:18:09.260 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:08 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:09.261 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:08 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:09.686 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-05T13:18:09.686 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93d5942700 1 Processor -- start 2023-12-05T13:18:09.686 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93d5942700 1 -- start start 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93d5942700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93d5942700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0102d10 con 0x7f93d0070f80 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93ceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93ceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34472/0 (socket says 172.21.15.29:34472) 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.987+0000 7f93ceffd700 1 -- 172.21.15.29:0/1391091104 learned_addr learned my addr 172.21.15.29:0/1391091104 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.988+0000 7f93ceffd700 1 -- 172.21.15.29:0/1391091104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0107860 con 0x7f93d0070f80 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.988+0000 7f93ceffd700 1 --2- 172.21.15.29:0/1391091104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0107320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098e0 tx=0x7f93c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c131c4444fe4c49 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.988+0000 7f93cdffb700 1 -- 172.21.15.29:0/1391091104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93c000b860 con 0x7f93d0070f80 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.988+0000 7f93cdffb700 1 -- 172.21.15.29:0/1391091104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f93c000be30 con 0x7f93d0070f80 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.988+0000 7f93cdffb700 1 -- 172.21.15.29:0/1391091104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93c0010380 con 0x7f93d0070f80 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 -- 172.21.15.29:0/1391091104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 msgr2=0x7f93d0107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 --2- 172.21.15.29:0/1391091104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0107320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098e0 tx=0x7f93c0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 -- 172.21.15.29:0/1391091104 shutdown_connections 2023-12-05T13:18:09.687 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 --2- 172.21.15.29:0/1391091104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0107320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 -- 172.21.15.29:0/1391091104 >> 172.21.15.29:0/1391091104 conn(0x7f93d00fc970 msgr2=0x7f93d00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 -- 172.21.15.29:0/1391091104 shutdown_connections 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.989+0000 7f93d5942700 1 -- 172.21.15.29:0/1391091104 wait complete. 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93d5942700 1 Processor -- start 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93d5942700 1 -- start start 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93d5942700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93d5942700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01138c0 con 0x7f93d0070f80 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93ceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93ceffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34482/0 (socket says 172.21.15.29:34482) 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93ceffd700 1 -- 172.21.15.29:0/3235151146 learned_addr learned my addr 172.21.15.29:0/3235151146 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93ceffd700 1 -- 172.21.15.29:0/3235151146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00094f0 con 0x7f93d0070f80 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.990+0000 7f93ceffd700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0113380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93c0006b00 tx=0x7f93c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.991+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93c0010a80 con 0x7f93d0070f80 2023-12-05T13:18:09.688 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.991+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d0113ac0 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.991+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f93c001a430 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.991+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93c00245b0 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.991+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d0113ed0 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.992+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f93c0024830 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.992+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d004bb80 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.992+0000 7f93c77fe700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f93bc0365f0 0x7f93bc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.992+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f93c004ab00 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.992+0000 7f93ce7fc700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f93bc0365f0 0x7f93bc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.992+0000 7f93ce7fc700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f93bc0365f0 0x7f93bc038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009990 tx=0x7f93b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:08.997+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f93c0010be0 con 0x7f93d0070f80 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.223+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d010d1b0 con 0x7f93bc0365f0 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.227+0000 7f93c77fe700 1 -- 172.21.15.29:0/3235151146 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f93d010d1b0 con 0x7f93bc0365f0 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f93bc0365f0 msgr2=0x7f93bc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f93bc0365f0 0x7f93bc038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009990 tx=0x7f93b8006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:09.689 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 msgr2=0x7f93d0113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0113380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93c0006b00 tx=0x7f93c0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 shutdown_connections 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f93bc0365f0 0x7f93bc038aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 --2- 172.21.15.29:0/3235151146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d0070f80 0x7f93d0113380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 >> 172.21.15.29:0/3235151146 conn(0x7f93d00fc970 msgr2=0x7f93d00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 shutdown_connections 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:09.230+0000 7f93d5942700 1 -- 172.21.15.29:0/3235151146 wait complete. 2023-12-05T13:18:09.690 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying mgr service with default placement... 2023-12-05T13:18:10.068 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:09 smithi029 ceph-mon[112128]: Added host smithi029 2023-12-05T13:18:10.069 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:09 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.233+0000 7fc1e0e24700 1 Processor -- start 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.233+0000 7fc1e0e24700 1 -- start start 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.234+0000 7fc1e0e24700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc06f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.234+0000 7fc1e0e24700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc06f9e0 con 0x7fc1dc06f000 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.234+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc06f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.234+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc06f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34490/0 (socket says 172.21.15.29:34490) 2023-12-05T13:18:10.890 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.234+0000 7fc1da59c700 1 -- 172.21.15.29:0/3873586 learned_addr learned my addr 172.21.15.29:0/3873586 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.235+0000 7fc1da59c700 1 -- 172.21.15.29:0/3873586 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc06fb20 con 0x7fc1dc06f000 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.235+0000 7fc1da59c700 1 --2- 172.21.15.29:0/3873586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc06f410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098e0 tx=0x7fc1cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fde8af777a8881 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.235+0000 7fc1d959a700 1 -- 172.21.15.29:0/3873586 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1cc00b860 con 0x7fc1dc06f000 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.235+0000 7fc1d959a700 1 -- 172.21.15.29:0/3873586 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1cc00be70 con 0x7fc1dc06f000 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.235+0000 7fc1d959a700 1 -- 172.21.15.29:0/3873586 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1cc010380 con 0x7fc1dc06f000 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3873586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 msgr2=0x7fc1dc06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 --2- 172.21.15.29:0/3873586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc06f410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098e0 tx=0x7fc1cc009250 comp rx=0 tx=0).stop 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3873586 shutdown_connections 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 --2- 172.21.15.29:0/3873586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc06f410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3873586 >> 172.21.15.29:0/3873586 conn(0x7fc1dc069180 msgr2=0x7fc1dc06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3873586 shutdown_connections 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.236+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3873586 wait complete. 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1e0e24700 1 Processor -- start 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1e0e24700 1 -- start start 2023-12-05T13:18:10.891 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1e0e24700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc11bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1e0e24700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc11c0f0 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc11bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc11bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34500/0 (socket says 172.21.15.29:34500) 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1da59c700 1 -- 172.21.15.29:0/3000318710 learned_addr learned my addr 172.21.15.29:0/3000318710 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.237+0000 7fc1da59c700 1 -- 172.21.15.29:0/3000318710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0094f0 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.238+0000 7fc1da59c700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc11bbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc006d40 tx=0x7fc1cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.238+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1cc010960 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.238+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1cc01a430 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.238+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc11c2f0 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.238+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1cc0245b0 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.238+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc11c700 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.239+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc1cc02d3f0 con 0x7fc1dc06f000 2023-12-05T13:18:10.892 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.239+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc0052e0 con 0x7fc1dc06f000 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.239+0000 7fc1caffd700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc1c4036640 0x7fc1c4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.239+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc1cc04a260 con 0x7fc1dc06f000 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.239+0000 7fc1d9d9b700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc1c4036640 0x7fc1c4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.240+0000 7fc1d9d9b700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc1c4036640 0x7fc1c4038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009990 tx=0x7fc1d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.245+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc1cc02b8e0 con 0x7fc1dc06f000 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.463+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1bc000bf0 con 0x7fc1c4036640 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.468+0000 7fc1caffd700 1 -- 172.21.15.29:0/3000318710 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc1bc000bf0 con 0x7fc1c4036640 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc1c4036640 msgr2=0x7fc1c4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc1c4036640 0x7fc1c4038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009990 tx=0x7fc1d0006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 msgr2=0x7fc1dc11bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc11bbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc006d40 tx=0x7fc1cc009250 comp rx=0 tx=0).stop 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 shutdown_connections 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc1c4036640 0x7fc1c4038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:10.893 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 --2- 172.21.15.29:0/3000318710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc1dc06f000 0x7fc1dc11bbb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:10.894 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 >> 172.21.15.29:0/3000318710 conn(0x7fc1dc069180 msgr2=0x7fc1dc06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:10.894 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 shutdown_connections 2023-12-05T13:18:10.894 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:10.470+0000 7fc1e0e24700 1 -- 172.21.15.29:0/3000318710 wait complete. 2023-12-05T13:18:10.894 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying crash service with default placement... 2023-12-05T13:18:11.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:10 smithi029 ceph-mon[112128]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:11.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:10 smithi029 ceph-mon[112128]: Saving service mon spec with placement count:5 2023-12-05T13:18:11.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:10 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:11.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:10 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:11.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:10 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:11.977 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-05T13:18:11.977 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f7895c78700 1 Processor -- start 2023-12-05T13:18:11.977 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f7895c78700 1 -- start start 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f7895c78700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f78901015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f7895c78700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890101b10 con 0x7f78901011c0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f788f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f78901015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f788f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f78901015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34514/0 (socket says 172.21.15.29:34514) 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.252+0000 7f788f7fe700 1 -- 172.21.15.29:0/3050015357 learned_addr learned my addr 172.21.15.29:0/3050015357 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.253+0000 7f788f7fe700 1 -- 172.21.15.29:0/3050015357 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890101c50 con 0x7f78901011c0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.253+0000 7f788f7fe700 1 --2- 172.21.15.29:0/3050015357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f78901015d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78800098e0 tx=0x7f7880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101115fde331a78e server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.253+0000 7f788e7fc700 1 -- 172.21.15.29:0/3050015357 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f788000b860 con 0x7f78901011c0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.253+0000 7f788e7fc700 1 -- 172.21.15.29:0/3050015357 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f788000be70 con 0x7f78901011c0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.253+0000 7f788e7fc700 1 -- 172.21.15.29:0/3050015357 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7880010380 con 0x7f78901011c0 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 -- 172.21.15.29:0/3050015357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 msgr2=0x7f78901015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 --2- 172.21.15.29:0/3050015357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f78901015d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78800098e0 tx=0x7f7880009250 comp rx=0 tx=0).stop 2023-12-05T13:18:11.978 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 -- 172.21.15.29:0/3050015357 shutdown_connections 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 --2- 172.21.15.29:0/3050015357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f78901015d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 -- 172.21.15.29:0/3050015357 >> 172.21.15.29:0/3050015357 conn(0x7f78900fc980 msgr2=0x7f78900fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 -- 172.21.15.29:0/3050015357 shutdown_connections 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.254+0000 7f7895c78700 1 -- 172.21.15.29:0/3050015357 wait complete. 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.255+0000 7f7895c78700 1 Processor -- start 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.255+0000 7f7895c78700 1 -- start start 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.255+0000 7f7895c78700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f7890110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.255+0000 7f7895c78700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78901105c0 con 0x7f78901011c0 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f788f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f7890110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f788f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f7890110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34518/0 (socket says 172.21.15.29:34518) 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f788f7fe700 1 -- 172.21.15.29:0/1080963833 learned_addr learned my addr 172.21.15.29:0/1080963833 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f788f7fe700 1 -- 172.21.15.29:0/1080963833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800094f0 con 0x7f78901011c0 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f788f7fe700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f7890110080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f788000c010 tx=0x7f7880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:11.979 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7880010960 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f7895c78700 1 -- 172.21.15.29:0/1080963833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78901107c0 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f788001a430 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7880019580 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.256+0000 7f7895c78700 1 -- 172.21.15.29:0/1080963833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7890110bd0 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.257+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7880019800 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.258+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78700052b0 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.258+0000 7f7877fff700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f78780365f0 0x7f7878038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.258+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f788004a390 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.258+0000 7f788effd700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f78780365f0 0x7f7878038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.258+0000 7f788effd700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f78780365f0 0x7f7878038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7884009990 tx=0x7f7884006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.263+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f788002b900 con 0x7f78901011c0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.483+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f7870000bc0 con 0x7f78780365f0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.488+0000 7f7877fff700 1 -- 172.21.15.29:0/1080963833 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f7870000bc0 con 0x7f78780365f0 2023-12-05T13:18:11.980 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f78780365f0 msgr2=0x7f7878038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f78780365f0 0x7f7878038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7884009990 tx=0x7f7884006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 msgr2=0x7f7890110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f7890110080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f788000c010 tx=0x7f7880009250 comp rx=0 tx=0).stop 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 shutdown_connections 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f78780365f0 0x7f7878038aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 --2- 172.21.15.29:0/1080963833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78901011c0 0x7f7890110080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 >> 172.21.15.29:0/1080963833 conn(0x7f78900fc980 msgr2=0x7f78900fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 shutdown_connections 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:11.490+0000 7f7875ffb700 1 -- 172.21.15.29:0/1080963833 wait complete. 2023-12-05T13:18:11.981 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying prometheus service with default placement... 2023-12-05T13:18:12.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:11 smithi029 ceph-mon[112128]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:12.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:11 smithi029 ceph-mon[112128]: Saving service mgr spec with placement count:2 2023-12-05T13:18:12.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:11 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:12.925 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:12 smithi029 ceph-mon[112128]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:12.925 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:12 smithi029 ceph-mon[112128]: Saving service crash spec with placement * 2023-12-05T13:18:12.925 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:12 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:12.925 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:12 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.361+0000 7f505e3d8700 1 Processor -- start 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.361+0000 7f505e3d8700 1 -- start start 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f505e3d8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f505e3d8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5058104310 con 0x7f50581039c0 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f5057fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:12.995 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f5057fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34534/0 (socket says 172.21.15.29:34534) 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f5057fff700 1 -- 172.21.15.29:0/3803620176 learned_addr learned my addr 172.21.15.29:0/3803620176 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f5057fff700 1 -- 172.21.15.29:0/3803620176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058101fb0 con 0x7f50581039c0 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.362+0000 7f5057fff700 1 --2- 172.21.15.29:0/3803620176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058103dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50480098e0 tx=0x7f5048009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656948d630b64020 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.363+0000 7f5056ffd700 1 -- 172.21.15.29:0/3803620176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f504800b860 con 0x7f50581039c0 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.363+0000 7f5056ffd700 1 -- 172.21.15.29:0/3803620176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f504800be70 con 0x7f50581039c0 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.363+0000 7f5056ffd700 1 -- 172.21.15.29:0/3803620176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5048010380 con 0x7f50581039c0 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 -- 172.21.15.29:0/3803620176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 msgr2=0x7f5058103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 --2- 172.21.15.29:0/3803620176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058103dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50480098e0 tx=0x7f5048009250 comp rx=0 tx=0).stop 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 -- 172.21.15.29:0/3803620176 shutdown_connections 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 --2- 172.21.15.29:0/3803620176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058103dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 -- 172.21.15.29:0/3803620176 >> 172.21.15.29:0/3803620176 conn(0x7f50580fda40 msgr2=0x7f50580ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 -- 172.21.15.29:0/3803620176 shutdown_connections 2023-12-05T13:18:12.996 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 -- 172.21.15.29:0/3803620176 wait complete. 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.364+0000 7f505e3d8700 1 Processor -- start 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f505e3d8700 1 -- start start 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f505e3d8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f505e3d8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5058077190 con 0x7f50581039c0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f5057fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f5057fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34542/0 (socket says 172.21.15.29:34542) 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f5057fff700 1 -- 172.21.15.29:0/1503081637 learned_addr learned my addr 172.21.15.29:0/1503081637 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.365+0000 7f5057fff700 1 -- 172.21.15.29:0/1503081637 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480094f0 con 0x7f50581039c0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.366+0000 7f5057fff700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058078d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f504800bac0 tx=0x7f5048009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.366+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50480109b0 con 0x7f50581039c0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.366+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f504801a430 con 0x7f50581039c0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.366+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5058077390 con 0x7f50581039c0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.366+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50480245b0 con 0x7f50581039c0 2023-12-05T13:18:12.997 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.366+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50580777a0 con 0x7f50581039c0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.367+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5048024710 con 0x7f50581039c0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.367+0000 7f5054ff9700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f5040036690 0x7f5040038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.367+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505810b190 con 0x7f50581039c0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.367+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f504801a9f0 con 0x7f50581039c0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.367+0000 7f50577fe700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f5040036690 0x7f5040038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.368+0000 7f50577fe700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f5040036690 0x7f5040038b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f504c009990 tx=0x7f504c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.372+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5048006d70 con 0x7f50581039c0 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.599+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f5058077a50 con 0x7f5040036690 2023-12-05T13:18:12.998 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.605+0000 7f5054ff9700 1 -- 172.21.15.29:0/1503081637 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f5058077a50 con 0x7f5040036690 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f5040036690 msgr2=0x7f5040038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f5040036690 0x7f5040038b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f504c009990 tx=0x7f504c006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 msgr2=0x7f5058078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058078d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f504800bac0 tx=0x7f5048009250 comp rx=0 tx=0).stop 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 shutdown_connections 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f5040036690 0x7f5040038b40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:12.999 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 --2- 172.21.15.29:0/1503081637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50581039c0 0x7f5058078d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:13.000 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.607+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 >> 172.21.15.29:0/1503081637 conn(0x7f50580fda40 msgr2=0x7f50580ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:13.000 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.608+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 shutdown_connections 2023-12-05T13:18:13.000 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:12.608+0000 7f505e3d8700 1 -- 172.21.15.29:0/1503081637 wait complete. 2023-12-05T13:18:13.000 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying grafana service with default placement... 2023-12-05T13:18:14.059 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.379+0000 7f28d6186700 1 Processor -- start 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.379+0000 7f28d6186700 1 -- start start 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.379+0000 7f28d6186700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.379+0000 7f28d6186700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0105410 con 0x7f28d0076c20 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28cf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28cf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0104ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34546/0 (socket says 172.21.15.29:34546) 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28cf7fe700 1 -- 172.21.15.29:0/364003624 learned_addr learned my addr 172.21.15.29:0/364003624 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28cf7fe700 1 -- 172.21.15.29:0/364003624 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0105550 con 0x7f28d0076c20 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28cf7fe700 1 --2- 172.21.15.29:0/364003624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0104ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28c00098e0 tx=0x7f28c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca122f64b7858050 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28ce7fc700 1 -- 172.21.15.29:0/364003624 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28c000b860 con 0x7f28d0076c20 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28ce7fc700 1 -- 172.21.15.29:0/364003624 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28c000be70 con 0x7f28d0076c20 2023-12-05T13:18:14.060 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.380+0000 7f28ce7fc700 1 -- 172.21.15.29:0/364003624 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28c0010380 con 0x7f28d0076c20 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.381+0000 7f28d6186700 1 -- 172.21.15.29:0/364003624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 msgr2=0x7f28d0104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.381+0000 7f28d6186700 1 --2- 172.21.15.29:0/364003624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0104ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28c00098e0 tx=0x7f28c0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.382+0000 7f28d6186700 1 -- 172.21.15.29:0/364003624 shutdown_connections 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.382+0000 7f28d6186700 1 --2- 172.21.15.29:0/364003624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0104ed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.382+0000 7f28d6186700 1 -- 172.21.15.29:0/364003624 >> 172.21.15.29:0/364003624 conn(0x7f28d00fc980 msgr2=0x7f28d00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.382+0000 7f28d6186700 1 -- 172.21.15.29:0/364003624 shutdown_connections 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.382+0000 7f28d6186700 1 -- 172.21.15.29:0/364003624 wait complete. 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.382+0000 7f28d6186700 1 Processor -- start 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28d6186700 1 -- start start 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28d6186700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28d6186700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01138c0 con 0x7f28d0076c20 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28cf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28cf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34552/0 (socket says 172.21.15.29:34552) 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28cf7fe700 1 -- 172.21.15.29:0/2226138488 learned_addr learned my addr 172.21.15.29:0/2226138488 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:14.061 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.383+0000 7f28cf7fe700 1 -- 172.21.15.29:0/2226138488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00094f0 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.384+0000 7f28cf7fe700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0113380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28c00094c0 tx=0x7f28c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.384+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28c0010850 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.384+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d0113ac0 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.384+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28c0010e60 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.384+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28c001a430 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.384+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d0113ed0 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.385+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f28c001a6b0 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.385+0000 7f28b7fff700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f28b80365f0 0x7f28b8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.385+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f28c004b3a0 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.385+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d004bb80 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.385+0000 7f28ceffd700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f28b80365f0 0x7f28b8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.386+0000 7f28ceffd700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f28b80365f0 0x7f28b8038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009990 tx=0x7f28c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.390+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f28c0018d90 con 0x7f28d0076c20 2023-12-05T13:18:14.062 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.608+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f28d010d170 con 0x7f28b80365f0 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.612+0000 7f28b7fff700 1 -- 172.21.15.29:0/2226138488 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f28d010d170 con 0x7f28b80365f0 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f28b80365f0 msgr2=0x7f28b8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f28b80365f0 0x7f28b8038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009990 tx=0x7f28c4006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 msgr2=0x7f28d0113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0113380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28c00094c0 tx=0x7f28c0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 shutdown_connections 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f28b80365f0 0x7f28b8038aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 --2- 172.21.15.29:0/2226138488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d0076c20 0x7f28d0113380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.614+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 >> 172.21.15.29:0/2226138488 conn(0x7f28d00fc980 msgr2=0x7f28d00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.615+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 shutdown_connections 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:13.615+0000 7f28d6186700 1 -- 172.21.15.29:0/2226138488 wait complete. 2023-12-05T13:18:14.063 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying node-exporter service with default placement... 2023-12-05T13:18:14.217 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:13 smithi029 ceph-mon[112128]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:14.217 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:13 smithi029 ceph-mon[112128]: Saving service prometheus spec with placement count:1 2023-12-05T13:18:14.217 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:13 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:14.217 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:13 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:15.166 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:14 smithi029 ceph-mon[112128]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:15.166 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:14 smithi029 ceph-mon[112128]: Saving service grafana spec with placement count:1 2023-12-05T13:18:15.166 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:14 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.633+0000 7fc318f33700 1 Processor -- start 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.633+0000 7fc318f33700 1 -- start start 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.633+0000 7fc318f33700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.633+0000 7fc318f33700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314101b20 con 0x7fc3141011d0 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.634+0000 7fc31259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.634+0000 7fc31259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34560/0 (socket says 172.21.15.29:34560) 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.634+0000 7fc31259c700 1 -- 172.21.15.29:0/1233352864 learned_addr learned my addr 172.21.15.29:0/1233352864 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:15.244 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.634+0000 7fc31259c700 1 -- 172.21.15.29:0/1233352864 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314101c60 con 0x7fc3141011d0 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.634+0000 7fc31259c700 1 --2- 172.21.15.29:0/1233352864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141015e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098e0 tx=0x7fc308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb88356f88bae1fe server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc31159a700 1 -- 172.21.15.29:0/1233352864 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc30800b860 con 0x7fc3141011d0 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc31159a700 1 -- 172.21.15.29:0/1233352864 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc30800be70 con 0x7fc3141011d0 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc31159a700 1 -- 172.21.15.29:0/1233352864 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc308010380 con 0x7fc3141011d0 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 -- 172.21.15.29:0/1233352864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 msgr2=0x7fc3141015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 --2- 172.21.15.29:0/1233352864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141015e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098e0 tx=0x7fc308009250 comp rx=0 tx=0).stop 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 -- 172.21.15.29:0/1233352864 shutdown_connections 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 --2- 172.21.15.29:0/1233352864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141015e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 -- 172.21.15.29:0/1233352864 >> 172.21.15.29:0/1233352864 conn(0x7fc3140fc970 msgr2=0x7fc3140fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 -- 172.21.15.29:0/1233352864 shutdown_connections 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.635+0000 7fc318f33700 1 -- 172.21.15.29:0/1233352864 wait complete. 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc318f33700 1 Processor -- start 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc318f33700 1 -- start start 2023-12-05T13:18:15.245 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc318f33700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141075b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc318f33700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314105a30 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc31259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc31259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34564/0 (socket says 172.21.15.29:34564) 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.636+0000 7fc31259c700 1 -- 172.21.15.29:0/3445449590 learned_addr learned my addr 172.21.15.29:0/3445449590 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc31259c700 1 -- 172.21.15.29:0/3445449590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080094f0 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc31259c700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141075b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc308011b60 tx=0x7fc308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc308010850 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc308010e60 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc314105c30 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc30801ae20 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.637+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc314106040 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.638+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc30802d3f0 con 0x7fc3141011d0 2023-12-05T13:18:15.246 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.638+0000 7fc302ffd700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc2fc0365f0 0x7fc2fc038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.638+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc30804a200 con 0x7fc3141011d0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.638+0000 7fc311d9b700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc2fc0365f0 0x7fc2fc038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.638+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31405f270 con 0x7fc3141011d0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.639+0000 7fc311d9b700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc2fc0365f0 0x7fc2fc038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc304009990 tx=0x7fc304006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.643+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc30802b8e0 con 0x7fc3141011d0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.856+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fc31410adc0 con 0x7fc2fc0365f0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.860+0000 7fc302ffd700 1 -- 172.21.15.29:0/3445449590 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fc31410adc0 con 0x7fc2fc0365f0 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc2fc0365f0 msgr2=0x7fc2fc038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc2fc0365f0 0x7fc2fc038aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc304009990 tx=0x7fc304006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 msgr2=0x7fc3141075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141075b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc308011b60 tx=0x7fc308009250 comp rx=0 tx=0).stop 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 shutdown_connections 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fc2fc0365f0 0x7fc2fc038aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:15.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 --2- 172.21.15.29:0/3445449590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3141011d0 0x7fc3141075b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:15.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 >> 172.21.15.29:0/3445449590 conn(0x7fc3140fc970 msgr2=0x7fc3140fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:15.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 shutdown_connections 2023-12-05T13:18:15.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:14.863+0000 7fc318f33700 1 -- 172.21.15.29:0/3445449590 wait complete. 2023-12-05T13:18:15.248 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying alertmanager service with default placement... 2023-12-05T13:18:16.141 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:15 smithi029 ceph-mon[112128]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:16.141 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:15 smithi029 ceph-mon[112128]: Saving service node-exporter spec with placement * 2023-12-05T13:18:16.141 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:15 smithi029 ceph-mon[112128]: from='mgr.14120 172.21.15.29:0/3624957704' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:16.209 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc9569700 1 Processor -- start 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc9569700 1 -- start start 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc9569700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc9569700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4104240 con 0x7f0cc41038f0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34578/0 (socket says 172.21.15.29:34578) 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.616+0000 7f0cc2ffd700 1 -- 172.21.15.29:0/1379374340 learned_addr learned my addr 172.21.15.29:0/1379374340 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.617+0000 7f0cc2ffd700 1 -- 172.21.15.29:0/1379374340 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4104380 con 0x7f0cc41038f0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.617+0000 7f0cc2ffd700 1 --2- 172.21.15.29:0/1379374340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4103d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098e0 tx=0x7f0cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c879524208328f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.617+0000 7f0cc1ffb700 1 -- 172.21.15.29:0/1379374340 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cb400b860 con 0x7f0cc41038f0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.617+0000 7f0cc1ffb700 1 -- 172.21.15.29:0/1379374340 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cb400be70 con 0x7f0cc41038f0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.617+0000 7f0cc1ffb700 1 -- 172.21.15.29:0/1379374340 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cb4010380 con 0x7f0cc41038f0 2023-12-05T13:18:16.210 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 -- 172.21.15.29:0/1379374340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 msgr2=0x7f0cc4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 --2- 172.21.15.29:0/1379374340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4103d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098e0 tx=0x7f0cb4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 -- 172.21.15.29:0/1379374340 shutdown_connections 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 --2- 172.21.15.29:0/1379374340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4103d00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 -- 172.21.15.29:0/1379374340 >> 172.21.15.29:0/1379374340 conn(0x7f0cc40fc0b0 msgr2=0x7f0cc40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 -- 172.21.15.29:0/1379374340 shutdown_connections 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 -- 172.21.15.29:0/1379374340 wait complete. 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.618+0000 7f0cc9569700 1 Processor -- start 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc9569700 1 -- start start 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc9569700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc9569700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4111690 con 0x7f0cc41038f0 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34580/0 (socket says 172.21.15.29:34580) 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc2ffd700 1 -- 172.21.15.29:0/3967811021 learned_addr learned my addr 172.21.15.29:0/3967811021 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc2ffd700 1 -- 172.21.15.29:0/3967811021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40094f0 con 0x7f0cc41038f0 2023-12-05T13:18:16.211 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cc2ffd700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4111150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4011b60 tx=0x7f0cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.619+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cb4010850 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.620+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cb4010e60 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.620+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cb401ae20 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.620+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc4111890 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.620+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc4111ca0 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.620+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f0cb402d3f0 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.621+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc404bb80 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.621+0000 7f0cbb7fe700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f0cb0036640 0x7f0cb0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.621+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0cb404a360 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.621+0000 7f0cc27fc700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f0cb0036640 0x7f0cb0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.621+0000 7f0cc27fc700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f0cb0036640 0x7f0cb0038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009990 tx=0x7f0cac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.626+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0cb4018b40 con 0x7f0cc41038f0 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.836+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cc410b010 con 0x7f0cb0036640 2023-12-05T13:18:16.212 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.841+0000 7f0cbb7fe700 1 -- 172.21.15.29:0/3967811021 <== mgr.14120 v2:172.21.15.29:6800/477452197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f0cc410b010 con 0x7f0cb0036640 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f0cb0036640 msgr2=0x7f0cb0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f0cb0036640 0x7f0cb0038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009990 tx=0x7f0cac006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 msgr2=0x7f0cc4111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4111150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4011b60 tx=0x7f0cb4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 shutdown_connections 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f0cb0036640 0x7f0cb0038af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 --2- 172.21.15.29:0/3967811021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cc41038f0 0x7f0cc4111150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.843+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 >> 172.21.15.29:0/3967811021 conn(0x7f0cc40fc0b0 msgr2=0x7f0cc40fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.844+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 shutdown_connections 2023-12-05T13:18:16.213 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:15.844+0000 7f0cc9569700 1 -- 172.21.15.29:0/3967811021 wait complete. 2023-12-05T13:18:17.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:16 smithi029 ceph-mon[112128]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:17.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:16 smithi029 ceph-mon[112128]: Saving service alertmanager spec with placement count:1 2023-12-05T13:18:17.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:16 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2086816488' entity='client.admin' 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.605+0000 7f507a985700 1 Processor -- start 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.605+0000 7f507a985700 1 -- start start 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.605+0000 7f507a985700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f50741015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.605+0000 7f507a985700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5074101b20 con 0x7f50741011d0 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5073fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f50741015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5073fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f50741015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34596/0 (socket says 172.21.15.29:34596) 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5073fff700 1 -- 172.21.15.29:0/1891318627 learned_addr learned my addr 172.21.15.29:0/1891318627 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5073fff700 1 -- 172.21.15.29:0/1891318627 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074101c60 con 0x7f50741011d0 2023-12-05T13:18:17.227 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5073fff700 1 --2- 172.21.15.29:0/1891318627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f50741015e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f506400bb80 tx=0x7f506400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03ac32ca2df8608 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5072ffd700 1 -- 172.21.15.29:0/1891318627 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f506400dd00 con 0x7f50741011d0 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5072ffd700 1 -- 172.21.15.29:0/1891318627 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f506400de60 con 0x7f50741011d0 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.606+0000 7f5072ffd700 1 -- 172.21.15.29:0/1891318627 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50640188d0 con 0x7f50741011d0 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 -- 172.21.15.29:0/1891318627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 msgr2=0x7f50741015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 --2- 172.21.15.29:0/1891318627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f50741015e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f506400bb80 tx=0x7f506400b4f0 comp rx=0 tx=0).stop 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 -- 172.21.15.29:0/1891318627 shutdown_connections 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 --2- 172.21.15.29:0/1891318627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f50741015e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 -- 172.21.15.29:0/1891318627 >> 172.21.15.29:0/1891318627 conn(0x7f50740fc970 msgr2=0x7f50740fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 -- 172.21.15.29:0/1891318627 shutdown_connections 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.607+0000 7f507a985700 1 -- 172.21.15.29:0/1891318627 wait complete. 2023-12-05T13:18:17.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f507a985700 1 Processor -- start 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f507a985700 1 -- start start 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f507a985700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f507410ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f507a985700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507410f470 con 0x7f50741011d0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f5073fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f507410ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f5073fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f507410ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34600/0 (socket says 172.21.15.29:34600) 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f5073fff700 1 -- 172.21.15.29:0/2086816488 learned_addr learned my addr 172.21.15.29:0/2086816488 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.608+0000 7f5073fff700 1 -- 172.21.15.29:0/2086816488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506400b790 con 0x7f50741011d0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.609+0000 7f5073fff700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f507410ef30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50640184f0 tx=0x7f506400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.609+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5064010b90 con 0x7f50741011d0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.609+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f506401d050 con 0x7f50741011d0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.609+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507410f670 con 0x7f50741011d0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.609+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5064022590 con 0x7f50741011d0 2023-12-05T13:18:17.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.609+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507410fa80 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.610+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5064023470 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.610+0000 7f5070ff9700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f505c0365f0 0x7f505c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.610+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5064014070 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.610+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507404bb80 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.610+0000 7f50737fe700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f505c0365f0 0x7f505c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.610+0000 7f50737fe700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f505c0365f0 0x7f505c038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5068009990 tx=0x7f5068006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.615+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f506402d460 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.815+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f5074102fb0 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.818+0000 7f5070ff9700 1 -- 172.21.15.29:0/2086816488 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f506400e360 con 0x7f50741011d0 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f505c0365f0 msgr2=0x7f505c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f505c0365f0 0x7f505c038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5068009990 tx=0x7f5068006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 msgr2=0x7f507410ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:17.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f507410ef30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50640184f0 tx=0x7f506400b4f0 comp rx=0 tx=0).stop 2023-12-05T13:18:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 shutdown_connections 2023-12-05T13:18:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f505c0365f0 0x7f505c038aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 --2- 172.21.15.29:0/2086816488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50741011d0 0x7f507410ef30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 >> 172.21.15.29:0/2086816488 conn(0x7f50740fc970 msgr2=0x7f5074105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 shutdown_connections 2023-12-05T13:18:17.231 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:16.821+0000 7f507a985700 1 -- 172.21.15.29:0/2086816488 wait complete. 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.630+0000 7f3e94708700 1 Processor -- start 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.630+0000 7f3e94708700 1 -- start start 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e94708700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e94708700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c103230 con 0x7f3e8c1028e0 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e924a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e924a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34616/0 (socket says 172.21.15.29:34616) 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e924a4700 1 -- 172.21.15.29:0/2061178293 learned_addr learned my addr 172.21.15.29:0/2061178293 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e924a4700 1 -- 172.21.15.29:0/2061178293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c103370 con 0x7f3e8c1028e0 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e924a4700 1 --2- 172.21.15.29:0/2061178293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c102cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e800098e0 tx=0x7f3e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd41085c7c179626 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e914a2700 1 -- 172.21.15.29:0/2061178293 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e8000b8f0 con 0x7f3e8c1028e0 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.631+0000 7f3e914a2700 1 -- 172.21.15.29:0/2061178293 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e80011420 con 0x7f3e8c1028e0 2023-12-05T13:18:18.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e914a2700 1 -- 172.21.15.29:0/2061178293 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e80010540 con 0x7f3e8c1028e0 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 -- 172.21.15.29:0/2061178293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 msgr2=0x7f3e8c102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 --2- 172.21.15.29:0/2061178293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c102cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e800098e0 tx=0x7f3e80009250 comp rx=0 tx=0).stop 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 -- 172.21.15.29:0/2061178293 shutdown_connections 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 --2- 172.21.15.29:0/2061178293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c102cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 -- 172.21.15.29:0/2061178293 >> 172.21.15.29:0/2061178293 conn(0x7f3e8c0fc0b0 msgr2=0x7f3e8c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 -- 172.21.15.29:0/2061178293 shutdown_connections 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.632+0000 7f3e94708700 1 -- 172.21.15.29:0/2061178293 wait complete. 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.633+0000 7f3e94708700 1 Processor -- start 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.633+0000 7f3e94708700 1 -- start start 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.633+0000 7f3e94708700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:18.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.633+0000 7f3e94708700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c113980 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e924a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e924a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c113440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34624/0 (socket says 172.21.15.29:34624) 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e924a4700 1 -- 172.21.15.29:0/4116420438 learned_addr learned my addr 172.21.15.29:0/4116420438 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e924a4700 1 -- 172.21.15.29:0/4116420438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800094f0 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e924a4700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c113440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e80011d60 tx=0x7f3e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e800107b0 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e80010dc0 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c113b80 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e8001ad00 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.634+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c113f90 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.635+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3e8002e440 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.635+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c04bb80 con 0x7f3e8c1028e0 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.635+0000 7f3e7effd700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3e78036640 0x7f3e78038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:18.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.635+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3e8004a540 con 0x7f3e8c1028e0 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.635+0000 7f3e91ca3700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3e78036640 0x7f3e78038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.636+0000 7f3e91ca3700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3e78036640 0x7f3e78038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009990 tx=0x7f3e88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.640+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3e80023b40 con 0x7f3e8c1028e0 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.841+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f3e8c108520 con 0x7f3e8c1028e0 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.844+0000 7f3e7effd700 1 -- 172.21.15.29:0/4116420438 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f3e80023b40 con 0x7f3e8c1028e0 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3e78036640 msgr2=0x7f3e78038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3e78036640 0x7f3e78038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009990 tx=0x7f3e88006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 msgr2=0x7f3e8c113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c113440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e80011d60 tx=0x7f3e80009250 comp rx=0 tx=0).stop 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 shutdown_connections 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f3e78036640 0x7f3e78038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:18.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 --2- 172.21.15.29:0/4116420438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e8c1028e0 0x7f3e8c113440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:18.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 >> 172.21.15.29:0/4116420438 conn(0x7f3e8c0fc0b0 msgr2=0x7f3e8c0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:18.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 shutdown_connections 2023-12-05T13:18:18.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:17.847+0000 7f3e94708700 1 -- 172.21.15.29:0/4116420438 wait complete. 2023-12-05T13:18:18.223 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling the dashboard module... 2023-12-05T13:18:19.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:18 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/4116420438' entity='client.admin' 2023-12-05T13:18:20.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:19 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/507145240' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-05T13:18:20.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.591+0000 7faaf8fc1700 1 Processor -- start 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.591+0000 7faaf8fc1700 1 -- start start 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf8fc1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf8fc1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4104240 con 0x7faaf41038f0 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53726/0 (socket says 172.21.15.29:53726) 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf259c700 1 -- 172.21.15.29:0/264121891 learned_addr learned my addr 172.21.15.29:0/264121891 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf259c700 1 -- 172.21.15.29:0/264121891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4104380 con 0x7faaf41038f0 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf259c700 1 --2- 172.21.15.29:0/264121891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4103d00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faae40098e0 tx=0x7faae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8faa31719ebaac3 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:20.237 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf159a700 1 -- 172.21.15.29:0/264121891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faae400b860 con 0x7faaf41038f0 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf159a700 1 -- 172.21.15.29:0/264121891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faae400be70 con 0x7faaf41038f0 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.592+0000 7faaf159a700 1 -- 172.21.15.29:0/264121891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faae4010380 con 0x7faaf41038f0 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 -- 172.21.15.29:0/264121891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 msgr2=0x7faaf4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 --2- 172.21.15.29:0/264121891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4103d00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faae40098e0 tx=0x7faae4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 -- 172.21.15.29:0/264121891 shutdown_connections 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 --2- 172.21.15.29:0/264121891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4103d00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 -- 172.21.15.29:0/264121891 >> 172.21.15.29:0/264121891 conn(0x7faaf40fc0b0 msgr2=0x7faaf40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 -- 172.21.15.29:0/264121891 shutdown_connections 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.593+0000 7faaf8fc1700 1 -- 172.21.15.29:0/264121891 wait complete. 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf8fc1700 1 Processor -- start 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf8fc1700 1 -- start start 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf8fc1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:20.238 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf8fc1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf41116b0 con 0x7faaf41038f0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53728/0 (socket says 172.21.15.29:53728) 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.594+0000 7faaf259c700 1 -- 172.21.15.29:0/507145240 learned_addr learned my addr 172.21.15.29:0/507145240 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaf259c700 1 -- 172.21.15.29:0/507145240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40094f0 con 0x7faaf41038f0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaf259c700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4111170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faae4011b60 tx=0x7faae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faae4010850 con 0x7faaf41038f0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faae4010e60 con 0x7faaf41038f0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaf8fc1700 1 -- 172.21.15.29:0/507145240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf41118b0 con 0x7faaf41038f0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faae401ae20 con 0x7faaf41038f0 2023-12-05T13:18:20.239 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.595+0000 7faaf8fc1700 1 -- 172.21.15.29:0/507145240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4111cc0 con 0x7faaf41038f0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.596+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7faae40109b0 con 0x7faaf41038f0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.596+0000 7faaeaffd700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7faae0036640 0x7faae0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.596+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad80052b0 con 0x7faaf41038f0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.596+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faae404a430 con 0x7faaf41038f0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.596+0000 7faaf1d9b700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7faae0036640 0x7faae0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.597+0000 7faaf1d9b700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7faae0036640 0x7faae0038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faadc009990 tx=0x7faadc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.601+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faae402d3f0 con 0x7faaf41038f0 2023-12-05T13:18:20.240 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:18.858+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7faad8005560 con 0x7faaf41038f0 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.848+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7faae402d770 con 0x7faaf41038f0 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.849+0000 7faaeaffd700 1 -- 172.21.15.29:0/507145240 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7faae400e260 con 0x7faaf41038f0 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7faae0036640 msgr2=0x7faae0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7faae0036640 0x7faae0038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faadc009990 tx=0x7faadc006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 msgr2=0x7faaf4111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4111170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faae4011b60 tx=0x7faae4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 shutdown_connections 2023-12-05T13:18:20.241 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7faae0036640 0x7faae0038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:20.242 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 --2- 172.21.15.29:0/507145240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf41038f0 0x7faaf4111170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:20.242 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 >> 172.21.15.29:0/507145240 conn(0x7faaf40fc0b0 msgr2=0x7faaf40fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:20.242 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 shutdown_connections 2023-12-05T13:18:20.242 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:19.852+0000 7faae8ff9700 1 -- 172.21.15.29:0/507145240 wait complete. 2023-12-05T13:18:21.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:20 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/507145240' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-05T13:18:21.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:20 smithi029 ceph-mon[112128]: mgrmap e9: smithi029.eekhlu(active, since 19s) 2023-12-05T13:18:21.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "active_name": "smithi029.eekhlu", 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.595+0000 7fa39e568700 1 Processor -- start 2023-12-05T13:18:21.189 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.595+0000 7fa39e568700 1 -- start start 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.595+0000 7fa39e568700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa3981015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.595+0000 7fa39e568700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398101b10 con 0x7fa3981011c0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa397fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa3981015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa397fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa3981015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53750/0 (socket says 172.21.15.29:53750) 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa397fff700 1 -- 172.21.15.29:0/2242305671 learned_addr learned my addr 172.21.15.29:0/2242305671 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa397fff700 1 -- 172.21.15.29:0/2242305671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398101c50 con 0x7fa3981011c0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa397fff700 1 --2- 172.21.15.29:0/2242305671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa3981015d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3880098e0 tx=0x7fa388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47067778d72c4e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa396ffd700 1 -- 172.21.15.29:0/2242305671 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa38800b860 con 0x7fa3981011c0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.596+0000 7fa396ffd700 1 -- 172.21.15.29:0/2242305671 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa38800be70 con 0x7fa3981011c0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa396ffd700 1 -- 172.21.15.29:0/2242305671 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa388010380 con 0x7fa3981011c0 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 -- 172.21.15.29:0/2242305671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 msgr2=0x7fa3981015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 --2- 172.21.15.29:0/2242305671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa3981015d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3880098e0 tx=0x7fa388009250 comp rx=0 tx=0).stop 2023-12-05T13:18:21.190 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 -- 172.21.15.29:0/2242305671 shutdown_connections 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 --2- 172.21.15.29:0/2242305671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa3981015d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 -- 172.21.15.29:0/2242305671 >> 172.21.15.29:0/2242305671 conn(0x7fa3980fc980 msgr2=0x7fa3980fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 -- 172.21.15.29:0/2242305671 shutdown_connections 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.597+0000 7fa39e568700 1 -- 172.21.15.29:0/2242305671 wait complete. 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.598+0000 7fa39e568700 1 Processor -- start 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.598+0000 7fa39e568700 1 -- start start 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa39e568700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa39810efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa39e568700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39810f4f0 con 0x7fa3981011c0 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa397fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa39810efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa397fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa39810efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53766/0 (socket says 172.21.15.29:53766) 2023-12-05T13:18:21.191 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa397fff700 1 -- 172.21.15.29:0/3139778388 learned_addr learned my addr 172.21.15.29:0/3139778388 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa397fff700 1 -- 172.21.15.29:0/3139778388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880094f0 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.599+0000 7fa397fff700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa39810efb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa388011b60 tx=0x7fa388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.600+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa388010850 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.600+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa388010e60 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.600+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39810f6f0 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.600+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3880243f0 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.600+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39810fb00 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.601+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fa388024660 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.601+0000 7fa394ff9700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 0x7fa38003ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.601+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39804bb80 con 0x7fa3981011c0 2023-12-05T13:18:21.192 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.601+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa38801a780 con 0x7fa3981011c0 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.601+0000 7fa3977fe700 1 -- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 msgr2=0x7fa38003ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.601+0000 7fa3977fe700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 0x7fa38003ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.606+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa388018940 con 0x7fa3981011c0 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.802+0000 7fa3977fe700 1 -- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 msgr2=0x7fa38003ad90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.802+0000 7fa3977fe700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 0x7fa38003ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.867+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa398108bb0 con 0x7fa3981011c0 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.867+0000 7fa394ff9700 1 -- 172.21.15.29:0/3139778388 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa388018350 con 0x7fa3981011c0 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.869+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 msgr2=0x7fa38003ad90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.869+0000 7fa39e568700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 0x7fa38003ad90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.869+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 msgr2=0x7fa39810efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:21.193 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.869+0000 7fa39e568700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa39810efb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa388011b60 tx=0x7fa388009250 comp rx=0 tx=0).stop 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.870+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 shutdown_connections 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.870+0000 7fa39e568700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7fa3800388e0 0x7fa38003ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.870+0000 7fa39e568700 1 --2- 172.21.15.29:0/3139778388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3981011c0 0x7fa39810efb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.870+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 >> 172.21.15.29:0/3139778388 conn(0x7fa3980fc980 msgr2=0x7fa398105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.870+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 shutdown_connections 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:20.870+0000 7fa39e568700 1 -- 172.21.15.29:0/3139778388 wait complete. 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for the mgr to restart... 2023-12-05T13:18:21.194 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr epoch 9... 2023-12-05T13:18:22.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:21 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3139778388' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-05T13:18:27.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:18:27.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:18:27.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: osdmap e3: 0 total, 0 up, 0 in 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: mgrmap e10: smithi029.eekhlu(active, starting, since 0.00355349s) 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:27 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:18:28.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:28 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:18:28.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:28 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:18:28.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:28 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:28.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:28 smithi029 ceph-mon[112128]: mgrmap e11: smithi029.eekhlu(active, since 1.00641s) 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806c835700 1 Processor -- start 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806c835700 1 -- start start 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806c835700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068104f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806c835700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80681054a0 con 0x7f8068070f40 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068104f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53772/0 (socket says 172.21.15.29:53772) 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.563+0000 7f806659c700 1 -- 172.21.15.29:0/3101861388 learned_addr learned my addr 172.21.15.29:0/3101861388 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:28.668 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.564+0000 7f806659c700 1 -- 172.21.15.29:0/3101861388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80681055e0 con 0x7f8068070f40 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.564+0000 7f806659c700 1 --2- 172.21.15.29:0/3101861388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068104f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8058009e50 tx=0x7f8058009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7209cc53fc4282 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.564+0000 7f806559a700 1 -- 172.21.15.29:0/3101861388 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80580092e0 con 0x7f8068070f40 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.564+0000 7f806559a700 1 -- 172.21.15.29:0/3101861388 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8058012430 con 0x7f8068070f40 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.564+0000 7f806559a700 1 -- 172.21.15.29:0/3101861388 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80580075c0 con 0x7f8068070f40 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 -- 172.21.15.29:0/3101861388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 msgr2=0x7f8068104f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 --2- 172.21.15.29:0/3101861388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068104f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8058009e50 tx=0x7f8058009840 comp rx=0 tx=0).stop 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 -- 172.21.15.29:0/3101861388 shutdown_connections 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 --2- 172.21.15.29:0/3101861388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068104f60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 -- 172.21.15.29:0/3101861388 >> 172.21.15.29:0/3101861388 conn(0x7f80680fc970 msgr2=0x7f80680fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 -- 172.21.15.29:0/3101861388 shutdown_connections 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 -- 172.21.15.29:0/3101861388 wait complete. 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.565+0000 7f806c835700 1 Processor -- start 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806c835700 1 -- start start 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806c835700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068111200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:28.669 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806c835700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8068111740 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068111200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068111200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53786/0 (socket says 172.21.15.29:53786) 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806659c700 1 -- 172.21.15.29:0/846941391 learned_addr learned my addr 172.21.15.29:0/846941391 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806659c700 1 -- 172.21.15.29:0/846941391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058009ae0 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.566+0000 7f806659c700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068111200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8058009fd0 tx=0x7f8058009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.567+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80580092e0 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.567+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8068111940 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.567+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8058012920 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.567+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8058025970 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.567+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8068111d50 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.567+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f8058019050 con 0x7f8068070f40 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.568+0000 7f8056ffd700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:28.670 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.568+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 --> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8050039200 con 0x7f8050036640 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.568+0000 7f8065d9b700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 msgr2=0x7f8050038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.568+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f805804a200 con 0x7f8068070f40 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.568+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.769+0000 7f8065d9b700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 msgr2=0x7f8050038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:21.769+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:22.170+0000 7f8065d9b700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 msgr2=0x7f8050038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:22.170+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:22.971+0000 7f8065d9b700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 msgr2=0x7f8050038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:22.971+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:24.572+0000 7f8065d9b700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 msgr2=0x7f8050038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/477452197 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:24.572+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:27.236+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f8058022d70 con 0x7f8068070f40 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:27.236+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 msgr2=0x7f8050038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:27.236+0000 7f8056ffd700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:28.671 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.239+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f805802e770 con 0x7f8068070f40 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.239+0000 7f8056ffd700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8050039fb0 0x7f805003c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.239+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8050039200 con 0x7f8050039fb0 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.240+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8050039fb0 0x7f805003c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.241+0000 7f8065d9b700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8050039fb0 0x7f805003c390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f805c0039d0 tx=0x7f805c0092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.241+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f8050039200 con 0x7f8050039fb0 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.252+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f806804bb80 con 0x7f8050039fb0 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f8056ffd700 1 -- 172.21.15.29:0/846941391 <== mgr.14162 v2:172.21.15.29:6800/525299250 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f806804bb80 con 0x7f8050039fb0 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8050039fb0 msgr2=0x7f805003c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8050039fb0 0x7f805003c390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f805c0039d0 tx=0x7f805c0092f0 comp rx=0 tx=0).stop 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 msgr2=0x7f8068111200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068111200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8058009fd0 tx=0x7f8058009840 comp rx=0 tx=0).stop 2023-12-05T13:18:28.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 shutdown_connections 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8050039fb0 0x7f805003c390 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8068070f40 0x7f8068111200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 --2- 172.21.15.29:0/846941391 >> [v2:172.21.15.29:6800/477452197,v1:172.21.15.29:6801/477452197] conn(0x7f8050036640 0x7f8050038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.253+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 >> 172.21.15.29:0/846941391 conn(0x7f80680fc970 msgr2=0x7f80680fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.254+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 shutdown_connections 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:28.254+0000 7f806c835700 1 -- 172.21.15.29:0/846941391 wait complete. 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:mgr epoch 9 is available 2023-12-05T13:18:28.673 INFO:teuthology.orchestra.run.smithi029.stdout:Generating a dashboard self-signed certificate... 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b08dab700 1 Processor -- start 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b08dab700 1 -- start start 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b08dab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b04107340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b08dab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04102d30 con 0x7f2b04070f60 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b04107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:29.908 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b04107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47558/0 (socket says 172.21.15.29:47558) 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.055+0000 7f2b0259c700 1 -- 172.21.15.29:0/2279175485 learned_addr learned my addr 172.21.15.29:0/2279175485 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.056+0000 7f2b0259c700 1 -- 172.21.15.29:0/2279175485 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04107880 con 0x7f2b04070f60 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.056+0000 7f2b0259c700 1 --2- 172.21.15.29:0/2279175485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b04107340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2af40098e0 tx=0x7f2af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275560e78f452510 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.056+0000 7f2b0159a700 1 -- 172.21.15.29:0/2279175485 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af400b860 con 0x7f2b04070f60 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.056+0000 7f2b0159a700 1 -- 172.21.15.29:0/2279175485 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2af400be70 con 0x7f2b04070f60 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.056+0000 7f2b0159a700 1 -- 172.21.15.29:0/2279175485 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af4010380 con 0x7f2b04070f60 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 -- 172.21.15.29:0/2279175485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 msgr2=0x7f2b04107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 --2- 172.21.15.29:0/2279175485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b04107340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2af40098e0 tx=0x7f2af4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 -- 172.21.15.29:0/2279175485 shutdown_connections 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 --2- 172.21.15.29:0/2279175485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b04107340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 -- 172.21.15.29:0/2279175485 >> 172.21.15.29:0/2279175485 conn(0x7f2b040fc970 msgr2=0x7f2b040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 -- 172.21.15.29:0/2279175485 shutdown_connections 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.057+0000 7f2b08dab700 1 -- 172.21.15.29:0/2279175485 wait complete. 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b08dab700 1 Processor -- start 2023-12-05T13:18:29.909 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b08dab700 1 -- start start 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b08dab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b041133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b08dab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04113910 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b041133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b0259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b041133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47564/0 (socket says 172.21.15.29:47564) 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b0259c700 1 -- 172.21.15.29:0/796260261 learned_addr learned my addr 172.21.15.29:0/796260261 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.058+0000 7f2b0259c700 1 -- 172.21.15.29:0/796260261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40094f0 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.059+0000 7f2b0259c700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b041133d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2af4006d40 tx=0x7f2af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.059+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af4010960 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.059+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2af401a430 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.059+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b04113b10 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.059+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2af40245b0 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.059+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b04113f20 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.060+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f2af402d3f0 con 0x7f2b04070f60 2023-12-05T13:18:29.910 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.060+0000 7f2af2ffd700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2aec036510 0x7f2aec0389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.060+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2af404a120 con 0x7f2b04070f60 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.060+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0404bb80 con 0x7f2b04070f60 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.060+0000 7f2b01d9b700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2aec036510 0x7f2aec0389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.061+0000 7f2b01d9b700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2aec036510 0x7f2aec0389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009990 tx=0x7f2af8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.065+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2af402b8e0 con 0x7f2b04070f60 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.279+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b0410cf90 con 0x7f2aec036510 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.383+0000 7f2af2ffd700 1 -- 172.21.15.29:0/796260261 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f2b0410cf90 con 0x7f2aec036510 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2aec036510 msgr2=0x7f2aec0389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2aec036510 0x7f2aec0389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009990 tx=0x7f2af8006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 msgr2=0x7f2b041133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b041133d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2af4006d40 tx=0x7f2af4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 shutdown_connections 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2aec036510 0x7f2aec0389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:29.911 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 --2- 172.21.15.29:0/796260261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b04070f60 0x7f2b041133d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:29.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 >> 172.21.15.29:0/796260261 conn(0x7f2b040fc970 msgr2=0x7f2b040fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:29.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 shutdown_connections 2023-12-05T13:18:29.912 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:29.385+0000 7f2b08dab700 1 -- 172.21.15.29:0/796260261 wait complete. 2023-12-05T13:18:29.912 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial admin user... 2023-12-05T13:18:29.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: [05/Dec/2023:13:18:28] ENGINE Bus STARTING 2023-12-05T13:18:29.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: [05/Dec/2023:13:18:28] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:18:29.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: [05/Dec/2023:13:18:28] ENGINE Bus STARTED 2023-12-05T13:18:29.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:29.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:29.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:29.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:29 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:30 smithi029 ceph-mon[112128]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:30 smithi029 ceph-mon[112128]: mgrmap e12: smithi029.eekhlu(active, since 2s) 2023-12-05T13:18:31.549 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4Q7N1RpGY.UK0KqR9hM2H.MaIbgBHd./fVHQ56ensUUAbqI4LCFv6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701782311, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-05T13:18:31.549 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.599+0000 7f2cd5e9d700 1 Processor -- start 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.599+0000 7f2cd5e9d700 1 -- start start 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.599+0000 7f2cd5e9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.599+0000 7f2cd5e9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0101b10 con 0x7f2cd01011c0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2ccf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2ccf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47570/0 (socket says 172.21.15.29:47570) 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2ccf7fe700 1 -- 172.21.15.29:0/2924242086 learned_addr learned my addr 172.21.15.29:0/2924242086 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2ccf7fe700 1 -- 172.21.15.29:0/2924242086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0101c50 con 0x7f2cd01011c0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2ccf7fe700 1 --2- 172.21.15.29:0/2924242086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01015d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40098e0 tx=0x7f2cc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ebb2ecfab45f1e server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2cce7fc700 1 -- 172.21.15.29:0/2924242086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc400b860 con 0x7f2cd01011c0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2cce7fc700 1 -- 172.21.15.29:0/2924242086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cc400be70 con 0x7f2cd01011c0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.600+0000 7f2cce7fc700 1 -- 172.21.15.29:0/2924242086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc4010380 con 0x7f2cd01011c0 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/2924242086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 msgr2=0x7f2cd01015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:31.550 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 --2- 172.21.15.29:0/2924242086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01015d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40098e0 tx=0x7f2cc4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/2924242086 shutdown_connections 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 --2- 172.21.15.29:0/2924242086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01015d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/2924242086 >> 172.21.15.29:0/2924242086 conn(0x7f2cd00fc980 msgr2=0x7f2cd00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/2924242086 shutdown_connections 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.601+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/2924242086 wait complete. 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2cd5e9d700 1 Processor -- start 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2cd5e9d700 1 -- start start 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2cd5e9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01075a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2cd5e9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0105a20 con 0x7f2cd01011c0 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2ccf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2ccf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01075a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47578/0 (socket says 172.21.15.29:47578) 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.602+0000 7f2ccf7fe700 1 -- 172.21.15.29:0/502997010 learned_addr learned my addr 172.21.15.29:0/502997010 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2ccf7fe700 1 -- 172.21.15.29:0/502997010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40094f0 con 0x7f2cd01011c0 2023-12-05T13:18:31.551 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2ccf7fe700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01075a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c010 tx=0x7f2cc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc4010960 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cc401a430 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd0105c20 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc4019580 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.603+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd0106030 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.604+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f2cc40197b0 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.604+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd004bb80 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.604+0000 7f2cb7fff700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2cb8036690 0x7f2cb8038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.604+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2cc404a450 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.604+0000 7f2cceffd700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2cb8036690 0x7f2cb8038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.605+0000 7f2cceffd700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2cb8036690 0x7f2cb8038b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009990 tx=0x7f2cc0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.609+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2cc402bd60 con 0x7f2cd01011c0 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:30.824+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd005f090 con 0x7f2cb8036690 2023-12-05T13:18:31.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.077+0000 7f2cb7fff700 1 -- 172.21.15.29:0/502997010 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f2cd005f090 con 0x7f2cb8036690 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2cb8036690 msgr2=0x7f2cb8038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2cb8036690 0x7f2cb8038b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009990 tx=0x7f2cc0006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 msgr2=0x7f2cd01075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01075a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c010 tx=0x7f2cc4009250 comp rx=0 tx=0).stop 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 shutdown_connections 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2cb8036690 0x7f2cb8038b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 --2- 172.21.15.29:0/502997010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01011c0 0x7f2cd01075a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 >> 172.21.15.29:0/502997010 conn(0x7f2cd00fc980 msgr2=0x7f2cd0076870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 shutdown_connections 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.079+0000 7f2cd5e9d700 1 -- 172.21.15.29:0/502997010 wait complete. 2023-12-05T13:18:31.553 INFO:teuthology.orchestra.run.smithi029.stdout:Fetching dashboard port number... 2023-12-05T13:18:32.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:31 smithi029 ceph-mon[112128]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:32.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:31 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 8443 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.930+0000 7f69eb368700 1 Processor -- start 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.930+0000 7f69eb368700 1 -- start start 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.930+0000 7f69eb368700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e4100d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.930+0000 7f69eb368700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41012a0 con 0x7f69e4100950 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.931+0000 7f69e9104700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e4100d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.931+0000 7f69e9104700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e4100d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47584/0 (socket says 172.21.15.29:47584) 2023-12-05T13:18:32.507 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.931+0000 7f69e9104700 1 -- 172.21.15.29:0/2267282304 learned_addr learned my addr 172.21.15.29:0/2267282304 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.931+0000 7f69e9104700 1 -- 172.21.15.29:0/2267282304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e41013e0 con 0x7f69e4100950 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.931+0000 7f69e9104700 1 --2- 172.21.15.29:0/2267282304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e4100d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69e00098e0 tx=0x7f69e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b40c36ac4b8fe02 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69d7fff700 1 -- 172.21.15.29:0/2267282304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e000b860 con 0x7f69e4100950 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69d7fff700 1 -- 172.21.15.29:0/2267282304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69e000be70 con 0x7f69e4100950 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69d7fff700 1 -- 172.21.15.29:0/2267282304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e0010380 con 0x7f69e4100950 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 -- 172.21.15.29:0/2267282304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 msgr2=0x7f69e4100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 --2- 172.21.15.29:0/2267282304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e4100d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69e00098e0 tx=0x7f69e0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 -- 172.21.15.29:0/2267282304 shutdown_connections 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 --2- 172.21.15.29:0/2267282304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e4100d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 -- 172.21.15.29:0/2267282304 >> 172.21.15.29:0/2267282304 conn(0x7f69e40fc0b0 msgr2=0x7f69e40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 -- 172.21.15.29:0/2267282304 shutdown_connections 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.932+0000 7f69eb368700 1 -- 172.21.15.29:0/2267282304 wait complete. 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69eb368700 1 Processor -- start 2023-12-05T13:18:32.508 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69eb368700 1 -- start start 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69eb368700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e41133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69eb368700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41138e0 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69e9104700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e41133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69e9104700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e41133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47594/0 (socket says 172.21.15.29:47594) 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.933+0000 7f69e9104700 1 -- 172.21.15.29:0/2875426072 learned_addr learned my addr 172.21.15.29:0/2875426072 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69e9104700 1 -- 172.21.15.29:0/2875426072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00094f0 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69e9104700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e41133a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f69e0011b60 tx=0x7f69e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e0010850 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69e0010e60 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69e00243f0 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4113ae0 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.934+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4113ef0 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.935+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f69e001a780 con 0x7f69e4100950 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.935+0000 7f69d5ffb700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f69d0036670 0x7f69d0038b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:32.509 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.935+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f69e004a6c0 con 0x7f69e4100950 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.935+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e404bb80 con 0x7f69e4100950 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.936+0000 7f69e8903700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f69d0036670 0x7f69d0038b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.936+0000 7f69e8903700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f69d0036670 0x7f69d0038b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009990 tx=0x7f69d8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:31.940+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f69e00109b0 con 0x7f69e4100950 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.142+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f69e4101ea0 con 0x7f69e4100950 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.142+0000 7f69d5ffb700 1 -- 172.21.15.29:0/2875426072 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f69e002c340 con 0x7f69e4100950 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.144+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f69d0036670 msgr2=0x7f69d0038b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.144+0000 7f69eb368700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f69d0036670 0x7f69d0038b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009990 tx=0x7f69d8006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.144+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 msgr2=0x7f69e41133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e41133a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f69e0011b60 tx=0x7f69e0009250 comp rx=0 tx=0).stop 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 shutdown_connections 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f69d0036670 0x7f69d0038b20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:32.510 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 --2- 172.21.15.29:0/2875426072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69e4100950 0x7f69e41133a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:32.511 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 >> 172.21.15.29:0/2875426072 conn(0x7f69e40fc0b0 msgr2=0x7f69e41036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:32.511 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 shutdown_connections 2023-12-05T13:18:32.511 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.145+0000 7f69eb368700 1 -- 172.21.15.29:0/2875426072 wait complete. 2023-12-05T13:18:32.516 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T13:18:32.516 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2023-12-05T13:18:32.524 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T13:18:32.524 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2023-12-05T13:18:32.524 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2023-12-05T13:18:32.524 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-05T13:18:32.526 INFO:teuthology.orchestra.run.smithi029.stdout:Ceph Dashboard is now available at: 2023-12-05T13:18:32.526 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:32.526 INFO:teuthology.orchestra.run.smithi029.stdout: URL: https://smithi029.front.sepia.ceph.com:8443/ 2023-12-05T13:18:32.526 INFO:teuthology.orchestra.run.smithi029.stdout: User: admin 2023-12-05T13:18:32.526 INFO:teuthology.orchestra.run.smithi029.stdout: Password: 2s87w4v1ps 2023-12-05T13:18:32.526 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:32.527 INFO:teuthology.orchestra.run.smithi029.stdout:Saving cluster configuration to /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config directory 2023-12-05T13:18:32.527 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling autotune for osd_memory_target 2023-12-05T13:18:33.146 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:32 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2875426072' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.909+0000 7fc618c22700 1 Processor -- start 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.909+0000 7fc618c22700 1 -- start start 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.909+0000 7fc618c22700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614101bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.909+0000 7fc618c22700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614102130 con 0x7fc6141017e0 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.909+0000 7fc61259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614101bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.909+0000 7fc61259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614101bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47610/0 (socket says 172.21.15.29:47610) 2023-12-05T13:18:33.474 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.910+0000 7fc61259c700 1 -- 172.21.15.29:0/518137183 learned_addr learned my addr 172.21.15.29:0/518137183 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.910+0000 7fc61259c700 1 -- 172.21.15.29:0/518137183 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614102270 con 0x7fc6141017e0 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.910+0000 7fc61259c700 1 --2- 172.21.15.29:0/518137183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614101bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098e0 tx=0x7fc604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec0f64c41d1cfd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.910+0000 7fc61159a700 1 -- 172.21.15.29:0/518137183 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60400b860 con 0x7fc6141017e0 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.910+0000 7fc61159a700 1 -- 172.21.15.29:0/518137183 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc60400be70 con 0x7fc6141017e0 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.910+0000 7fc61159a700 1 -- 172.21.15.29:0/518137183 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc604010380 con 0x7fc6141017e0 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 -- 172.21.15.29:0/518137183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 msgr2=0x7fc614101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 --2- 172.21.15.29:0/518137183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614101bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6040098e0 tx=0x7fc604009250 comp rx=0 tx=0).stop 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 -- 172.21.15.29:0/518137183 shutdown_connections 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 --2- 172.21.15.29:0/518137183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614101bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 -- 172.21.15.29:0/518137183 >> 172.21.15.29:0/518137183 conn(0x7fc6140fc0b0 msgr2=0x7fc6140fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 -- 172.21.15.29:0/518137183 shutdown_connections 2023-12-05T13:18:33.475 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.911+0000 7fc618c22700 1 -- 172.21.15.29:0/518137183 wait complete. 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc618c22700 1 Processor -- start 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc618c22700 1 -- start start 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc618c22700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc618c22700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141116b0 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc61259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc61259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47612/0 (socket says 172.21.15.29:47612) 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc61259c700 1 -- 172.21.15.29:0/1983410283 learned_addr learned my addr 172.21.15.29:0/1983410283 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc61259c700 1 -- 172.21.15.29:0/1983410283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040094f0 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.912+0000 7fc61259c700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614111170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc604011b60 tx=0x7fc604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.913+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc604010850 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.913+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc604010e60 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.913+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc60401ae20 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.913+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6141118b0 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.913+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc614111cc0 con 0x7fc6141017e0 2023-12-05T13:18:33.476 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.913+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fc6040109b0 con 0x7fc6141017e0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.914+0000 7fc602ffd700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc5fc036690 0x7fc5fc038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.914+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61404bb80 con 0x7fc6141017e0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.914+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc60404a2f0 con 0x7fc6141017e0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.916+0000 7fc611d9b700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc5fc036690 0x7fc5fc038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.916+0000 7fc611d9b700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc5fc036690 0x7fc5fc038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc608009990 tx=0x7fc608006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:32.919+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc60402b670 con 0x7fc6141017e0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.118+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fc614102fa0 con 0x7fc6141017e0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.118+0000 7fc602ffd700 1 -- 172.21.15.29:0/1983410283 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc60402b880 con 0x7fc6141017e0 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.120+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc5fc036690 msgr2=0x7fc5fc038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.120+0000 7fc618c22700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc5fc036690 0x7fc5fc038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc608009990 tx=0x7fc608006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.120+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 msgr2=0x7fc614111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.120+0000 7fc618c22700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614111170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc604011b60 tx=0x7fc604009250 comp rx=0 tx=0).stop 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.121+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 shutdown_connections 2023-12-05T13:18:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.121+0000 7fc618c22700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc5fc036690 0x7fc5fc038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:33.478 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.121+0000 7fc618c22700 1 --2- 172.21.15.29:0/1983410283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc6141017e0 0x7fc614111170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:33.478 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.121+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 >> 172.21.15.29:0/1983410283 conn(0x7fc6140fc0b0 msgr2=0x7fc6140fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:33.478 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.121+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 shutdown_connections 2023-12-05T13:18:33.478 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.121+0000 7fc618c22700 1 -- 172.21.15.29:0/1983410283 wait complete. 2023-12-05T13:18:34.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.909+0000 7f1c874ab700 1 Processor -- start 2023-12-05T13:18:34.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.909+0000 7f1c874ab700 1 -- start start 2023-12-05T13:18:34.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.909+0000 7f1c874ab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c801015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.909+0000 7f1c874ab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80101b10 con 0x7f1c801011c0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c85247700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c801015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c85247700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c801015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47614/0 (socket says 172.21.15.29:47614) 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c85247700 1 -- 172.21.15.29:0/3366914996 learned_addr learned my addr 172.21.15.29:0/3366914996 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c85247700 1 -- 172.21.15.29:0/3366914996 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80101c50 con 0x7f1c801011c0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c85247700 1 --2- 172.21.15.29:0/3366914996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c801015d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c700098e0 tx=0x7f1c70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645fb5b1fda64aa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c77fff700 1 -- 172.21.15.29:0/3366914996 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c7000b860 con 0x7f1c801011c0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c77fff700 1 -- 172.21.15.29:0/3366914996 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c7000be70 con 0x7f1c801011c0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.910+0000 7f1c77fff700 1 -- 172.21.15.29:0/3366914996 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c70010380 con 0x7f1c801011c0 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 -- 172.21.15.29:0/3366914996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 msgr2=0x7f1c801015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 --2- 172.21.15.29:0/3366914996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c801015d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c700098e0 tx=0x7f1c70009250 comp rx=0 tx=0).stop 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 -- 172.21.15.29:0/3366914996 shutdown_connections 2023-12-05T13:18:34.617 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 --2- 172.21.15.29:0/3366914996 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c801015d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 -- 172.21.15.29:0/3366914996 >> 172.21.15.29:0/3366914996 conn(0x7f1c800fc980 msgr2=0x7f1c800fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 -- 172.21.15.29:0/3366914996 shutdown_connections 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.911+0000 7f1c874ab700 1 -- 172.21.15.29:0/3366914996 wait complete. 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c874ab700 1 Processor -- start 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c874ab700 1 -- start start 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c874ab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c80113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c874ab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80076c10 con 0x7f1c801011c0 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c85247700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c80113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c85247700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c80113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47626/0 (socket says 172.21.15.29:47626) 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.912+0000 7f1c85247700 1 -- 172.21.15.29:0/46791909 learned_addr learned my addr 172.21.15.29:0/46791909 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c85247700 1 -- 172.21.15.29:0/46791909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700094f0 con 0x7f1c801011c0 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c85247700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c80113e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c70011b60 tx=0x7f1c70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:34.618 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c70010850 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c70010e60 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c80076e10 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c7001ae20 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.913+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c80114580 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.914+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f1c700109b0 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.914+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8010a080 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.914+0000 7f1c75ffb700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1c6c036730 0x7f1c6c038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.914+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1c7004a470 con 0x7f1c801011c0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.915+0000 7f1c84a46700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1c6c036730 0x7f1c6c038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:34.619 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.915+0000 7f1c84a46700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1c6c036730 0x7f1c6c038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009990 tx=0x7f1c7c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:33.919+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1c7002d3f0 con 0x7f1c801011c0 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.232+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f1c8004bb80 con 0x7f1c801011c0 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.235+0000 7f1c75ffb700 1 -- 172.21.15.29:0/46791909 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1c7002d3f0 con 0x7f1c801011c0 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1c6c036730 msgr2=0x7f1c6c038be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1c6c036730 0x7f1c6c038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009990 tx=0x7f1c7c006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 msgr2=0x7f1c80113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c80113e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c70011b60 tx=0x7f1c70009250 comp rx=0 tx=0).stop 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 shutdown_connections 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1c6c036730 0x7f1c6c038be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 --2- 172.21.15.29:0/46791909 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c801011c0 0x7f1c80113e80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 >> 172.21.15.29:0/46791909 conn(0x7f1c800fc980 msgr2=0x7f1c800fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 shutdown_connections 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2023-12-05T13:18:34.237+0000 7f1c874ab700 1 -- 172.21.15.29:0/46791909 wait complete. 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-05T13:18:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout:Or, if you are only running a single cluster on this host: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: ceph telemetry on 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout:For more information see: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-05T13:18:34.621 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:34.622 INFO:teuthology.orchestra.run.smithi029.stdout:Bootstrap complete. 2023-12-05T13:18:34.659 INFO:tasks.cephadm:Fetching config... 2023-12-05T13:18:34.660 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:18:34.660 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-05T13:18:34.723 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-05T13:18:34.723 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:18:34.724 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-05T13:18:34.783 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-05T13:18:34.784 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:18:34.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/keyring of=/dev/stdout 2023-12-05T13:18:34.859 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-05T13:18:34.860 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:18:34.860 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-05T13:18:34.921 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-05T13:18:34.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaQPYjoHwS0I8LF/fVobYDIxmupgizDaeUJ/qhtnKzUk+VaxadKHaqvWzC3fUEm7t9vNZHfWNU0Ex+EZJYGJdhU4kcnrMDbXKzEC9tQ5uIfnbUzVMjEpXV57l1RheznTlJtGRJKHc5FHIqcbfyfeUFcrSu0pu5T5izpc6J7qBnkCJ65tssthpH6fqFj0M2H6qKxEwgmNX0iE2MRp0ry8YGKVU3l6mQCrK+IDM7QLmw3W2tnQZuWk4FFk7B0y1Frqa05NpxRQu9BRxekCUg6WSakaWvhyrgoAL1WieGvv2RX4ycj2r+uQYTgzn8ujo5xmkr8p53pStkwY9hRxZVCzl+I+LWjN2daqu1olozaFxKSO7PKsrq4vEpQK3j1k25yifMB+s+Na8BQ7211vBtOW+H4skeH5+36fnoYK/KxDLCgQXsIiO7hAZKkTsNhewUDVa0M/XSOX/74XE+k0ydc2pP+yzdPvI59h6QPN1av0JxSoihti4AQks2BdlPBh7inD8= ceph-34f4f484-9370-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-05T13:18:35.004 INFO:teuthology.orchestra.run.smithi029.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaQPYjoHwS0I8LF/fVobYDIxmupgizDaeUJ/qhtnKzUk+VaxadKHaqvWzC3fUEm7t9vNZHfWNU0Ex+EZJYGJdhU4kcnrMDbXKzEC9tQ5uIfnbUzVMjEpXV57l1RheznTlJtGRJKHc5FHIqcbfyfeUFcrSu0pu5T5izpc6J7qBnkCJ65tssthpH6fqFj0M2H6qKxEwgmNX0iE2MRp0ry8YGKVU3l6mQCrK+IDM7QLmw3W2tnQZuWk4FFk7B0y1Frqa05NpxRQu9BRxekCUg6WSakaWvhyrgoAL1WieGvv2RX4ycj2r+uQYTgzn8ujo5xmkr8p53pStkwY9hRxZVCzl+I+LWjN2daqu1olozaFxKSO7PKsrq4vEpQK3j1k25yifMB+s+Na8BQ7211vBtOW+H4skeH5+36fnoYK/KxDLCgQXsIiO7hAZKkTsNhewUDVa0M/XSOX/74XE+k0ydc2pP+yzdPvI59h6QPN1av0JxSoihti4AQks2BdlPBh7inD8= ceph-34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:18:35.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaQPYjoHwS0I8LF/fVobYDIxmupgizDaeUJ/qhtnKzUk+VaxadKHaqvWzC3fUEm7t9vNZHfWNU0Ex+EZJYGJdhU4kcnrMDbXKzEC9tQ5uIfnbUzVMjEpXV57l1RheznTlJtGRJKHc5FHIqcbfyfeUFcrSu0pu5T5izpc6J7qBnkCJ65tssthpH6fqFj0M2H6qKxEwgmNX0iE2MRp0ry8YGKVU3l6mQCrK+IDM7QLmw3W2tnQZuWk4FFk7B0y1Frqa05NpxRQu9BRxekCUg6WSakaWvhyrgoAL1WieGvv2RX4ycj2r+uQYTgzn8ujo5xmkr8p53pStkwY9hRxZVCzl+I+LWjN2daqu1olozaFxKSO7PKsrq4vEpQK3j1k25yifMB+s+Na8BQ7211vBtOW+H4skeH5+36fnoYK/KxDLCgQXsIiO7hAZKkTsNhewUDVa0M/XSOX/74XE+k0ydc2pP+yzdPvI59h6QPN1av0JxSoihti4AQks2BdlPBh7inD8= ceph-34f4f484-9370-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-05T13:18:35.064 INFO:teuthology.orchestra.run.smithi052.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaQPYjoHwS0I8LF/fVobYDIxmupgizDaeUJ/qhtnKzUk+VaxadKHaqvWzC3fUEm7t9vNZHfWNU0Ex+EZJYGJdhU4kcnrMDbXKzEC9tQ5uIfnbUzVMjEpXV57l1RheznTlJtGRJKHc5FHIqcbfyfeUFcrSu0pu5T5izpc6J7qBnkCJ65tssthpH6fqFj0M2H6qKxEwgmNX0iE2MRp0ry8YGKVU3l6mQCrK+IDM7QLmw3W2tnQZuWk4FFk7B0y1Frqa05NpxRQu9BRxekCUg6WSakaWvhyrgoAL1WieGvv2RX4ycj2r+uQYTgzn8ujo5xmkr8p53pStkwY9hRxZVCzl+I+LWjN2daqu1olozaFxKSO7PKsrq4vEpQK3j1k25yifMB+s+Na8BQ7211vBtOW+H4skeH5+36fnoYK/KxDLCgQXsIiO7hAZKkTsNhewUDVa0M/XSOX/74XE+k0ydc2pP+yzdPvI59h6QPN1av0JxSoihti4AQks2BdlPBh7inD8= ceph-34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:18:35.077 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-05T13:18:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:34 smithi029 ceph-mon[112128]: mgrmap e13: smithi029.eekhlu(active, since 6s) 2023-12-05T13:18:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:34 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/46791909' entity='client.admin' 2023-12-05T13:18:35.367 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 -- 172.21.15.29:0/3479967659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 msgr2=0x7f76540fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 --2- 172.21.15.29:0/3479967659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f76540fbb90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f76500048c0 tx=0x7f7650009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 -- 172.21.15.29:0/3479967659 shutdown_connections 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 --2- 172.21.15.29:0/3479967659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f76540fbb90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 -- 172.21.15.29:0/3479967659 >> 172.21.15.29:0/3479967659 conn(0x7f76540f6e40 msgr2=0x7f76540f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 -- 172.21.15.29:0/3479967659 shutdown_connections 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.888+0000 7f765b566700 1 -- 172.21.15.29:0/3479967659 wait complete. 2023-12-05T13:18:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f765b566700 1 Processor -- start 2023-12-05T13:18:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f765b566700 1 -- start start 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f765b566700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f765410b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f765b566700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765410bee0 con 0x7f76540fb780 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f7659302700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f765410b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f7659302700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f765410b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47642/0 (socket says 172.21.15.29:47642) 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.889+0000 7f7659302700 1 -- 172.21.15.29:0/233397391 learned_addr learned my addr 172.21.15.29:0/233397391 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f7659302700 1 -- 172.21.15.29:0/233397391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650005040 con 0x7f76540fb780 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f7659302700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f765410b9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7650000c00 tx=0x7f7650009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76500097f0 con 0x7f76540fb780 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f765001e8d0 con 0x7f76540fb780 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765410c0e0 con 0x7f76540fb780 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76500137e0 con 0x7f76540fb780 2023-12-05T13:18:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.890+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765410cd80 con 0x7f76540fb780 2023-12-05T13:18:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.891+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f7650013940 con 0x7f76540fb780 2023-12-05T13:18:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.891+0000 7f7649ffb700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f7640036720 0x7f7640038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.891+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f765004c380 con 0x7f76540fb780 2023-12-05T13:18:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.892+0000 7f7658b01700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f7640036720 0x7f7640038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.892+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765410c570 con 0x7f76540fb780 2023-12-05T13:18:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.892+0000 7f7658b01700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f7640036720 0x7f7640038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7644009990 tx=0x7f7644006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:36.898 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:36.897+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f76500273c0 con 0x7f76540fb780 2023-12-05T13:18:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.099+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f765405f270 con 0x7f76540fb780 2023-12-05T13:18:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.102+0000 7f7649ffb700 1 -- 172.21.15.29:0/233397391 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7650011370 con 0x7f76540fb780 2023-12-05T13:18:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f7640036720 msgr2=0x7f7640038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f7640036720 0x7f7640038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7644009990 tx=0x7f7644006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 msgr2=0x7f765410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f765410b9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7650000c00 tx=0x7f7650009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 shutdown_connections 2023-12-05T13:18:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f7640036720 0x7f7640038bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 --2- 172.21.15.29:0/233397391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76540fb780 0x7f765410b9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 >> 172.21.15.29:0/233397391 conn(0x7f76540f6e40 msgr2=0x7f76540f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 shutdown_connections 2023-12-05T13:18:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:37.105+0000 7f765b566700 1 -- 172.21.15.29:0/233397391 wait complete. 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd/host:smithi029", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: Deploying daemon crash.smithi029 on smithi029 2023-12-05T13:18:37.398 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:37 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/233397391' entity='client.admin' 2023-12-05T13:18:37.511 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-05T13:18:37.511 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-05T13:18:38.060 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:18:39.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 -- 172.21.15.29:0/4230181188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 msgr2=0x7fda540faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:39.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 --2- 172.21.15.29:0/4230181188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda540faf40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda440048c0 tx=0x7fda44009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 -- 172.21.15.29:0/4230181188 shutdown_connections 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 --2- 172.21.15.29:0/4230181188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda540faf40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 -- 172.21.15.29:0/4230181188 >> 172.21.15.29:0/4230181188 conn(0x7fda540f65d0 msgr2=0x7fda540f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 -- 172.21.15.29:0/4230181188 shutdown_connections 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.697+0000 7fda59fac700 1 -- 172.21.15.29:0/4230181188 wait complete. 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.698+0000 7fda59fac700 1 Processor -- start 2023-12-05T13:18:39.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.698+0000 7fda59fac700 1 -- start start 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda59fac700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda5410ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda59fac700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5410cf70 con 0x7fda540fab30 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda537fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda5410ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda537fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda5410ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41972/0 (socket says 172.21.15.29:41972) 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda537fe700 1 -- 172.21.15.29:0/3177603938 learned_addr learned my addr 172.21.15.29:0/3177603938 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda537fe700 1 -- 172.21.15.29:0/3177603938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44005040 con 0x7fda540fab30 2023-12-05T13:18:39.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda537fe700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda5410ca30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda4400b690 tx=0x7fda44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:39.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda44009650 con 0x7fda540fab30 2023-12-05T13:18:39.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda440097b0 con 0x7fda540fab30 2023-12-05T13:18:39.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.699+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5410d170 con 0x7fda540fab30 2023-12-05T13:18:39.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.700+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda4401c5b0 con 0x7fda540fab30 2023-12-05T13:18:39.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.700+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5410de10 con 0x7fda540fab30 2023-12-05T13:18:39.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.700+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fda4401c820 con 0x7fda540fab30 2023-12-05T13:18:39.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.701+0000 7fda3bfff700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fda3c036720 0x7fda3c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:39.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.701+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fda4404a7e0 con 0x7fda540fab30 2023-12-05T13:18:39.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.701+0000 7fda52ffd700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fda3c036720 0x7fda3c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:39.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.701+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5405f270 con 0x7fda540fab30 2023-12-05T13:18:39.703 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.701+0000 7fda52ffd700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fda3c036720 0x7fda3c038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda48009990 tx=0x7fda48006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:39.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.706+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fda44023300 con 0x7fda540fab30 2023-12-05T13:18:39.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.925+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fda5410e890 con 0x7fda3c036720 2023-12-05T13:18:39.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.928+0000 7fda3bfff700 1 -- 172.21.15.29:0/3177603938 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fda5410e890 con 0x7fda3c036720 2023-12-05T13:18:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fda3c036720 msgr2=0x7fda3c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fda3c036720 0x7fda3c038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda48009990 tx=0x7fda48006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 msgr2=0x7fda5410ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda5410ca30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda4400b690 tx=0x7fda44009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:39.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 shutdown_connections 2023-12-05T13:18:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fda3c036720 0x7fda3c038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 --2- 172.21.15.29:0/3177603938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540fab30 0x7fda5410ca30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 >> 172.21.15.29:0/3177603938 conn(0x7fda540f65d0 msgr2=0x7fda540f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 shutdown_connections 2023-12-05T13:18:39.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:39.931+0000 7fda59fac700 1 -- 172.21.15.29:0/3177603938 wait complete. 2023-12-05T13:18:40.463 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi052 2023-12-05T13:18:40.463 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:18:40.463 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.conf 2023-12-05T13:18:40.487 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:18:40.487 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:18:40.550 INFO:tasks.cephadm:Adding host smithi052 to orchestrator... 2023-12-05T13:18:40.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch host add smithi052 2023-12-05T13:18:40.925 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:18:41.066 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:41.066 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:41.066 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:41.066 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:41.067 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:41.067 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:41.067 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:40 smithi029 ceph-mon[112128]: Deploying daemon node-exporter.smithi029 on smithi029 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.122+0000 7f2c38b4e700 1 -- 172.21.15.29:0/3426378687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 msgr2=0x7f2c340ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.122+0000 7f2c38b4e700 1 --2- 172.21.15.29:0/3426378687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c340ff430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c240048c0 tx=0x7f2c24009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 -- 172.21.15.29:0/3426378687 shutdown_connections 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 --2- 172.21.15.29:0/3426378687 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c340ff430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 -- 172.21.15.29:0/3426378687 >> 172.21.15.29:0/3426378687 conn(0x7f2c340f6e40 msgr2=0x7f2c340f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 -- 172.21.15.29:0/3426378687 shutdown_connections 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 -- 172.21.15.29:0/3426378687 wait complete. 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 Processor -- start 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 -- start start 2023-12-05T13:18:42.126 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c3410ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.123+0000 7f2c38b4e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3410cfa0 con 0x7f2c34065aa0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c3259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c3410ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c3259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c3410ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41998/0 (socket says 172.21.15.29:41998) 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c3259c700 1 -- 172.21.15.29:0/422574727 learned_addr learned my addr 172.21.15.29:0/422574727 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c3259c700 1 -- 172.21.15.29:0/422574727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24005040 con 0x7f2c34065aa0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c3259c700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c3410ca60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400b690 tx=0x7f2c24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c24009650 con 0x7f2c34065aa0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c240097b0 con 0x7f2c34065aa0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3410d1a0 con 0x7f2c34065aa0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c2401c5b0 con 0x7f2c34065aa0 2023-12-05T13:18:42.127 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.124+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3410de40 con 0x7f2c34065aa0 2023-12-05T13:18:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.125+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f2c2401c820 con 0x7f2c34065aa0 2023-12-05T13:18:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.125+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3405f270 con 0x7f2c34065aa0 2023-12-05T13:18:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.125+0000 7f2c2affd700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2c20036720 0x7f2c20038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.126+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2c24049930 con 0x7f2c34065aa0 2023-12-05T13:18:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.126+0000 7f2c31d9b700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2c20036720 0x7f2c20038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:42.128 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.126+0000 7f2c31d9b700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2c20036720 0x7f2c20038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009990 tx=0x7f2c1c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:42.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.131+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2c24023300 con 0x7f2c34065aa0 2023-12-05T13:18:42.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:42.363+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi052", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c3410ea00 con 0x7f2c20036720 2023-12-05T13:18:43.574 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:43 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:43.575 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:43 smithi029 ceph-mon[112128]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi052", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:44.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.301+0000 7f2c2affd700 1 -- 172.21.15.29:0/422574727 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f2c3410ea00 con 0x7f2c20036720 2023-12-05T13:18:44.302 INFO:teuthology.orchestra.run.smithi029.stdout:Added host 'smithi052' with addr '172.21.15.52' 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2c20036720 msgr2=0x7f2c20038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2c20036720 0x7f2c20038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009990 tx=0x7f2c1c006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 msgr2=0x7f2c3410ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c3410ca60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400b690 tx=0x7f2c24009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 shutdown_connections 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f2c20036720 0x7f2c20038bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 --2- 172.21.15.29:0/422574727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c34065aa0 0x7f2c3410ca60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.303+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 >> 172.21.15.29:0/422574727 conn(0x7f2c340f6e40 msgr2=0x7f2c340f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.304+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 shutdown_connections 2023-12-05T13:18:44.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:44.304+0000 7f2c38b4e700 1 -- 172.21.15.29:0/422574727 wait complete. 2023-12-05T13:18:44.687 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-05T13:18:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: Deploying cephadm binary to smithi052 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: Deploying daemon alertmanager.smithi029 on smithi029 2023-12-05T13:18:45.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:44 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:46.194 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:45 smithi029 ceph-mon[112128]: Added host smithi052 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 -- 172.21.15.29:0/3265043730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 msgr2=0x7f6b200faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 --2- 172.21.15.29:0/3265043730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b200faf40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0048c0 tx=0x7f6b1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 -- 172.21.15.29:0/3265043730 shutdown_connections 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 --2- 172.21.15.29:0/3265043730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b200faf40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 -- 172.21.15.29:0/3265043730 >> 172.21.15.29:0/3265043730 conn(0x7f6b200f65d0 msgr2=0x7f6b200f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 -- 172.21.15.29:0/3265043730 shutdown_connections 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 -- 172.21.15.29:0/3265043730 wait complete. 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 Processor -- start 2023-12-05T13:18:46.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.736+0000 7f6b280d9700 1 -- start start 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b280d9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b2010ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b280d9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2010cf90 con 0x7f6b200fab30 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b25e75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b2010ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b25e75700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b2010ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42020/0 (socket says 172.21.15.29:42020) 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b25e75700 1 -- 172.21.15.29:0/3361030508 learned_addr learned my addr 172.21.15.29:0/3361030508 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b25e75700 1 -- 172.21.15.29:0/3361030508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c005040 con 0x7f6b200fab30 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b25e75700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b2010ca50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009040 tx=0x7f6b1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b1c009650 con 0x7f6b200fab30 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b1c0097b0 con 0x7f6b200fab30 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2010d190 con 0x7f6b200fab30 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b1c01c5b0 con 0x7f6b200fab30 2023-12-05T13:18:46.740 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.737+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2010de30 con 0x7f6b200fab30 2023-12-05T13:18:46.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.738+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f6b1c013420 con 0x7f6b200fab30 2023-12-05T13:18:46.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.738+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2005f270 con 0x7f6b200fab30 2023-12-05T13:18:46.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.738+0000 7f6b167fc700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f6b0c0366d0 0x7f6b0c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:46.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.739+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6b1c049930 con 0x7f6b200fab30 2023-12-05T13:18:46.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.739+0000 7f6b25674700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f6b0c0366d0 0x7f6b0c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:46.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.739+0000 7f6b25674700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f6b0c0366d0 0x7f6b0c038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009990 tx=0x7f6b10006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:46.745 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.744+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6b1c0139d0 con 0x7f6b200fab30 2023-12-05T13:18:46.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.955+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b2010e9f0 con 0x7f6b0c0366d0 2023-12-05T13:18:46.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.956+0000 7f6b167fc700 1 -- 172.21.15.29:0/3361030508 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f6b2010e9f0 con 0x7f6b0c0366d0 2023-12-05T13:18:46.958 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:18:46.958 INFO:teuthology.orchestra.run.smithi029.stdout:[{"addr": "172.21.15.29", "hostname": "smithi029", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}] 2023-12-05T13:18:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f6b0c0366d0 msgr2=0x7f6b0c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f6b0c0366d0 0x7f6b0c038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009990 tx=0x7f6b10006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 msgr2=0x7f6b2010ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b2010ca50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009040 tx=0x7f6b1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 shutdown_connections 2023-12-05T13:18:46.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f6b0c0366d0 0x7f6b0c038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 --2- 172.21.15.29:0/3361030508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b200fab30 0x7f6b2010ca50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 >> 172.21.15.29:0/3361030508 conn(0x7f6b200f65d0 msgr2=0x7f6b200f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 shutdown_connections 2023-12-05T13:18:46.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:46.959+0000 7f6b280d9700 1 -- 172.21.15.29:0/3361030508 wait complete. 2023-12-05T13:18:47.584 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-05T13:18:47.584 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-05T13:18:47.962 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:18:48.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:48 smithi029 ceph-mon[112128]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T13:18:48.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:48 smithi029 ceph-mon[112128]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:18:48.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:48 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:49.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 -- 172.21.15.29:0/788991234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 msgr2=0x7ff6c00ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 --2- 172.21.15.29:0/788991234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00ff7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00048c0 tx=0x7ff6b0009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 -- 172.21.15.29:0/788991234 shutdown_connections 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 --2- 172.21.15.29:0/788991234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00ff7a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 -- 172.21.15.29:0/788991234 >> 172.21.15.29:0/788991234 conn(0x7ff6c00f6e40 msgr2=0x7ff6c00f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 -- 172.21.15.29:0/788991234 shutdown_connections 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.434+0000 7ff6c4deb700 1 -- 172.21.15.29:0/788991234 wait complete. 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6c4deb700 1 Processor -- start 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6c4deb700 1 -- start start 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6c4deb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6c4deb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00fb2d0 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6be59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6be59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49182/0 (socket says 172.21.15.29:49182) 2023-12-05T13:18:49.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.435+0000 7ff6be59c700 1 -- 172.21.15.29:0/2810649990 learned_addr learned my addr 172.21.15.29:0/2810649990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:18:49.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6be59c700 1 -- 172.21.15.29:0/2810649990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0005040 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6be59c700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00fce50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009040 tx=0x7ff6b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6b0009620 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff6b0009780 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c00fb4d0 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6b001c5b0 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.436+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c00fb9c0 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.437+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff6b001c820 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.437+0000 7ff6aeffd700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7ff6a8036720 0x7ff6a8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:49.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.437+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff6b0049800 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.437+0000 7ff6bdd9b700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7ff6a8036720 0x7ff6a8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:49.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.437+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0106510 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.438+0000 7ff6bdd9b700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7ff6a8036720 0x7ff6a8038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009990 tx=0x7ff6b4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:49.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.442+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff6b0023300 con 0x7ff6c00fd3c0 2023-12-05T13:18:49.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:49.657+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff6c0102690 con 0x7ff6c00fd3c0 2023-12-05T13:18:50.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.303+0000 7ff6aeffd700 1 -- 172.21.15.29:0/2810649990 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff6c0102690 con 0x7ff6c00fd3c0 2023-12-05T13:18:50.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7ff6a8036720 msgr2=0x7ff6a8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7ff6a8036720 0x7ff6a8038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009990 tx=0x7ff6b4006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 msgr2=0x7ff6c00fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00fce50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009040 tx=0x7ff6b0009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 shutdown_connections 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7ff6a8036720 0x7ff6a8038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 --2- 172.21.15.29:0/2810649990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6c00fd3c0 0x7ff6c00fce50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 >> 172.21.15.29:0/2810649990 conn(0x7ff6c00f6e40 msgr2=0x7ff6c00f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 shutdown_connections 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:18:50.305+0000 7ff6c4deb700 1 -- 172.21.15.29:0/2810649990 wait complete. 2023-12-05T13:18:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2023-12-05T13:18:50.493 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:50 smithi029 ceph-mon[112128]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:18:50.494 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:50 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2810649990' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-05T13:18:50.666 INFO:tasks.cephadm:Adding mon.smithi029 on smithi029 2023-12-05T13:18:50.666 INFO:tasks.cephadm:Adding mon.smithi052 on smithi052 2023-12-05T13:18:50.667 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch apply mon '2;smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052' 2023-12-05T13:18:50.988 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2810649990' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: osdmap e4: 0 total, 0 up, 0 in 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:51.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T13:18:51.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:51 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.273+0000 7f8d987fc700 1 -- 172.21.15.52:0/2702318693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 msgr2=0x7f8d900fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.273+0000 7f8d987fc700 1 --2- 172.21.15.52:0/2702318693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d900fbb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d800048c0 tx=0x7f8d80009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:52.275 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 -- 172.21.15.52:0/2702318693 shutdown_connections 2023-12-05T13:18:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 --2- 172.21.15.52:0/2702318693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d900fbb80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 -- 172.21.15.52:0/2702318693 >> 172.21.15.52:0/2702318693 conn(0x7f8d900f6e50 msgr2=0x7f8d900f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 -- 172.21.15.52:0/2702318693 shutdown_connections 2023-12-05T13:18:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 -- 172.21.15.52:0/2702318693 wait complete. 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 Processor -- start 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.274+0000 7f8d987fc700 1 -- start start 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d987fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d9010b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d987fc700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9010bec0 con 0x7f8d900fb770 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d96598700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d9010b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d96598700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d9010b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:44632/0 (socket says 172.21.15.52:44632) 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d96598700 1 -- 172.21.15.52:0/2928837528 learned_addr learned my addr 172.21.15.52:0/2928837528 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d96598700 1 -- 172.21.15.52:0/2928837528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80005040 con 0x7f8d900fb770 2023-12-05T13:18:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d96598700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d9010b980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009330 tx=0x7f8d80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.275+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d800096b0 con 0x7f8d900fb770 2023-12-05T13:18:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.276+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9010c0c0 con 0x7f8d900fb770 2023-12-05T13:18:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.276+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d80009810 con 0x7f8d900fb770 2023-12-05T13:18:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.276+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d8001c5b0 con 0x7f8d900fb770 2023-12-05T13:18:52.278 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.276+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9010cd60 con 0x7f8d900fb770 2023-12-05T13:18:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.276+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8d80013420 con 0x7f8d900fb770 2023-12-05T13:18:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.276+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9005f270 con 0x7f8d900fb770 2023-12-05T13:18:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.277+0000 7f8d86ffd700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8d7c0366d0 0x7f8d7c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.277+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8d80049a90 con 0x7f8d900fb770 2023-12-05T13:18:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.277+0000 7f8d95d97700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8d7c0366d0 0x7f8d7c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.277+0000 7f8d95d97700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8d7c0366d0 0x7f8d7c038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009990 tx=0x7f8d8c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:52.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.282+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d800119c0 con 0x7f8d900fb770 2023-12-05T13:18:52.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.495+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 --> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d9010d9d0 con 0x7f8d7c0366d0 2023-12-05T13:18:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.502+0000 7f8d86ffd700 1 -- 172.21.15.52:0/2928837528 <== mgr.14162 v2:172.21.15.29:6800/525299250 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8d9010d9d0 con 0x7f8d7c0366d0 2023-12-05T13:18:52.504 INFO:teuthology.orchestra.run.smithi052.stdout:Scheduled mon update... 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8d7c0366d0 msgr2=0x7f8d7c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8d7c0366d0 0x7f8d7c038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009990 tx=0x7f8d8c006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 msgr2=0x7f8d9010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d9010b980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009330 tx=0x7f8d80009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 shutdown_connections 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f8d7c0366d0 0x7f8d7c038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:52.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 --2- 172.21.15.52:0/2928837528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d900fb770 0x7f8d9010b980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:52.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 >> 172.21.15.52:0/2928837528 conn(0x7f8d900f6e50 msgr2=0x7f8d900f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:52.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 shutdown_connections 2023-12-05T13:18:52.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:52.504+0000 7f8d987fc700 1 -- 172.21.15.52:0/2928837528 wait complete. 2023-12-05T13:18:52.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:52 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T13:18:52.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:52 smithi029 ceph-mon[112128]: Deploying daemon grafana.smithi029 on smithi029 2023-12-05T13:18:52.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:52 smithi029 ceph-mon[112128]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:18:52.882 DEBUG:teuthology.orchestra.run.smithi052:mon.smithi052> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi052.service 2023-12-05T13:18:52.885 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:18:52.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:18:52.922 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:-- Logs begin at Tue 2023-12-05 12:51:31 UTC. -- 2023-12-05T13:18:53.222 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:53.284 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:53.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:53 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:53.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:53 smithi029 ceph-mon[112128]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:18:53.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:53 smithi029 ceph-mon[112128]: Saving service mon spec with placement smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052;count:2 2023-12-05T13:18:53.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:53 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 -- 172.21.15.52:0/3067972699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 msgr2=0x7f19a80fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 --2- 172.21.15.52:0/3067972699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a80fbb90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19980048c0 tx=0x7f1998009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 -- 172.21.15.52:0/3067972699 shutdown_connections 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 --2- 172.21.15.52:0/3067972699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a80fbb90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 -- 172.21.15.52:0/3067972699 >> 172.21.15.52:0/3067972699 conn(0x7f19a80f6e40 msgr2=0x7f19a80f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 -- 172.21.15.52:0/3067972699 shutdown_connections 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 -- 172.21.15.52:0/3067972699 wait complete. 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.284+0000 7f19ae196700 1 Processor -- start 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19ae196700 1 -- start start 2023-12-05T13:18:54.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19ae196700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a810ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:54.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19ae196700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a810cfc0 con 0x7f19a80fb780 2023-12-05T13:18:54.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a810ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:54.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a810ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:44646/0 (socket says 172.21.15.52:44646) 2023-12-05T13:18:54.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19a77fe700 1 -- 172.21.15.52:0/3010347197 learned_addr learned my addr 172.21.15.52:0/3010347197 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:18:54.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.285+0000 7f19a77fe700 1 -- 172.21.15.52:0/3010347197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998005040 con 0x7f19a80fb780 2023-12-05T13:18:54.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.286+0000 7f19a77fe700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a810ca80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1998009330 tx=0x7f1998009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.286+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19980096b0 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.286+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1998009810 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.286+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a810d1c0 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.286+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f199801c5b0 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.286+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a810de60 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.287+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f1998013420 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.287+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a805f270 con 0x7f19a80fb780 2023-12-05T13:18:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.287+0000 7f198ffff700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1990036720 0x7f1990038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:54.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.287+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f19980499b0 con 0x7f19a80fb780 2023-12-05T13:18:54.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.287+0000 7f19a6ffd700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1990036720 0x7f1990038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:54.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.288+0000 7f19a6ffd700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1990036720 0x7f1990038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f199c009990 tx=0x7f199c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:54.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.292+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1998011db0 con 0x7f19a80fb780 2023-12-05T13:18:54.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.573+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f19a810e9b0 con 0x7f19a80fb780 2023-12-05T13:18:54.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.574+0000 7f198ffff700 1 -- 172.21.15.52:0/3010347197 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1998011370 con 0x7f19a80fb780 2023-12-05T13:18:54.575 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:18:54.576 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1990036720 msgr2=0x7f1990038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1990036720 0x7f1990038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f199c009990 tx=0x7f199c006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 msgr2=0x7f19a810ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a810ca80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1998009330 tx=0x7f1998009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 shutdown_connections 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f1990036720 0x7f1990038bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 --2- 172.21.15.52:0/3010347197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a80fb780 0x7f19a810ca80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:54.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 >> 172.21.15.52:0/3010347197 conn(0x7f19a80f6e40 msgr2=0x7f19a8065610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:54.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 shutdown_connections 2023-12-05T13:18:54.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:54.576+0000 7f19ae196700 1 -- 172.21.15.52:0/3010347197 wait complete. 2023-12-05T13:18:54.579 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:18:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:54 smithi029 ceph-mon[112128]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:18:55.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:55 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3010347197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:18:55.989 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:18:55.989 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:18:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:56 smithi029 ceph-mon[112128]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 -- 172.21.15.52:0/3925948560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 msgr2=0x7fd4840faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 --2- 172.21.15.52:0/3925948560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd4840faf40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4740048c0 tx=0x7fd474009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 -- 172.21.15.52:0/3925948560 shutdown_connections 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 --2- 172.21.15.52:0/3925948560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd4840faf40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 -- 172.21.15.52:0/3925948560 >> 172.21.15.52:0/3925948560 conn(0x7fd4840f65d0 msgr2=0x7fd4840f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 -- 172.21.15.52:0/3925948560 shutdown_connections 2023-12-05T13:18:57.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.376+0000 7fd488d2c700 1 -- 172.21.15.52:0/3925948560 wait complete. 2023-12-05T13:18:57.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd488d2c700 1 Processor -- start 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd488d2c700 1 -- start start 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd488d2c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd48410ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd488d2c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48410cf90 con 0x7fd4840fab30 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd48259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd48410ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd48259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd48410ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:44652/0 (socket says 172.21.15.52:44652) 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.377+0000 7fd48259c700 1 -- 172.21.15.52:0/667200588 learned_addr learned my addr 172.21.15.52:0/667200588 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd48259c700 1 -- 172.21.15.52:0/667200588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474005040 con 0x7fd4840fab30 2023-12-05T13:18:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd48259c700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd48410ca50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd474009040 tx=0x7fd474009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:57.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd474009650 con 0x7fd4840fab30 2023-12-05T13:18:57.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48410d190 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4740097b0 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd47401c5b0 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.378+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48410de30 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.379+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd474013420 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.379+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48405f270 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.379+0000 7fd472ffd700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd46c036720 0x7fd46c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.379+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd474049970 con 0x7fd4840fab30 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.380+0000 7fd481d9b700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd46c036720 0x7fd46c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:18:57.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.380+0000 7fd481d9b700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd46c036720 0x7fd46c038bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd478009990 tx=0x7fd478006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:18:57.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.386+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd474011550 con 0x7fd4840fab30 2023-12-05T13:18:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.673+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd48410e980 con 0x7fd4840fab30 2023-12-05T13:18:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.674+0000 7fd472ffd700 1 -- 172.21.15.52:0/667200588 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd474011370 con 0x7fd4840fab30 2023-12-05T13:18:57.675 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:18:57.675 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:18:57.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd46c036720 msgr2=0x7fd46c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd46c036720 0x7fd46c038bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd478009990 tx=0x7fd478006e40 comp rx=0 tx=0).stop 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 msgr2=0x7fd48410ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd48410ca50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd474009040 tx=0x7fd474009e30 comp rx=0 tx=0).stop 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 shutdown_connections 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd46c036720 0x7fd46c038bd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 --2- 172.21.15.52:0/667200588 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4840fab30 0x7fd48410ca50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 >> 172.21.15.52:0/667200588 conn(0x7fd4840f65d0 msgr2=0x7fd4840f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 shutdown_connections 2023-12-05T13:18:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:18:57.676+0000 7fd488d2c700 1 -- 172.21.15.52:0/667200588 wait complete. 2023-12-05T13:18:57.679 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:18:58.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:57 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/667200588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:18:59.054 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:18:59.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:18:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:18:58 smithi029 ceph-mon[112128]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:18:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:00.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 -- 172.21.15.52:0/933096729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 msgr2=0x7f89d40fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:00.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 --2- 172.21.15.52:0/933096729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d40fbb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f89d00048c0 tx=0x7f89d0009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:00.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 -- 172.21.15.52:0/933096729 shutdown_connections 2023-12-05T13:19:00.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 --2- 172.21.15.52:0/933096729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d40fbb90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:00.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 -- 172.21.15.52:0/933096729 >> 172.21.15.52:0/933096729 conn(0x7f89d40f6e40 msgr2=0x7f89d40f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 -- 172.21.15.52:0/933096729 shutdown_connections 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 -- 172.21.15.52:0/933096729 wait complete. 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.429+0000 7f89db3df700 1 Processor -- start 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89db3df700 1 -- start start 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89db3df700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d410cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89db3df700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d410cff0 con 0x7f89d40fb780 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89d917b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d410cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89d917b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d410cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:34290/0 (socket says 172.21.15.52:34290) 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89d917b700 1 -- 172.21.15.52:0/2329945426 learned_addr learned my addr 172.21.15.52:0/2329945426 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89d917b700 1 -- 172.21.15.52:0/2329945426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0005040 con 0x7f89d40fb780 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.430+0000 7f89d917b700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d410cab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009330 tx=0x7f89d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.431+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89d00096b0 con 0x7f89d40fb780 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.431+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89d0009810 con 0x7f89d40fb780 2023-12-05T13:19:00.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.431+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d410d1f0 con 0x7f89d40fb780 2023-12-05T13:19:00.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.431+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f89d001c5b0 con 0x7f89d40fb780 2023-12-05T13:19:00.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.431+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d410de90 con 0x7f89d40fb780 2023-12-05T13:19:00.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.432+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f89d0013420 con 0x7f89d40fb780 2023-12-05T13:19:00.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.432+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d405f270 con 0x7f89d40fb780 2023-12-05T13:19:00.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.432+0000 7f89c9ffb700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f89c0036720 0x7f89c0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:00.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.432+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f89d0049a70 con 0x7f89d40fb780 2023-12-05T13:19:00.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.432+0000 7f89d897a700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f89c0036720 0x7f89c0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:00.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.433+0000 7f89d897a700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f89c0036720 0x7f89c0038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009990 tx=0x7f89c4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:00.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.437+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f89d00119c0 con 0x7f89d40fb780 2023-12-05T13:19:00.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.717+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f89d410e230 con 0x7f89d40fb780 2023-12-05T13:19:00.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.719+0000 7f89c9ffb700 1 -- 172.21.15.52:0/2329945426 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f89d0011370 con 0x7f89d40fb780 2023-12-05T13:19:00.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:00.720 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f89c0036720 msgr2=0x7f89c0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f89c0036720 0x7f89c0038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009990 tx=0x7f89c4006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 msgr2=0x7f89d410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d410cab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009330 tx=0x7f89d0009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 shutdown_connections 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f89c0036720 0x7f89c0038bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 --2- 172.21.15.52:0/2329945426 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89d40fb780 0x7f89d410cab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 >> 172.21.15.52:0/2329945426 conn(0x7f89d40f6e40 msgr2=0x7f89d40f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 shutdown_connections 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:00.720+0000 7f89db3df700 1 -- 172.21.15.52:0/2329945426 wait complete. 2023-12-05T13:19:00.722 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:01.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:00 smithi029 ceph-mon[112128]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:01.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:00 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/2329945426' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:02.108 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:02.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:02.415 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:02.487 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:03.085 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:02 smithi029 ceph-mon[112128]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.502+0000 7fd5d449c700 1 -- 172.21.15.52:0/248163452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 msgr2=0x7fd5cc0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.502+0000 7fd5d449c700 1 --2- 172.21.15.52:0/248163452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc0fbb80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80048c0 tx=0x7fd5c8009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 -- 172.21.15.52:0/248163452 shutdown_connections 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 --2- 172.21.15.52:0/248163452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc0fbb80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 -- 172.21.15.52:0/248163452 >> 172.21.15.52:0/248163452 conn(0x7fd5cc0f6e50 msgr2=0x7fd5cc0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 -- 172.21.15.52:0/248163452 shutdown_connections 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 -- 172.21.15.52:0/248163452 wait complete. 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 Processor -- start 2023-12-05T13:19:03.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.503+0000 7fd5d449c700 1 -- start start 2023-12-05T13:19:03.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d449c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc10b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:03.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d449c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc10bec0 con 0x7fd5cc0fb770 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d2238700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc10b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d2238700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc10b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:34308/0 (socket says 172.21.15.52:34308) 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d2238700 1 -- 172.21.15.52:0/3804077944 learned_addr learned my addr 172.21.15.52:0/3804077944 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d2238700 1 -- 172.21.15.52:0/3804077944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8005040 con 0x7fd5cc0fb770 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.504+0000 7fd5d2238700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc10b980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009330 tx=0x7fd5c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.505+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5c80096b0 con 0x7fd5cc0fb770 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.505+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc10c0c0 con 0x7fd5cc0fb770 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.505+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5c8009810 con 0x7fd5cc0fb770 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.505+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5c801c5b0 con 0x7fd5cc0fb770 2023-12-05T13:19:03.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.505+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc10cd60 con 0x7fd5cc0fb770 2023-12-05T13:19:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.506+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd5c8013420 con 0x7fd5cc0fb770 2023-12-05T13:19:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.506+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc05f270 con 0x7fd5cc0fb770 2023-12-05T13:19:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.506+0000 7fd5c2ffd700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd5b80366d0 0x7fd5b8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.506+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd5c8049a10 con 0x7fd5cc0fb770 2023-12-05T13:19:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.506+0000 7fd5d1a37700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd5b80366d0 0x7fd5b8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.506+0000 7fd5d1a37700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd5b80366d0 0x7fd5b8038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009990 tx=0x7fd5bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:03.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.511+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd5c80119c0 con 0x7fd5cc0fb770 2023-12-05T13:19:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.791+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd5cc10d8b0 con 0x7fd5cc0fb770 2023-12-05T13:19:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.792+0000 7fd5c2ffd700 1 -- 172.21.15.52:0/3804077944 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd5c8011370 con 0x7fd5cc0fb770 2023-12-05T13:19:03.794 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:03.794 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd5b80366d0 msgr2=0x7fd5b8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd5b80366d0 0x7fd5b8038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009990 tx=0x7fd5bc006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 msgr2=0x7fd5cc10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc10b980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009330 tx=0x7fd5c8009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 shutdown_connections 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd5b80366d0 0x7fd5b8038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 --2- 172.21.15.52:0/3804077944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5cc0fb770 0x7fd5cc10b980 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 >> 172.21.15.52:0/3804077944 conn(0x7fd5cc0f6e50 msgr2=0x7fd5cc0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 shutdown_connections 2023-12-05T13:19:03.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:03.794+0000 7fd5d449c700 1 -- 172.21.15.52:0/3804077944 wait complete. 2023-12-05T13:19:03.797 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:04.021 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:03 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3804077944' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:04.021 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:03 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:04.021 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:03 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:05.143 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:04 smithi029 ceph-mon[112128]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:05.143 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:04 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:05.143 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:04 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:05.143 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:04 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:05.143 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:04 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:05.143 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:04 smithi029 ceph-mon[112128]: Deploying daemon prometheus.smithi029 on smithi029 2023-12-05T13:19:05.163 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:05.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 -- 172.21.15.52:0/1647932708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 msgr2=0x7f537c0faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 --2- 172.21.15.52:0/1647932708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0faf40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53780048c0 tx=0x7f5378009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 -- 172.21.15.52:0/1647932708 shutdown_connections 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 --2- 172.21.15.52:0/1647932708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0faf40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 -- 172.21.15.52:0/1647932708 >> 172.21.15.52:0/1647932708 conn(0x7f537c0f65d0 msgr2=0x7f537c0f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 -- 172.21.15.52:0/1647932708 shutdown_connections 2023-12-05T13:19:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.626+0000 7f5384601700 1 -- 172.21.15.52:0/1647932708 wait complete. 2023-12-05T13:19:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f5384601700 1 Processor -- start 2023-12-05T13:19:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f5384601700 1 -- start start 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f5384601700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f5384601700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0fbad0 con 0x7f537c0fab30 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f538239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f538239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:34312/0 (socket says 172.21.15.52:34312) 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.627+0000 7f538239d700 1 -- 172.21.15.52:0/3258285993 learned_addr learned my addr 172.21.15.52:0/3258285993 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f538239d700 1 -- 172.21.15.52:0/3258285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378005040 con 0x7f537c0fab30 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f538239d700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0fd650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f537800b690 tx=0x7f5378009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5378009650 con 0x7f537c0fab30 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53780097b0 con 0x7f537c0fab30 2023-12-05T13:19:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0fbcd0 con 0x7f537c0fab30 2023-12-05T13:19:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f537801c5b0 con 0x7f537c0fab30 2023-12-05T13:19:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.628+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0fc1c0 con 0x7f537c0fab30 2023-12-05T13:19:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.629+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f5378013a60 con 0x7f537c0fab30 2023-12-05T13:19:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.629+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c1064a0 con 0x7f537c0fab30 2023-12-05T13:19:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.629+0000 7f5372ffd700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5368036770 0x7f5368038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.629+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5378049a40 con 0x7f537c0fab30 2023-12-05T13:19:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.630+0000 7f5381b9c700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5368036770 0x7f5368038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.630+0000 7f5381b9c700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5368036770 0x7f5368038c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f536c009990 tx=0x7f536c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.635+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5378023300 con 0x7f537c0fab30 2023-12-05T13:19:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.921+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f537c04bb80 con 0x7f537c0fab30 2023-12-05T13:19:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.922+0000 7f5372ffd700 1 -- 172.21.15.52:0/3258285993 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5378011b60 con 0x7f537c0fab30 2023-12-05T13:19:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:06.924 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5368036770 msgr2=0x7f5368038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5368036770 0x7f5368038c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f536c009990 tx=0x7f536c006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 msgr2=0x7f537c0fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0fd650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f537800b690 tx=0x7f5378009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 shutdown_connections 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5368036770 0x7f5368038c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 --2- 172.21.15.52:0/3258285993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f537c0fab30 0x7f537c0fd650 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 >> 172.21.15.52:0/3258285993 conn(0x7f537c0f65d0 msgr2=0x7f537c0f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 shutdown_connections 2023-12-05T13:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:06.924+0000 7f5384601700 1 -- 172.21.15.52:0/3258285993 wait complete. 2023-12-05T13:19:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:07.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:06 smithi029 ceph-mon[112128]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:08.337 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:08.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:08.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:07 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3258285993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:08.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:07 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:08.643 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:09.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:08 smithi029 ceph-mon[112128]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 -- 172.21.15.52:0/4004726992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 msgr2=0x7f64900fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 --2- 172.21.15.52:0/4004726992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f64900fbb80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64800048c0 tx=0x7f6480009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 -- 172.21.15.52:0/4004726992 shutdown_connections 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 --2- 172.21.15.52:0/4004726992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f64900fbb80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 -- 172.21.15.52:0/4004726992 >> 172.21.15.52:0/4004726992 conn(0x7f64900f6e50 msgr2=0x7f64900f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 -- 172.21.15.52:0/4004726992 shutdown_connections 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.788+0000 7f6494f73700 1 -- 172.21.15.52:0/4004726992 wait complete. 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f6494f73700 1 Processor -- start 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f6494f73700 1 -- start start 2023-12-05T13:19:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f6494f73700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f649010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f6494f73700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490066300 con 0x7f64900fb770 2023-12-05T13:19:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f648e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f649010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f648e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f649010f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:34338/0 (socket says 172.21.15.52:34338) 2023-12-05T13:19:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f648e59c700 1 -- 172.21.15.52:0/271179403 learned_addr learned my addr 172.21.15.52:0/271179403 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.789+0000 7f648e59c700 1 -- 172.21.15.52:0/271179403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480005040 con 0x7f64900fb770 2023-12-05T13:19:09.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.790+0000 7f648e59c700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f649010f740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6480009330 tx=0x7f6480009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.790+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64800096b0 con 0x7f64900fb770 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.790+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6480009810 con 0x7f64900fb770 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.790+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f648001c5b0 con 0x7f64900fb770 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.790+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6490066500 con 0x7f64900fb770 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.790+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649010fec0 con 0x7f64900fb770 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.791+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f6480013420 con 0x7f64900fb770 2023-12-05T13:19:09.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.791+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6490105400 con 0x7f64900fb770 2023-12-05T13:19:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.791+0000 7f6486ffd700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f647c036720 0x7f647c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.791+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6480049a90 con 0x7f64900fb770 2023-12-05T13:19:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.791+0000 7f648dd9b700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f647c036720 0x7f647c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.792+0000 7f648dd9b700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f647c036720 0x7f647c038bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6478009990 tx=0x7f6478006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:09.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:09.797+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f64800119c0 con 0x7f64900fb770 2023-12-05T13:19:10.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.078+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f649004bb80 con 0x7f64900fb770 2023-12-05T13:19:10.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.079+0000 7f6486ffd700 1 -- 172.21.15.52:0/271179403 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6480011370 con 0x7f64900fb770 2023-12-05T13:19:10.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:10.081 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f647c036720 msgr2=0x7f647c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:10.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f647c036720 0x7f647c038bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6478009990 tx=0x7f6478006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 msgr2=0x7f649010f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f649010f740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6480009330 tx=0x7f6480009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 shutdown_connections 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f647c036720 0x7f647c038bd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 --2- 172.21.15.52:0/271179403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64900fb770 0x7f649010f740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 >> 172.21.15.52:0/271179403 conn(0x7f64900f6e50 msgr2=0x7f64900f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 shutdown_connections 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:10.081+0000 7f6494f73700 1 -- 172.21.15.52:0/271179403 wait complete. 2023-12-05T13:19:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:11.260 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:10 smithi029 ceph-mon[112128]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:11.261 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:10 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/271179403' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:11.459 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:11.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:11.773 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:11.840 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:12.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 -- 172.21.15.52:0/3624095306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 msgr2=0x7f5acc0faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:12.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 --2- 172.21.15.52:0/3624095306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0faf40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0048c0 tx=0x7f5abc009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:12.854 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 -- 172.21.15.52:0/3624095306 shutdown_connections 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 --2- 172.21.15.52:0/3624095306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0faf40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 -- 172.21.15.52:0/3624095306 >> 172.21.15.52:0/3624095306 conn(0x7f5acc0f65d0 msgr2=0x7f5acc0f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 -- 172.21.15.52:0/3624095306 shutdown_connections 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.852+0000 7f5ad1bea700 1 -- 172.21.15.52:0/3624095306 wait complete. 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5ad1bea700 1 Processor -- start 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5ad1bea700 1 -- start start 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5ad1bea700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0fd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5ad1bea700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0fbad0 con 0x7f5acc0fab30 2023-12-05T13:19:12.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5acb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5acb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0fd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:45776/0 (socket says 172.21.15.52:45776) 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.853+0000 7f5acb7fe700 1 -- 172.21.15.52:0/1405220559 learned_addr learned my addr 172.21.15.52:0/1405220559 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5acb7fe700 1 -- 172.21.15.52:0/1405220559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc005040 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5acb7fe700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0fd650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009040 tx=0x7f5abc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5abc009650 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5abc0097b0 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc0fbcd0 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5abc01c5b0 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.854+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc0fc1c0 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.855+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f5abc013420 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.855+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc1064a0 con 0x7f5acc0fab30 2023-12-05T13:19:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.855+0000 7f5ac3fff700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5ab8036720 0x7f5ab8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.855+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5abc049940 con 0x7f5acc0fab30 2023-12-05T13:19:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.855+0000 7f5acaffd700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5ab8036720 0x7f5ab8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.856+0000 7f5acaffd700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5ab8036720 0x7f5ab8038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009990 tx=0x7f5ab4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:12.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:12.862+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5abc0119c0 con 0x7f5acc0fab30 2023-12-05T13:19:12.961 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:12 smithi029 ceph-mon[112128]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:13.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.144+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5acc04bb80 con 0x7f5acc0fab30 2023-12-05T13:19:13.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.144+0000 7f5ac3fff700 1 -- 172.21.15.52:0/1405220559 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5abc011370 con 0x7f5acc0fab30 2023-12-05T13:19:13.146 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:13.146 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5ab8036720 msgr2=0x7f5ab8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5ab8036720 0x7f5ab8038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009990 tx=0x7f5ab4006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 msgr2=0x7f5acc0fd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0fd650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009040 tx=0x7f5abc009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 shutdown_connections 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7f5ab8036720 0x7f5ab8038bd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 --2- 172.21.15.52:0/1405220559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5acc0fab30 0x7f5acc0fd650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 >> 172.21.15.52:0/1405220559 conn(0x7f5acc0f65d0 msgr2=0x7f5acc0f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 shutdown_connections 2023-12-05T13:19:13.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:13.146+0000 7f5ad1bea700 1 -- 172.21.15.52:0/1405220559 wait complete. 2023-12-05T13:19:13.149 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:14.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:13 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/1405220559' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:14.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:13 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:14.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:13 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:14.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:13 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:14.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:13 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-05T13:19:14.545 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:14.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:14.922 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:14 smithi029 ceph-mon[112128]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:14 smithi029 ceph-mon[112128]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-05T13:19:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:14 smithi029 ceph-mon[112128]: mgrmap e14: smithi029.eekhlu(active, since 47s) 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 -- 172.21.15.52:0/4238772139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 msgr2=0x7fc8640fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 --2- 172.21.15.52:0/4238772139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc8640fd150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8600048c0 tx=0x7fc860009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 -- 172.21.15.52:0/4238772139 shutdown_connections 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 --2- 172.21.15.52:0/4238772139 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc8640fd150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 -- 172.21.15.52:0/4238772139 >> 172.21.15.52:0/4238772139 conn(0x7fc8640f65d0 msgr2=0x7fc8640f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 -- 172.21.15.52:0/4238772139 shutdown_connections 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.952+0000 7fc86b4ca700 1 -- 172.21.15.52:0/4238772139 wait complete. 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc86b4ca700 1 Processor -- start 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc86b4ca700 1 -- start start 2023-12-05T13:19:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc86b4ca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc86410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc86b4ca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86410f280 con 0x7fc8640fcd40 2023-12-05T13:19:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc869266700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc86410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc869266700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc86410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:45802/0 (socket says 172.21.15.52:45802) 2023-12-05T13:19:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.953+0000 7fc869266700 1 -- 172.21.15.52:0/3818234269 learned_addr learned my addr 172.21.15.52:0/3818234269 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc869266700 1 -- 172.21.15.52:0/3818234269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860005040 con 0x7fc8640fcd40 2023-12-05T13:19:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc869266700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc86410ed40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc86000b690 tx=0x7fc860009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc860009650 con 0x7fc8640fcd40 2023-12-05T13:19:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8600097b0 con 0x7fc8640fcd40 2023-12-05T13:19:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86410f480 con 0x7fc8640fcd40 2023-12-05T13:19:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc86001c5b0 con 0x7fc8640fcd40 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.954+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86410ffe0 con 0x7fc8640fcd40 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.955+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7fc860013a60 con 0x7fc8640fcd40 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.955+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86404bb80 con 0x7fc8640fcd40 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.956+0000 7fc859ffb700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.956+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc860049910 con 0x7fc8640fcd40 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.956+0000 7fc868a65700 1 -- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 msgr2=0x7fc850038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/525299250 2023-12-05T13:19:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.956+0000 7fc868a65700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:19:15.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:15.961+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc860011550 con 0x7fc8640fcd40 2023-12-05T13:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.157+0000 7fc868a65700 1 -- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 msgr2=0x7fc850038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/525299250 2023-12-05T13:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.157+0000 7fc868a65700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T13:19:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.242+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc864110e60 con 0x7fc8640fcd40 2023-12-05T13:19:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.242+0000 7fc859ffb700 1 -- 172.21.15.52:0/3818234269 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc860011370 con 0x7fc8640fcd40 2023-12-05T13:19:16.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:16.244 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 msgr2=0x7fc850038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:19:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 msgr2=0x7fc86410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc86410ed40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc86000b690 tx=0x7fc860009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 shutdown_connections 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fc850036720 0x7fc850038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 --2- 172.21.15.52:0/3818234269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8640fcd40 0x7fc86410ed40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 >> 172.21.15.52:0/3818234269 conn(0x7fc8640f65d0 msgr2=0x7fc8640f7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 shutdown_connections 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:16.245+0000 7fc86b4ca700 1 -- 172.21.15.52:0/3818234269 wait complete. 2023-12-05T13:19:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:16.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:16 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3818234269' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:17.636 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:17.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:17.945 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:18.008 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 -- 172.21.15.52:0/3282593360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 msgr2=0x7fd68c0faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 --2- 172.21.15.52:0/3282593360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c0faf40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6800048c0 tx=0x7fd680009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 -- 172.21.15.52:0/3282593360 shutdown_connections 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 --2- 172.21.15.52:0/3282593360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c0faf40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 -- 172.21.15.52:0/3282593360 >> 172.21.15.52:0/3282593360 conn(0x7fd68c0f65d0 msgr2=0x7fd68c0f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 -- 172.21.15.52:0/3282593360 shutdown_connections 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.008+0000 7fd692d4b700 1 -- 172.21.15.52:0/3282593360 wait complete. 2023-12-05T13:19:19.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd692d4b700 1 Processor -- start 2023-12-05T13:19:19.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd692d4b700 1 -- start start 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd692d4b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c10ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd692d4b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c10cf90 con 0x7fd68c0fab30 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd690ae7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c10ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd690ae7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c10ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:45808/0 (socket says 172.21.15.52:45808) 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.009+0000 7fd690ae7700 1 -- 172.21.15.52:0/3998664966 learned_addr learned my addr 172.21.15.52:0/3998664966 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd690ae7700 1 -- 172.21.15.52:0/3998664966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680005040 con 0x7fd68c0fab30 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd690ae7700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c10ca50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b690 tx=0x7fd680009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd680009650 con 0x7fd68c0fab30 2023-12-05T13:19:19.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd6800097b0 con 0x7fd68c0fab30 2023-12-05T13:19:19.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c10d190 con 0x7fd68c0fab30 2023-12-05T13:19:19.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd68001c570 con 0x7fd68c0fab30 2023-12-05T13:19:19.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.010+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c10de30 con 0x7fd68c0fab30 2023-12-05T13:19:19.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.011+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7fd68001c830 con 0x7fd68c0fab30 2023-12-05T13:19:19.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.011+0000 7fd6897fa700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 0x7fd67c038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:19.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.011+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c05f270 con 0x7fd68c0fab30 2023-12-05T13:19:19.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.011+0000 7fd68bfff700 1 -- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 msgr2=0x7fd67c038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/525299250 2023-12-05T13:19:19.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.011+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd680049a90 con 0x7fd68c0fab30 2023-12-05T13:19:19.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.011+0000 7fd68bfff700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 0x7fd67c038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:19:19.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.017+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd680023300 con 0x7fd68c0fab30 2023-12-05T13:19:19.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.212+0000 7fd68bfff700 1 -- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 msgr2=0x7fd67c038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/525299250 2023-12-05T13:19:19.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.212+0000 7fd68bfff700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 0x7fd67c038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T13:19:19.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.299+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd68c10e950 con 0x7fd68c0fab30 2023-12-05T13:19:19.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.300+0000 7fd6897fa700 1 -- 172.21.15.52:0/3998664966 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd680011b60 con 0x7fd68c0fab30 2023-12-05T13:19:19.301 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:19.301 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 msgr2=0x7fd67c038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 0x7fd67c038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 msgr2=0x7fd68c10ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c10ca50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b690 tx=0x7fd680009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 shutdown_connections 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:6800/525299250,v1:172.21.15.29:6801/525299250] conn(0x7fd67c036770 0x7fd67c038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 --2- 172.21.15.52:0/3998664966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd68c0fab30 0x7fd68c10ca50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 >> 172.21.15.52:0/3998664966 conn(0x7fd68c0f65d0 msgr2=0x7fd68c0f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.302+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 shutdown_connections 2023-12-05T13:19:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:19.303+0000 7fd692d4b700 1 -- 172.21.15.52:0/3998664966 wait complete. 2023-12-05T13:19:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:19.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:19 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3998664966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:20.688 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:20.688 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:20.998 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:21.066 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:21.942 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:19:21.942 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: mgrmap e15: smithi029.eekhlu(active, starting, since 0.0033323s) 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:19:21.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:19:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.136+0000 7f6563b42700 1 -- 172.21.15.52:0/3663437222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 msgr2=0x7f655c0fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.136+0000 7f6563b42700 1 --2- 172.21.15.52:0/3663437222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c0fb5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f65580048c0 tx=0x7f6558009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.136+0000 7f6563b42700 1 -- 172.21.15.52:0/3663437222 shutdown_connections 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.136+0000 7f6563b42700 1 --2- 172.21.15.52:0/3663437222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c0fb5c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.136+0000 7f6563b42700 1 -- 172.21.15.52:0/3663437222 >> 172.21.15.52:0/3663437222 conn(0x7f655c0f6e40 msgr2=0x7f655c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f6563b42700 1 -- 172.21.15.52:0/3663437222 shutdown_connections 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f6563b42700 1 -- 172.21.15.52:0/3663437222 wait complete. 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f6563b42700 1 Processor -- start 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f6563b42700 1 -- start start 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f6563b42700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c10ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f6563b42700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c10f270 con 0x7f655c0fb1b0 2023-12-05T13:19:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f65618de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c10ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.137+0000 7f65618de700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c10ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:55126/0 (socket says 172.21.15.52:55126) 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f65618de700 1 -- 172.21.15.52:0/1006055328 learned_addr learned my addr 172.21.15.52:0/1006055328 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f65618de700 1 -- 172.21.15.52:0/1006055328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6558005040 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f65618de700 1 --2- 172.21.15.52:0/1006055328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c10ed30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f655800b690 tx=0x7f6558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6558009650 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65580097b0 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c10f470 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f655801c5b0 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.138+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c10ffd0 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.139+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) v1 ==== 43075+0+0 (secure 0 0 0) 0x7f655801c870 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.139+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6558049580 con 0x7f655c0fb1b0 2023-12-05T13:19:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.139+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c04bb80 con 0x7f655c0fb1b0 2023-12-05T13:19:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.148+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6558023300 con 0x7f655c0fb1b0 2023-12-05T13:19:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.434+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f655c110e50 con 0x7f655c0fb1b0 2023-12-05T13:19:22.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.435+0000 7f65527fc700 1 -- 172.21.15.52:0/1006055328 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6558047030 con 0x7f655c0fb1b0 2023-12-05T13:19:22.435 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:22.436 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 msgr2=0x7f655c10ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 --2- 172.21.15.52:0/1006055328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c10ed30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f655800b690 tx=0x7f6558009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 shutdown_connections 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 --2- 172.21.15.52:0/1006055328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f655c0fb1b0 0x7f655c10ed30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 >> 172.21.15.52:0/1006055328 conn(0x7f655c0f6e40 msgr2=0x7f655c0f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 shutdown_connections 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:22.437+0000 7f6563b42700 1 -- 172.21.15.52:0/1006055328 wait complete. 2023-12-05T13:19:22.438 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:23.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:23.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:19:23.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:19:23.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:19:23.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: [05/Dec/2023:13:19:22] ENGINE Bus STARTING 2023-12-05T13:19:23.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: [05/Dec/2023:13:19:22] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:19:23.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: [05/Dec/2023:13:19:22] ENGINE Bus STARTED 2023-12-05T13:19:23.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:23.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/1006055328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:23.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:23.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:22 smithi029 ceph-mon[112128]: mgrmap e16: smithi029.eekhlu(active, since 1.00613s) 2023-12-05T13:19:23.840 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:23.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:24.262 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:23 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:24.262 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:23 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:24.473 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T13:19:25.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.783+0000 7fe9f3cff700 1 -- 172.21.15.52:0/303477911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 msgr2=0x7fe9ec0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:25.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.783+0000 7fe9f3cff700 1 --2- 172.21.15.52:0/303477911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec0fcc80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80048c0 tx=0x7fe9e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.783+0000 7fe9f3cff700 1 -- 172.21.15.52:0/303477911 shutdown_connections 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.783+0000 7fe9f3cff700 1 --2- 172.21.15.52:0/303477911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec0fcc80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.783+0000 7fe9f3cff700 1 -- 172.21.15.52:0/303477911 >> 172.21.15.52:0/303477911 conn(0x7fe9ec0f7f50 msgr2=0x7fe9ec0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.784+0000 7fe9f3cff700 1 -- 172.21.15.52:0/303477911 shutdown_connections 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.784+0000 7fe9f3cff700 1 -- 172.21.15.52:0/303477911 wait complete. 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.784+0000 7fe9f3cff700 1 Processor -- start 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.784+0000 7fe9f3cff700 1 -- start start 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.784+0000 7fe9f3cff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.784+0000 7fe9f3cff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec06ff90 con 0x7fe9ec0fc870 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9f1a9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9f1a9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:55152/0 (socket says 172.21.15.52:55152) 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9f1a9b700 1 -- 172.21.15.52:0/859292428 learned_addr learned my addr 172.21.15.52:0/859292428 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9f1a9b700 1 -- 172.21.15.52:0/859292428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8005040 con 0x7fe9ec0fc870 2023-12-05T13:19:25.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9f1a9b700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec071b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009330 tx=0x7fe9e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:25.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9e80096b0 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9e8009810 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec070190 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.785+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9e801c5b0 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.786+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec070680 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.786+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fe9e8013420 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.787+0000 7fe9e27fc700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe9d8036810 0x7fe9d8038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.787+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec106500 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.787+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe9e8049c70 con 0x7fe9ec0fc870 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.787+0000 7fe9f129a700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe9d8036810 0x7fe9d8038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:25.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.788+0000 7fe9f129a700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe9d8036810 0x7fe9d8038cc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009990 tx=0x7fe9dc006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:25.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:25.792+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe9e80117e0 con 0x7fe9ec0fc870 2023-12-05T13:19:26.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.077+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe9ec04bb80 con 0x7fe9ec0fc870 2023-12-05T13:19:26.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.078+0000 7fe9e27fc700 1 -- 172.21.15.52:0/859292428 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe9e801be90 con 0x7fe9ec0fc870 2023-12-05T13:19:26.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:26.078 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:26.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe9d8036810 msgr2=0x7fe9d8038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:26.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe9d8036810 0x7fe9d8038cc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009990 tx=0x7fe9dc006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 msgr2=0x7fe9ec071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec071b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009330 tx=0x7fe9e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 shutdown_connections 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe9d8036810 0x7fe9d8038cc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 --2- 172.21.15.52:0/859292428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ec0fc870 0x7fe9ec071b10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 >> 172.21.15.52:0/859292428 conn(0x7fe9ec0f7f50 msgr2=0x7fe9ec0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 shutdown_connections 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:26.080+0000 7fe9f3cff700 1 -- 172.21.15.52:0/859292428 wait complete. 2023-12-05T13:19:26.081 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:25 smithi029 ceph-mon[112128]: mgrmap e17: smithi029.eekhlu(active, since 2s) 2023-12-05T13:19:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd/host:smithi029", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/859292428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:26 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:19:27.848 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:27.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:19:28.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:19:28.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:28.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:27 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:28.180 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:19:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T13:19:29.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:29.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:28 smithi029 ceph-mon[112128]: Deploying daemon crash.smithi052 on smithi052 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.772+0000 7f26b0d5f700 1 -- 172.21.15.52:0/1650296785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 msgr2=0x7f26ac102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.772+0000 7f26b0d5f700 1 --2- 172.21.15.52:0/1650296785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac102cc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f269c0048c0 tx=0x7f269c009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.772+0000 7f26b0d5f700 1 -- 172.21.15.52:0/1650296785 shutdown_connections 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.772+0000 7f26b0d5f700 1 --2- 172.21.15.52:0/1650296785 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac102cc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.772+0000 7f26b0d5f700 1 -- 172.21.15.52:0/1650296785 >> 172.21.15.52:0/1650296785 conn(0x7f26ac0715e0 msgr2=0x7f26ac0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.773+0000 7f26b0d5f700 1 -- 172.21.15.52:0/1650296785 shutdown_connections 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.773+0000 7f26b0d5f700 1 -- 172.21.15.52:0/1650296785 wait complete. 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.773+0000 7f26b0d5f700 1 Processor -- start 2023-12-05T13:19:29.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.773+0000 7f26b0d5f700 1 -- start start 2023-12-05T13:19:29.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.774+0000 7f26b0d5f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac0fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:29.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.774+0000 7f26b0d5f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0fbd20 con 0x7f26ac1028f0 2023-12-05T13:19:29.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.774+0000 7f26aa59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac0fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:29.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.774+0000 7f26aa59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac0fb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:55168/0 (socket says 172.21.15.52:55168) 2023-12-05T13:19:29.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.774+0000 7f26aa59c700 1 -- 172.21.15.52:0/3990091535 learned_addr learned my addr 172.21.15.52:0/3990091535 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:29.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.775+0000 7f26aa59c700 1 -- 172.21.15.52:0/3990091535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c005040 con 0x7f26ac1028f0 2023-12-05T13:19:29.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.775+0000 7f26aa59c700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac0fb7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f269c009300 tx=0x7f269c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:29.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.775+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f269c004e60 con 0x7f26ac1028f0 2023-12-05T13:19:29.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.775+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac0fbf20 con 0x7f26ac1028f0 2023-12-05T13:19:29.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.775+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac0fc410 con 0x7f26ac1028f0 2023-12-05T13:19:29.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.777+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f269c013420 con 0x7f26ac1028f0 2023-12-05T13:19:29.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.777+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f269c01c5b0 con 0x7f26ac1028f0 2023-12-05T13:19:29.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.778+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c0052e0 con 0x7f26ac1028f0 2023-12-05T13:19:29.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.781+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f269c009600 con 0x7f26ac1028f0 2023-12-05T13:19:29.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.782+0000 7f269affd700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2694036860 0x7f2694038d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:29.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.782+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f269c0498e0 con 0x7f26ac1028f0 2023-12-05T13:19:29.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.782+0000 7f26a9d9b700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2694036860 0x7f2694038d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:29.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.783+0000 7f26a9d9b700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2694036860 0x7f2694038d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009990 tx=0x7f26a0006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:29.788+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f269c011960 con 0x7f26ac1028f0 2023-12-05T13:19:30.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.089+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f268c005590 con 0x7f26ac1028f0 2023-12-05T13:19:30.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.089+0000 7f269affd700 1 -- 172.21.15.52:0/3990091535 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f269c011370 con 0x7f26ac1028f0 2023-12-05T13:19:30.091 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:30.091 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2694036860 msgr2=0x7f2694038d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2694036860 0x7f2694038d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009990 tx=0x7f26a0006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 msgr2=0x7f26ac0fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac0fb7e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f269c009300 tx=0x7f269c009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 shutdown_connections 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2694036860 0x7f2694038d10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 --2- 172.21.15.52:0/3990091535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26ac1028f0 0x7f26ac0fb7e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 >> 172.21.15.52:0/3990091535 conn(0x7f26ac0715e0 msgr2=0x7f26ac103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.093+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 shutdown_connections 2023-12-05T13:19:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:30.094+0000 7f26b0d5f700 1 -- 172.21.15.52:0/3990091535 wait complete. 2023-12-05T13:19:30.096 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:30 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3990091535' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:30 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:30 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:30 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:31.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:30 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:31.426 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:31.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:32.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:31 smithi029 ceph-mon[112128]: Deploying daemon node-exporter.smithi052 on smithi052 2023-12-05T13:19:33.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/1567322223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 msgr2=0x7f2cd0101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 --2- 172.21.15.52:0/1567322223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0101bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00048c0 tx=0x7f2cc0009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/1567322223 shutdown_connections 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 --2- 172.21.15.52:0/1567322223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0101bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/1567322223 >> 172.21.15.52:0/1567322223 conn(0x7f2cd00715e0 msgr2=0x7f2cd00719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/1567322223 shutdown_connections 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.230+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/1567322223 wait complete. 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cd4c8a700 1 Processor -- start 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cd4c8a700 1 -- start start 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cd4c8a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0114d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cd4c8a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd0115260 con 0x7f2cd01017e0 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cce59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0114d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cce59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0114d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:36830/0 (socket says 172.21.15.52:36830) 2023-12-05T13:19:33.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.231+0000 7f2cce59c700 1 -- 172.21.15.52:0/8833605 learned_addr learned my addr 172.21.15.52:0/8833605 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cce59c700 1 -- 172.21.15.52:0/8833605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0005040 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cce59c700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0114d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009040 tx=0x7f2cc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc0004e60 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cc0009650 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd0115460 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cc001c3f0 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.232+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd0115950 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.233+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f2cc001c6b0 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.233+0000 7f2cbeffd700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2cb80367c0 0x7f2cb8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.233+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd005f270 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.233+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2cc0049a50 con 0x7f2cd01017e0 2023-12-05T13:19:33.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.234+0000 7f2ccdd9b700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2cb80367c0 0x7f2cb8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:33.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.234+0000 7f2ccdd9b700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2cb80367c0 0x7f2cb8038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009990 tx=0x7f2cc4006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:33.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.239+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2cc0025400 con 0x7f2cd01017e0 2023-12-05T13:19:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:32 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:33.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.545+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2cd01104d0 con 0x7f2cd01017e0 2023-12-05T13:19:33.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.545+0000 7f2cbeffd700 1 -- 172.21.15.52:0/8833605 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2cc0011b60 con 0x7f2cd01017e0 2023-12-05T13:19:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:33.547 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2cb80367c0 msgr2=0x7f2cb8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2cb80367c0 0x7f2cb8038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009990 tx=0x7f2cc4006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 msgr2=0x7f2cd0114d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0114d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009040 tx=0x7f2cc0009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 shutdown_connections 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2cb80367c0 0x7f2cb8038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 --2- 172.21.15.52:0/8833605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2cd01017e0 0x7f2cd0114d20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 >> 172.21.15.52:0/8833605 conn(0x7f2cd00715e0 msgr2=0x7f2cd0065610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:33.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 shutdown_connections 2023-12-05T13:19:33.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:33.548+0000 7f2cd4c8a700 1 -- 172.21.15.52:0/8833605 wait complete. 2023-12-05T13:19:33.551 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:34.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:33 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/8833605' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:35.098 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:35.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:35.697 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:35 smithi029 ceph-mon[112128]: Deploying daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:19:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 -- 172.21.15.52:0/3373744050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 msgr2=0x7f2430101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 --2- 172.21.15.52:0/3373744050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f2430101bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f24200048c0 tx=0x7f2420009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 -- 172.21.15.52:0/3373744050 shutdown_connections 2023-12-05T13:19:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 --2- 172.21.15.52:0/3373744050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f2430101bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 -- 172.21.15.52:0/3373744050 >> 172.21.15.52:0/3373744050 conn(0x7f24300715e0 msgr2=0x7f24300719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 -- 172.21.15.52:0/3373744050 shutdown_connections 2023-12-05T13:19:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.817+0000 7f2434f8a700 1 -- 172.21.15.52:0/3373744050 wait complete. 2023-12-05T13:19:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f2434f8a700 1 Processor -- start 2023-12-05T13:19:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f2434f8a700 1 -- start start 2023-12-05T13:19:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f2434f8a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f243010db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f2434f8a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243010e0b0 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f242e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f243010db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f242e59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f243010db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.52:36862/0 (socket says 172.21.15.52:36862) 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f242e59c700 1 -- 172.21.15.52:0/1844653482 learned_addr learned my addr 172.21.15.52:0/1844653482 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.818+0000 7f242e59c700 1 -- 172.21.15.52:0/1844653482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420005040 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.819+0000 7f242e59c700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f243010db70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2420009040 tx=0x7f2420009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.819+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2420004e60 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.819+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2420009650 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.819+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243010e2b0 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.819+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f242001c3f0 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.819+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243010e720 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.820+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f24200097c0 con 0x7f24301017e0 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.820+0000 7f241effd700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f24180367c0 0x7f2418038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.820+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2430100a50 con 0x7f24301017e0 2023-12-05T13:19:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.820+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f24200499d0 con 0x7f24301017e0 2023-12-05T13:19:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.820+0000 7f242dd9b700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f24180367c0 0x7f2418038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.821+0000 7f242dd9b700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f24180367c0 0x7f2418038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2424009990 tx=0x7f2424006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:36.826+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2420011550 con 0x7f24301017e0 2023-12-05T13:19:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.123+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f24300655e0 con 0x7f24301017e0 2023-12-05T13:19:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.124+0000 7f241effd700 1 -- 172.21.15.52:0/1844653482 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f242001bc20 con 0x7f24301017e0 2023-12-05T13:19:37.125 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:37.126 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:17:34.041914Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T13:19:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f24180367c0 msgr2=0x7f2418038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f24180367c0 0x7f2418038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2424009990 tx=0x7f2424006e40 comp rx=0 tx=0).stop 2023-12-05T13:19:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 msgr2=0x7f243010db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f243010db70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2420009040 tx=0x7f2420009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 shutdown_connections 2023-12-05T13:19:37.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f24180367c0 0x7f2418038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:37.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 --2- 172.21.15.52:0/1844653482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24301017e0 0x7f243010db70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:37.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 >> 172.21.15.52:0/1844653482 conn(0x7f24300715e0 msgr2=0x7f2430102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:37.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 shutdown_connections 2023-12-05T13:19:37.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:37.126+0000 7f2434f8a700 1 -- 172.21.15.52:0/1844653482 wait complete. 2023-12-05T13:19:37.128 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-12-05T13:19:37.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:36 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:19:37.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:36 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/1844653482' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:38.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:19:38.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:38.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:37 smithi029 ceph-mon[112128]: Deploying daemon mon.smithi052 on smithi052 2023-12-05T13:19:38.510 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T13:19:38.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T13:19:38.997 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 systemd[1]: Started Ceph mon.smithi052 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: load: jerasure load: lrc 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: RocksDB version: 6.15.5 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Compile date Dec 4 2023 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: DB SUMMARY 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: DB Session ID: 7GQFMQXNBDPHUKPYF4EW 2023-12-05T13:19:40.192 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: CURRENT file: CURRENT 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi052/store.db dir, Total Num: 0, files: 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi052/store.db: 000004.log size: 511 ; 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.error_if_exists: 0 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.create_if_missing: 0 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.paranoid_checks: 1 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.env: 0x55a7df74ba80 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.fs: Posix File System 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.info_log: 0x55a7e0f86780 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.statistics: (nil) 2023-12-05T13:19:40.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.use_fsync: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_log_file_size: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.allow_fallocate: 1 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.use_direct_reads: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.db_log_dir: 2023-12-05T13:19:40.194 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi052/store.db 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.write_buffer_manager: 0x55a7e1cf69f0 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T13:19:40.195 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.unordered_write: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.row_cache: None 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.wal_filter: None 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.preserve_deletes: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.two_write_queues: 0 2023-12-05T13:19:40.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.atomic_flush: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.log_readahead_size: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_background_jobs: 2 2023-12-05T13:19:40.197 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_background_compactions: -1 2023-12-05T13:19:40.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_subcompactions: 1 2023-12-05T13:19:40.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T13:19:40.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T13:19:40.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T13:19:40.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T13:19:40.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_open_files: -1 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_background_flushes: -1 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Compression algorithms supported: 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T13:19:40.200 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kZSTD supported: 0 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kXpressCompression supported: 0 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kZlibCompression supported: 1 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kSnappyCompression supported: 1 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kLZ4Compression supported: 1 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: kBZip2Compression supported: 0 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000003 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.merge_operator: 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_filter: None 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T13:19:40.201 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a7e0fd6f90) 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks: 1 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_top_level_index_and_filter: 1 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_type: 0 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_index_type: 0 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_shortening: 1 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: hash_index_allow_collision: 1 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: checksum: 1 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: no_block_cache: 0 2023-12-05T13:19:40.202 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache: 0x55a7e1009090 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_name: BinnedLRUCache 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_options: 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: capacity : 536870912 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_shard_bits : 4 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: strict_capacity_limit : 0 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: high_pri_pool_ratio: 0.000 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_compressed: (nil) 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: persistent_cache: (nil) 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size: 4096 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size_deviation: 10 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_restart_interval: 16 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_block_restart_interval: 1 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: metadata_block_size: 4096 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: partition_filters: 0 2023-12-05T13:19:40.203 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: use_delta_encoding: 1 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: whole_key_filtering: 1 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: verify_compression: 0 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: read_amp_bytes_per_bit: 0 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: format_version: 4 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_index_compression: 1 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_align: 0 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression: NoCompression 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.num_levels: 7 2023-12-05T13:19:40.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:19:40.205 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T13:19:40.206 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.arena_block_size: 4194304 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T13:19:40.207 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.table_properties_collectors: 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.inplace_update_support: 0 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T13:19:40.208 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.bloom_locality: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.max_successive_merges: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.ttl: 2592000 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T13:19:40.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.enable_blob_files: false 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.min_blob_size: 0 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782379975109, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-05T13:19:40.210 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782379975437, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701782379, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "58bc01d4-cd3e-4d5c-b4af-29ba5a2f5463", "db_session_id": "7GQFMQXNBDPHUKPYF4EW"}} 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782379975814, "job": 1, "event": "recovery_finished"} 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi052/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55a7e0f9d180 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: DB pointer 0x55a7e1072000 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** DB Stats ** 2023-12-05T13:19:40.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:19:40.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:19:40.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T13:19:40.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.0 0.00 0.00 1 0.000 0 0 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:19:40.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052 does not exist in monmap, will attempt to join an existing cluster 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: using public_addr v2:172.21.15.52:0/0 -> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: starting mon.smithi052 rank -1 at public addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] at bind addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi052 fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(???) e0 preinit fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:19:40.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).mds e1 new map 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).mds e1 print_map 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: e1 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: legacy client fscid: -1 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: No filesystems configured 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-05T13:19:40.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2810649990' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: osdmap e4: 0 total, 0 up, 0 in 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T13:19:40.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Deploying daemon grafana.smithi029 on smithi029 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Saving service mon spec with placement smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052;count:2 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3010347197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/667200588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/2329945426' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3804077944' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Deploying daemon prometheus.smithi029 on smithi029 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3258285993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/271179403' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/1405220559' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14162 172.21.15.29:0/4272154692' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mgrmap e14: smithi029.eekhlu(active, since 47s) 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3818234269' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3998664966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mgrmap e15: smithi029.eekhlu(active, starting, since 0.0033323s) 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:19:40.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: [05/Dec/2023:13:19:22] ENGINE Bus STARTING 2023-12-05T13:19:40.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: [05/Dec/2023:13:19:22] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: [05/Dec/2023:13:19:22] ENGINE Bus STARTED 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/1006055328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mgrmap e16: smithi029.eekhlu(active, since 1.00613s) 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: mgrmap e17: smithi029.eekhlu(active, since 2s) 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd/host:smithi029", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/859292428' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:19:40.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:19:40.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Deploying daemon crash.smithi052 on smithi052 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3990091535' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: Deploying daemon node-exporter.smithi052 on smithi052 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/8833605' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: Deploying daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/1844653482' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:40.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: Deploying daemon mon.smithi052 on smithi052 2023-12-05T13:19:40.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-05T13:19:40.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:40 smithi052 ceph-mon[121072]: mon.smithi052@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-05T13:19:45.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:19:45.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: mon.smithi029 calling monitor election 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: mon.smithi052 calling monitor election 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: mon.smithi029 is new leader, mons smithi029,smithi052 in quorum (ranks 0,1) 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: monmap e2: 2 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],smithi052=[v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: fsmap 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T13:19:45.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: mgrmap e17: smithi029.eekhlu(active, since 23s) 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: overall HEALTH_OK 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: mon.smithi029 calling monitor election 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: mon.smithi052 calling monitor election 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: mon.smithi029 is new leader, mons smithi029,smithi052 in quorum (ranks 0,1) 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: monmap e2: 2 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],smithi052=[v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: fsmap 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: mgrmap e17: smithi029.eekhlu(active, since 23s) 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: overall HEALTH_OK 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1043187366' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:45.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.126+0000 7f37aebd2700 1 -- 172.21.15.52:0/450047912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37980062b0 msgr2=0x7f3798008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.126+0000 7f37aebd2700 1 --2- 172.21.15.52:0/450047912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37980062b0 0x7f3798008710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f37a80663a0 tx=0x7f379c002040 comp rx=0 tx=0).stop 2023-12-05T13:19:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.127+0000 7f37aebd2700 1 -- 172.21.15.52:0/450047912 shutdown_connections 2023-12-05T13:19:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.127+0000 7f37aebd2700 1 --2- 172.21.15.52:0/450047912 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37980062b0 0x7f3798008710 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:46.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.127+0000 7f37aebd2700 1 -- 172.21.15.52:0/450047912 >> 172.21.15.52:0/450047912 conn(0x7f37a8071760 msgr2=0x7f37a8071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:46.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.127+0000 7f37aebd2700 1 -- 172.21.15.52:0/450047912 shutdown_connections 2023-12-05T13:19:46.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.127+0000 7f37aebd2700 1 -- 172.21.15.52:0/450047912 wait complete. 2023-12-05T13:19:46.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.128+0000 7f37aebd2700 1 Processor -- start 2023-12-05T13:19:46.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.128+0000 7f37aebd2700 1 -- start start 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.128+0000 7f37aebd2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.128+0000 7f37aebd2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37a80fbe40 0x7f37a80fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.128+0000 7f37aebd2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a8119020 con 0x7f37a80fbe40 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.128+0000 7f37aebd2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a8119160 con 0x7f37980062b0 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34150/0 (socket says 172.21.15.52:34150) 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 -- 172.21.15.52:0/1832621647 learned_addr learned my addr 172.21.15.52:0/1832621647 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 -- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 msgr2=0x7f37a80fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 -- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 msgr2=0x7f37a80fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37a7fff700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37a80fbe40 0x7f37a80fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T13:19:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37ac96e700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37a7fff700 1 -- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 msgr2=0x7f37a80fb900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37a7fff700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37a7fff700 1 -- 172.21.15.52:0/1832621647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c005040 con 0x7f37a80fbe40 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.129+0000 7f37a7fff700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37a80fbe40 0x7f37a80fc2b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f379400b790 tx=0x7f37940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.130+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3794011810 con 0x7f37a80fbe40 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.130+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3794011e20 con 0x7f37a80fbe40 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.130+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a81193c0 con 0x7f37a80fbe40 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.130+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f379400f2e0 con 0x7f37a80fbe40 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.130+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a81198d0 con 0x7f37a80fbe40 2023-12-05T13:19:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.131+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a805f270 con 0x7f37a80fbe40 2023-12-05T13:19:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.131+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f379400f440 con 0x7f37a80fbe40 2023-12-05T13:19:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.132+0000 7f37a57fa700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f378c069020 0x7f378c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.132+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3794085f90 con 0x7f37a80fbe40 2023-12-05T13:19:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.132+0000 7f37ac96e700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f378c069020 0x7f378c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.133+0000 7f37ac96e700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f378c069020 0x7f378c06b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f379c0175d0 tx=0x7f379c002040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:46.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.137+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3794053490 con 0x7f37a80fbe40 2023-12-05T13:19:46.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:46 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:46.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:46 smithi052 ceph-mon[121072]: mgrmap e18: smithi029.eekhlu(active, since 23s), standbys: smithi052.ocazcp 2023-12-05T13:19:46.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:46 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:19:46.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:46 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:46.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:46 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:19:46.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:46 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:46.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.438+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f37a8104560 con 0x7f37a80fbe40 2023-12-05T13:19:46.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.439+0000 7f37a57fa700 1 -- 172.21.15.52:0/1832621647 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7f3794015090 con 0x7f37a80fbe40 2023-12-05T13:19:46.440 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-12-05T13:19:46.440 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","modified":"2023-12-05T13:19:40.005205Z","created":"2023-12-05T13:17:34.041914Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi029","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-05T13:19:46.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f378c069020 msgr2=0x7f378c06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:46.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f378c069020 0x7f378c06b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f379c0175d0 tx=0x7f379c002040 comp rx=0 tx=0).stop 2023-12-05T13:19:46.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37a80fbe40 msgr2=0x7f37a80fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:46.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37a80fbe40 0x7f37a80fc2b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f379400b790 tx=0x7f37940091a0 comp rx=0 tx=0).stop 2023-12-05T13:19:46.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 shutdown_connections 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f378c069020 0x7f378c06b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37980062b0 0x7f37a80fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 --2- 172.21.15.52:0/1832621647 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37a80fbe40 0x7f37a80fc2b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 >> 172.21.15.52:0/1832621647 conn(0x7f37a8071760 msgr2=0x7f37a80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 shutdown_connections 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:19:46.441+0000 7f37aebd2700 1 -- 172.21.15.52:0/1832621647 wait complete. 2023-12-05T13:19:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 2 2023-12-05T13:19:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:46 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:46 smithi029 ceph-mon[112128]: mgrmap e18: smithi029.eekhlu(active, since 23s), standbys: smithi052.ocazcp 2023-12-05T13:19:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:46 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:19:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:46 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:46 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:19:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:46 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:19:46.901 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-05T13:19:46.901 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-05T13:19:47.220 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:19:47.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:47 smithi029 ceph-mon[112128]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:47.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:47 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/1832621647' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:47.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:47 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:47.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:47 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:47.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:47 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:47.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:47 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:19:47.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:47 smithi052 ceph-mon[121072]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:47.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:47 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/1832621647' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T13:19:47.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:47 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:47.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:47 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:47.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:47 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:47.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:47 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:19:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 -- 172.21.15.29:0/3693509883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 msgr2=0x7f507c101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 --2- 172.21.15.29:0/3693509883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c101ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50780048c0 tx=0x7f5078009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 -- 172.21.15.29:0/3693509883 shutdown_connections 2023-12-05T13:19:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 --2- 172.21.15.29:0/3693509883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c101ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:48.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 -- 172.21.15.29:0/3693509883 >> 172.21.15.29:0/3693509883 conn(0x7f507c0f7310 msgr2=0x7f507c0f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:48.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 -- 172.21.15.29:0/3693509883 shutdown_connections 2023-12-05T13:19:48.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 -- 172.21.15.29:0/3693509883 wait complete. 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 Processor -- start 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.606+0000 7f5082b01700 1 -- start start 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f5082b01700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c10dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f5082b01700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c10e2b0 0x7f507c116c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f5082b01700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c10e7b0 con 0x7f507c1017d0 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f5082b01700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c10e920 con 0x7f507c10e2b0 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f508089d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c10dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:48.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f508089d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c10dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37076/0 (socket says 172.21.15.29:37076) 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f508089d700 1 -- 172.21.15.29:0/886171539 learned_addr learned my addr 172.21.15.29:0/886171539 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f5073fff700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c10e2b0 0x7f507c116c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f508089d700 1 -- 172.21.15.29:0/886171539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c10e2b0 msgr2=0x7f507c116c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f508089d700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c10e2b0 0x7f507c116c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.607+0000 7f508089d700 1 -- 172.21.15.29:0/886171539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078005040 con 0x7f507c1017d0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.608+0000 7f508089d700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c10dd70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f507800bfe0 tx=0x7f5078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.608+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507800e040 con 0x7f507c1017d0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.608+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c117160 con 0x7f507c1017d0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.608+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5078013420 con 0x7f507c1017d0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.608+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507801c630 con 0x7f507c1017d0 2023-12-05T13:19:48.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.608+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c1176f0 con 0x7f507c1017d0 2023-12-05T13:19:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.609+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c05f270 con 0x7f507c1017d0 2023-12-05T13:19:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.609+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f5078009580 con 0x7f507c1017d0 2023-12-05T13:19:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.610+0000 7f50717fa700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5064069040 0x7f506406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.610+0000 7f5073fff700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5064069040 0x7f506406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.610+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5078087020 con 0x7f507c1017d0 2023-12-05T13:19:48.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.610+0000 7f5073fff700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5064069040 0x7f506406b4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f506c009ac0 tx=0x7f506c008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:48.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.614+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f50780545d0 con 0x7f507c1017d0 2023-12-05T13:19:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.825+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f507c065e60 con 0x7f507c1017d0 2023-12-05T13:19:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.826+0000 7f50717fa700 1 -- 172.21.15.29:0/886171539 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7f50780867d0 con 0x7f507c1017d0 2023-12-05T13:19:48.827 INFO:teuthology.orchestra.run.smithi029.stdout:# minimal ceph.conf for 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:19:48.828 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-12-05T13:19:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:19:48.828 INFO:teuthology.orchestra.run.smithi029.stdout: mon_host = [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] 2023-12-05T13:19:48.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5064069040 msgr2=0x7f506406b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:48.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5064069040 0x7f506406b4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f506c009ac0 tx=0x7f506c008040 comp rx=0 tx=0).stop 2023-12-05T13:19:48.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 msgr2=0x7f507c10dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:48.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c10dd70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f507800bfe0 tx=0x7f5078009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:48.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 shutdown_connections 2023-12-05T13:19:48.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5064069040 0x7f506406b4f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:48.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f507c1017d0 0x7f507c10dd70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:48.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 --2- 172.21.15.29:0/886171539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f507c10e2b0 0x7f507c116c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:48.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 >> 172.21.15.29:0/886171539 conn(0x7f507c0f7310 msgr2=0x7f507c0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:48.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 shutdown_connections 2023-12-05T13:19:48.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:48.828+0000 7f5082b01700 1 -- 172.21.15.29:0/886171539 wait complete. 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:19:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:19:48.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:19:48.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:19:48.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:49.344 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-05T13:19:49.344 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:19:49.344 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.conf 2023-12-05T13:19:49.379 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:19:49.380 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:19:49.452 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:19:49.452 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.conf 2023-12-05T13:19:49.491 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:19:49.491 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:19:49.567 INFO:tasks.cephadm:Deploying OSDs... 2023-12-05T13:19:49.567 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:19:49.568 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2023-12-05T13:19:49.590 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-05T13:19:49.590 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2023-12-05T13:19:49.653 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-05T13:19:49.653 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:49.653 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 397369 Links: 1 2023-12-05T13:19:49.653 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:49.653 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:49.654 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-12-05 13:19:12.907099041 +0000 2023-12-05T13:19:49.654 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-12-05 13:08:37.513924895 +0000 2023-12-05T13:19:49.654 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-12-05 13:08:37.513924895 +0000 2023-12-05T13:19:49.654 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-12-05T13:19:49.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-05T13:19:49.724 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: Reconfiguring mon.smithi029 (unknown last config time)... 2023-12-05T13:19:49.724 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: Reconfiguring daemon mon.smithi029 on smithi029 2023-12-05T13:19:49.724 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:49.724 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/886171539' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:49.724 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:49.725 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:49.725 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:19:49.725 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:19:49.725 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:49.726 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-12-05T13:19:49.726 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-12-05T13:19:49.726 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000112587 s, 4.5 MB/s 2023-12-05T13:19:49.728 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-05T13:19:49.793 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 392133 Links: 1 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-12-05 13:19:12.907099041 +0000 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-12-05 13:08:38.096915515 +0000 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-12-05 13:08:38.096915515 +0000 2023-12-05T13:19:49.859 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-12-05T13:19:49.860 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-05T13:19:49.935 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-12-05T13:19:49.935 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-12-05T13:19:49.935 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000110227 s, 4.6 MB/s 2023-12-05T13:19:49.937 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-05T13:19:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: Reconfiguring mon.smithi029 (unknown last config time)... 2023-12-05T13:19:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: Reconfiguring daemon mon.smithi029 on smithi029 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/886171539' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:19:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:50.001 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 397503 Links: 1 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-12-05 13:19:12.907099041 +0000 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-12-05 13:08:38.656906506 +0000 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-12-05 13:08:38.656906506 +0000 2023-12-05T13:19:50.066 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-12-05T13:19:50.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-05T13:19:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-12-05T13:19:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-12-05T13:19:50.142 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000102058 s, 5.0 MB/s 2023-12-05T13:19:50.143 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-05T13:19:50.206 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2023-12-05T13:19:50.268 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-05T13:19:50.268 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:50.268 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 6h/6d Inode: 397561 Links: 1 2023-12-05T13:19:50.269 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:50.269 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:50.269 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-12-05 13:19:12.907099041 +0000 2023-12-05T13:19:50.269 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-12-05 13:08:39.229897288 +0000 2023-12-05T13:19:50.269 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-12-05 13:08:39.229897288 +0000 2023-12-05T13:19:50.269 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-12-05T13:19:50.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-05T13:19:50.341 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-12-05T13:19:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-12-05T13:19:50.342 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000110921 s, 4.6 MB/s 2023-12-05T13:19:50.343 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-05T13:19:50.406 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:19:50.406 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2023-12-05T13:19:50.429 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-05T13:19:50.430 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 390809 Links: 1 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-12-05 13:19:39.165850032 +0000 2023-12-05T13:19:50.494 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-12-05 13:08:31.848896738 +0000 2023-12-05T13:19:50.495 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-12-05 13:08:31.848896738 +0000 2023-12-05T13:19:50.495 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-12-05T13:19:50.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-05T13:19:50.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-12-05T13:19:50.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-12-05T13:19:50.569 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000134879 s, 3.8 MB/s 2023-12-05T13:19:50.570 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-05T13:19:50.636 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2023-12-05T13:19:50.699 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 396648 Links: 1 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-12-05 13:19:39.165850032 +0000 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-12-05 13:08:32.419889858 +0000 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-12-05 13:08:32.419889858 +0000 2023-12-05T13:19:50.700 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-12-05T13:19:50.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-05T13:19:50.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-12-05T13:19:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-12-05T13:19:50.773 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000122395 s, 4.2 MB/s 2023-12-05T13:19:50.774 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-05T13:19:50.838 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2023-12-05T13:19:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: Reconfiguring mgr.smithi029.eekhlu (unknown last config time)... 2023-12-05T13:19:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: Reconfiguring daemon mgr.smithi029.eekhlu on smithi029 2023-12-05T13:19:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:19:50.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:50.902 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-05T13:19:50.902 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:50.902 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 396138 Links: 1 2023-12-05T13:19:50.902 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:50.903 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:50.903 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-12-05 13:19:39.165850032 +0000 2023-12-05T13:19:50.903 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-12-05 13:08:33.028882521 +0000 2023-12-05T13:19:50.903 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-12-05 13:08:33.028882521 +0000 2023-12-05T13:19:50.903 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-12-05T13:19:50.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: Reconfiguring mgr.smithi029.eekhlu (unknown last config time)... 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: Reconfiguring daemon mgr.smithi029.eekhlu on smithi029 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:19:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-12-05T13:19:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-12-05T13:19:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00012797 s, 4.0 MB/s 2023-12-05T13:19:50.976 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-05T13:19:51.041 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2023-12-05T13:19:51.105 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-05T13:19:51.105 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T13:19:51.105 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 396247 Links: 1 2023-12-05T13:19:51.106 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:19:51.106 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T13:19:51.106 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-12-05 13:19:39.165850032 +0000 2023-12-05T13:19:51.106 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-12-05 13:08:33.617875425 +0000 2023-12-05T13:19:51.106 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-12-05 13:08:33.617875425 +0000 2023-12-05T13:19:51.106 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-12-05T13:19:51.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-05T13:19:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-12-05T13:19:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-12-05T13:19:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000117127 s, 4.4 MB/s 2023-12-05T13:19:51.179 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-05T13:19:51.244 INFO:tasks.cephadm:Deploying osd.0 on smithi029 with /dev/vg_nvme/lv_4... 2023-12-05T13:19:51.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-05T13:19:51.563 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:19:51.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:51 smithi029 ceph-mon[112128]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:51.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:51 smithi029 ceph-mon[112128]: Reconfiguring crash.smithi029 (monmap changed)... 2023-12-05T13:19:51.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:51 smithi029 ceph-mon[112128]: Reconfiguring daemon crash.smithi029 on smithi029 2023-12-05T13:19:51.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:51 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:51.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:51 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:51.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:51 smithi052 ceph-mon[121072]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:51.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:51 smithi052 ceph-mon[121072]: Reconfiguring crash.smithi029 (monmap changed)... 2023-12-05T13:19:51.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:51 smithi052 ceph-mon[121072]: Reconfiguring daemon crash.smithi029 on smithi029 2023-12-05T13:19:51.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:51 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:51.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:51 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:52 smithi029 ceph-mon[112128]: Reconfiguring alertmanager.smithi029 (dependencies changed)... 2023-12-05T13:19:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:52 smithi029 ceph-mon[112128]: Reconfiguring daemon alertmanager.smithi029 on smithi029 2023-12-05T13:19:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:19:52.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:52 smithi052 ceph-mon[121072]: Reconfiguring alertmanager.smithi029 (dependencies changed)... 2023-12-05T13:19:52.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:52 smithi052 ceph-mon[121072]: Reconfiguring daemon alertmanager.smithi029 on smithi029 2023-12-05T13:19:52.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:19:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-05T13:19:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-05T13:19:53.762 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-12-05T13:19:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-12-05T13:19:53.762 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00901065 s, 1.2 GB/s 2023-12-05T13:19:53.762 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-12-05T13:19:53.806 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:53 smithi029 ceph-mon[112128]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:53 smithi052 ceph-mon[121072]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:54.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi029:vg_nvme/lv_4 2023-12-05T13:19:54.741 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:19:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:54 smithi029 ceph-mon[112128]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:54.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:54 smithi052 ceph-mon[121072]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:56.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 -- 172.21.15.29:0/3091073932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0668e0 msgr2=0x7f9e1c0ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:56.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 --2- 172.21.15.29:0/3091073932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0668e0 0x7f9e1c0ff7f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c004940 tx=0x7f9e0c009e30 comp rx=0 tx=0).stop 2023-12-05T13:19:56.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 -- 172.21.15.29:0/3091073932 shutdown_connections 2023-12-05T13:19:56.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 --2- 172.21.15.29:0/3091073932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:56.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 --2- 172.21.15.29:0/3091073932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0668e0 0x7f9e1c0ff7f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:56.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 -- 172.21.15.29:0/3091073932 >> 172.21.15.29:0/3091073932 conn(0x7f9e1c0f71c0 msgr2=0x7f9e1c0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:19:56.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 -- 172.21.15.29:0/3091073932 shutdown_connections 2023-12-05T13:19:56.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 -- 172.21.15.29:0/3091073932 wait complete. 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.000+0000 7f9e21178700 1 Processor -- start 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e21178700 1 -- start start 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e21178700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e1c0668e0 0x7f9e1c10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e21178700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e21178700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c10e0b0 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e21178700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c10e950 con 0x7f9e1c0668e0 2023-12-05T13:19:56.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c10dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37102/0 (socket says 172.21.15.29:37102) 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 -- 172.21.15.29:0/2160088701 learned_addr learned my addr 172.21.15.29:0/2160088701 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1ad9d700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e1c0668e0 0x7f9e1c10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 -- 172.21.15.29:0/2160088701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e1c0668e0 msgr2=0x7f9e1c10d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e1c0668e0 0x7f9e1c10d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 -- 172.21.15.29:0/2160088701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c005040 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.001+0000 7f9e1a59c700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c10dab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c800 tx=0x7f9e10004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.002+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e100106f0 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.002+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e10010d00 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.002+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1c10ec30 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.002+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e100113a0 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.002+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c10f170 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.003+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c04bb80 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.003+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f9e10011660 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.004+0000 7f9e037fe700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9e04068ed0 0x7f9e0406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:19:56.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.004+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9e10085c70 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.004+0000 7f9e1ad9d700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9e04068ed0 0x7f9e0406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:19:56.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.004+0000 7f9e1ad9d700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9e04068ed0 0x7f9e0406b380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00b3b0 tx=0x7f9e0c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:19:56.009 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.009+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9e10056cb0 con 0x7f9e1c0ffdc0 2023-12-05T13:19:56.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:19:56.222+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e1c10f620 con 0x7f9e04068ed0 2023-12-05T13:19:57.048 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:57.048 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:57.048 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:57.048 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: Reconfiguring grafana.smithi029 (dependencies changed)... 2023-12-05T13:19:57.049 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: Reconfiguring daemon grafana.smithi029 on smithi029 2023-12-05T13:19:57.049 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:19:57.049 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:19:57.049 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:19:57.049 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: Reconfiguring grafana.smithi029 (dependencies changed)... 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: Reconfiguring daemon grafana.smithi029 on smithi029 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:19:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:19:58.948 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:19:58 smithi029 ceph-mon[112128]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:19:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:19:58 smithi052 ceph-mon[121072]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:00.380 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:00.381 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:00.381 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:00 smithi029 ceph-mon[112128]: Reconfiguring prometheus.smithi029 (dependencies changed)... 2023-12-05T13:20:00.381 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:00 smithi029 ceph-mon[112128]: Reconfiguring daemon prometheus.smithi029 on smithi029 2023-12-05T13:20:00.381 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:00 smithi029 ceph-mon[112128]: overall HEALTH_OK 2023-12-05T13:20:00.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:00.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:00.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:00 smithi052 ceph-mon[121072]: Reconfiguring prometheus.smithi029 (dependencies changed)... 2023-12-05T13:20:00.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:00 smithi052 ceph-mon[121072]: Reconfiguring daemon prometheus.smithi029 on smithi029 2023-12-05T13:20:00.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:00 smithi052 ceph-mon[121072]: overall HEALTH_OK 2023-12-05T13:20:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:01 smithi052 ceph-mon[121072]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:01 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1752367720' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc29bb5c-04bc-4518-a111-9d849c4f0d99"}]: dispatch 2023-12-05T13:20:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:01 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1752367720' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc29bb5c-04bc-4518-a111-9d849c4f0d99"}]': finished 2023-12-05T13:20:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:01 smithi052 ceph-mon[121072]: osdmap e6: 1 total, 0 up, 1 in 2023-12-05T13:20:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:01 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:01 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2939513743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:20:01.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:01 smithi029 ceph-mon[112128]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:01.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:01 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1752367720' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc29bb5c-04bc-4518-a111-9d849c4f0d99"}]: dispatch 2023-12-05T13:20:01.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:01 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1752367720' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc29bb5c-04bc-4518-a111-9d849c4f0d99"}]': finished 2023-12-05T13:20:01.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:01 smithi029 ceph-mon[112128]: osdmap e6: 1 total, 0 up, 1 in 2023-12-05T13:20:01.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:01 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:01.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:01 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2939513743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:20:03.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:03 smithi052 ceph-mon[121072]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:03 smithi029 ceph-mon[112128]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:05.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:05 smithi029 ceph-mon[112128]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:05.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:05 smithi052 ceph-mon[121072]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:07.240 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:07 smithi029 ceph-mon[112128]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:07.240 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:07.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:07 smithi052 ceph-mon[121072]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:07.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:08 smithi052 ceph-mon[121072]: Reconfiguring crash.smithi052 (monmap changed)... 2023-12-05T13:20:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:20:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:08 smithi052 ceph-mon[121072]: Reconfiguring daemon crash.smithi052 on smithi052 2023-12-05T13:20:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:08 smithi029 ceph-mon[112128]: Reconfiguring crash.smithi052 (monmap changed)... 2023-12-05T13:20:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:20:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:08 smithi029 ceph-mon[112128]: Reconfiguring daemon crash.smithi052 on smithi052 2023-12-05T13:20:09.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:09.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:09.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:09.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: Reconfiguring mgr.smithi052.ocazcp (monmap changed)... 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: Deploying daemon osd.0 on smithi029 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:09 smithi029 ceph-mon[112128]: Reconfiguring daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:20:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T13:20:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: Reconfiguring mgr.smithi052.ocazcp (monmap changed)... 2023-12-05T13:20:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:20:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:20:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: Deploying daemon osd.0 on smithi029 2023-12-05T13:20:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:09 smithi052 ceph-mon[121072]: Reconfiguring daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:20:10.615 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:10.615 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:10.615 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:20:10.615 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:20:10.615 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:20:10.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:20:10.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:11.658 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: Reconfiguring mon.smithi052 (monmap changed)... 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: Reconfiguring daemon mon.smithi052 on smithi052 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi029.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi029.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T13:20:11.659 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.660 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:11 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: Reconfiguring mon.smithi052 (monmap changed)... 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: Reconfiguring daemon mon.smithi052 on smithi052 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi029.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:20:11.753 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi029.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T13:20:11.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:11.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:11 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:20:12.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T13:20:12.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:20:12.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi029.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T13:20:12.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:20:12.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi029.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T13:20:12.856 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:12.856 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:12 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:20:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi029.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T13:20:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:20:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi029.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T13:20:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:20:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi029.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T13:20:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:12 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:13 smithi029 ceph-mon[112128]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:13 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:13 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:13.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:13 smithi052 ceph-mon[121072]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:13.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:13 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:13.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:13 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:15.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:15.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:15.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:15.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:15.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.878+0000 7f9e037fe700 1 -- 172.21.15.29:0/2160088701 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9e1c10f620 con 0x7f9e04068ed0 2023-12-05T13:20:15.880 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 0 on host 'smithi029' 2023-12-05T13:20:15.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9e04068ed0 msgr2=0x7f9e0406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9e04068ed0 0x7f9e0406b380 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00b3b0 tx=0x7f9e0c009e30 comp rx=0 tx=0).stop 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 msgr2=0x7f9e1c10dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c10dab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c800 tx=0x7f9e10004470 comp rx=0 tx=0).stop 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 shutdown_connections 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9e04068ed0 0x7f9e0406b380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e1c0668e0 0x7f9e1c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 --2- 172.21.15.29:0/2160088701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e1c0ffdc0 0x7f9e1c10dab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.881+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 >> 172.21.15.29:0/2160088701 conn(0x7f9e1c0f71c0 msgr2=0x7f9e1c0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.882+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 shutdown_connections 2023-12-05T13:20:15.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:15.882+0000 7f9e21178700 1 -- 172.21.15.29:0/2160088701 wait complete. 2023-12-05T13:20:16.350 DEBUG:teuthology.orchestra.run.smithi029:osd.0> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.0.service 2023-12-05T13:20:16.353 INFO:tasks.cephadm:Deploying osd.1 on smithi029 with /dev/vg_nvme/lv_3... 2023-12-05T13:20:16.353 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-05T13:20:16.388 INFO:journalctl@ceph.osd.0.smithi029.stdout:-- Logs begin at Tue 2023-12-05 12:51:39 UTC. -- 2023-12-05T13:20:16.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:16 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:16 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:16 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:16 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.744 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:20:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:16 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:16 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:16 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:16 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:17.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:17 smithi029 ceph-mon[112128]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:17.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:17 smithi029 ceph-mon[112128]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T13:20:17.605 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:20:17 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[135899]: 2023-12-05T13:20:17.381+0000 7ff989801540 -1 osd.0 0 log_to_monitors true 2023-12-05T13:20:17.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:17 smithi052 ceph-mon[121072]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:17.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:17 smithi052 ceph-mon[121072]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T13:20:18.404 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-05T13:20:18.405 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-05T13:20:18.405 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-12-05T13:20:18.405 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-12-05T13:20:18.405 INFO:teuthology.orchestra.run.smithi029.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00837158 s, 1.3 GB/s 2023-12-05T13:20:18.405 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-12-05T13:20:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:18 smithi052 ceph-mon[121072]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T13:20:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:18 smithi052 ceph-mon[121072]: osdmap e7: 1 total, 0 up, 1 in 2023-12-05T13:20:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:18 smithi052 ceph-mon[121072]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:20:18.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:18.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:18.744 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[135899]: 2023-12-05T13:20:18.438+0000 7ff97ffe6700 -1 osd.0 0 waiting for initial osdmap 2023-12-05T13:20:18.744 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[135899]: 2023-12-05T13:20:18.443+0000 7ff97b5e2700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:20:18.744 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-mon[112128]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T13:20:18.744 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-mon[112128]: osdmap e7: 1 total, 0 up, 1 in 2023-12-05T13:20:18.745 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:18.745 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-mon[112128]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:20:18.745 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:18.745 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:18.778 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi029:vg_nvme/lv_3 2023-12-05T13:20:19.139 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:20:19.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:19 smithi052 ceph-mon[121072]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:19.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:19 smithi052 ceph-mon[121072]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-12-05T13:20:19.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:19 smithi052 ceph-mon[121072]: osdmap e8: 1 total, 0 up, 1 in 2023-12-05T13:20:19.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:19 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:19.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:19 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:19.765 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:19 smithi029 ceph-mon[112128]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:19.765 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:19 smithi029 ceph-mon[112128]: from='osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-12-05T13:20:19.765 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:19 smithi029 ceph-mon[112128]: osdmap e8: 1 total, 0 up, 1 in 2023-12-05T13:20:19.765 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:19 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:19.766 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:19 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:20.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 -- 172.21.15.29:0/2921413340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 msgr2=0x7f05240ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 --2- 172.21.15.29:0/2921413340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f05240ffb10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0514004940 tx=0x7f0514009e30 comp rx=0 tx=0).stop 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 -- 172.21.15.29:0/2921413340 shutdown_connections 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 --2- 172.21.15.29:0/2921413340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0524100050 0x7f0524102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 --2- 172.21.15.29:0/2921413340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f05240ffb10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 -- 172.21.15.29:0/2921413340 >> 172.21.15.29:0/2921413340 conn(0x7f05240f71d0 msgr2=0x7f05240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 -- 172.21.15.29:0/2921413340 shutdown_connections 2023-12-05T13:20:20.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.576+0000 7f0529001700 1 -- 172.21.15.29:0/2921413340 wait complete. 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.577+0000 7f0529001700 1 Processor -- start 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.577+0000 7f0529001700 1 -- start start 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.577+0000 7f0529001700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f052410d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.577+0000 7f0529001700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0524100050 0x7f052410da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.577+0000 7f0529001700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052410e050 con 0x7f05240fd730 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.577+0000 7f0529001700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052410e8f0 con 0x7f0524100050 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f052410d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f052410d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56372/0 (socket says 172.21.15.29:56372) 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 -- 172.21.15.29:0/2779391057 learned_addr learned my addr 172.21.15.29:0/2779391057 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f052259c700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0524100050 0x7f052410da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:20:20.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 -- 172.21.15.29:0/2779391057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0524100050 msgr2=0x7f052410da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0524100050 0x7f052410da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 -- 172.21.15.29:0/2779391057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514005040 con 0x7f05240fd730 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0522d9d700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f052410d510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0514009360 tx=0x7f0514009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f051400e040 con 0x7f05240fd730 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052410eb70 con 0x7f05240fd730 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f051400bc50 con 0x7f05240fd730 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f051401c3f0 con 0x7f05240fd730 2023-12-05T13:20:20.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.578+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052410f0b0 con 0x7f05240fd730 2023-12-05T13:20:20.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.579+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05241075c0 con 0x7f05240fd730 2023-12-05T13:20:20.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.580+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f0514013420 con 0x7f05240fd730 2023-12-05T13:20:20.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.580+0000 7f050b7fe700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f050c068ed0 0x7f050c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:20:20.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.580+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f0514087260 con 0x7f05240fd730 2023-12-05T13:20:20.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.580+0000 7f052259c700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f050c068ed0 0x7f050c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:20:20.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.581+0000 7f052259c700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f050c068ed0 0x7f050c06b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0518004f40 tx=0x7f051800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:20:20.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.585+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0514057fc0 con 0x7f05240fd730 2023-12-05T13:20:20.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:20 smithi029 ceph-mon[112128]: purged_snaps scrub starts 2023-12-05T13:20:20.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:20 smithi029 ceph-mon[112128]: purged_snaps scrub ok 2023-12-05T13:20:20.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:20.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:20 smithi029 ceph-mon[112128]: osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] boot 2023-12-05T13:20:20.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:20 smithi029 ceph-mon[112128]: osdmap e9: 1 total, 1 up, 1 in 2023-12-05T13:20:20.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:20.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:20 smithi052 ceph-mon[121072]: purged_snaps scrub starts 2023-12-05T13:20:20.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:20 smithi052 ceph-mon[121072]: purged_snaps scrub ok 2023-12-05T13:20:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:20 smithi052 ceph-mon[121072]: osd.0 [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] boot 2023-12-05T13:20:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:20 smithi052 ceph-mon[121072]: osdmap e9: 1 total, 1 up, 1 in 2023-12-05T13:20:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:20:20.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:20.805+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f052402b150 con 0x7f050c068ed0 2023-12-05T13:20:21.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:21 smithi052 ceph-mon[121072]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:21.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:20:21.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:20:21.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:21.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:21 smithi052 ceph-mon[121072]: osdmap e10: 1 total, 1 up, 1 in 2023-12-05T13:20:21.801 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:21 smithi029 ceph-mon[112128]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T13:20:21.801 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:20:21.802 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:20:21.802 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:21.802 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:21 smithi029 ceph-mon[112128]: osdmap e10: 1 total, 1 up, 1 in 2023-12-05T13:20:22.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:20:22.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:22.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:20:22.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:20:22.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:22.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:22.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:22.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:22.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi029 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi029 to 12902M 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2827284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a6e62e0-e01c-442e-9edc-e84c329ccd13"}]: dispatch 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2827284' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a6e62e0-e01c-442e-9edc-e84c329ccd13"}]': finished 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: osdmap e11: 2 total, 1 up, 2 in 2023-12-05T13:20:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:23 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: Detected new or changed devices on smithi029 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi029 to 12902M 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2827284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a6e62e0-e01c-442e-9edc-e84c329ccd13"}]: dispatch 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2827284' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a6e62e0-e01c-442e-9edc-e84c329ccd13"}]': finished 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: osdmap e11: 2 total, 1 up, 2 in 2023-12-05T13:20:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:23 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:24 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/119992781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:20:24.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:24 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/119992781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:20:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:25 smithi052 ceph-mon[121072]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:25 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:25.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:25 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:25.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:25 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:25.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:25 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:25.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:25 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:25.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:25 smithi029 ceph-mon[112128]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:25.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:25.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:25.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:25.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:25.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:25 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:27.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:27 smithi052 ceph-mon[121072]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:27.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:27 smithi029 ceph-mon[112128]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:29 smithi052 ceph-mon[121072]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:29.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:29 smithi029 ceph-mon[112128]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:30 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T13:20:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:30 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:30 smithi052 ceph-mon[121072]: Deploying daemon osd.1 on smithi029 2023-12-05T13:20:30.763 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:30 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T13:20:30.763 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:30 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:30.763 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:30 smithi029 ceph-mon[112128]: Deploying daemon osd.1 on smithi029 2023-12-05T13:20:31.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:31 smithi052 ceph-mon[121072]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:31.735 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:31 smithi029 ceph-mon[112128]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:33 smithi029 ceph-mon[112128]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:33 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:33 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:33 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:33.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:33 smithi052 ceph-mon[121072]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:33.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:33 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:33.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:33 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:33.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:33 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:35.775 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:35 smithi029 ceph-mon[112128]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:35.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:35 smithi052 ceph-mon[121072]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:36.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.304+0000 7f050b7fe700 1 -- 172.21.15.29:0/2779391057 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f052402b150 con 0x7f050c068ed0 2023-12-05T13:20:36.305 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 1 on host 'smithi029' 2023-12-05T13:20:36.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f050c068ed0 msgr2=0x7f050c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f050c068ed0 0x7f050c06b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0518004f40 tx=0x7f051800b040 comp rx=0 tx=0).stop 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 msgr2=0x7f052410d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f052410d510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0514009360 tx=0x7f0514009e30 comp rx=0 tx=0).stop 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 shutdown_connections 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f050c068ed0 0x7f050c06b380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05240fd730 0x7f052410d510 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 --2- 172.21.15.29:0/2779391057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0524100050 0x7f052410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:36.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 >> 172.21.15.29:0/2779391057 conn(0x7f05240f71d0 msgr2=0x7f05240f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:20:36.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 shutdown_connections 2023-12-05T13:20:36.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:36.307+0000 7f0529001700 1 -- 172.21.15.29:0/2779391057 wait complete. 2023-12-05T13:20:36.754 DEBUG:teuthology.orchestra.run.smithi029:osd.1> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.1.service 2023-12-05T13:20:36.757 INFO:tasks.cephadm:Deploying osd.2 on smithi029 with /dev/vg_nvme/lv_2... 2023-12-05T13:20:36.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-05T13:20:36.796 INFO:journalctl@ceph.osd.1.smithi029.stdout:-- Logs begin at Tue 2023-12-05 12:51:39 UTC. -- 2023-12-05T13:20:37.313 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:20:37.512 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:20:37 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[145555]: 2023-12-05T13:20:37.363+0000 7f0029a0c540 -1 osd.1 0 log_to_monitors true 2023-12-05T13:20:37.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:37 smithi029 ceph-mon[112128]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:37.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:37.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:37.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:37 smithi052 ceph-mon[121072]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:38.481 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:38.481 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:38.481 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:38 smithi029 ceph-mon[112128]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T13:20:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:38 smithi052 ceph-mon[121072]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T13:20:38.780 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-05T13:20:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-05T13:20:38.781 INFO:teuthology.orchestra.run.smithi029.stderr: stderr: 10+0 records in 2023-12-05T13:20:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:10+0 records out 2023-12-05T13:20:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00949574 s, 1.1 GB/s 2023-12-05T13:20:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:--> Zapping successful for: 2023-12-05T13:20:39.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi029:vg_nvme/lv_2 2023-12-05T13:20:39.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-mon[112128]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:39.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-mon[112128]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T13:20:39.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-mon[112128]: osdmap e12: 2 total, 1 up, 2 in 2023-12-05T13:20:39.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:39.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-mon[112128]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:20:39.354 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[145555]: 2023-12-05T13:20:39.316+0000 7f00201f1700 -1 osd.1 0 waiting for initial osdmap 2023-12-05T13:20:39.354 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:20:39 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[145555]: 2023-12-05T13:20:39.320+0000 7f0018fe8700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:20:39.520 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:20:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:39 smithi052 ceph-mon[121072]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:39 smithi052 ceph-mon[121072]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T13:20:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:39 smithi052 ceph-mon[121072]: osdmap e12: 2 total, 1 up, 2 in 2023-12-05T13:20:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:39 smithi052 ceph-mon[121072]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:20:40.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:40 smithi029 ceph-mon[112128]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-12-05T13:20:40.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:40 smithi029 ceph-mon[112128]: osdmap e13: 2 total, 1 up, 2 in 2023-12-05T13:20:40.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:40 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:40.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:40 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:40 smithi052 ceph-mon[121072]: from='osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-12-05T13:20:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:40 smithi052 ceph-mon[121072]: osdmap e13: 2 total, 1 up, 2 in 2023-12-05T13:20:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:40.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 -- 172.21.15.29:0/2142987465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 msgr2=0x7f7918102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 --2- 172.21.15.29:0/2142987465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f7918102430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7908004940 tx=0x7f7908009e30 comp rx=0 tx=0).stop 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 -- 172.21.15.29:0/2142987465 shutdown_connections 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 --2- 172.21.15.29:0/2142987465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f7918102430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 --2- 172.21.15.29:0/2142987465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79180fd730 0x7f79180ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 -- 172.21.15.29:0/2142987465 >> 172.21.15.29:0/2142987465 conn(0x7f79180f7190 msgr2=0x7f79180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:20:40.875 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 -- 172.21.15.29:0/2142987465 shutdown_connections 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.872+0000 7f79200ff700 1 -- 172.21.15.29:0/2142987465 wait complete. 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f79200ff700 1 Processor -- start 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f79200ff700 1 -- start start 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f79200ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79180fd730 0x7f791810d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f79200ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f791810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f79200ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791810dfe0 con 0x7f7918100050 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f79200ff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791810e880 con 0x7f79180fd730 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f791810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f791810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57736/0 (socket says 172.21.15.29:57736) 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 -- 172.21.15.29:0/3520979716 learned_addr learned my addr 172.21.15.29:0/3520979716 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791de9b700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79180fd730 0x7f791810d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:20:40.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 -- 172.21.15.29:0/3520979716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79180fd730 msgr2=0x7f791810d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79180fd730 0x7f791810d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 -- 172.21.15.29:0/3520979716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908005040 con 0x7f7918100050 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.873+0000 7f791d69a700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f791810d9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7908000c00 tx=0x7f7908009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.874+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7908021070 con 0x7f7918100050 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.874+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f790801c400 con 0x7f7918100050 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.874+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791810eb00 con 0x7f7918100050 2023-12-05T13:20:40.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.874+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790800e070 con 0x7f7918100050 2023-12-05T13:20:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.874+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791810efe0 con 0x7f7918100050 2023-12-05T13:20:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.875+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791804bb80 con 0x7f7918100050 2023-12-05T13:20:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.875+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f790801c9c0 con 0x7f7918100050 2023-12-05T13:20:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.876+0000 7f790e7fc700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7904068ed0 0x7f790406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:20:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.876+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f79080872f0 con 0x7f7918100050 2023-12-05T13:20:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.876+0000 7f791de9b700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7904068ed0 0x7f790406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:20:40.879 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.876+0000 7f791de9b700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7904068ed0 0x7f790406b380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7914009b80 tx=0x7f791400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:20:40.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:40.881+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7908057f20 con 0x7f7918100050 2023-12-05T13:20:41.100 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:41.099+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f791810f3f0 con 0x7f7904068ed0 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: purged_snaps scrub starts 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: purged_snaps scrub ok 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] boot 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: osdmap e14: 2 total, 2 up, 2 in 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:41.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:41 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:41.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: purged_snaps scrub starts 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: purged_snaps scrub ok 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: osd.1 [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] boot 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: osdmap e14: 2 total, 2 up, 2 in 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:20:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:20:41.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:41.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:41 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:42.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:42 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi029 2023-12-05T13:20:42.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:42 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi029 to 6451M 2023-12-05T13:20:42.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:42 smithi052 ceph-mon[121072]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:20:42.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:42 smithi052 ceph-mon[121072]: osdmap e15: 2 total, 2 up, 2 in 2023-12-05T13:20:42.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:42 smithi029 ceph-mon[112128]: Detected new or changed devices on smithi029 2023-12-05T13:20:42.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:42 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi029 to 6451M 2023-12-05T13:20:42.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:42 smithi029 ceph-mon[112128]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:20:42.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:42 smithi029 ceph-mon[112128]: osdmap e15: 2 total, 2 up, 2 in 2023-12-05T13:20:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:43 smithi029 ceph-mon[112128]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:43 smithi052 ceph-mon[121072]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:44 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2855169575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3002b9e9-bd72-42cc-ae96-94d56978a07b"}]: dispatch 2023-12-05T13:20:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:44 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2855169575' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3002b9e9-bd72-42cc-ae96-94d56978a07b"}]': finished 2023-12-05T13:20:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:44 smithi029 ceph-mon[112128]: osdmap e16: 3 total, 2 up, 3 in 2023-12-05T13:20:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:44 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:20:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:44 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1673538281' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:20:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:44 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2855169575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3002b9e9-bd72-42cc-ae96-94d56978a07b"}]: dispatch 2023-12-05T13:20:44.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:44 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2855169575' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3002b9e9-bd72-42cc-ae96-94d56978a07b"}]': finished 2023-12-05T13:20:44.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:44 smithi052 ceph-mon[121072]: osdmap e16: 3 total, 2 up, 3 in 2023-12-05T13:20:44.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:44 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:20:44.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:44 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1673538281' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:20:45.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:45 smithi029 ceph-mon[112128]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:45.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:45.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:45.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:45.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:45.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:45 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:45 smithi052 ceph-mon[121072]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:20:45.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:45 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:47.581 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:47 smithi029 ceph-mon[112128]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:47.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:47 smithi052 ceph-mon[121072]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:49 smithi029 ceph-mon[112128]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:49 smithi052 ceph-mon[121072]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T13:20:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T13:20:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:20:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:51 smithi029 ceph-mon[112128]: Deploying daemon osd.2 on smithi029 2023-12-05T13:20:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:51 smithi029 ceph-mon[112128]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:51.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:51 smithi052 ceph-mon[121072]: Deploying daemon osd.2 on smithi029 2023-12-05T13:20:51.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:51 smithi052 ceph-mon[121072]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:52.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:52.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:20:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:53 smithi029 ceph-mon[112128]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:53 smithi052 ceph-mon[121072]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:54.689 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:54.689 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:54.689 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:54.689 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:54 smithi029 ceph-mon[112128]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:54.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:20:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:54 smithi052 ceph-mon[121072]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:55.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.949+0000 7f790e7fc700 1 -- 172.21.15.29:0/3520979716 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f791810f3f0 con 0x7f7904068ed0 2023-12-05T13:20:55.950 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 2 on host 'smithi029' 2023-12-05T13:20:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7904068ed0 msgr2=0x7f790406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7904068ed0 0x7f790406b380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7914009b80 tx=0x7f791400b040 comp rx=0 tx=0).stop 2023-12-05T13:20:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 msgr2=0x7f791810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:20:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f791810d9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7908000c00 tx=0x7f7908009e30 comp rx=0 tx=0).stop 2023-12-05T13:20:55.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 shutdown_connections 2023-12-05T13:20:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7904068ed0 0x7f790406b380 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79180fd730 0x7f791810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 --2- 172.21.15.29:0/3520979716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7918100050 0x7f791810d9e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:20:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 >> 172.21.15.29:0/3520979716 conn(0x7f79180f7190 msgr2=0x7f79180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:20:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 shutdown_connections 2023-12-05T13:20:55.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:20:55.951+0000 7f79200ff700 1 -- 172.21.15.29:0/3520979716 wait complete. 2023-12-05T13:20:56.406 DEBUG:teuthology.orchestra.run.smithi029:osd.2> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.2.service 2023-12-05T13:20:56.409 INFO:tasks.cephadm:Deploying osd.3 on smithi052 with /dev/vg_nvme/lv_4... 2023-12-05T13:20:56.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-05T13:20:56.448 INFO:journalctl@ceph.osd.2.smithi029.stdout:-- Logs begin at Tue 2023-12-05 12:51:39 UTC. -- 2023-12-05T13:20:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:20:57.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:56 smithi052 ceph-mon[121072]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:57.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:57.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:56 smithi029 ceph-mon[112128]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:57.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:20:57 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[155199]: 2023-12-05T13:20:57.592+0000 7f4bcbbd1540 -1 osd.2 0 log_to_monitors true 2023-12-05T13:20:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-05T13:20:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-05T13:20:58.306 INFO:teuthology.orchestra.run.smithi052.stderr: stderr: 10+0 records in 2023-12-05T13:20:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:10+0 records out 2023-12-05T13:20:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00873249 s, 1.2 GB/s 2023-12-05T13:20:58.306 INFO:teuthology.orchestra.run.smithi052.stderr:--> Zapping successful for: 2023-12-05T13:20:58.587 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:58.587 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:58.587 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:58 smithi029 ceph-mon[112128]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T13:20:58.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:58.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:20:58.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:58 smithi052 ceph-mon[121072]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T13:20:58.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi052:vg_nvme/lv_4 2023-12-05T13:20:59.009 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:20:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:59 smithi052 ceph-mon[121072]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:59 smithi052 ceph-mon[121072]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T13:20:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:59 smithi052 ceph-mon[121072]: osdmap e17: 3 total, 2 up, 3 in 2023-12-05T13:20:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:59 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:20:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:20:59 smithi052 ceph-mon[121072]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:20:59.807 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[155199]: 2023-12-05T13:20:59.389+0000 7f4bc23b6700 -1 osd.2 0 waiting for initial osdmap 2023-12-05T13:20:59.808 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[155199]: 2023-12-05T13:20:59.394+0000 7f4bbd1b1700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:20:59.808 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-mon[112128]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:20:59.808 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-mon[112128]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T13:20:59.808 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-mon[112128]: osdmap e17: 3 total, 2 up, 3 in 2023-12-05T13:20:59.808 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:20:59.808 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:20:59 smithi029 ceph-mon[112128]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 -- 172.21.15.52:0/1318304439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fbaf0 msgr2=0x7f19380fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 --2- 172.21.15.52:0/1318304439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fbaf0 0x7f19380fbf00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1928004940 tx=0x7f1928009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 -- 172.21.15.52:0/1318304439 shutdown_connections 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 --2- 172.21.15.52:0/1318304439 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380fcd00 0x7f19380fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 --2- 172.21.15.52:0/1318304439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fbaf0 0x7f19380fbf00 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 -- 172.21.15.52:0/1318304439 >> 172.21.15.52:0/1318304439 conn(0x7f19380f7190 msgr2=0x7f19380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:00.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 -- 172.21.15.52:0/1318304439 shutdown_connections 2023-12-05T13:21:00.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.104+0000 7f193ea35700 1 -- 172.21.15.52:0/1318304439 wait complete. 2023-12-05T13:21:00.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f193ea35700 1 Processor -- start 2023-12-05T13:21:00.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f193ea35700 1 -- start start 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f193ea35700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380fbaf0 0x7f1938112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f193ea35700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 0x7f1938114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f193ea35700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1938066000 con 0x7f19380fbaf0 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f193ea35700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1938066140 con 0x7f19380fcd00 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f19377fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 0x7f1938114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f19377fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 0x7f1938114b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40690/0 (socket says 172.21.15.52:40690) 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f19377fe700 1 -- 172.21.15.52:0/4016925899 learned_addr learned my addr 172.21.15.52:0/4016925899 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:21:00.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.105+0000 7f1937fff700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380fbaf0 0x7f1938112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f19377fe700 1 -- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380fbaf0 msgr2=0x7f1938112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f19377fe700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380fbaf0 0x7f1938112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f19377fe700 1 -- 172.21.15.52:0/4016925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928005040 con 0x7f19380fcd00 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f19377fe700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 0x7f1938114b60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f192c00eb40 tx=0x7f192c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192c007cc0 con 0x7f19380fcd00 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f192c00f040 con 0x7f19380fcd00 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19381150a0 con 0x7f19380fcd00 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f192c00c990 con 0x7f19380fcd00 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.106+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1938115440 con 0x7f19380fcd00 2023-12-05T13:21:00.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.107+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193804bb80 con 0x7f19380fcd00 2023-12-05T13:21:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.108+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f192c00cc00 con 0x7f19380fcd00 2023-12-05T13:21:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.108+0000 7f1934ff9700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1920068ed0 0x7f192006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.108+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7f192c085d20 con 0x7f19380fcd00 2023-12-05T13:21:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.108+0000 7f1937fff700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1920068ed0 0x7f192006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:00.110 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.109+0000 7f1937fff700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1920068ed0 0x7f192006b380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1928009fd0 tx=0x7f1928009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:00.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.113+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f192c04da00 con 0x7f19380fcd00 2023-12-05T13:21:00.323 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:00.321+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1938101650 con 0x7f1920068ed0 2023-12-05T13:21:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: osdmap e18: 3 total, 2 up, 3 in 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:00.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: osdmap e18: 3 total, 2 up, 3 in 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:00.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: purged_snaps scrub starts 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: purged_snaps scrub ok 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi029 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi029 to 4300M 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] boot 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: osdmap e19: 3 total, 3 up, 3 in 2023-12-05T13:21:01.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:01 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: purged_snaps scrub starts 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: purged_snaps scrub ok 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: Detected new or changed devices on smithi029 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi029 to 4300M 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: osd.2 [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] boot 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: osdmap e19: 3 total, 3 up, 3 in 2023-12-05T13:21:01.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:01 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:21:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: osdmap e20: 3 total, 3 up, 3 in 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/2594220040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e250cbd9-ad56-4a7b-babf-fdb3cabab073"}]: dispatch 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e250cbd9-ad56-4a7b-babf-fdb3cabab073"}]: dispatch 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e250cbd9-ad56-4a7b-babf-fdb3cabab073"}]': finished 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: osdmap e21: 4 total, 3 up, 4 in 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:02.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:02 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: osdmap e20: 3 total, 3 up, 3 in 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/2594220040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e250cbd9-ad56-4a7b-babf-fdb3cabab073"}]: dispatch 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e250cbd9-ad56-4a7b-babf-fdb3cabab073"}]: dispatch 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e250cbd9-ad56-4a7b-babf-fdb3cabab073"}]': finished 2023-12-05T13:21:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: osdmap e21: 4 total, 3 up, 4 in 2023-12-05T13:21:02.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:02.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:02 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-05T13:21:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:03 smithi052 ceph-mon[121072]: pgmap v58: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:03 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/2761887927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:21:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-05T13:21:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:03 smithi052 ceph-mon[121072]: osdmap e22: 4 total, 3 up, 4 in 2023-12-05T13:21:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:03 smithi029 ceph-mon[112128]: pgmap v58: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:03 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/2761887927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:21:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-05T13:21:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:03 smithi029 ceph-mon[112128]: osdmap e22: 4 total, 3 up, 4 in 2023-12-05T13:21:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:04.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:04.405+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f192c053220 con 0x7f19380fcd00 2023-12-05T13:21:04.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161277]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T13:21:04.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161277]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:04.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161277]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:04.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161277]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:05.104 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161280]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T13:21:05.104 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161280]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:05.104 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161280]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:05.104 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:21:04 smithi029 sudo[161280]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:05.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161283]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T13:21:05.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161283]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:05.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161283]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:05.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161283]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:05 smithi029 ceph-mon[112128]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:05 smithi029 ceph-mon[112128]: mgrmap e19: smithi029.eekhlu(active, since 102s), standbys: smithi052.ocazcp 2023-12-05T13:21:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:05 smithi029 ceph-mon[112128]: osdmap e23: 4 total, 3 up, 4 in 2023-12-05T13:21:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:05 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:05 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:05 smithi052 ceph-mon[121072]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:05 smithi052 ceph-mon[121072]: mgrmap e19: smithi029.eekhlu(active, since 102s), standbys: smithi052.ocazcp 2023-12-05T13:21:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:05 smithi052 ceph-mon[121072]: osdmap e23: 4 total, 3 up, 4 in 2023-12-05T13:21:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:05 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:05 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:06.104 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161286]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T13:21:06.104 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161286]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:06.104 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161286]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:06.104 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:21:05 smithi029 sudo[161286]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:06.581 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161289]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T13:21:06.581 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161289]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:06.581 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161289]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:06.581 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161289]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:06.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161292]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T13:21:06.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161292]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:06.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161292]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:06.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:21:06 smithi029 sudo[161292]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:07.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161295]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T13:21:07.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161295]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:07.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161295]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:07.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161295]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:07.694 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:07 smithi052 ceph-mon[121072]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:07.694 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:07 smithi052 ceph-mon[121072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T13:21:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161298]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T13:21:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161298]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161298]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 sudo[161298]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 ceph-mon[112128]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:07 smithi029 ceph-mon[112128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T13:21:08.301 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:07 smithi052 sudo[126634]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T13:21:08.301 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:07 smithi052 sudo[126634]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:08.301 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:07 smithi052 sudo[126634]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:08.301 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:07 smithi052 sudo[126634]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 sudo[126661]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T13:21:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 sudo[126661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T13:21:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 sudo[126661]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 sudo[126661]: pam_unix(sudo:session): session closed for user root 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T13:21:08.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:08 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:21:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T13:21:08.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:08 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:09 smithi052 ceph-mon[121072]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T13:21:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:09 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:09 smithi052 ceph-mon[121072]: Deploying daemon osd.3 on smithi052 2023-12-05T13:21:09.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:09 smithi029 ceph-mon[112128]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:09.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T13:21:09.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:09 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:09.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:09 smithi029 ceph-mon[112128]: Deploying daemon osd.3 on smithi052 2023-12-05T13:21:11.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:11 smithi029 ceph-mon[112128]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:11.909 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:11 smithi052 ceph-mon[121072]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:13.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:13 smithi052 ceph-mon[121072]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-12-05T13:21:13.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:13 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:13.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:13 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:13.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:13 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:13 smithi029 ceph-mon[112128]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-12-05T13:21:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:13 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:13 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:13 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:15.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.024+0000 7f1934ff9700 1 -- 172.21.15.52:0/4016925899 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1938101650 con 0x7f1920068ed0 2023-12-05T13:21:15.026 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 3 on host 'smithi052' 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.026+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1920068ed0 msgr2=0x7f192006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.026+0000 7f193ea35700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1920068ed0 0x7f192006b380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1928009fd0 tx=0x7f1928009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.026+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 msgr2=0x7f1938114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.026+0000 7f193ea35700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 0x7f1938114b60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f192c00eb40 tx=0x7f192c00b040 comp rx=0 tx=0).stop 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 shutdown_connections 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1920068ed0 0x7f192006b380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19380fbaf0 0x7f1938112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 --2- 172.21.15.52:0/4016925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19380fcd00 0x7f1938114b60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 >> 172.21.15.52:0/4016925899 conn(0x7f19380f7190 msgr2=0x7f19380fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 shutdown_connections 2023-12-05T13:21:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:15.027+0000 7f193ea35700 1 -- 172.21.15.52:0/4016925899 wait complete. 2023-12-05T13:21:15.436 DEBUG:teuthology.orchestra.run.smithi052:osd.3> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.3.service 2023-12-05T13:21:15.438 INFO:tasks.cephadm:Deploying osd.4 on smithi052 with /dev/vg_nvme/lv_3... 2023-12-05T13:21:15.439 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-05T13:21:15.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:-- Logs begin at Tue 2023-12-05 12:51:31 UTC. -- 2023-12-05T13:21:15.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-05T13:21:15.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:15.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:15.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:15.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:15 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-05T13:21:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:15.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:15 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:21:16.723 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:21:16 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[127336]: 2023-12-05T13:21:16.568+0000 7fe42a8c9540 -1 osd.3 0 log_to_monitors true 2023-12-05T13:21:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-05T13:21:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-05T13:21:17.578 INFO:teuthology.orchestra.run.smithi052.stderr: stderr: 10+0 records in 2023-12-05T13:21:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:10+0 records out 2023-12-05T13:21:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0147575 s, 711 MB/s 2023-12-05T13:21:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:--> Zapping successful for: 2023-12-05T13:21:17.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:17 smithi052 ceph-mon[121072]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-05T13:21:17.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:17 smithi052 ceph-mon[121072]: from='osd.3 [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:21:17.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:17 smithi052 ceph-mon[121072]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:21:17.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:17 smithi029 ceph-mon[112128]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-05T13:21:17.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:17 smithi029 ceph-mon[112128]: from='osd.3 [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:21:17.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:17 smithi029 ceph-mon[112128]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:21:18.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi052:vg_nvme/lv_3 2023-12-05T13:21:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: osdmap e24: 4 total, 3 up, 4 in 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='osd.3 [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:18.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:18.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:18.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.859 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[127336]: 2023-12-05T13:21:18.555+0000 7fe4228b1700 -1 osd.3 0 waiting for initial osdmap 2023-12-05T13:21:18.859 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[127336]: 2023-12-05T13:21:18.562+0000 7fe419ea5700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:21:18.859 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T13:21:18.859 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: osdmap e24: 4 total, 3 up, 4 in 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='osd.3 [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:18.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:18.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:18.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:18.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:19.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 -- 172.21.15.52:0/3227793240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102100 msgr2=0x7f7ae81044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:19.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 --2- 172.21.15.52:0/3227793240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102100 0x7f7ae81044e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7adc004940 tx=0x7f7adc009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 -- 172.21.15.52:0/3227793240 shutdown_connections 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 --2- 172.21.15.52:0/3227793240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102100 0x7f7ae81044e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 --2- 172.21.15.52:0/3227793240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ae8066900 0x7f7ae8101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 -- 172.21.15.52:0/3227793240 >> 172.21.15.52:0/3227793240 conn(0x7f7ae80f71d0 msgr2=0x7f7ae80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 -- 172.21.15.52:0/3227793240 shutdown_connections 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.403+0000 7f7aed320700 1 -- 172.21.15.52:0/3227793240 wait complete. 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.404+0000 7f7aed320700 1 Processor -- start 2023-12-05T13:21:19.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.404+0000 7f7aed320700 1 -- start start 2023-12-05T13:21:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.404+0000 7f7aed320700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 0x7f7ae810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.404+0000 7f7aed320700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ae8102100 0x7f7ae810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:19.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.404+0000 7f7aed320700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae81103a0 con 0x7f7ae8102100 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.404+0000 7f7aed320700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8110c40 con 0x7f7ae8066900 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 0x7f7ae810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 0x7f7ae810f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44022/0 (socket says 172.21.15.52:44022) 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 -- 172.21.15.52:0/1241115778 learned_addr learned my addr 172.21.15.52:0/1241115778 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae67fc700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ae8102100 0x7f7ae810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 -- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ae8102100 msgr2=0x7f7ae810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ae8102100 0x7f7ae810fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 -- 172.21.15.52:0/1241115778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc005040 con 0x7f7ae8066900 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7ae6ffd700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 0x7f7ae810f860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c830 tx=0x7f7ad8004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad80106f0 con 0x7f7ae8066900 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae8110f20 con 0x7f7ae8066900 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ad8010d00 con 0x7f7ae8066900 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad8012e90 con 0x7f7ae8066900 2023-12-05T13:21:19.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.405+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae8111460 con 0x7f7ae8066900 2023-12-05T13:21:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.406+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae8109700 con 0x7f7ae8066900 2023-12-05T13:21:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.407+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7ad8010850 con 0x7f7ae8066900 2023-12-05T13:21:19.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.407+0000 7f7acf7fe700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7ad0068f60 0x7f7ad006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.408+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3490+0+0 (secure 0 0 0) 0x7f7ad80865b0 con 0x7f7ae8066900 2023-12-05T13:21:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.408+0000 7f7ae67fc700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7ad0068f60 0x7f7ad006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:19.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.408+0000 7f7ae67fc700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7ad0068f60 0x7f7ad006b410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7adc004890 tx=0x7f7adc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:19.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.412+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7ad8056cc0 con 0x7f7ae8066900 2023-12-05T13:21:19.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:19.624+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae81116e0 con 0x7f7ad0068f60 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: Detected new or changed devices on smithi052 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi052 to 15974M 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: osdmap e25: 4 total, 3 up, 4 in 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:19.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:19 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:19.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi052 2023-12-05T13:21:19.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi052 to 15974M 2023-12-05T13:21:19.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-05T13:21:19.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2023-12-05T13:21:19.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: osdmap e25: 4 total, 3 up, 4 in 2023-12-05T13:21:19.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:19.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:19 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: purged_snaps scrub starts 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: purged_snaps scrub ok 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: osd.3 [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] boot 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: osdmap e26: 4 total, 4 up, 4 in 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:20.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:20 smithi052 ceph-mon[121072]: osdmap e27: 4 total, 4 up, 4 in 2023-12-05T13:21:20.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: purged_snaps scrub starts 2023-12-05T13:21:20.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: purged_snaps scrub ok 2023-12-05T13:21:20.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:20.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: osd.3 [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] boot 2023-12-05T13:21:20.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: osdmap e26: 4 total, 4 up, 4 in 2023-12-05T13:21:20.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:21:20.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:21:20.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:21:20.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:21:20.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:20.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T13:21:20.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:20 smithi029 ceph-mon[112128]: osdmap e27: 4 total, 4 up, 4 in 2023-12-05T13:21:22.172 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: osdmap e28: 4 total, 4 up, 4 in 2023-12-05T13:21:22.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/2462978078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89646f3e-7cb0-46b5-b821-1fb42aeb152d"}]: dispatch 2023-12-05T13:21:22.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89646f3e-7cb0-46b5-b821-1fb42aeb152d"}]: dispatch 2023-12-05T13:21:22.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89646f3e-7cb0-46b5-b821-1fb42aeb152d"}]': finished 2023-12-05T13:21:22.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: osdmap e29: 5 total, 4 up, 5 in 2023-12-05T13:21:22.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:22.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: osdmap e28: 4 total, 4 up, 4 in 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/2462978078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89646f3e-7cb0-46b5-b821-1fb42aeb152d"}]: dispatch 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89646f3e-7cb0-46b5-b821-1fb42aeb152d"}]: dispatch 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89646f3e-7cb0-46b5-b821-1fb42aeb152d"}]': finished 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: osdmap e29: 5 total, 4 up, 5 in 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:23.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:22 smithi052 ceph-mon[121072]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 175 KiB/s, 0 objects/s recovering 2023-12-05T13:21:23.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:22 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/1066382850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:21:23.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:22 smithi052 ceph-mon[121072]: osdmap e30: 5 total, 4 up, 5 in 2023-12-05T13:21:23.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:22 smithi029 ceph-mon[112128]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 175 KiB/s, 0 objects/s recovering 2023-12-05T13:21:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:22 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/1066382850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:21:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:22 smithi029 ceph-mon[112128]: osdmap e30: 5 total, 4 up, 5 in 2023-12-05T13:21:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:25.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:24 smithi052 ceph-mon[121072]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-05T13:21:25.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:24 smithi029 ceph-mon[112128]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-05T13:21:27.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:26 smithi052 ceph-mon[121072]: pgmap v80: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-12-05T13:21:27.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:26 smithi029 ceph-mon[112128]: pgmap v80: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-12-05T13:21:28.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:27 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T13:21:28.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:27 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:27 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T13:21:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:27 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:29.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:28 smithi052 ceph-mon[121072]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-05T13:21:29.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:28 smithi052 ceph-mon[121072]: Deploying daemon osd.4 on smithi052 2023-12-05T13:21:29.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:28 smithi029 ceph-mon[112128]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-12-05T13:21:29.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:28 smithi029 ceph-mon[112128]: Deploying daemon osd.4 on smithi052 2023-12-05T13:21:31.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:30 smithi052 ceph-mon[121072]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:31.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:30 smithi029 ceph-mon[112128]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:33.198 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:32 smithi052 ceph-mon[121072]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:33.198 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:32 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:33.198 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:32 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:33.199 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:32 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:32 smithi029 ceph-mon[112128]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:32 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:32 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:32 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:34.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.631+0000 7f7acf7fe700 1 -- 172.21.15.52:0/1241115778 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7ae81116e0 con 0x7f7ad0068f60 2023-12-05T13:21:34.632 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 4 on host 'smithi052' 2023-12-05T13:21:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7ad0068f60 msgr2=0x7f7ad006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7ad0068f60 0x7f7ad006b410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7adc004890 tx=0x7f7adc009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 msgr2=0x7f7ae810f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 0x7f7ae810f860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c830 tx=0x7f7ad8004470 comp rx=0 tx=0).stop 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 shutdown_connections 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7ad0068f60 0x7f7ad006b410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8066900 0x7f7ae810f860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 --2- 172.21.15.52:0/1241115778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ae8102100 0x7f7ae810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 >> 172.21.15.52:0/1241115778 conn(0x7f7ae80f71d0 msgr2=0x7f7ae8104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 shutdown_connections 2023-12-05T13:21:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:34.633+0000 7f7aed320700 1 -- 172.21.15.52:0/1241115778 wait complete. 2023-12-05T13:21:35.030 DEBUG:teuthology.orchestra.run.smithi052:osd.4> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.4.service 2023-12-05T13:21:35.032 INFO:tasks.cephadm:Deploying osd.5 on smithi052 with /dev/vg_nvme/lv_2... 2023-12-05T13:21:35.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-05T13:21:35.069 INFO:journalctl@ceph.osd.4.smithi052.stdout:-- Logs begin at Tue 2023-12-05 12:51:31 UTC. -- 2023-12-05T13:21:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:21:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:35 smithi052 ceph-mon[121072]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:35.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:35 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:35 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:35 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:35 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:35 smithi029 ceph-mon[112128]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:36.068 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:21:35 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[135280]: 2023-12-05T13:21:35.850+0000 7efc12f25540 -1 osd.4 0 log_to_monitors true 2023-12-05T13:21:36.653 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:36 smithi052 ceph-mon[121072]: from='osd.4 [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:21:36.653 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:36 smithi052 ceph-mon[121072]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:21:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:36 smithi029 ceph-mon[112128]: from='osd.4 [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:21:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:36 smithi029 ceph-mon[112128]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:21:37.353 INFO:teuthology.orchestra.run.smithi052.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-05T13:21:37.353 INFO:teuthology.orchestra.run.smithi052.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-05T13:21:37.354 INFO:teuthology.orchestra.run.smithi052.stderr: stderr: 10+0 records in 2023-12-05T13:21:37.354 INFO:teuthology.orchestra.run.smithi052.stderr:10+0 records out 2023-12-05T13:21:37.354 INFO:teuthology.orchestra.run.smithi052.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112116 s, 935 MB/s 2023-12-05T13:21:37.354 INFO:teuthology.orchestra.run.smithi052.stderr:--> Zapping successful for: 2023-12-05T13:21:37.717 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[135280]: 2023-12-05T13:21:37.398+0000 7efc0970a700 -1 osd.4 0 waiting for initial osdmap 2023-12-05T13:21:37.717 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[135280]: 2023-12-05T13:21:37.407+0000 7efc04505700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: osdmap e31: 5 total, 4 up, 5 in 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: from='osd.4 [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:37.717 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:37.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi052:vg_nvme/lv_2 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: osdmap e31: 5 total, 4 up, 5 in 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: from='osd.4 [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: osdmap e32: 5 total, 4 up, 5 in 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:38.714 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.715 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:38.715 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:38.715 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.715 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:38 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: osdmap e32: 5 total, 4 up, 5 in 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:38 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:39.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.327+0000 7ff95f167700 1 -- 172.21.15.52:0/3865337276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958102100 msgr2=0x7ff9581044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:39.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.327+0000 7ff95f167700 1 --2- 172.21.15.52:0/3865337276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958102100 0x7ff9581044e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff94c004940 tx=0x7ff94c009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:39.329 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 -- 172.21.15.52:0/3865337276 shutdown_connections 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 --2- 172.21.15.52:0/3865337276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958102100 0x7ff9581044e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 --2- 172.21.15.52:0/3865337276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff958066070 0x7ff958101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 -- 172.21.15.52:0/3865337276 >> 172.21.15.52:0/3865337276 conn(0x7ff9580f7190 msgr2=0x7ff9580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 -- 172.21.15.52:0/3865337276 shutdown_connections 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 -- 172.21.15.52:0/3865337276 wait complete. 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 Processor -- start 2023-12-05T13:21:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.328+0000 7ff95f167700 1 -- start start 2023-12-05T13:21:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95f167700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 0x7ff95810f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95f167700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff958102100 0x7ff95810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95f167700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581103a0 con 0x7ff958102100 2023-12-05T13:21:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95f167700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958110c40 con 0x7ff958066070 2023-12-05T13:21:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 0x7ff95810f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 0x7ff95810f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59478/0 (socket says 172.21.15.52:59478) 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 -- 172.21.15.52:0/1722348008 learned_addr learned my addr 172.21.15.52:0/1722348008 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff957fff700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff958102100 0x7ff95810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 -- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff958102100 msgr2=0x7ff95810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff958102100 0x7ff95810fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 -- 172.21.15.52:0/1722348008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c005040 con 0x7ff958066070 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff95cf03700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 0x7ff95810f860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff948002a50 tx=0x7ff9480046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.329+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff948007cc0 con 0x7ff958066070 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.330+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff958110f20 con 0x7ff958066070 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.330+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff94800f040 con 0x7ff958066070 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.330+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94800d9c0 con 0x7ff958066070 2023-12-05T13:21:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.330+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff958111460 con 0x7ff958066070 2023-12-05T13:21:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.331+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958109700 con 0x7ff958066070 2023-12-05T13:21:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.331+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff94800db20 con 0x7ff958066070 2023-12-05T13:21:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.331+0000 7ff9557fa700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff940068f70 0x7ff94006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.332+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7ff9480865e0 con 0x7ff958066070 2023-12-05T13:21:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.332+0000 7ff957fff700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff940068f70 0x7ff94006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.332+0000 7ff957fff700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff940068f70 0x7ff94006b420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00b3b0 tx=0x7ff94c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.336+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9480569b0 con 0x7ff958066070 2023-12-05T13:21:39.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:39.547+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff958111680 con 0x7ff940068f70 2023-12-05T13:21:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: purged_snaps scrub starts 2023-12-05T13:21:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: purged_snaps scrub ok 2023-12-05T13:21:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi052 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi052 to 7987M 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: osd.4 [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] boot 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: osdmap e33: 5 total, 5 up, 5 in 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:39.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:39 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: purged_snaps scrub starts 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: purged_snaps scrub ok 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: Detected new or changed devices on smithi052 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi052 to 7987M 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: osd.4 [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] boot 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: osdmap e33: 5 total, 5 up, 5 in 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:39 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:40.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:40 smithi052 ceph-mon[121072]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:21:40.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:21:40.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:21:40.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:40 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:40.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:40 smithi052 ceph-mon[121072]: osdmap e34: 5 total, 5 up, 5 in 2023-12-05T13:21:40.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:40 smithi029 ceph-mon[112128]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:21:40.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:40 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T13:21:40.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:40 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T13:21:40.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:40 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:40.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:40 smithi029 ceph-mon[112128]: osdmap e34: 5 total, 5 up, 5 in 2023-12-05T13:21:41.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:41 smithi052 ceph-mon[121072]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:41.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:41 smithi029 ceph-mon[112128]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:42.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:42 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/3397249088' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f"}]: dispatch 2023-12-05T13:21:42.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:42 smithi052 ceph-mon[121072]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f"}]: dispatch 2023-12-05T13:21:42.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:42 smithi052 ceph-mon[121072]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f"}]': finished 2023-12-05T13:21:42.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:42 smithi052 ceph-mon[121072]: osdmap e35: 6 total, 5 up, 6 in 2023-12-05T13:21:42.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:42 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:42.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:42 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/1985008753' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:21:42.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:42 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/3397249088' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f"}]: dispatch 2023-12-05T13:21:42.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:42 smithi029 ceph-mon[112128]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f"}]: dispatch 2023-12-05T13:21:42.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:42 smithi029 ceph-mon[112128]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f"}]': finished 2023-12-05T13:21:42.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:42 smithi029 ceph-mon[112128]: osdmap e35: 6 total, 5 up, 6 in 2023-12-05T13:21:42.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:42 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:42.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:42 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/1985008753' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T13:21:43.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:43 smithi029 ceph-mon[112128]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:43.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:43 smithi052 ceph-mon[121072]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:45.618 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:45 smithi052 ceph-mon[121072]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:45.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:45 smithi029 ceph-mon[112128]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:47.701 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:47 smithi052 ceph-mon[121072]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:47.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:47 smithi029 ceph-mon[112128]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T13:21:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:48.955 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T13:21:48.955 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:49.592 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:49 smithi052 ceph-mon[121072]: Deploying daemon osd.5 on smithi052 2023-12-05T13:21:49.592 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:49 smithi052 ceph-mon[121072]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:49 smithi029 ceph-mon[112128]: Deploying daemon osd.5 on smithi052 2023-12-05T13:21:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:49 smithi029 ceph-mon[112128]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:51.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:50 smithi052 ceph-mon[121072]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:51.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:50 smithi029 ceph-mon[112128]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:52.935 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:52.935 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:52.935 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:52.936 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:52 smithi052 ceph-mon[121072]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:52.936 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:52 smithi029 ceph-mon[112128]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:21:54.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.002+0000 7ff9557fa700 1 -- 172.21.15.52:0/1722348008 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff958111680 con 0x7ff940068f70 2023-12-05T13:21:54.005 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 5 on host 'smithi052' 2023-12-05T13:21:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.005+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff940068f70 msgr2=0x7ff94006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.005+0000 7ff95f167700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff940068f70 0x7ff94006b420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00b3b0 tx=0x7ff94c009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.005+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 msgr2=0x7ff95810f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 0x7ff95810f860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff948002a50 tx=0x7ff9480046b0 comp rx=0 tx=0).stop 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 shutdown_connections 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff940068f70 0x7ff94006b420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff958066070 0x7ff95810f860 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 --2- 172.21.15.52:0/1722348008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff958102100 0x7ff95810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:54.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 >> 172.21.15.52:0/1722348008 conn(0x7ff9580f7190 msgr2=0x7ff9580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 shutdown_connections 2023-12-05T13:21:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:21:54.006+0000 7ff95f167700 1 -- 172.21.15.52:0/1722348008 wait complete. 2023-12-05T13:21:54.444 DEBUG:teuthology.orchestra.run.smithi052:osd.5> sudo journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.5.service 2023-12-05T13:21:54.446 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-05T13:21:54.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-05T13:21:54.481 INFO:journalctl@ceph.osd.5.smithi052.stdout:-- Logs begin at Tue 2023-12-05 12:51:31 UTC. -- 2023-12-05T13:21:54.745 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:21:55.194 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:54 smithi029 ceph-mon[112128]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:55.194 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.194 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.194 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.194 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.299 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:54 smithi052 ceph-mon[121072]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:55.300 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.300 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.300 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.300 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:55.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 -- 172.21.15.29:0/4199704362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fee20 msgr2=0x7fa6340ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:55.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/4199704362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fee20 0x7fa6340ff230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa628004940 tx=0x7fa628009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:55.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 -- 172.21.15.29:0/4199704362 shutdown_connections 2023-12-05T13:21:55.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/4199704362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fff90 0x7fa634100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/4199704362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fee20 0x7fa6340ff230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 -- 172.21.15.29:0/4199704362 >> 172.21.15.29:0/4199704362 conn(0x7fa6340fa5d0 msgr2=0x7fa6340fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.827+0000 7fa63b3cb700 1 -- 172.21.15.29:0/4199704362 shutdown_connections 2023-12-05T13:21:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.828+0000 7fa63b3cb700 1 -- 172.21.15.29:0/4199704362 wait complete. 2023-12-05T13:21:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa63b3cb700 1 Processor -- start 2023-12-05T13:21:55.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa63b3cb700 1 -- start start 2023-12-05T13:21:55.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa63b3cb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 0x7fa63410f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:55.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa63b3cb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 0x7fa63410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:55.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa63b3cb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634110210 con 0x7fa6340fff90 2023-12-05T13:21:55.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa63b3cb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634110ab0 con 0x7fa6340fee20 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa638966700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 0x7fa63410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa639167700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 0x7fa63410f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa638966700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 0x7fa63410fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56742/0 (socket says 172.21.15.29:56742) 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa638966700 1 -- 172.21.15.29:0/2804786509 learned_addr learned my addr 172.21.15.29:0/2804786509 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa639167700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 0x7fa63410f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:47186/0 (socket says 172.21.15.29:47186) 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa639167700 1 -- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 msgr2=0x7fa63410fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa639167700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 0x7fa63410fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.829+0000 7fa639167700 1 -- 172.21.15.29:0/2804786509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628005040 con 0x7fa6340fee20 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa638966700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 0x7fa63410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa639167700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 0x7fa63410f6d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa62800b0d0 tx=0x7fa628009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa62800e070 con 0x7fa6340fee20 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa634110d30 con 0x7fa6340fee20 2023-12-05T13:21:55.832 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa62801c400 con 0x7fa6340fee20 2023-12-05T13:21:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa62800b650 con 0x7fa6340fee20 2023-12-05T13:21:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.830+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634111210 con 0x7fa6340fee20 2023-12-05T13:21:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.831+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63404bb80 con 0x7fa6340fee20 2023-12-05T13:21:55.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.832+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa62801c9e0 con 0x7fa6340fee20 2023-12-05T13:21:55.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.832+0000 7fa625ffb700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa620068f60 0x7fa62006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:55.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.832+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4317+0+0 (secure 0 0 0) 0x7fa628087bc0 con 0x7fa6340fee20 2023-12-05T13:21:55.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.832+0000 7fa638966700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa620068f60 0x7fa62006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:55.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.833+0000 7fa638966700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa620068f60 0x7fa62006b410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6300041d0 tx=0x7fa63000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:55.838 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:55.837+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa628057fa0 con 0x7fa6340fee20 2023-12-05T13:21:55.974 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:21:55 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[144192]: 2023-12-05T13:21:55.610+0000 7fed86b8e540 -1 osd.5 0 log_to_monitors true 2023-12-05T13:21:56.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.041+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fa6341077d0 con 0x7fa6340fee20 2023-12-05T13:21:56.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.041+0000 7fa625ffb700 1 -- 172.21.15.29:0/2804786509 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7fa628057b30 con 0x7fa6340fee20 2023-12-05T13:21:56.042 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa620068f60 msgr2=0x7fa62006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa620068f60 0x7fa62006b410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6300041d0 tx=0x7fa63000b040 comp rx=0 tx=0).stop 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 msgr2=0x7fa63410f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 0x7fa63410f6d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa62800b0d0 tx=0x7fa628009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 shutdown_connections 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa620068f60 0x7fa62006b410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6340fee20 0x7fa63410f6d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 --2- 172.21.15.29:0/2804786509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6340fff90 0x7fa63410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 >> 172.21.15.29:0/2804786509 conn(0x7fa6340fa5d0 msgr2=0x7fa634103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 shutdown_connections 2023-12-05T13:21:56.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:56.044+0000 7fa63b3cb700 1 -- 172.21.15.29:0/2804786509 wait complete. 2023-12-05T13:21:56.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:56 smithi029 ceph-mon[112128]: from='osd.5 [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:21:56.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:56 smithi029 ceph-mon[112128]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:21:56.431 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1701782498,"num_in_osds":6,"osd_in_since":1701782501,"num_remapped_pgs":0} 2023-12-05T13:21:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:56 smithi052 ceph-mon[121072]: from='osd.5 [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:21:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:56 smithi052 ceph-mon[121072]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:21:57.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[144192]: 2023-12-05T13:21:57.010+0000 7fed7d373700 -1 osd.5 0 waiting for initial osdmap 2023-12-05T13:21:57.224 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[144192]: 2023-12-05T13:21:57.021+0000 7fed7716c700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: osdmap e36: 6 total, 5 up, 6 in 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='osd.5 [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2804786509' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:57.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:57.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:57.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:57.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:57.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: osdmap e36: 6 total, 5 up, 6 in 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='osd.5 [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2804786509' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T13:21:57.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:57.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:57.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-05T13:21:57.735 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:21:58.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: Detected new or changed devices on smithi052 2023-12-05T13:21:58.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi052 to 5324M 2023-12-05T13:21:58.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2023-12-05T13:21:58.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: osdmap e37: 6 total, 5 up, 6 in 2023-12-05T13:21:58.336 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:58.336 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:58.336 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:58.336 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:58.336 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:58.336 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi052 2023-12-05T13:21:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi052 to 5324M 2023-12-05T13:21:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: osdmap e37: 6 total, 5 up, 6 in 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:21:58.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 -- 172.21.15.29:0/3758568903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 msgr2=0x7f8484070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 --2- 172.21.15.29:0/3758568903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f8484070980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8474004940 tx=0x7f8474009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 -- 172.21.15.29:0/3758568903 shutdown_connections 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 --2- 172.21.15.29:0/3758568903 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f8484070980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 --2- 172.21.15.29:0/3758568903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8484071b60 0x7f848406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 -- 172.21.15.29:0/3758568903 >> 172.21.15.29:0/3758568903 conn(0x7f84840f82d0 msgr2=0x7f84840fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 -- 172.21.15.29:0/3758568903 shutdown_connections 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.867+0000 7f848b3b9700 1 -- 172.21.15.29:0/3758568903 wait complete. 2023-12-05T13:21:58.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.868+0000 7f848b3b9700 1 Processor -- start 2023-12-05T13:21:58.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.868+0000 7f848b3b9700 1 -- start start 2023-12-05T13:21:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.868+0000 7f848b3b9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f848410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.868+0000 7f848b3b9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8484071b60 0x7f848410fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.868+0000 7f848b3b9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84841102c0 con 0x7f8484070510 2023-12-05T13:21:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.868+0000 7f848b3b9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8484110b60 con 0x7f8484071b60 2023-12-05T13:21:58.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f848410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f848410f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57950/0 (socket says 172.21.15.29:57950) 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 -- 172.21.15.29:0/2979621475 learned_addr learned my addr 172.21.15.29:0/2979621475 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8488954700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8484071b60 0x7f848410fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 -- 172.21.15.29:0/2979621475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8484071b60 msgr2=0x7f848410fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8484071b60 0x7f848410fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 -- 172.21.15.29:0/2979621475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474005040 con 0x7f8484070510 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8489155700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f848410f780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f848000c830 tx=0x7f8480004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84800106f0 con 0x7f8484070510 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8484110e40 con 0x7f8484070510 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8480010d00 con 0x7f8484070510 2023-12-05T13:21:58.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.869+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8480012e90 con 0x7f8484070510 2023-12-05T13:21:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.870+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8484111380 con 0x7f8484070510 2023-12-05T13:21:58.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.871+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84841096f0 con 0x7f8484070510 2023-12-05T13:21:58.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.871+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8480010850 con 0x7f8484070510 2023-12-05T13:21:58.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.871+0000 7f8479ffb700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8470068f60 0x7f847006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:21:58.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.871+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8480086a20 con 0x7f8484070510 2023-12-05T13:21:58.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.872+0000 7f8488954700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8470068f60 0x7f847006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:21:58.874 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.872+0000 7f8488954700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8470068f60 0x7f847006b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f847400b3b0 tx=0x7f8474009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:21:58.877 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:58.876+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8480056cc0 con 0x7f8484070510 2023-12-05T13:21:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.080+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f848404bb80 con 0x7f8484070510 2023-12-05T13:21:59.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.080+0000 7f8479ffb700 1 -- 172.21.15.29:0/2979621475 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f8480056850 con 0x7f8484070510 2023-12-05T13:21:59.082 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8470068f60 msgr2=0x7f847006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8470068f60 0x7f847006b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f847400b3b0 tx=0x7f8474009e30 comp rx=0 tx=0).stop 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 msgr2=0x7f848410f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f848410f780 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f848000c830 tx=0x7f8480004470 comp rx=0 tx=0).stop 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 shutdown_connections 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8470068f60 0x7f847006b410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8484070510 0x7f848410f780 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 --2- 172.21.15.29:0/2979621475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8484071b60 0x7f848410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 >> 172.21.15.29:0/2979621475 conn(0x7f84840f82d0 msgr2=0x7f84840fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 shutdown_connections 2023-12-05T13:21:59.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:21:59.083+0000 7f848b3b9700 1 -- 172.21.15.29:0/2979621475 wait complete. 2023-12-05T13:21:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:59 smithi029 ceph-mon[112128]: purged_snaps scrub starts 2023-12-05T13:21:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:59 smithi029 ceph-mon[112128]: purged_snaps scrub ok 2023-12-05T13:21:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:59 smithi029 ceph-mon[112128]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:59 smithi029 ceph-mon[112128]: osd.5 [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] boot 2023-12-05T13:21:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:59 smithi029 ceph-mon[112128]: osdmap e38: 6 total, 6 up, 6 in 2023-12-05T13:21:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:21:59 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:59 smithi052 ceph-mon[121072]: purged_snaps scrub starts 2023-12-05T13:21:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:59 smithi052 ceph-mon[121072]: purged_snaps scrub ok 2023-12-05T13:21:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:59 smithi052 ceph-mon[121072]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T13:21:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:59 smithi052 ceph-mon[121072]: osd.5 [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] boot 2023-12-05T13:21:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:59 smithi052 ceph-mon[121072]: osdmap e38: 6 total, 6 up, 6 in 2023-12-05T13:21:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:21:59 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:21:59.500 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1701782518,"num_in_osds":6,"osd_in_since":1701782501,"num_remapped_pgs":0} 2023-12-05T13:21:59.500 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T13:21:59.797 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:00.301 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:00 smithi029 ceph-mon[112128]: osdmap e39: 6 total, 6 up, 6 in 2023-12-05T13:22:00.301 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:00 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2979621475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T13:22:00.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:00 smithi052 ceph-mon[121072]: osdmap e39: 6 total, 6 up, 6 in 2023-12-05T13:22:00.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:00 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2979621475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T13:22:00.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/1513177929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 msgr2=0x7f6e94065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:00.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/1513177929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94065800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6e88004940 tx=0x7f6e88009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:00.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/1513177929 shutdown_connections 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/1513177929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94065800 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/1513177929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e94102c20 0x7f6e94102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/1513177929 >> 172.21.15.29:0/1513177929 conn(0x7f6e940719b0 msgr2=0x7f6e94071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/1513177929 shutdown_connections 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/1513177929 wait complete. 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.910+0000 7f6e9a6eb700 1 Processor -- start 2023-12-05T13:22:00.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e9a6eb700 1 -- start start 2023-12-05T13:22:00.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e9a6eb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:00.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e9a6eb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e94102c20 0x7f6e94113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:00.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e9a6eb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e941142c0 con 0x7f6e94065390 2023-12-05T13:22:00.913 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e9a6eb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9410d5f0 con 0x7f6e94102c20 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57964/0 (socket says 172.21.15.29:57964) 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 -- 172.21.15.29:0/2724726333 learned_addr learned my addr 172.21.15.29:0/2724726333 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e937fe700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e94102c20 0x7f6e94113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 -- 172.21.15.29:0/2724726333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e94102c20 msgr2=0x7f6e94113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e94102c20 0x7f6e94113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 -- 172.21.15.29:0/2724726333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88005040 con 0x7f6e94065390 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.911+0000 7f6e93fff700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94113730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c830 tx=0x7f6e84004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.912+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e8400a760 con 0x7f6e94065390 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.912+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9410d8d0 con 0x7f6e94065390 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.912+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e8400ad70 con 0x7f6e94065390 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.912+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e840113a0 con 0x7f6e94065390 2023-12-05T13:22:00.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.912+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9410de10 con 0x7f6e94065390 2023-12-05T13:22:00.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.913+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e940fff40 con 0x7f6e94065390 2023-12-05T13:22:00.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.913+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6e84012400 con 0x7f6e94065390 2023-12-05T13:22:00.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.914+0000 7f6e90ff9700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6e7c068f60 0x7f6e7c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.914+0000 7f6e937fe700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6e7c068f60 0x7f6e7c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.914+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6e84086ad0 con 0x7f6e94065390 2023-12-05T13:22:00.916 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.914+0000 7f6e937fe700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6e7c068f60 0x7f6e7c06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b3b0 tx=0x7f6e88009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:00.919 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:00.918+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6e84056d70 con 0x7f6e94065390 2023-12-05T13:22:01.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.120+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e9404bb80 con 0x7f6e94065390 2023-12-05T13:22:01.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.121+0000 7f6e90ff9700 1 -- 172.21.15.29:0/2724726333 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11008 (secure 0 0 0) 0x7f6e84056900 con 0x7f6e94065390 2023-12-05T13:22:01.122 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:01.122 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","created":"2023-12-05T13:17:36.045441+0000","modified":"2023-12-05T13:21:59.066031+0000","last_up_change":"2023-12-05T13:21:58.006915+0000","last_in_change":"2023-12-05T13:21:41.541471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T13:21:02.367176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bc29bb5c-04bc-4518-a111-9d849c4f0d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6803","nonce":3753865905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6805","nonce":3753865905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6809","nonce":3753865905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6807","nonce":3753865905}]},"public_addr":"172.21.15.29:6803/3753865905","cluster_addr":"172.21.15.29:6805/3753865905","heartbeat_back_addr":"172.21.15.29:6809/3753865905","heartbeat_front_addr":"172.21.15.29:6807/3753865905","state":["exists","up"]},{"osd":1,"uuid":"3a6e62e0-e01c-442e-9edc-e84c329ccd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6811","nonce":526482960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6813","nonce":526482960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6817","nonce":526482960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6815","nonce":526482960}]},"public_addr":"172.21.15.29:6811/526482960","cluster_addr":"172.21.15.29:6813/526482960","heartbeat_back_addr":"172.21.15.29:6817/526482960","heartbeat_front_addr":"172.21.15.29:6815/526482960","state":["exists","up"]},{"osd":2,"uuid":"3002b9e9-bd72-42cc-ae96-94d56978a07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6819","nonce":958560708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6821","nonce":958560708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6825","nonce":958560708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6823","nonce":958560708}]},"public_addr":"172.21.15.29:6819/958560708","cluster_addr":"172.21.15.29:6821/958560708","heartbeat_back_addr":"172.21.15.29:6825/958560708","heartbeat_front_addr":"172.21.15.29:6823/958560708","state":["exists","up"]},{"osd":3,"uuid":"e250cbd9-ad56-4a7b-babf-fdb3cabab073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6801","nonce":428901563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6803","nonce":428901563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6807","nonce":428901563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6805","nonce":428901563}]},"public_addr":"172.21.15.52:6801/428901563","cluster_addr":"172.21.15.52:6803/428901563","heartbeat_back_addr":"172.21.15.52:6807/428901563","heartbeat_front_addr":"172.21.15.52:6805/428901563","state":["exists","up"]},{"osd":4,"uuid":"89646f3e-7cb0-46b5-b821-1fb42aeb152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6809","nonce":845940001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6811","nonce":845940001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6815","nonce":845940001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6813","nonce":845940001}]},"public_addr":"172.21.15.52:6809/845940001","cluster_addr":"172.21.15.52:6811/845940001","heartbeat_back_addr":"172.21.15.52:6815/845940001","heartbeat_front_addr":"172.21.15.52:6813/845940001","state":["exists","up"]},{"osd":5,"uuid":"bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6817","nonce":4188463667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6819","nonce":4188463667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6823","nonce":4188463667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6821","nonce":4188463667}]},"public_addr":"172.21.15.52:6817/4188463667","cluster_addr":"172.21.15.52:6819/4188463667","heartbeat_back_addr":"172.21.15.52:6823/4188463667","heartbeat_front_addr":"172.21.15.52:6821/4188463667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:18.340381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:38.341916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:58.622396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:17.619538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:36.860723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:56.648279+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/3643035279":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/2512512522":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/4099120105":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/2782816162":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6801/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1756367778":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/2026205753":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6800/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/599938718":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/3972762513":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1009526803":"2023-12-06T13:18:27.235853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T13:22:01.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6e7c068f60 msgr2=0x7f6e7c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:01.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6e7c068f60 0x7f6e7c06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800b3b0 tx=0x7f6e88009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:01.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 msgr2=0x7f6e94113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:01.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94113730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c830 tx=0x7f6e84004470 comp rx=0 tx=0).stop 2023-12-05T13:22:01.124 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 shutdown_connections 2023-12-05T13:22:01.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6e7c068f60 0x7f6e7c06b410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:01.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e94065390 0x7f6e94113730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:01.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 --2- 172.21.15.29:0/2724726333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e94102c20 0x7f6e94113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:01.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.123+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 >> 172.21.15.29:0/2724726333 conn(0x7f6e940719b0 msgr2=0x7f6e940fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:01.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.124+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 shutdown_connections 2023-12-05T13:22:01.125 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:01.124+0000 7f6e9a6eb700 1 -- 172.21.15.29:0/2724726333 wait complete. 2023-12-05T13:22:01.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:01 smithi029 ceph-mon[112128]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:01 smithi052 ceph-mon[121072]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:01.522 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T13:21:02.367176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-05T13:22:01.523 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-05T13:22:01.820 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:02.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:02 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2724726333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:22:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:02 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2724726333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:22:02.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 -- 172.21.15.29:0/1293026083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10680fbb40 msgr2=0x7f10680fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:02.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 --2- 172.21.15.29:0/1293026083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10680fbb40 0x7f10680fbfb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f105c004940 tx=0x7f105c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:02.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 -- 172.21.15.29:0/1293026083 shutdown_connections 2023-12-05T13:22:02.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 --2- 172.21.15.29:0/1293026083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10680fbb40 0x7f10680fbfb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:02.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 --2- 172.21.15.29:0/1293026083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1068101b00 0x7f1068101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:02.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 -- 172.21.15.29:0/1293026083 >> 172.21.15.29:0/1293026083 conn(0x7f10680719b0 msgr2=0x7f1068071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 -- 172.21.15.29:0/1293026083 shutdown_connections 2023-12-05T13:22:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.924+0000 7f106e265700 1 -- 172.21.15.29:0/1293026083 wait complete. 2023-12-05T13:22:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.925+0000 7f106e265700 1 Processor -- start 2023-12-05T13:22:02.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.925+0000 7f106e265700 1 -- start start 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.925+0000 7f106e265700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10680fbb40 0x7f106810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f106e265700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 0x7f106810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f106e265700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106810f290 con 0x7f1068101b00 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f106e265700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106810f400 con 0x7f10680fbb40 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 0x7f106810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 0x7f106810ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57980/0 (socket says 172.21.15.29:57980) 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 -- 172.21.15.29:0/1748300475 learned_addr learned my addr 172.21.15.29:0/1748300475 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:02.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f1067fff700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10680fbb40 0x7f106810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 -- 172.21.15.29:0/1748300475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10680fbb40 msgr2=0x7f106810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10680fbb40 0x7f106810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 -- 172.21.15.29:0/1748300475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c005040 con 0x7f1068101b00 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f10677fe700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 0x7f106810ece0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b3b0 tx=0x7f105c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105c00e040 con 0x7f1068101b00 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f105c01c430 con 0x7f1068101b00 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1068117710 con 0x7f1068101b00 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105c013640 con 0x7f1068101b00 2023-12-05T13:22:02.929 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.926+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1068117c20 con 0x7f1068101b00 2023-12-05T13:22:02.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.928+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1068103fb0 con 0x7f1068101b00 2023-12-05T13:22:02.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.928+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f105c00bb80 con 0x7f1068101b00 2023-12-05T13:22:02.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.928+0000 7f1064ff9700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1050068f60 0x7f105006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:02.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.928+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f105c0875d0 con 0x7f1068101b00 2023-12-05T13:22:02.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.928+0000 7f1067fff700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1050068f60 0x7f105006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:02.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.929+0000 7f1067fff700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1050068f60 0x7f105006b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1058007fd0 tx=0x7f1058009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:02.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:02.933+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f105c053e90 con 0x7f1068101b00 2023-12-05T13:22:03.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.133+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f106804bb80 con 0x7f1068101b00 2023-12-05T13:22:03.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.133+0000 7f1064ff9700 1 -- 172.21.15.29:0/1748300475 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f105c0574b0 con 0x7f1068101b00 2023-12-05T13:22:03.134 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-12-05T13:22:03.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1050068f60 msgr2=0x7f105006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:03.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1050068f60 0x7f105006b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1058007fd0 tx=0x7f1058009040 comp rx=0 tx=0).stop 2023-12-05T13:22:03.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 msgr2=0x7f106810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 0x7f106810ece0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b3b0 tx=0x7f105c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 shutdown_connections 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1050068f60 0x7f105006b410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10680fbb40 0x7f106810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 --2- 172.21.15.29:0/1748300475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1068101b00 0x7f106810ece0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.135+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 >> 172.21.15.29:0/1748300475 conn(0x7f10680719b0 msgr2=0x7f10680fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:03.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.136+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 shutdown_connections 2023-12-05T13:22:03.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:03.136+0000 7f106e265700 1 -- 172.21.15.29:0/1748300475 wait complete. 2023-12-05T13:22:03.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:03 smithi029 ceph-mon[112128]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:03.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:03 smithi052 ceph-mon[121072]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:03.580 INFO:tasks.cephadm:Setting up client nodes... 2023-12-05T13:22:03.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-05T13:22:03.878 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:04.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:04 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1748300475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:22:04.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:04 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1748300475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 -- 172.21.15.29:0/2269457017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 msgr2=0x7ff51c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 --2- 172.21.15.29:0/2269457017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c0fd150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff50c004940 tx=0x7ff50c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 -- 172.21.15.29:0/2269457017 shutdown_connections 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 --2- 172.21.15.29:0/2269457017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c0fd150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 --2- 172.21.15.29:0/2269457017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c0fbaf0 0x7ff51c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 -- 172.21.15.29:0/2269457017 >> 172.21.15.29:0/2269457017 conn(0x7ff51c0f7190 msgr2=0x7ff51c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 -- 172.21.15.29:0/2269457017 shutdown_connections 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 -- 172.21.15.29:0/2269457017 wait complete. 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.986+0000 7ff524730700 1 Processor -- start 2023-12-05T13:22:04.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff524730700 1 -- start start 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff524730700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c0fbaf0 0x7ff51c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff524730700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff524730700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c10e0c0 con 0x7ff51c0fcd00 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff524730700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c10e960 con 0x7ff51c0fbaf0 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57988/0 (socket says 172.21.15.29:57988) 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 -- 172.21.15.29:0/57667156 learned_addr learned my addr 172.21.15.29:0/57667156 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff5224cc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c0fbaf0 0x7ff51c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 -- 172.21.15.29:0/57667156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c0fbaf0 msgr2=0x7ff51c10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c0fbaf0 0x7ff51c10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 -- 172.21.15.29:0/57667156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c005040 con 0x7ff51c0fcd00 2023-12-05T13:22:04.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.987+0000 7ff521ccb700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c10dac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009360 tx=0x7ff50c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:04.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.988+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50c00e040 con 0x7ff51c0fcd00 2023-12-05T13:22:04.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.988+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff50c00bc50 con 0x7ff51c0fcd00 2023-12-05T13:22:04.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.988+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c10ebe0 con 0x7ff51c0fcd00 2023-12-05T13:22:04.990 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.988+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50c01c3f0 con 0x7ff51c0fcd00 2023-12-05T13:22:04.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.988+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c10f120 con 0x7ff51c0fcd00 2023-12-05T13:22:04.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.989+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c04bb80 con 0x7ff51c0fcd00 2023-12-05T13:22:04.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.989+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff50c013420 con 0x7ff51c0fcd00 2023-12-05T13:22:04.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.990+0000 7ff512ffd700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff508068f60 0x7ff50806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:04.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.990+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff50c087dd0 con 0x7ff51c0fcd00 2023-12-05T13:22:04.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.990+0000 7ff5224cc700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff508068f60 0x7ff50806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:04.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.990+0000 7ff5224cc700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff508068f60 0x7ff50806b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0fcb60 tx=0x7ff51800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:04.994+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff50c057ff0 con 0x7ff51c0fcd00 2023-12-05T13:22:05.276 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.275+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff51c104490 con 0x7ff51c0fcd00 2023-12-05T13:22:05.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.280+0000 7ff512ffd700 1 -- 172.21.15.29:0/57667156 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff50c057b80 con 0x7ff51c0fcd00 2023-12-05T13:22:05.281 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-12-05T13:22:05.281 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD9I29lf3yGEBAAktAbr+trxNsLqqTK9CmIKw== 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff508068f60 msgr2=0x7ff50806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff508068f60 0x7ff50806b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0fcb60 tx=0x7ff51800b040 comp rx=0 tx=0).stop 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 msgr2=0x7ff51c10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c10dac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009360 tx=0x7ff50c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 shutdown_connections 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff508068f60 0x7ff50806b410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c0fbaf0 0x7ff51c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:05.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 --2- 172.21.15.29:0/57667156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff51c0fcd00 0x7ff51c10dac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:05.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 >> 172.21.15.29:0/57667156 conn(0x7ff51c0f7190 msgr2=0x7ff51c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:05.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 shutdown_connections 2023-12-05T13:22:05.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:05.282+0000 7ff524730700 1 -- 172.21.15.29:0/57667156 wait complete. 2023-12-05T13:22:05.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:05 smithi029 ceph-mon[112128]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:05.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:05 smithi052 ceph-mon[121072]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:05.671 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:22:05.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-05T13:22:05.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-05T13:22:05.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-05T13:22:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi052/config 2023-12-05T13:22:06.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:06 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/57667156' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T13:22:06.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:06 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/57667156' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T13:22:06.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:06 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/57667156' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T13:22:06.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:06 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/57667156' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.293+0000 7faafaaab700 1 -- 172.21.15.52:0/1841782215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 msgr2=0x7faaf40fb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.293+0000 7faafaaab700 1 --2- 172.21.15.52:0/1841782215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fb380 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faae8004940 tx=0x7faae8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.293+0000 7faafaaab700 1 -- 172.21.15.52:0/1841782215 shutdown_connections 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.293+0000 7faafaaab700 1 --2- 172.21.15.52:0/1841782215 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fb950 0x7faaf40fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.293+0000 7faafaaab700 1 --2- 172.21.15.52:0/1841782215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fb380 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.293+0000 7faafaaab700 1 -- 172.21.15.52:0/1841782215 >> 172.21.15.52:0/1841782215 conn(0x7faaf40f6950 msgr2=0x7faaf40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.294+0000 7faafaaab700 1 -- 172.21.15.52:0/1841782215 shutdown_connections 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.294+0000 7faafaaab700 1 -- 172.21.15.52:0/1841782215 wait complete. 2023-12-05T13:22:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.294+0000 7faafaaab700 1 Processor -- start 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.294+0000 7faafaaab700 1 -- start start 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faafaaab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faafaaab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fbf50 0x7faaf40fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faafaaab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40fc950 con 0x7faaf40fbf50 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faafaaab700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40fca90 con 0x7faaf40faf70 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44364/0 (socket says 172.21.15.52:44364) 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 -- 172.21.15.52:0/304243839 learned_addr learned my addr 172.21.15.52:0/304243839 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf3fff700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fbf50 0x7faaf40fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 -- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fbf50 msgr2=0x7faaf40fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fbf50 0x7faaf40fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 -- 172.21.15.52:0/304243839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8005040 con 0x7faaf40faf70 2023-12-05T13:22:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf3fff700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fbf50 0x7faaf40fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:22:07.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf8847700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fdad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faae8000c00 tx=0x7faae8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:07.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae8021070 con 0x7faaf40faf70 2023-12-05T13:22:07.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf40fcd10 con 0x7faaf40faf70 2023-12-05T13:22:07.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faae8009410 con 0x7faaf40faf70 2023-12-05T13:22:07.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae800e070 con 0x7faaf40faf70 2023-12-05T13:22:07.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.295+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4115a40 con 0x7faaf40faf70 2023-12-05T13:22:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.296+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf404bb80 con 0x7faaf40faf70 2023-12-05T13:22:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.297+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faae801c400 con 0x7faaf40faf70 2023-12-05T13:22:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.298+0000 7faaf17fa700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7faae4068f60 0x7faae406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.298+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faae8088420 con 0x7faaf40faf70 2023-12-05T13:22:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.298+0000 7faaf3fff700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7faae4068f60 0x7faae406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.299+0000 7faaf3fff700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7faae4068f60 0x7faae406b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faae0004600 tx=0x7faae000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:07.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.302+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faae80586e0 con 0x7faaf40faf70 2023-12-05T13:22:07.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.586+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7faaf4065150 con 0x7faaf40faf70 2023-12-05T13:22:07.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.591+0000 7faaf17fa700 1 -- 172.21.15.52:0/304243839 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7faae8004490 con 0x7faaf40faf70 2023-12-05T13:22:07.592 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2023-12-05T13:22:07.592 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD/I29lyckSIxAAsVK3Nrr65OMzkMxRw+E4Ow== 2023-12-05T13:22:07.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7faae4068f60 msgr2=0x7faae406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7faae4068f60 0x7faae406b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faae0004600 tx=0x7faae000b040 comp rx=0 tx=0).stop 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 msgr2=0x7faaf40fdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fdad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faae8000c00 tx=0x7faae8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 shutdown_connections 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7faae4068f60 0x7faae406b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faaf40faf70 0x7faaf40fdad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 --2- 172.21.15.52:0/304243839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faaf40fbf50 0x7faaf40fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 >> 172.21.15.52:0/304243839 conn(0x7faaf40f6950 msgr2=0x7faaf41013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 shutdown_connections 2023-12-05T13:22:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-12-05T13:22:07.593+0000 7faafaaab700 1 -- 172.21.15.52:0/304243839 wait complete. 2023-12-05T13:22:07.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:07 smithi029 ceph-mon[112128]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:07.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:07.621 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:07 smithi052 ceph-mon[121072]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:07.621 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:08.021 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:22:08.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-05T13:22:08.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-05T13:22:08.069 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-05T13:22:08.069 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-05T13:22:08.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-05T13:22:08.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:08 smithi029 ceph-mon[112128]: from='client.? 172.21.15.52:0/304243839' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T13:22:08.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:08 smithi029 ceph-mon[112128]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T13:22:08.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:08 smithi029 ceph-mon[112128]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T13:22:08.368 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:08 smithi052 ceph-mon[121072]: from='client.? 172.21.15.52:0/304243839' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T13:22:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:08 smithi052 ceph-mon[121072]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T13:22:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:08 smithi052 ceph-mon[121072]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 -- 172.21.15.29:0/3981075032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd540fbb00 msgr2=0x7fcd540fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/3981075032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd540fbb00 0x7fcd540fbf70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcd44004940 tx=0x7fcd44009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 -- 172.21.15.29:0/3981075032 shutdown_connections 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/3981075032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd540fbb00 0x7fcd540fbf70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/3981075032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd54101b60 0x7fcd54101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 -- 172.21.15.29:0/3981075032 >> 172.21.15.29:0/3981075032 conn(0x7fcd540f7680 msgr2=0x7fcd540f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 -- 172.21.15.29:0/3981075032 shutdown_connections 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 -- 172.21.15.29:0/3981075032 wait complete. 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 Processor -- start 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.444+0000 7fcd5bf38700 1 -- start start 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd5bf38700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb00 0x7fcd54112540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd5bf38700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 0x7fcd54112a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd5bf38700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd541130d0 con 0x7fcd54101b60 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd5bf38700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5410c400 con 0x7fcd540fbb00 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 0x7fcd54112a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 0x7fcd54112a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46226/0 (socket says 172.21.15.29:46226) 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 -- 172.21.15.29:0/2511908080 learned_addr learned my addr 172.21.15.29:0/2511908080 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd59cd4700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb00 0x7fcd54112540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:09.451 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 -- 172.21.15.29:0/2511908080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb00 msgr2=0x7fcd54112540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb00 0x7fcd54112540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 -- 172.21.15.29:0/2511908080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44005040 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd59cd4700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb00 0x7fcd54112540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd594d3700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 0x7fcd54112a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400b3b0 tx=0x7fcd44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4400e040 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd44009af0 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd44013770 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.445+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5410c680 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.446+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5410cb60 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.446+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd540fb280 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.448+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcd4401e420 con 0x7fcd54101b60 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.448+0000 7fcd4a7fc700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcd40068f60 0x7fcd4006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.448+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcd4408b570 con 0x7fcd54101b60 2023-12-05T13:22:09.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.448+0000 7fcd59cd4700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcd40068f60 0x7fcd4006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:09.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.449+0000 7fcd59cd4700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcd40068f60 0x7fcd4006b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009fd0 tx=0x7fcd50009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:09.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.452+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcd4405b7f0 con 0x7fcd54101b60 2023-12-05T13:22:09.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:09 smithi029 ceph-mon[112128]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:09.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.715+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcd54108a90 con 0x7fcd54101b60 2023-12-05T13:22:09.719 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.718+0000 7fcd4a7fc700 1 -- 172.21.15.29:0/2511908080 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166773 (secure 0 0 0) 0x7fcd44011370 con 0x7fcd54101b60 2023-12-05T13:22:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:09.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcd40068f60 msgr2=0x7fcd4006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcd40068f60 0x7fcd4006b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009fd0 tx=0x7fcd50009ee0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 msgr2=0x7fcd54112a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 0x7fcd54112a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400b3b0 tx=0x7fcd44009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 shutdown_connections 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcd40068f60 0x7fcd4006b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb00 0x7fcd54112540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 --2- 172.21.15.29:0/2511908080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b60 0x7fcd54112a80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 >> 172.21.15.29:0/2511908080 conn(0x7fcd540f7680 msgr2=0x7fcd540f8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 shutdown_connections 2023-12-05T13:22:09.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:09.721+0000 7fcd5bf38700 1 -- 172.21.15.29:0/2511908080 wait complete. 2023-12-05T13:22:09.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:09 smithi052 ceph-mon[121072]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:10.112 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":19,"active_gid":14210,"active_name":"smithi029.eekhlu","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":382423942},{"type":"v1","addr":"172.21.15.29:6801","nonce":382423942}]},"active_addr":"172.21.15.29:6801/382423942","active_change":"2023-12-05T13:19:21.825320+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi052.ocazcp","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.29:8443/","prometheus":"http://172.21.15.29:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":245095326}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":1614407330}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":1782978356}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":2154010871}]}]} 2023-12-05T13:22:10.116 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-05T13:22:10.116 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-05T13:22:10.116 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T13:22:10.416 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:10.542 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:10 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2511908080' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-05T13:22:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:10 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2511908080' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-05T13:22:11.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 -- 172.21.15.29:0/1078194646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 msgr2=0x7f2520102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 --2- 172.21.15.29:0/1078194646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520102fc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f251c004940 tx=0x7f251c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 -- 172.21.15.29:0/1078194646 shutdown_connections 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 --2- 172.21.15.29:0/1078194646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2520103590 0x7f25200fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 --2- 172.21.15.29:0/1078194646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520102fc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 -- 172.21.15.29:0/1078194646 >> 172.21.15.29:0/1078194646 conn(0x7f25200f87a0 msgr2=0x7f25200fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 -- 172.21.15.29:0/1078194646 shutdown_connections 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.411+0000 7f2527fd8700 1 -- 172.21.15.29:0/1078194646 wait complete. 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2527fd8700 1 Processor -- start 2023-12-05T13:22:11.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2527fd8700 1 -- start start 2023-12-05T13:22:11.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2527fd8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:11.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2527fd8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2520103590 0x7f2520113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:11.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2527fd8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252010d500 con 0x7f2520102bf0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2527fd8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252010d670 con 0x7f2520103590 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2525d74700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2525d74700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46244/0 (socket says 172.21.15.29:46244) 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2525d74700 1 -- 172.21.15.29:0/695218999 learned_addr learned my addr 172.21.15.29:0/695218999 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.412+0000 7f2525573700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2520103590 0x7f2520113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f2525d74700 1 -- 172.21.15.29:0/695218999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2520103590 msgr2=0x7f2520113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f2525d74700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2520103590 0x7f2520113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f2525d74700 1 -- 172.21.15.29:0/695218999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c005040 con 0x7f2520102bf0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f2525d74700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520113640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f251c00b3b0 tx=0x7f251c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251c00e040 con 0x7f2520102bf0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252010d8f0 con 0x7f2520102bf0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f251c00bc50 con 0x7f2520102bf0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251c013420 con 0x7f2520102bf0 2023-12-05T13:22:11.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.413+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252010de30 con 0x7f2520102bf0 2023-12-05T13:22:11.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.414+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200fc3a0 con 0x7f2520102bf0 2023-12-05T13:22:11.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.415+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f251c01c430 con 0x7f2520102bf0 2023-12-05T13:22:11.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.415+0000 7f25127fc700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f250c068f60 0x7f250c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:11.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.415+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f251c087850 con 0x7f2520102bf0 2023-12-05T13:22:11.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.415+0000 7f2525573700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f250c068f60 0x7f250c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:11.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.416+0000 7f2525573700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f250c068f60 0x7f250c06b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2514006fd0 tx=0x7f2514008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:11.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.420+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f251c057ba0 con 0x7f2520102bf0 2023-12-05T13:22:11.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:11 smithi029 ceph-mon[112128]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:11.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.622+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f252010ec20 con 0x7f2520102bf0 2023-12-05T13:22:11.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.623+0000 7f25127fc700 1 -- 172.21.15.29:0/695218999 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11008 (secure 0 0 0) 0x7f251c057730 con 0x7f2520102bf0 2023-12-05T13:22:11.624 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:11.624 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","created":"2023-12-05T13:17:36.045441+0000","modified":"2023-12-05T13:21:59.066031+0000","last_up_change":"2023-12-05T13:21:58.006915+0000","last_in_change":"2023-12-05T13:21:41.541471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T13:21:02.367176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bc29bb5c-04bc-4518-a111-9d849c4f0d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6803","nonce":3753865905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6805","nonce":3753865905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6809","nonce":3753865905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6807","nonce":3753865905}]},"public_addr":"172.21.15.29:6803/3753865905","cluster_addr":"172.21.15.29:6805/3753865905","heartbeat_back_addr":"172.21.15.29:6809/3753865905","heartbeat_front_addr":"172.21.15.29:6807/3753865905","state":["exists","up"]},{"osd":1,"uuid":"3a6e62e0-e01c-442e-9edc-e84c329ccd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6811","nonce":526482960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6813","nonce":526482960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6817","nonce":526482960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6815","nonce":526482960}]},"public_addr":"172.21.15.29:6811/526482960","cluster_addr":"172.21.15.29:6813/526482960","heartbeat_back_addr":"172.21.15.29:6817/526482960","heartbeat_front_addr":"172.21.15.29:6815/526482960","state":["exists","up"]},{"osd":2,"uuid":"3002b9e9-bd72-42cc-ae96-94d56978a07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6819","nonce":958560708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6821","nonce":958560708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6825","nonce":958560708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6823","nonce":958560708}]},"public_addr":"172.21.15.29:6819/958560708","cluster_addr":"172.21.15.29:6821/958560708","heartbeat_back_addr":"172.21.15.29:6825/958560708","heartbeat_front_addr":"172.21.15.29:6823/958560708","state":["exists","up"]},{"osd":3,"uuid":"e250cbd9-ad56-4a7b-babf-fdb3cabab073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6801","nonce":428901563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6803","nonce":428901563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6807","nonce":428901563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6805","nonce":428901563}]},"public_addr":"172.21.15.52:6801/428901563","cluster_addr":"172.21.15.52:6803/428901563","heartbeat_back_addr":"172.21.15.52:6807/428901563","heartbeat_front_addr":"172.21.15.52:6805/428901563","state":["exists","up"]},{"osd":4,"uuid":"89646f3e-7cb0-46b5-b821-1fb42aeb152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6809","nonce":845940001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6811","nonce":845940001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6815","nonce":845940001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6813","nonce":845940001}]},"public_addr":"172.21.15.52:6809/845940001","cluster_addr":"172.21.15.52:6811/845940001","heartbeat_back_addr":"172.21.15.52:6815/845940001","heartbeat_front_addr":"172.21.15.52:6813/845940001","state":["exists","up"]},{"osd":5,"uuid":"bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6817","nonce":4188463667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6819","nonce":4188463667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6823","nonce":4188463667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6821","nonce":4188463667}]},"public_addr":"172.21.15.52:6817/4188463667","cluster_addr":"172.21.15.52:6819/4188463667","heartbeat_back_addr":"172.21.15.52:6823/4188463667","heartbeat_front_addr":"172.21.15.52:6821/4188463667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:18.340381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:38.341916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:58.622396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:17.619538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:36.860723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:56.648279+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/3643035279":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/2512512522":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/4099120105":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/2782816162":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6801/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1756367778":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/2026205753":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6800/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/599938718":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/3972762513":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1009526803":"2023-12-06T13:18:27.235853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T13:22:11.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.625+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f250c068f60 msgr2=0x7f250c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:11.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f250c068f60 0x7f250c06b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2514006fd0 tx=0x7f2514008040 comp rx=0 tx=0).stop 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 msgr2=0x7f2520113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520113640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f251c00b3b0 tx=0x7f251c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 shutdown_connections 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f250c068f60 0x7f250c06b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2520102bf0 0x7f2520113640 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 --2- 172.21.15.29:0/695218999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2520103590 0x7f2520113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 >> 172.21.15.29:0/695218999 conn(0x7f25200f87a0 msgr2=0x7f25200fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 shutdown_connections 2023-12-05T13:22:11.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:11.626+0000 7f2527fd8700 1 -- 172.21.15.29:0/695218999 wait complete. 2023-12-05T13:22:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:11 smithi052 ceph-mon[121072]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:12.012 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-05T13:22:12.012 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T13:22:12.308 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:12.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:12 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/695218999' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:22:12.599 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:12 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/695218999' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:22:13.346 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2638523119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88102410 msgr2=0x7f4a880fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2638523119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88102410 0x7f4a880fc2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4a74004940 tx=0x7f4a74009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2638523119 shutdown_connections 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2638523119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88102410 0x7f4a880fc2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2638523119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a88101b00 0x7f4a88101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2638523119 >> 172.21.15.29:0/2638523119 conn(0x7f4a880711a0 msgr2=0x7f4a880715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2638523119 shutdown_connections 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.345+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2638523119 wait complete. 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8efdb700 1 Processor -- start 2023-12-05T13:22:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8efdb700 1 -- start start 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8efdb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 0x7f4a881125b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8efdb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a88102410 0x7f4a88112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8efdb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a881131d0 con 0x7f4a88101b00 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8efdb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8810c470 con 0x7f4a88102410 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8cd77700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 0x7f4a881125b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8cd77700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 0x7f4a881125b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46252/0 (socket says 172.21.15.29:46252) 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.346+0000 7f4a8cd77700 1 -- 172.21.15.29:0/2637967971 learned_addr learned my addr 172.21.15.29:0/2637967971 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a87fff700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a88102410 0x7f4a88112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a8cd77700 1 -- 172.21.15.29:0/2637967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a88102410 msgr2=0x7f4a88112af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a8cd77700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a88102410 0x7f4a88112af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a8cd77700 1 -- 172.21.15.29:0/2637967971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74005040 con 0x7f4a88101b00 2023-12-05T13:22:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a8cd77700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 0x7f4a881125b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00b790 tx=0x7f4a7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c00f770 con 0x7f4a88101b00 2023-12-05T13:22:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a7c00fd80 con 0x7f4a88101b00 2023-12-05T13:22:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8810c750 con 0x7f4a88101b00 2023-12-05T13:22:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c00d310 con 0x7f4a88101b00 2023-12-05T13:22:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.347+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8810cc90 con 0x7f4a88101b00 2023-12-05T13:22:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.348+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a880fee60 con 0x7f4a88101b00 2023-12-05T13:22:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.349+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4a7c010420 con 0x7f4a88101b00 2023-12-05T13:22:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.349+0000 7f4a857fa700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a78068f60 0x7f4a7806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.349+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4a7c086920 con 0x7f4a88101b00 2023-12-05T13:22:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.349+0000 7f4a87fff700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a78068f60 0x7f4a7806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.350+0000 7f4a87fff700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a78068f60 0x7f4a7806b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400b3b0 tx=0x7f4a74009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:13.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.354+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a7c056c60 con 0x7f4a88101b00 2023-12-05T13:22:13.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.558+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a8810db90 con 0x7f4a88101b00 2023-12-05T13:22:13.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.559+0000 7f4a857fa700 1 -- 172.21.15.29:0/2637967971 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11008 (secure 0 0 0) 0x7f4a7c0567f0 con 0x7f4a88101b00 2023-12-05T13:22:13.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:13.560 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":39,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","created":"2023-12-05T13:17:36.045441+0000","modified":"2023-12-05T13:21:59.066031+0000","last_up_change":"2023-12-05T13:21:58.006915+0000","last_in_change":"2023-12-05T13:21:41.541471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T13:21:02.367176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bc29bb5c-04bc-4518-a111-9d849c4f0d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6803","nonce":3753865905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6805","nonce":3753865905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6809","nonce":3753865905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6807","nonce":3753865905}]},"public_addr":"172.21.15.29:6803/3753865905","cluster_addr":"172.21.15.29:6805/3753865905","heartbeat_back_addr":"172.21.15.29:6809/3753865905","heartbeat_front_addr":"172.21.15.29:6807/3753865905","state":["exists","up"]},{"osd":1,"uuid":"3a6e62e0-e01c-442e-9edc-e84c329ccd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6811","nonce":526482960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6813","nonce":526482960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6817","nonce":526482960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6815","nonce":526482960}]},"public_addr":"172.21.15.29:6811/526482960","cluster_addr":"172.21.15.29:6813/526482960","heartbeat_back_addr":"172.21.15.29:6817/526482960","heartbeat_front_addr":"172.21.15.29:6815/526482960","state":["exists","up"]},{"osd":2,"uuid":"3002b9e9-bd72-42cc-ae96-94d56978a07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6819","nonce":958560708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6821","nonce":958560708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6825","nonce":958560708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6823","nonce":958560708}]},"public_addr":"172.21.15.29:6819/958560708","cluster_addr":"172.21.15.29:6821/958560708","heartbeat_back_addr":"172.21.15.29:6825/958560708","heartbeat_front_addr":"172.21.15.29:6823/958560708","state":["exists","up"]},{"osd":3,"uuid":"e250cbd9-ad56-4a7b-babf-fdb3cabab073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6801","nonce":428901563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6803","nonce":428901563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6807","nonce":428901563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6805","nonce":428901563}]},"public_addr":"172.21.15.52:6801/428901563","cluster_addr":"172.21.15.52:6803/428901563","heartbeat_back_addr":"172.21.15.52:6807/428901563","heartbeat_front_addr":"172.21.15.52:6805/428901563","state":["exists","up"]},{"osd":4,"uuid":"89646f3e-7cb0-46b5-b821-1fb42aeb152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6809","nonce":845940001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6811","nonce":845940001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6815","nonce":845940001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6813","nonce":845940001}]},"public_addr":"172.21.15.52:6809/845940001","cluster_addr":"172.21.15.52:6811/845940001","heartbeat_back_addr":"172.21.15.52:6815/845940001","heartbeat_front_addr":"172.21.15.52:6813/845940001","state":["exists","up"]},{"osd":5,"uuid":"bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6817","nonce":4188463667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6819","nonce":4188463667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6823","nonce":4188463667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6821","nonce":4188463667}]},"public_addr":"172.21.15.52:6817/4188463667","cluster_addr":"172.21.15.52:6819/4188463667","heartbeat_back_addr":"172.21.15.52:6823/4188463667","heartbeat_front_addr":"172.21.15.52:6821/4188463667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:18.340381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:38.341916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:58.622396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:17.619538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:36.860723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:56.648279+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/3643035279":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/2512512522":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/4099120105":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/2782816162":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6801/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1756367778":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/2026205753":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6800/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/599938718":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/3972762513":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1009526803":"2023-12-06T13:18:27.235853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T13:22:13.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a78068f60 msgr2=0x7f4a7806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:13.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a78068f60 0x7f4a7806b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400b3b0 tx=0x7f4a74009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:13.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 msgr2=0x7f4a881125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:13.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 0x7f4a881125b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00b790 tx=0x7f4a7c009250 comp rx=0 tx=0).stop 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 shutdown_connections 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a78068f60 0x7f4a7806b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a88101b00 0x7f4a881125b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 --2- 172.21.15.29:0/2637967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a88102410 0x7f4a88112af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 >> 172.21.15.29:0/2637967971 conn(0x7f4a880711a0 msgr2=0x7f4a880fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 shutdown_connections 2023-12-05T13:22:13.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:13.561+0000 7f4a8efdb700 1 -- 172.21.15.29:0/2637967971 wait complete. 2023-12-05T13:22:13.594 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:13 smithi029 ceph-mon[112128]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:13 smithi052 ceph-mon[121072]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:13.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-05T13:22:13.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-05T13:22:13.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-05T13:22:13.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-05T13:22:13.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-05T13:22:13.973 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-05T13:22:14.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:14 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2637967971' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:22:14.723 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:14.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:14 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2637967971' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:22:14.875 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:15.328 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:15.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:15 smithi029 ceph-mon[112128]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:15.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:15 smithi052 ceph-mon[121072]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:15.732 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:15.933 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:15.933 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:17.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 -- 172.21.15.29:0/418753668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 msgr2=0x7f68280fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 --2- 172.21.15.29:0/418753668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fdfe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6818004940 tx=0x7f6818009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 -- 172.21.15.29:0/418753668 shutdown_connections 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 --2- 172.21.15.29:0/418753668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68280fe5b0 0x7f6828106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 --2- 172.21.15.29:0/418753668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fdfe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 -- 172.21.15.29:0/418753668 >> 172.21.15.29:0/418753668 conn(0x7f68280f76c0 msgr2=0x7f68280f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 -- 172.21.15.29:0/418753668 shutdown_connections 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.851+0000 7f682dcba700 1 -- 172.21.15.29:0/418753668 wait complete. 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f682dcba700 1 Processor -- start 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f682dcba700 1 -- start start 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f682dcba700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f682dcba700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68280fe5b0 0x7f68280fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f682dcba700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280fc580 con 0x7f68280fdc10 2023-12-05T13:22:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f682dcba700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280fc6f0 con 0x7f68280fe5b0 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f68277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f68277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46260/0 (socket says 172.21.15.29:46260) 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f68277fe700 1 -- 172.21.15.29:0/3593682372 learned_addr learned my addr 172.21.15.29:0/3593682372 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.852+0000 7f6826ffd700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68280fe5b0 0x7f68280fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f68277fe700 1 -- 172.21.15.29:0/3593682372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68280fe5b0 msgr2=0x7f68280fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f68277fe700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68280fe5b0 0x7f68280fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f68277fe700 1 -- 172.21.15.29:0/3593682372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818005040 con 0x7f68280fdc10 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f68277fe700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fba40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f6818009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6818021070 con 0x7f68280fdc10 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f681801c400 con 0x7f68280fdc10 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6828119820 con 0x7f68280fdc10 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681800e070 con 0x7f68280fdc10 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.853+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6828119c80 con 0x7f68280fdc10 2023-12-05T13:22:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.854+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f682805e300 con 0x7f68280fdc10 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f681801c950 con 0x7f68280fdc10 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f681ffff700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6814068f60 0x7f681406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6818087a60 con 0x7f68280fdc10 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f6826ffd700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6814068f60 0x7f681406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f681ffff700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] conn(0x7f681406ec30 0x7f6814071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 --> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68140716f0 con 0x7f681406ec30 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.855+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f681808c220 con 0x7f68280fdc10 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.856+0000 7f6827fff700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] conn(0x7f681406ec30 0x7f6814071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.856+0000 7f6826ffd700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6814068f60 0x7f681406b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f68280fd440 tx=0x7f681000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.856+0000 7f6827fff700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] conn(0x7f681406ec30 0x7f6814071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.857+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== osd.2 v2:172.21.15.29:6818/958560708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f68140716f0 con 0x7f681406ec30 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.875+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 --> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f682805e730 con 0x7f681406ec30 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.875+0000 7f681ffff700 1 -- 172.21.15.29:0/3593682372 <== osd.2 v2:172.21.15.29:6818/958560708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f682805e730 con 0x7f681406ec30 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] conn(0x7f681406ec30 msgr2=0x7f6814071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] conn(0x7f681406ec30 0x7f6814071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6814068f60 msgr2=0x7f681406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6814068f60 0x7f681406b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f68280fd440 tx=0x7f681000b040 comp rx=0 tx=0).stop 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 msgr2=0x7f68280fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fba40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f6818009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 shutdown_connections 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6818/958560708,v1:172.21.15.29:6819/958560708] conn(0x7f681406ec30 0x7f6814071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6814068f60 0x7f681406b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68280fdc10 0x7f68280fba40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 --2- 172.21.15.29:0/3593682372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68280fe5b0 0x7f68280fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 >> 172.21.15.29:0/3593682372 conn(0x7f68280f76c0 msgr2=0x7f6828101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 shutdown_connections 2023-12-05T13:22:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:16.876+0000 7f682dcba700 1 -- 172.21.15.29:0/3593682372 wait complete. 2023-12-05T13:22:17.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:17 smithi029 ceph-mon[112128]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:17.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:17 smithi052 ceph-mon[121072]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:17.760 INFO:teuthology.orchestra.run.smithi029.stdout:81604378642 2023-12-05T13:22:17.760 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-05T13:22:17.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 -- 172.21.15.29:0/3551166456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 msgr2=0x7f65d0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 --2- 172.21.15.29:0/3551166456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d0065800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65b8004940 tx=0x7f65b8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 -- 172.21.15.29:0/3551166456 shutdown_connections 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 --2- 172.21.15.29:0/3551166456 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d0065800 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 --2- 172.21.15.29:0/3551166456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d0102c20 0x7f65d0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 -- 172.21.15.29:0/3551166456 >> 172.21.15.29:0/3551166456 conn(0x7f65d00719b0 msgr2=0x7f65d0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 -- 172.21.15.29:0/3551166456 shutdown_connections 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 -- 172.21.15.29:0/3551166456 wait complete. 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.645+0000 7f65d5223700 1 Processor -- start 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65d5223700 1 -- start start 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65d5223700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d01135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65d5223700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d0102c20 0x7f65d0113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65d5223700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0114170 con 0x7f65d0065390 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65d5223700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d010d4a0 con 0x7f65d0102c20 2023-12-05T13:22:17.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65ced9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d01135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65ced9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d01135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46278/0 (socket says 172.21.15.29:46278) 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65ced9d700 1 -- 172.21.15.29:0/2333907614 learned_addr learned my addr 172.21.15.29:0/2333907614 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65c659c700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d0102c20 0x7f65d0113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65ced9d700 1 -- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d0102c20 msgr2=0x7f65d0113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65ced9d700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d0102c20 0x7f65d0113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.646+0000 7f65ced9d700 1 -- 172.21.15.29:0/2333907614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8005040 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.647+0000 7f65ced9d700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d01135e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f65c0002a80 tx=0x7f65c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.647+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c0007cc0 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.647+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d010d780 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.647+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65c000f040 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.647+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c000da60 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.647+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d010dcc0 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.648+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65d010e160 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.648+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f65c000dbc0 con 0x7f65d0065390 2023-12-05T13:22:17.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c7fff700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f65bc068f60 0x7f65bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f65c00866c0 con 0x7f65d0065390 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c659c700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f65bc068f60 0x7f65bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c7fff700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] conn(0x7f65bc06ec30 0x7f65bc071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 --> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65bc0716f0 con 0x7f65bc06ec30 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65c0088cb0 con 0x7f65d0065390 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65c659c700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f65bc068f60 0x7f65bc06b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65d010ee80 tx=0x7f65b8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.649+0000 7f65cf59e700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] conn(0x7f65bc06ec30 0x7f65bc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:17.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.650+0000 7f65cf59e700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] conn(0x7f65bc06ec30 0x7f65bc071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.650+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== osd.5 v2:172.21.15.52:6816/4188463667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f65bc0716f0 con 0x7f65bc06ec30 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.666+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 --> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65d005e2c0 con 0x7f65bc06ec30 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65c7fff700 1 -- 172.21.15.29:0/2333907614 <== osd.5 v2:172.21.15.52:6816/4188463667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f65d005e2c0 con 0x7f65bc06ec30 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] conn(0x7f65bc06ec30 msgr2=0x7f65bc071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] conn(0x7f65bc06ec30 0x7f65bc071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f65bc068f60 msgr2=0x7f65bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f65bc068f60 0x7f65bc06b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65d010ee80 tx=0x7f65b8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 msgr2=0x7f65d01135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d01135e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f65c0002a80 tx=0x7f65c00046b0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 shutdown_connections 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:6816/4188463667,v1:172.21.15.52:6817/4188463667] conn(0x7f65bc06ec30 0x7f65bc071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f65bc068f60 0x7f65bc06b410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d0065390 0x7f65d01135e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 --2- 172.21.15.29:0/2333907614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65d0102c20 0x7f65d0113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:17.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 >> 172.21.15.29:0/2333907614 conn(0x7f65d00719b0 msgr2=0x7f65d00fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:17.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 shutdown_connections 2023-12-05T13:22:17.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:17.667+0000 7f65d5223700 1 -- 172.21.15.29:0/2333907614 wait complete. 2023-12-05T13:22:18.687 INFO:teuthology.orchestra.run.smithi029.stdout:163208757254 2023-12-05T13:22:18.688 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 -- 172.21.15.29:0/3374039492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fb9b0 msgr2=0x7f79c40fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 --2- 172.21.15.29:0/3374039492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fb9b0 0x7f79c40fbd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004940 tx=0x7f79b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 -- 172.21.15.29:0/3374039492 shutdown_connections 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 --2- 172.21.15.29:0/3374039492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fc2c0 0x7f79c4109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 --2- 172.21.15.29:0/3374039492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fb9b0 0x7f79c40fbd80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 -- 172.21.15.29:0/3374039492 >> 172.21.15.29:0/3374039492 conn(0x7f79c40f7680 msgr2=0x7f79c40f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 -- 172.21.15.29:0/3374039492 shutdown_connections 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.171+0000 7f79c9bab700 1 -- 172.21.15.29:0/3374039492 wait complete. 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c9bab700 1 Processor -- start 2023-12-05T13:22:19.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c9bab700 1 -- start start 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c9bab700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fb9b0 0x7f79c4115780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c9bab700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 0x7f79c4115cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c9bab700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4116310 con 0x7f79c40fc2c0 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c9bab700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c410f640 con 0x7f79c40fb9b0 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 0x7f79c4115cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 0x7f79c4115cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33430/0 (socket says 172.21.15.29:33430) 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.172+0000 7f79c2ffd700 1 -- 172.21.15.29:0/2447632484 learned_addr learned my addr 172.21.15.29:0/2447632484 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c37fe700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fb9b0 0x7f79c4115780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c2ffd700 1 -- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fb9b0 msgr2=0x7f79c4115780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c2ffd700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fb9b0 0x7f79c4115780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c2ffd700 1 -- 172.21.15.29:0/2447632484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4005040 con 0x7f79c40fc2c0 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c37fe700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fb9b0 0x7f79c4115780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c2ffd700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 0x7f79c4115cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f79b8002a50 tx=0x7f79b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.175 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b8007cc0 con 0x7f79c40fc2c0 2023-12-05T13:22:19.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c410f920 con 0x7f79c40fc2c0 2023-12-05T13:22:19.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79b800f040 con 0x7f79c40fc2c0 2023-12-05T13:22:19.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b8009540 con 0x7f79c40fc2c0 2023-12-05T13:22:19.176 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.173+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c410fe60 con 0x7f79c40fc2c0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.174+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79c4110380 con 0x7f79c40fc2c0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f79b80096a0 con 0x7f79c40fc2c0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79abfff700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f79ac068f60 0x7f79ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f79b80872f0 con 0x7f79c40fc2c0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79c37fe700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f79ac068f60 0x7f79ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79abfff700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] conn(0x7f79ac06ec30 0x7f79ac071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 --> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79ac0716f0 con 0x7f79ac06ec30 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.175+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79b80876d0 con 0x7f79c40fc2c0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.176+0000 7f79c37fe700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f79ac068f60 0x7f79ac06b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004f90 tx=0x7f79b4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.176+0000 7f79c3fff700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] conn(0x7f79ac06ec30 0x7f79ac071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.176+0000 7f79c3fff700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] conn(0x7f79ac06ec30 0x7f79ac071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.177+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== osd.3 v2:172.21.15.52:6800/428901563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f79ac0716f0 con 0x7f79ac06ec30 2023-12-05T13:22:19.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.193+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 --> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79c405e340 con 0x7f79ac06ec30 2023-12-05T13:22:19.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.193+0000 7f79abfff700 1 -- 172.21.15.29:0/2447632484 <== osd.3 v2:172.21.15.52:6800/428901563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f79c405e340 con 0x7f79ac06ec30 2023-12-05T13:22:19.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.193+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] conn(0x7f79ac06ec30 msgr2=0x7f79ac071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.193+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] conn(0x7f79ac06ec30 0x7f79ac071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f79ac068f60 msgr2=0x7f79ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f79ac068f60 0x7f79ac06b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004f90 tx=0x7f79b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 msgr2=0x7f79c4115cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 0x7f79c4115cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f79b8002a50 tx=0x7f79b80046b0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 shutdown_connections 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:6800/428901563,v1:172.21.15.52:6801/428901563] conn(0x7f79ac06ec30 0x7f79ac071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f79ac068f60 0x7f79ac06b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c40fb9b0 0x7f79c4115780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 --2- 172.21.15.29:0/2447632484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f79c40fc2c0 0x7f79c4115cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 >> 172.21.15.29:0/2447632484 conn(0x7f79c40f7680 msgr2=0x7f79c40f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 shutdown_connections 2023-12-05T13:22:19.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.194+0000 7f79c9bab700 1 -- 172.21.15.29:0/2447632484 wait complete. 2023-12-05T13:22:19.558 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:19 smithi029 ceph-mon[112128]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 -- 172.21.15.29:0/1850630019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 msgr2=0x7fa4300fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 --2- 172.21.15.29:0/1850630019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa4300fbfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa424004940 tx=0x7fa424009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 -- 172.21.15.29:0/1850630019 shutdown_connections 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 --2- 172.21.15.29:0/1850630019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa4300fbfb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 --2- 172.21.15.29:0/1850630019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa430101b00 0x7fa430101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 -- 172.21.15.29:0/1850630019 >> 172.21.15.29:0/1850630019 conn(0x7fa4300719b0 msgr2=0x7fa430071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 -- 172.21.15.29:0/1850630019 shutdown_connections 2023-12-05T13:22:19.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.369+0000 7fa43572d700 1 -- 172.21.15.29:0/1850630019 wait complete. 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa43572d700 1 Processor -- start 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa43572d700 1 -- start start 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa43572d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa430113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa43572d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa430101b00 0x7fa430113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa43572d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4301141e0 con 0x7fa4300fbb40 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa43572d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43010d4d0 con 0x7fa430101b00 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa42effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa430113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa42effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa430113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33436/0 (socket says 172.21.15.29:33436) 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa42effd700 1 -- 172.21.15.29:0/3938958811 learned_addr learned my addr 172.21.15.29:0/3938958811 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa42effd700 1 -- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa430101b00 msgr2=0x7fa430113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa42effd700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa430101b00 0x7fa430113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.370+0000 7fa42effd700 1 -- 172.21.15.29:0/3938958811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424005040 con 0x7fa4300fbb40 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.371+0000 7fa42effd700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa430113610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa420002a80 tx=0x7fa4200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.371+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa420007cc0 con 0x7fa4300fbb40 2023-12-05T13:22:19.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.371+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa42000f040 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.371+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa420009640 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.371+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43010d760 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.371+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43010dc20 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.372+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa43010e110 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa4200097a0 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa4177fe700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa418068f60 0x7fa41806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa420086240 con 0x7fa4300fbb40 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa42e7fc700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa418068f60 0x7fa41806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa4177fe700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] conn(0x7fa41806ec30 0x7fa418071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 --> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4180716f0 con 0x7fa41806ec30 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.373+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa420088830 con 0x7fa4300fbb40 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.374+0000 7fa42e7fc700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa418068f60 0x7fa41806b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa424004f90 tx=0x7fa424009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.374+0000 7fa42f7fe700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] conn(0x7fa41806ec30 0x7fa418071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.374+0000 7fa42f7fe700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] conn(0x7fa41806ec30 0x7fa418071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.375+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== osd.4 v2:172.21.15.52:6808/845940001 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa4180716f0 con 0x7fa41806ec30 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 --> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4300734d0 con 0x7fa41806ec30 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa4177fe700 1 -- 172.21.15.29:0/3938958811 <== osd.4 v2:172.21.15.52:6808/845940001 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa4300734d0 con 0x7fa41806ec30 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] conn(0x7fa41806ec30 msgr2=0x7fa418071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] conn(0x7fa41806ec30 0x7fa418071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa418068f60 msgr2=0x7fa41806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa418068f60 0x7fa41806b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa424004f90 tx=0x7fa424009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 msgr2=0x7fa430113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.391+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa430113610 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa420002a80 tx=0x7fa4200046b0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 shutdown_connections 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:6808/845940001,v1:172.21.15.52:6809/845940001] conn(0x7fa41806ec30 0x7fa418071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa418068f60 0x7fa41806b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4300fbb40 0x7fa430113610 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 --2- 172.21.15.29:0/3938958811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa430101b00 0x7fa430113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 >> 172.21.15.29:0/3938958811 conn(0x7fa4300719b0 msgr2=0x7fa4300faaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 shutdown_connections 2023-12-05T13:22:19.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.392+0000 7fa43572d700 1 -- 172.21.15.29:0/3938958811 wait complete. 2023-12-05T13:22:19.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:19 smithi052 ceph-mon[121072]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:19.726 INFO:teuthology.orchestra.run.smithi029.stdout:111669149711 2023-12-05T13:22:19.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 -- 172.21.15.29:0/3343114078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 msgr2=0x7f5b84065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 --2- 172.21.15.29:0/3343114078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b84065800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5b70004940 tx=0x7f5b70009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 -- 172.21.15.29:0/3343114078 shutdown_connections 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 --2- 172.21.15.29:0/3343114078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b84065800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 --2- 172.21.15.29:0/3343114078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b84102c20 0x7f5b84102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 -- 172.21.15.29:0/3343114078 >> 172.21.15.29:0/3343114078 conn(0x7f5b840719b0 msgr2=0x7f5b84071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 -- 172.21.15.29:0/3343114078 shutdown_connections 2023-12-05T13:22:19.849 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.847+0000 7f5b8af05700 1 -- 172.21.15.29:0/3343114078 wait complete. 2023-12-05T13:22:19.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.848+0000 7f5b8af05700 1 Processor -- start 2023-12-05T13:22:19.850 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.848+0000 7f5b8af05700 1 -- start start 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b8af05700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b841135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b8af05700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b84102c20 0x7f5b84113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b8af05700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84114170 con 0x7f5b84065390 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b8af05700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8410d4a0 con 0x7f5b84102c20 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b841135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b841135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33452/0 (socket says 172.21.15.29:33452) 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 -- 172.21.15.29:0/2093104164 learned_addr learned my addr 172.21.15.29:0/2093104164 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b83fff700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b84102c20 0x7f5b84113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 -- 172.21.15.29:0/2093104164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b84102c20 msgr2=0x7f5b84113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b84102c20 0x7f5b84113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 -- 172.21.15.29:0/2093104164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70005040 con 0x7f5b84065390 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.849+0000 7f5b88ca1700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b841135e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b78002a80 tx=0x7f5b780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.850+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b78007cc0 con 0x7f5b84065390 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.850+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b7800f040 con 0x7f5b84065390 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.850+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b7800da60 con 0x7f5b84065390 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.850+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8410d780 con 0x7f5b84065390 2023-12-05T13:22:19.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.850+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8410dcc0 con 0x7f5b84065390 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.851+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b8410e1b0 con 0x7f5b84065390 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.851+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5b7800dbc0 con 0x7f5b84065390 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b817fa700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5b74068f70 0x7f5b7406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5b78086630 con 0x7f5b84065390 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b83fff700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5b74068f70 0x7f5b7406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b817fa700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] conn(0x7f5b7406ec40 0x7f5b74071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 --> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b74071700 con 0x7f5b7406ec40 2023-12-05T13:22:19.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b78088c80 con 0x7f5b84065390 2023-12-05T13:22:19.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b894a2700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] conn(0x7f5b7406ec40 0x7f5b74071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.852+0000 7f5b83fff700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5b74068f70 0x7f5b7406b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b8410ee80 tx=0x7f5b70009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.853+0000 7f5b894a2700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] conn(0x7f5b7406ec40 0x7f5b74071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.854+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== osd.1 v2:172.21.15.29:6810/526482960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5b74071700 con 0x7f5b7406ec40 2023-12-05T13:22:19.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.870+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 --> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b8405e340 con 0x7f5b7406ec40 2023-12-05T13:22:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b817fa700 1 -- 172.21.15.29:0/2093104164 <== osd.1 v2:172.21.15.29:6810/526482960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b8405e340 con 0x7f5b7406ec40 2023-12-05T13:22:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] conn(0x7f5b7406ec40 msgr2=0x7f5b74071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] conn(0x7f5b7406ec40 0x7f5b74071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5b74068f70 msgr2=0x7f5b7406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5b74068f70 0x7f5b7406b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b8410ee80 tx=0x7f5b70009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 msgr2=0x7f5b841135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b841135e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b78002a80 tx=0x7f5b780046b0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 shutdown_connections 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6810/526482960,v1:172.21.15.29:6811/526482960] conn(0x7f5b7406ec40 0x7f5b74071050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5b74068f70 0x7f5b7406b420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b84065390 0x7f5b841135e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.871+0000 7f5b8af05700 1 --2- 172.21.15.29:0/2093104164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b84102c20 0x7f5b84113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.872+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 >> 172.21.15.29:0/2093104164 conn(0x7f5b840719b0 msgr2=0x7f5b840fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.872+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 shutdown_connections 2023-12-05T13:22:19.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.872+0000 7f5b8af05700 1 -- 172.21.15.29:0/2093104164 wait complete. 2023-12-05T13:22:19.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.972+0000 7f0a6283a700 1 -- 172.21.15.29:0/1818044405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 msgr2=0x7f0a5c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.972+0000 7f0a6283a700 1 --2- 172.21.15.29:0/1818044405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 0x7f0a5c101ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c004940 tx=0x7f0a4c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.972+0000 7f0a6283a700 1 -- 172.21.15.29:0/1818044405 shutdown_connections 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.972+0000 7f0a6283a700 1 --2- 172.21.15.29:0/1818044405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.972+0000 7f0a6283a700 1 --2- 172.21.15.29:0/1818044405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 0x7f0a5c101ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.972+0000 7f0a6283a700 1 -- 172.21.15.29:0/1818044405 >> 172.21.15.29:0/1818044405 conn(0x7f0a5c0719b0 msgr2=0x7f0a5c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.973+0000 7f0a6283a700 1 -- 172.21.15.29:0/1818044405 shutdown_connections 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.973+0000 7f0a6283a700 1 -- 172.21.15.29:0/1818044405 wait complete. 2023-12-05T13:22:19.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.973+0000 7f0a6283a700 1 Processor -- start 2023-12-05T13:22:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a6283a700 1 -- start start 2023-12-05T13:22:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a6283a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c1157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a6283a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 0x7f0a5c115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a6283a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c116350 con 0x7f0a5c101b00 2023-12-05T13:22:19.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a6283a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c10f680 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a5bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c1157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a5b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 0x7f0a5c115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a5bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c1157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:51254/0 (socket says 172.21.15.29:51254) 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.974+0000 7f0a5bfff700 1 -- 172.21.15.29:0/4018522908 learned_addr learned my addr 172.21.15.29:0/4018522908 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a5bfff700 1 -- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 msgr2=0x7f0a5c115d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a5bfff700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 0x7f0a5c115d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a5bfff700 1 -- 172.21.15.29:0/4018522908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c005040 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a5bfff700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c1157c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c008d80 tx=0x7f0a4c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a4c00e030 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a4c004290 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c10f900 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a4c01cda0 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.975+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c10fe40 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.976+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a5c1103b0 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0a4c013a30 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a58ff9700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0a44068f70 0x7f0a4406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0a4c088430 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a58ff9700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] conn(0x7f0a4406ec40 0x7f0a44071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 --> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a44071700 con 0x7f0a4406ec40 2023-12-05T13:22:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c08aa20 con 0x7f0a5c0fbb40 2023-12-05T13:22:19.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.977+0000 7f0a5b7fe700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0a44068f70 0x7f0a4406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.978+0000 7f0a60dd7700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] conn(0x7f0a4406ec40 0x7f0a44071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.978+0000 7f0a5b7fe700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0a44068f70 0x7f0a4406b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c110ff0 tx=0x7f0a5000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.978+0000 7f0a60dd7700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] conn(0x7f0a4406ec40 0x7f0a44071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:19.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.979+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== osd.0 v2:172.21.15.29:6802/3753865905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0a44071700 con 0x7f0a4406ec40 2023-12-05T13:22:19.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.996+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 --> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a5c0734d0 con 0x7f0a4406ec40 2023-12-05T13:22:19.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.996+0000 7f0a58ff9700 1 -- 172.21.15.29:0/4018522908 <== osd.0 v2:172.21.15.29:6802/3753865905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a5c0734d0 con 0x7f0a4406ec40 2023-12-05T13:22:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] conn(0x7f0a4406ec40 msgr2=0x7f0a44071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] conn(0x7f0a4406ec40 0x7f0a44071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0a44068f70 msgr2=0x7f0a4406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0a44068f70 0x7f0a4406b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c110ff0 tx=0x7f0a5000b040 comp rx=0 tx=0).stop 2023-12-05T13:22:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 msgr2=0x7f0a5c1157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c1157c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c008d80 tx=0x7f0a4c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 shutdown_connections 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6802/3753865905,v1:172.21.15.29:6803/3753865905] conn(0x7f0a4406ec40 0x7f0a44071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0a44068f70 0x7f0a4406b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a5c0fbb40 0x7f0a5c1157c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 --2- 172.21.15.29:0/4018522908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a5c101b00 0x7f0a5c115d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.997+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 >> 172.21.15.29:0/4018522908 conn(0x7f0a5c0719b0 msgr2=0x7f0a5c0faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.998+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 shutdown_connections 2023-12-05T13:22:19.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:19.998+0000 7f0a6283a700 1 -- 172.21.15.29:0/4018522908 wait complete. 2023-12-05T13:22:20.368 INFO:teuthology.orchestra.run.smithi029.stdout:141733920779 2023-12-05T13:22:20.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-05T13:22:20.756 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:20.773 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:20.779 INFO:teuthology.orchestra.run.smithi029.stdout:60129542166 2023-12-05T13:22:20.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-05T13:22:20.948 INFO:teuthology.orchestra.run.smithi029.stdout:38654705691 2023-12-05T13:22:20.949 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-05T13:22:21.178 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:21.178 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:21.448 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:21 smithi029 ceph-mon[112128]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:21.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:21 smithi052 ceph-mon[121072]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:22.586 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:22.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/3825889327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e38101b60 msgr2=0x7f0e38101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:22.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/3825889327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e38101b60 0x7f0e38101f30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0e34004940 tx=0x7f0e34009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:22.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/3825889327 shutdown_connections 2023-12-05T13:22:22.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/3825889327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e380fbb00 0x7f0e380fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/3825889327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e38101b60 0x7f0e38101f30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/3825889327 >> 172.21.15.29:0/3825889327 conn(0x7f0e380f7680 msgr2=0x7f0e380f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:22.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/3825889327 shutdown_connections 2023-12-05T13:22:22.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.728+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/3825889327 wait complete. 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3fcfa700 1 Processor -- start 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3fcfa700 1 -- start start 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3fcfa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 0x7f0e3810e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3fcfa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38101b60 0x7f0e3810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3fcfa700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3810f240 con 0x7f0e380fbb00 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3fcfa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3810f380 con 0x7f0e38101b60 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3da96700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 0x7f0e3810e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3da96700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 0x7f0e3810e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33478/0 (socket says 172.21.15.29:33478) 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.729+0000 7f0e3da96700 1 -- 172.21.15.29:0/2215986938 learned_addr learned my addr 172.21.15.29:0/2215986938 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e3da96700 1 -- 172.21.15.29:0/2215986938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38101b60 msgr2=0x7f0e3810ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e3da96700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38101b60 0x7f0e3810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e3da96700 1 -- 172.21.15.29:0/2215986938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34005040 con 0x7f0e380fbb00 2023-12-05T13:22:22.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e3da96700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 0x7f0e3810e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400b3b0 tx=0x7f0e34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:22.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3400e040 con 0x7f0e380fbb00 2023-12-05T13:22:22.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e3400bc50 con 0x7f0e380fbb00 2023-12-05T13:22:22.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e38117680 con 0x7f0e380fbb00 2023-12-05T13:22:22.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e34013420 con 0x7f0e380fbb00 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.730+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e38117b90 con 0x7f0e380fbb00 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.731+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38103f40 con 0x7f0e380fbb00 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.732+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0e3401c430 con 0x7f0e380fbb00 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.732+0000 7f0e2e7fc700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e24068f60 0x7f0e2406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.732+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0e34087850 con 0x7f0e380fbb00 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.732+0000 7f0e3d295700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e24068f60 0x7f0e2406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:22.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.733+0000 7f0e3d295700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e24068f60 0x7f0e2406b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e380666c0 tx=0x7f0e28009ce0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:22.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.737+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0e34054110 con 0x7f0e380fbb00 2023-12-05T13:22:22.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.941+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0e380fb280 con 0x7f0e380fbb00 2023-12-05T13:22:22.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.941+0000 7f0e2e7fc700 1 -- 172.21.15.29:0/2215986938 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e34057730 con 0x7f0e380fbb00 2023-12-05T13:22:22.943 INFO:teuthology.orchestra.run.smithi029.stdout:141733920779 2023-12-05T13:22:22.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e24068f60 msgr2=0x7f0e2406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:22.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e24068f60 0x7f0e2406b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e380666c0 tx=0x7f0e28009ce0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 msgr2=0x7f0e3810e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 0x7f0e3810e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400b3b0 tx=0x7f0e34009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 shutdown_connections 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e24068f60 0x7f0e2406b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e380fbb00 0x7f0e3810e770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 --2- 172.21.15.29:0/2215986938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38101b60 0x7f0e3810ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 >> 172.21.15.29:0/2215986938 conn(0x7f0e380f7680 msgr2=0x7f0e380f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.943+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 shutdown_connections 2023-12-05T13:22:22.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.944+0000 7f0e3fcfa700 1 -- 172.21.15.29:0/2215986938 wait complete. 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 -- 172.21.15.29:0/285375290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430104ef0 msgr2=0x7f04301052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 --2- 172.21.15.29:0/285375290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430104ef0 0x7f04301052c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f042c004940 tx=0x7f042c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 -- 172.21.15.29:0/285375290 shutdown_connections 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 --2- 172.21.15.29:0/285375290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0430105890 0x7f04300fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 --2- 172.21.15.29:0/285375290 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430104ef0 0x7f04301052c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 -- 172.21.15.29:0/285375290 >> 172.21.15.29:0/285375290 conn(0x7f04300faaa0 msgr2=0x7f04300fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:22.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.989+0000 7f0437af5700 1 -- 172.21.15.29:0/285375290 shutdown_connections 2023-12-05T13:22:22.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.990+0000 7f0437af5700 1 -- 172.21.15.29:0/285375290 wait complete. 2023-12-05T13:22:22.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.990+0000 7f0437af5700 1 Processor -- start 2023-12-05T13:22:22.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.990+0000 7f0437af5700 1 -- start start 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0437af5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0430104ef0 0x7f04301158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0437af5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 0x7f0430115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0437af5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430116440 con 0x7f0430105890 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0437af5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043010f770 con 0x7f0430104ef0 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435090700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 0x7f0430115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435090700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 0x7f0430115df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33506/0 (socket says 172.21.15.29:33506) 2023-12-05T13:22:22.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435090700 1 -- 172.21.15.29:0/2891005631 learned_addr learned my addr 172.21.15.29:0/2891005631 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435891700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0430104ef0 0x7f04301158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435090700 1 -- 172.21.15.29:0/2891005631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0430104ef0 msgr2=0x7f04301158b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435090700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0430104ef0 0x7f04301158b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.991+0000 7f0435090700 1 -- 172.21.15.29:0/2891005631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c005040 con 0x7f0430105890 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.992+0000 7f0435090700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 0x7f0430115df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0420002a50 tx=0x7f0420004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.992+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0420007cc0 con 0x7f0430105890 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.992+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f042000f040 con 0x7f0430105890 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.992+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f042000d920 con 0x7f0430105890 2023-12-05T13:22:22.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.992+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043010fa50 con 0x7f0430105890 2023-12-05T13:22:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.992+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043010ff90 con 0x7f0430105890 2023-12-05T13:22:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.994+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0430102200 con 0x7f0430105890 2023-12-05T13:22:22.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.994+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0420009680 con 0x7f0430105890 2023-12-05T13:22:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.995+0000 7f04267fc700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f041c068fb0 0x7f041c06b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.995+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0420086890 con 0x7f0430105890 2023-12-05T13:22:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.995+0000 7f0435891700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f041c068fb0 0x7f041c06b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:22.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:22.996+0000 7f0435891700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f041c068fb0 0x7f041c06b460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f042c004560 tx=0x7f042c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:22.999 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:23.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.003+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0420056a10 con 0x7f0430105890 2023-12-05T13:22:23.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.234+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04300fe6a0 con 0x7f0430105890 2023-12-05T13:22:23.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.235+0000 7f04267fc700 1 -- 172.21.15.29:0/2891005631 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04200565a0 con 0x7f0430105890 2023-12-05T13:22:23.237 INFO:teuthology.orchestra.run.smithi029.stdout:81604378643 2023-12-05T13:22:23.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f041c068fb0 msgr2=0x7f041c06b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:23.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f041c068fb0 0x7f041c06b460 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f042c004560 tx=0x7f042c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:23.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 msgr2=0x7f0430115df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:23.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 0x7f0430115df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0420002a50 tx=0x7f0420004600 comp rx=0 tx=0).stop 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 shutdown_connections 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f041c068fb0 0x7f041c06b460 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0430104ef0 0x7f04301158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 --2- 172.21.15.29:0/2891005631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0430105890 0x7f0430115df0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 >> 172.21.15.29:0/2891005631 conn(0x7f04300faaa0 msgr2=0x7f04300fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 shutdown_connections 2023-12-05T13:22:23.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:23.237+0000 7f0437af5700 1 -- 172.21.15.29:0/2891005631 wait complete. 2023-12-05T13:22:23.419 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920779 got 141733920779 for osd.4 2023-12-05T13:22:23.419 DEBUG:teuthology.parallel:result is None 2023-12-05T13:22:23.502 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:23 smithi029 ceph-mon[112128]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:23.502 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:23 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2215986938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-05T13:22:23.502 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:23 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2891005631' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-05T13:22:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:23 smithi052 ceph-mon[121072]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:23 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2215986938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-05T13:22:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:23 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2891005631' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-05T13:22:24.001 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378643 for osd.2 2023-12-05T13:22:24.002 DEBUG:teuthology.parallel:result is None 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 -- 172.21.15.29:0/1114194870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc700fbb40 msgr2=0x7efc700fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 --2- 172.21.15.29:0/1114194870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc700fbb40 0x7efc700fbfb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc64004940 tx=0x7efc64009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 -- 172.21.15.29:0/1114194870 shutdown_connections 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 --2- 172.21.15.29:0/1114194870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc700fbb40 0x7efc700fbfb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 --2- 172.21.15.29:0/1114194870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc70101b00 0x7efc70101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 -- 172.21.15.29:0/1114194870 >> 172.21.15.29:0/1114194870 conn(0x7efc700719b0 msgr2=0x7efc70071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:24.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 -- 172.21.15.29:0/1114194870 shutdown_connections 2023-12-05T13:22:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 -- 172.21.15.29:0/1114194870 wait complete. 2023-12-05T13:22:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 Processor -- start 2023-12-05T13:22:24.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.207+0000 7efc74ba4700 1 -- start start 2023-12-05T13:22:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc74ba4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc700fbb40 0x7efc70112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc74ba4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 0x7efc70112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc74ba4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc701131d0 con 0x7efc70101b00 2023-12-05T13:22:24.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc74ba4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7010c4c0 con 0x7efc700fbb40 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 0x7efc70112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 0x7efc70112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33530/0 (socket says 172.21.15.29:33530) 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 -- 172.21.15.29:0/635534446 learned_addr learned my addr 172.21.15.29:0/635534446 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6e59c700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc700fbb40 0x7efc70112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 -- 172.21.15.29:0/635534446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc700fbb40 msgr2=0x7efc70112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc700fbb40 0x7efc70112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 -- 172.21.15.29:0/635534446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64005040 con 0x7efc70101b00 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6e59c700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc700fbb40 0x7efc70112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc6dd9b700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 0x7efc70112b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc64009180 tx=0x7efc64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc6400e040 con 0x7efc70101b00 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc64013420 con 0x7efc70101b00 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7010c740 con 0x7efc70101b00 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.208+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc6401c630 con 0x7efc70101b00 2023-12-05T13:22:24.212 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.209+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7010cc80 con 0x7efc70101b00 2023-12-05T13:22:24.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.209+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc701122d0 con 0x7efc70101b00 2023-12-05T13:22:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.210+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7efc640139e0 con 0x7efc70101b00 2023-12-05T13:22:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.210+0000 7efc5effd700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7efc58068f60 0x7efc5806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.210+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efc64087cb0 con 0x7efc70101b00 2023-12-05T13:22:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.210+0000 7efc6e59c700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7efc58068f60 0x7efc5806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:24.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.211+0000 7efc6e59c700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7efc58068f60 0x7efc5806b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc60009fd0 tx=0x7efc6000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:24.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.215+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efc64057ff0 con 0x7efc70101b00 2023-12-05T13:22:24.303 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.426+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efc7004bb80 con 0x7efc70101b00 2023-12-05T13:22:24.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.426+0000 7efc5effd700 1 -- 172.21.15.29:0/635534446 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc64057b80 con 0x7efc70101b00 2023-12-05T13:22:24.428 INFO:teuthology.orchestra.run.smithi029.stdout:163208757255 2023-12-05T13:22:24.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7efc58068f60 msgr2=0x7efc5806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7efc58068f60 0x7efc5806b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efc60009fd0 tx=0x7efc6000b040 comp rx=0 tx=0).stop 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 msgr2=0x7efc70112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 0x7efc70112b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc64009180 tx=0x7efc64009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 shutdown_connections 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7efc58068f60 0x7efc5806b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc700fbb40 0x7efc70112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 --2- 172.21.15.29:0/635534446 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc70101b00 0x7efc70112b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 >> 172.21.15.29:0/635534446 conn(0x7efc700719b0 msgr2=0x7efc700fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 shutdown_connections 2023-12-05T13:22:24.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.429+0000 7efc74ba4700 1 -- 172.21.15.29:0/635534446 wait complete. 2023-12-05T13:22:25.288 INFO:teuthology.orchestra.run.smithi029.stdout:111669149712 2023-12-05T13:22:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.975+0000 7fc68f758700 1 -- 172.21.15.29:0/1130145353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688065390 msgr2=0x7fc688065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.975+0000 7fc68f758700 1 --2- 172.21.15.29:0/1130145353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688065390 0x7fc688065800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc678004940 tx=0x7fc678009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.975+0000 7fc68f758700 1 -- 172.21.15.29:0/1130145353 shutdown_connections 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.975+0000 7fc68f758700 1 --2- 172.21.15.29:0/1130145353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688065390 0x7fc688065800 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.975+0000 7fc68f758700 1 --2- 172.21.15.29:0/1130145353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688102c20 0x7fc688102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.975+0000 7fc68f758700 1 -- 172.21.15.29:0/1130145353 >> 172.21.15.29:0/1130145353 conn(0x7fc6880719b0 msgr2=0x7fc688071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.976+0000 7fc68f758700 1 -- 172.21.15.29:0/1130145353 shutdown_connections 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.976+0000 7fc68f758700 1 -- 172.21.15.29:0/1130145353 wait complete. 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.976+0000 7fc68f758700 1 Processor -- start 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.976+0000 7fc68f758700 1 -- start start 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68f758700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688065390 0x7fc688113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68f758700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 0x7fc688113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68f758700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6881142e0 con 0x7fc688102c20 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68f758700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68810d610 con 0x7fc688065390 2023-12-05T13:22:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 0x7fc688113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 0x7fc688113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33548/0 (socket says 172.21.15.29:33548) 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 -- 172.21.15.29:0/2152444450 learned_addr learned my addr 172.21.15.29:0/2152444450 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68d4f4700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688065390 0x7fc688113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 -- 172.21.15.29:0/2152444450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688065390 msgr2=0x7fc688113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688065390 0x7fc688113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 -- 172.21.15.29:0/2152444450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678005040 con 0x7fc688102c20 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc68ccf3700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 0x7fc688113c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc67800b3b0 tx=0x7fc678009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.977+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc67800e040 con 0x7fc688102c20 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.978+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc67801c430 con 0x7fc688102c20 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.978+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc678013640 con 0x7fc688102c20 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.978+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68810d890 con 0x7fc688102c20 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.978+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68810ddd0 con 0x7fc688102c20 2023-12-05T13:22:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.979+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6880fff40 con 0x7fc688102c20 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.979+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc67801c5a0 con 0x7fc688102c20 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.980+0000 7fc67dffb700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fc674068f60 0x7fc67406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.980+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc678087540 con 0x7fc688102c20 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.980+0000 7fc68d4f4700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fc674068f60 0x7fc67406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.980+0000 7fc68d4f4700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fc674068f60 0x7fc67406b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc684004f60 tx=0x7fc68400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:24.984+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc678057870 con 0x7fc688102c20 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.189+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6880734d0 con 0x7fc688102c20 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.189+0000 7fc67dffb700 1 -- 172.21.15.29:0/2152444450 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc678057400 con 0x7fc688102c20 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fc674068f60 msgr2=0x7fc67406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fc674068f60 0x7fc67406b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc684004f60 tx=0x7fc68400b040 comp rx=0 tx=0).stop 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 msgr2=0x7fc688113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 0x7fc688113c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc67800b3b0 tx=0x7fc678009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 shutdown_connections 2023-12-05T13:22:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fc674068f60 0x7fc67406b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688065390 0x7fc688113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 --2- 172.21.15.29:0/2152444450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc688102c20 0x7fc688113c90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 >> 172.21.15.29:0/2152444450 conn(0x7fc6880719b0 msgr2=0x7fc6880face0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:25.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 shutdown_connections 2023-12-05T13:22:25.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.191+0000 7fc68f758700 1 -- 172.21.15.29:0/2152444450 wait complete. 2023-12-05T13:22:25.486 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:25 smithi029 ceph-mon[112128]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:25.486 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:25 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/635534446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-05T13:22:25.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:25 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2152444450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-05T13:22:25.514 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757254 got 163208757255 for osd.5 2023-12-05T13:22:25.514 DEBUG:teuthology.parallel:result is None 2023-12-05T13:22:25.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 -- 172.21.15.29:0/3350701756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fd9f0 msgr2=0x7f00f40fddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 --2- 172.21.15.29:0/3350701756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fddc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00e4004940 tx=0x7f00e4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:25.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 -- 172.21.15.29:0/3350701756 shutdown_connections 2023-12-05T13:22:25.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 --2- 172.21.15.29:0/3350701756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fe390 0x7f00f41069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 --2- 172.21.15.29:0/3350701756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fddc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 -- 172.21.15.29:0/3350701756 >> 172.21.15.29:0/3350701756 conn(0x7f00f40755d0 msgr2=0x7f00f40f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:25.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 -- 172.21.15.29:0/3350701756 shutdown_connections 2023-12-05T13:22:25.538 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.535+0000 7f00f939e700 1 -- 172.21.15.29:0/3350701756 wait complete. 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.536+0000 7f00f939e700 1 Processor -- start 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.536+0000 7f00f939e700 1 -- start start 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f939e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f939e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 0x7f00f40fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f939e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40fc360 con 0x7f00f40fe390 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f939e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40fc4d0 con 0x7f00f40fd9f0 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 0x7f00f40fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:25.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 0x7f00f40fbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33570/0 (socket says 172.21.15.29:33570) 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f37fe700 1 -- 172.21.15.29:0/3172870539 learned_addr learned my addr 172.21.15.29:0/3172870539 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f3fff700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f37fe700 1 -- 172.21.15.29:0/3172870539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fd9f0 msgr2=0x7f00f40fb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f37fe700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f37fe700 1 -- 172.21.15.29:0/3172870539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4005040 con 0x7f00f40fe390 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.537+0000 7f00f3fff700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:22:25.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.538+0000 7f00f37fe700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 0x7f00f40fbd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c830 tx=0x7f00e8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.538+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e800a760 con 0x7f00f40fe390 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.538+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f4119650 con 0x7f00f40fe390 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.538+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f00e800ad70 con 0x7f00f40fe390 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.538+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e80113a0 con 0x7f00f40fe390 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.538+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f4119b30 con 0x7f00f40fe390 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.539+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f4103fe0 con 0x7f00f40fe390 2023-12-05T13:22:25.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.540+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f00e8012400 con 0x7f00f40fe390 2023-12-05T13:22:25.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.540+0000 7f00f0ff9700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f00dc068f60 0x7f00dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:25.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.540+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f00e8086ad0 con 0x7f00f40fe390 2023-12-05T13:22:25.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.540+0000 7f00f3fff700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f00dc068f60 0x7f00dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:25.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.541+0000 7f00f3fff700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f00dc068f60 0x7f00dc06b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00e4004f90 tx=0x7f00e4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:25.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.545+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f00e80532e0 con 0x7f00f40fe390 2023-12-05T13:22:25.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149711 got 111669149712 for osd.3 2023-12-05T13:22:25.689 DEBUG:teuthology.parallel:result is None 2023-12-05T13:22:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:25 smithi052 ceph-mon[121072]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:25 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/635534446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-05T13:22:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:25 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2152444450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-05T13:22:25.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.758+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00f405f270 con 0x7f00f40fe390 2023-12-05T13:22:25.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.758+0000 7f00f0ff9700 1 -- 172.21.15.29:0/3172870539 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00e8056900 con 0x7f00f40fe390 2023-12-05T13:22:25.760 INFO:teuthology.orchestra.run.smithi029.stdout:60129542167 2023-12-05T13:22:25.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f00dc068f60 msgr2=0x7f00dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f00dc068f60 0x7f00dc06b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00e4004f90 tx=0x7f00e4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:25.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 msgr2=0x7f00f40fbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:25.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 0x7f00f40fbd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c830 tx=0x7f00e8004470 comp rx=0 tx=0).stop 2023-12-05T13:22:25.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 shutdown_connections 2023-12-05T13:22:25.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f00dc068f60 0x7f00dc06b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00f40fd9f0 0x7f00f40fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 --2- 172.21.15.29:0/3172870539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00f40fe390 0x7f00f40fbd60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:25.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 >> 172.21.15.29:0/3172870539 conn(0x7f00f40755d0 msgr2=0x7f00f4101160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:25.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 shutdown_connections 2023-12-05T13:22:25.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:25.760+0000 7f00f939e700 1 -- 172.21.15.29:0/3172870539 wait complete. 2023-12-05T13:22:26.302 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542166 got 60129542167 for osd.1 2023-12-05T13:22:26.302 DEBUG:teuthology.parallel:result is None 2023-12-05T13:22:26.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:26 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3172870539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 -- 172.21.15.29:0/1901277258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8065390 msgr2=0x7fa3a8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1901277258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8065390 0x7fa3a8065800 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa390004940 tx=0x7fa390009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 -- 172.21.15.29:0/1901277258 shutdown_connections 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1901277258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8065390 0x7fa3a8065800 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1901277258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a8102c20 0x7fa3a8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 -- 172.21.15.29:0/1901277258 >> 172.21.15.29:0/1901277258 conn(0x7fa3a80719b0 msgr2=0x7fa3a8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 -- 172.21.15.29:0/1901277258 shutdown_connections 2023-12-05T13:22:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.619+0000 7fa3ae439700 1 -- 172.21.15.29:0/1901277258 wait complete. 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3ae439700 1 Processor -- start 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3ae439700 1 -- start start 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3ae439700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a8065390 0x7fa3a8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3ae439700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 0x7fa3a8113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3ae439700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81142c0 con 0x7fa3a8102c20 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3ae439700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a810d5f0 con 0x7fa3a8065390 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 0x7fa3a8113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 0x7fa3a8113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33582/0 (socket says 172.21.15.29:33582) 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1244568531 learned_addr learned my addr 172.21.15.29:0/1244568531 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.620+0000 7fa3a7fff700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a8065390 0x7fa3a8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1244568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a8065390 msgr2=0x7fa3a8113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a77fe700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a8065390 0x7fa3a8113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a77fe700 1 -- 172.21.15.29:0/1244568531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390005040 con 0x7fa3a8102c20 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a77fe700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 0x7fa3a8113c70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa390009fd0 tx=0x7fa390009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa39000e040 con 0x7fa3a8102c20 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a810d870 con 0x7fa3a8102c20 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa390013420 con 0x7fa3a8102c20 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa39001c630 con 0x7fa3a8102c20 2023-12-05T13:22:26.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.621+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a810ddb0 con 0x7fa3a8102c20 2023-12-05T13:22:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.622+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a80fff40 con 0x7fa3a8102c20 2023-12-05T13:22:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.623+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa390013590 con 0x7fa3a8102c20 2023-12-05T13:22:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.623+0000 7fa3a4ff9700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa394068f70 0x7fa39406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.623+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa390087c80 con 0x7fa3a8102c20 2023-12-05T13:22:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.623+0000 7fa3a7fff700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa394068f70 0x7fa39406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:26.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.624+0000 7fa3a7fff700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa394068f70 0x7fa39406b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa398004f40 tx=0x7fa39800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:26.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.628+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa390057fd0 con 0x7fa3a8102c20 2023-12-05T13:22:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:26 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3172870539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-05T13:22:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.830+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa3a80734d0 con 0x7fa3a8102c20 2023-12-05T13:22:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.831+0000 7fa3a4ff9700 1 -- 172.21.15.29:0/1244568531 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa390057b60 con 0x7fa3a8102c20 2023-12-05T13:22:26.833 INFO:teuthology.orchestra.run.smithi029.stdout:38654705693 2023-12-05T13:22:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa394068f70 msgr2=0x7fa39406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa394068f70 0x7fa39406b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa398004f40 tx=0x7fa39800b040 comp rx=0 tx=0).stop 2023-12-05T13:22:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 msgr2=0x7fa3a8113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 0x7fa3a8113c70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa390009fd0 tx=0x7fa390009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 shutdown_connections 2023-12-05T13:22:26.835 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa394068f70 0x7fa39406b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a8065390 0x7fa3a8113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 --2- 172.21.15.29:0/1244568531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8102c20 0x7fa3a8113c70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 >> 172.21.15.29:0/1244568531 conn(0x7fa3a80719b0 msgr2=0x7fa3a80fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 shutdown_connections 2023-12-05T13:22:26.836 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:26.833+0000 7fa3ae439700 1 -- 172.21.15.29:0/1244568531 wait complete. 2023-12-05T13:22:27.218 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705691 got 38654705693 for osd.0 2023-12-05T13:22:27.219 DEBUG:teuthology.parallel:result is None 2023-12-05T13:22:27.219 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-05T13:22:27.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-05T13:22:27.521 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:27.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:27 smithi029 ceph-mon[112128]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:27.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:27 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1244568531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-05T13:22:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:27 smithi052 ceph-mon[121072]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:27 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1244568531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3567856186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 msgr2=0x7f9b540fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3567856186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b540fbfb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b44004940 tx=0x7f9b44009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3567856186 shutdown_connections 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3567856186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b540fbfb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3567856186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 0x7f9b54101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3567856186 >> 172.21.15.29:0/3567856186 conn(0x7f9b540719b0 msgr2=0x7f9b54071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3567856186 shutdown_connections 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.580+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3567856186 wait complete. 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b5c1a5700 1 Processor -- start 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b5c1a5700 1 -- start start 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b5c1a5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b54112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b5c1a5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 0x7f9b54112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b5c1a5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541131d0 con 0x7f9b540fbb40 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b5c1a5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5410c4c0 con 0x7f9b54101b00 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59f41700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b54112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59f41700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b54112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57164/0 (socket says 172.21.15.29:57164) 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59f41700 1 -- 172.21.15.29:0/3605271018 learned_addr learned my addr 172.21.15.29:0/3605271018 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59740700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 0x7f9b54112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59f41700 1 -- 172.21.15.29:0/3605271018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 msgr2=0x7f9b54112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59f41700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 0x7f9b54112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59f41700 1 -- 172.21.15.29:0/3605271018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44005040 con 0x7f9b540fbb40 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.581+0000 7f9b59740700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 0x7f9b54112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.582+0000 7f9b59f41700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b54112640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c830 tx=0x7f9b50004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.582+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5000a760 con 0x7f9b540fbb40 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.582+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b5000ad70 con 0x7f9b540fbb40 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.582+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b500113a0 con 0x7f9b540fbb40 2023-12-05T13:22:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.582+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5410c7a0 con 0x7f9b540fbb40 2023-12-05T13:22:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.582+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5410cce0 con 0x7f9b540fbb40 2023-12-05T13:22:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.583+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b541122f0 con 0x7f9b540fbb40 2023-12-05T13:22:28.586 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.583+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9b50012400 con 0x7f9b540fbb40 2023-12-05T13:22:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.584+0000 7f9b4a7fc700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9b40068f60 0x7f9b4006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.584+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9b500869e0 con 0x7f9b540fbb40 2023-12-05T13:22:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.584+0000 7f9b59740700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9b40068f60 0x7f9b4006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:28.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.584+0000 7f9b59740700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9b40068f60 0x7f9b4006b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000c00 tx=0x7f9b44009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:28.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.588+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9b50056d20 con 0x7f9b540fbb40 2023-12-05T13:22:28.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.785+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b5404bbf0 con 0x7f9b40068f60 2023-12-05T13:22:28.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.786+0000 7f9b4a7fc700 1 -- 172.21.15.29:0/3605271018 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24747 (secure 0 0 0) 0x7f9b5404bbf0 con 0x7f9b40068f60 2023-12-05T13:22:28.789 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.788+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9b40068f60 msgr2=0x7f9b4006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:28.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.788+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9b40068f60 0x7f9b4006b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000c00 tx=0x7f9b44009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.788+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 msgr2=0x7f9b54112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.788+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b54112640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c830 tx=0x7f9b50004470 comp rx=0 tx=0).stop 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 shutdown_connections 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9b40068f60 0x7f9b4006b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b540fbb40 0x7f9b54112640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 --2- 172.21.15.29:0/3605271018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b54101b00 0x7f9b54112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 >> 172.21.15.29:0/3605271018 conn(0x7f9b540719b0 msgr2=0x7f9b540fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 shutdown_connections 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:28.789+0000 7f9b5c1a5700 1 -- 172.21.15.29:0/3605271018 wait complete. 2023-12-05T13:22:28.791 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-12-05T13:22:29.193 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-12-05T13:22:27.861015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787556,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683356,"statfs":{"total":575970213888,"available":574139756544,"internally_reserved":0,"allocated":3919872,"data_stored":2582244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002059"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-05T13:21:57.277930+0000","last_change":"2023-12-05T13:21:38.399279+0000","last_active":"2023-12-05T13:21:57.277930+0000","last_peered":"2023-12-05T13:21:57.277930+0000","last_clean":"2023-12-05T13:21:57.277930+0000","last_became_active":"2023-12-05T13:21:38.398875+0000","last_became_peered":"2023-12-05T13:21:38.398875+0000","last_unstale":"2023-12-05T13:21:57.277930+0000","last_undegraded":"2023-12-05T13:21:57.277930+0000","last_fullsized":"2023-12-05T13:21:57.277930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-05T13:21:02.368118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-05T13:21:02.368118+0000","last_clean_scrub_stamp":"2023-12-05T13:21:02.368118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-06T15:58:55.400224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757256,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":4,"up_from":33,"seq":141733920780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":3,"up_from":26,"seq":111669149713,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 13:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Tue Dec 5 13:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Tue Dec 5 13:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 13:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Dec 5 13:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.36299999999999999}]},{"osd":3,"last update":"Tue Dec 5 13:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 5 13:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.433},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Dec 5 13:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Dec 5 13:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 13:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Dec 5 13:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Tue Dec 5 13:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-05T13:22:29.195 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-05T13:22:29.497 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:29.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:29 smithi029 ceph-mon[112128]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:29 smithi052 ceph-mon[121072]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 -- 172.21.15.29:0/661697390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 msgr2=0x7f6b9c0fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 --2- 172.21.15.29:0/661697390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c0fe020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c004940 tx=0x7f6b8c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 -- 172.21.15.29:0/661697390 shutdown_connections 2023-12-05T13:22:30.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 --2- 172.21.15.29:0/661697390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 0x7f6b9c106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 --2- 172.21.15.29:0/661697390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c0fe020 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 -- 172.21.15.29:0/661697390 >> 172.21.15.29:0/661697390 conn(0x7f6b9c0f7680 msgr2=0x7f6b9c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 -- 172.21.15.29:0/661697390 shutdown_connections 2023-12-05T13:22:30.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.550+0000 7f6ba115a700 1 -- 172.21.15.29:0/661697390 wait complete. 2023-12-05T13:22:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6ba115a700 1 Processor -- start 2023-12-05T13:22:30.556 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6ba115a700 1 -- start start 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6ba115a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6ba115a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 0x7f6b9c113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6ba115a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c10d540 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6ba115a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c10d6b0 con 0x7f6b9c0fe5f0 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57174/0 (socket says 172.21.15.29:57174) 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9ad9d700 1 -- 172.21.15.29:0/2266350986 learned_addr learned my addr 172.21.15.29:0/2266350986 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9a59c700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 0x7f6b9c113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9ad9d700 1 -- 172.21.15.29:0/2266350986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 msgr2=0x7f6b9c113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9ad9d700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 0x7f6b9c113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9ad9d700 1 -- 172.21.15.29:0/2266350986 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c005040 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.551+0000 7f6b9a59c700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 0x7f6b9c113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.552+0000 7f6b9ad9d700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c113680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009390 tx=0x7f6b8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.552+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8c00e040 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.552+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c10d990 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.552+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b8c004290 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.552+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8c01c3f0 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.552+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c10ded0 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.553+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c104240 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.554+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6b8c00bc50 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.554+0000 7f6b837fe700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6b84068f70 0x7f6b8406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.554+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6b8c087e60 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.554+0000 7f6b9a59c700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6b84068f70 0x7f6b8406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.554+0000 7f6b9a59c700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6b84068f70 0x7f6b8406b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c10ef20 tx=0x7f6b90008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:30.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.559+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6b8c0581b0 con 0x7f6b9c0fdc50 2023-12-05T13:22:30.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:30 smithi029 ceph-mon[112128]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T13:22:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:30 smithi052 ceph-mon[121072]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T13:22:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.754+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b9c04bb80 con 0x7f6b84068f70 2023-12-05T13:22:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.755+0000 7f6b837fe700 1 -- 172.21.15.29:0/2266350986 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24776 (secure 0 0 0) 0x7f6b9c04bb80 con 0x7f6b84068f70 2023-12-05T13:22:30.757 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:30.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6b84068f70 msgr2=0x7f6b8406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:30.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6b84068f70 0x7f6b8406b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c10ef20 tx=0x7f6b90008040 comp rx=0 tx=0).stop 2023-12-05T13:22:30.759 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 msgr2=0x7f6b9c113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c113680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009390 tx=0x7f6b8c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 shutdown_connections 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f6b84068f70 0x7f6b8406b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b9c0fdc50 0x7f6b9c113680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 --2- 172.21.15.29:0/2266350986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b9c0fe5f0 0x7f6b9c113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.757+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 >> 172.21.15.29:0/2266350986 conn(0x7f6b9c0f7680 msgr2=0x7f6b9c1013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.758+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 shutdown_connections 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:30.758+0000 7f6ba115a700 1 -- 172.21.15.29:0/2266350986 wait complete. 2023-12-05T13:22:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2023-12-05T13:22:31.151 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-12-05T13:22:29.861330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787556,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683356,"statfs":{"total":575970213888,"available":574139756544,"internally_reserved":0,"allocated":3919872,"data_stored":2582244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001923"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":188,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-05T13:21:57.277930+0000","last_change":"2023-12-05T13:21:38.399279+0000","last_active":"2023-12-05T13:21:57.277930+0000","last_peered":"2023-12-05T13:21:57.277930+0000","last_clean":"2023-12-05T13:21:57.277930+0000","last_became_active":"2023-12-05T13:21:38.398875+0000","last_became_peered":"2023-12-05T13:21:38.398875+0000","last_unstale":"2023-12-05T13:21:57.277930+0000","last_undegraded":"2023-12-05T13:21:57.277930+0000","last_fullsized":"2023-12-05T13:21:57.277930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-05T13:21:02.368118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-05T13:21:02.368118+0000","last_clean_scrub_stamp":"2023-12-05T13:21:02.368118+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-06T15:58:55.400224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149713,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 13:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Tue Dec 5 13:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Tue Dec 5 13:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 13:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Dec 5 13:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.36299999999999999}]},{"osd":3,"last update":"Tue Dec 5 13:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 5 13:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.433},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Dec 5 13:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Dec 5 13:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 13:21:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Dec 5 13:22:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Tue Dec 5 13:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-05T13:22:31.152 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-05T13:22:31.152 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-05T13:22:31.152 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-05T13:22:31.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-05T13:22:31.451 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:31.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:31 smithi029 ceph-mon[112128]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:31.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:31 smithi052 ceph-mon[121072]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:32 smithi052 ceph-mon[121072]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 -- 172.21.15.29:0/1520889475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 msgr2=0x7fb8880fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/1520889475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb8880fdfe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb878004940 tx=0x7fb878009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 -- 172.21.15.29:0/1520889475 shutdown_connections 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/1520889475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 0x7fb888106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/1520889475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb8880fdfe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 -- 172.21.15.29:0/1520889475 >> 172.21.15.29:0/1520889475 conn(0x7fb8880f76c0 msgr2=0x7fb8880f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:32.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 -- 172.21.15.29:0/1520889475 shutdown_connections 2023-12-05T13:22:32.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.523+0000 7fb88e5d3700 1 -- 172.21.15.29:0/1520889475 wait complete. 2023-12-05T13:22:32.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.524+0000 7fb88e5d3700 1 Processor -- start 2023-12-05T13:22:32.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.524+0000 7fb88e5d3700 1 -- start start 2023-12-05T13:22:32.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.524+0000 7fb88e5d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb888113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.524+0000 7fb88e5d3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 0x7fb888113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.524+0000 7fb88e5d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb888114350 con 0x7fb8880fdc10 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.524+0000 7fb88e5d3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88810d5f0 con 0x7fb8880fe5b0 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb888113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb888113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57186/0 (socket says 172.21.15.29:57186) 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 -- 172.21.15.29:0/2677435377 learned_addr learned my addr 172.21.15.29:0/2677435377 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb8877fe700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 0x7fb888113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 -- 172.21.15.29:0/2677435377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 msgr2=0x7fb888113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 0x7fb888113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 -- 172.21.15.29:0/2677435377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878005040 con 0x7fb8880fdc10 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb8877fe700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 0x7fb888113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:22:32.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb887fff700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb888113730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb87800b3b0 tx=0x7fb878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:32.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb87800e040 con 0x7fb8880fdc10 2023-12-05T13:22:32.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb878009af0 con 0x7fb8880fdc10 2023-12-05T13:22:32.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88810d870 con 0x7fb8880fdc10 2023-12-05T13:22:32.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb87801c3f0 con 0x7fb8880fdc10 2023-12-05T13:22:32.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.525+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88810ddb0 con 0x7fb8880fdc10 2023-12-05T13:22:32.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.527+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb888104200 con 0x7fb8880fdc10 2023-12-05T13:22:32.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.528+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb87800bc50 con 0x7fb8880fdc10 2023-12-05T13:22:32.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.528+0000 7fb884ff9700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb870068f60 0x7fb87006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:32.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.528+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb878088910 con 0x7fb8880fdc10 2023-12-05T13:22:32.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.528+0000 7fb8877fe700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb870068f60 0x7fb87006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:32.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.528+0000 7fb8877fe700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb870068f60 0x7fb87006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb88810e800 tx=0x7fb87c008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:32.534 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.532+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb878058c50 con 0x7fb8880fdc10 2023-12-05T13:22:32.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:32 smithi029 ceph-mon[112128]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T13:22:32.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.780+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb8880fb2c0 con 0x7fb8880fdc10 2023-12-05T13:22:32.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.781+0000 7fb884ff9700 1 -- 172.21.15.29:0/2677435377 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb8780587e0 con 0x7fb8880fdc10 2023-12-05T13:22:32.782 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:32.782 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb870068f60 msgr2=0x7fb87006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb870068f60 0x7fb87006b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb88810e800 tx=0x7fb87c008040 comp rx=0 tx=0).stop 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 msgr2=0x7fb888113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb888113730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb87800b3b0 tx=0x7fb878009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 shutdown_connections 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb870068f60 0x7fb87006b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8880fdc10 0x7fb888113730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 --2- 172.21.15.29:0/2677435377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8880fe5b0 0x7fb888113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:32.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 >> 172.21.15.29:0/2677435377 conn(0x7fb8880f76c0 msgr2=0x7fb888101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:32.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 shutdown_connections 2023-12-05T13:22:32.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:32.782+0000 7fb88e5d3700 1 -- 172.21.15.29:0/2677435377 wait complete. 2023-12-05T13:22:33.236 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-05T13:22:33.236 INFO:tasks.cephadm:Setup complete, yielding 2023-12-05T13:22:33.236 INFO:teuthology.run_tasks:Running task print... 2023-12-05T13:22:33.246 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-05T13:22:33.246 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:22:33.259 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:22:33.260 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-05T13:22:33.559 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:33 smithi029 ceph-mon[112128]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:33 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2677435377' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-05T13:22:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:33 smithi052 ceph-mon[121072]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:33 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2677435377' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2893058698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee01020e0 msgr2=0x7fcee01044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2893058698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee01020e0 0x7fcee01044c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcec8004940 tx=0x7fcec8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2893058698 shutdown_connections 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2893058698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee01020e0 0x7fcee01044c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2893058698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee0066090 0x7fcee0101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2893058698 >> 172.21.15.29:0/2893058698 conn(0x7fcee00f7190 msgr2=0x7fcee00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2893058698 shutdown_connections 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.693+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2893058698 wait complete. 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcee5ff7700 1 Processor -- start 2023-12-05T13:22:34.695 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcee5ff7700 1 -- start start 2023-12-05T13:22:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcee5ff7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 0x7fcee010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcee5ff7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee01020e0 0x7fcee010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcee5ff7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01102e0 con 0x7fcee0066090 2023-12-05T13:22:34.696 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcee5ff7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0110b80 con 0x7fcee01020e0 2023-12-05T13:22:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcedf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 0x7fcee010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcedf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 0x7fcee010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57204/0 (socket says 172.21.15.29:57204) 2023-12-05T13:22:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcedf7fe700 1 -- 172.21.15.29:0/2786045427 learned_addr learned my addr 172.21.15.29:0/2786045427 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.694+0000 7fcedeffd700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee01020e0 0x7fcee010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fcedf7fe700 1 -- 172.21.15.29:0/2786045427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee01020e0 msgr2=0x7fcee010fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:34.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fcedf7fe700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee01020e0 0x7fcee010fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fcedf7fe700 1 -- 172.21.15.29:0/2786045427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8005040 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fcedf7fe700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 0x7fcee010f7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fced0002a50 tx=0x7fced00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced0007cc0 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fced000f040 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee0110e60 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced000d9c0 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.695+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee01113a0 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.696+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee01097e0 con 0x7fcee0066090 2023-12-05T13:22:34.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.697+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fced000db60 con 0x7fcee0066090 2023-12-05T13:22:34.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.697+0000 7fced7fff700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcecc068f60 0x7fcecc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:34.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.697+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fced00860f0 con 0x7fcee0066090 2023-12-05T13:22:34.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.697+0000 7fcedeffd700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcecc068f60 0x7fcecc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:34.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.698+0000 7fcedeffd700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcecc068f60 0x7fcecc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcec8004890 tx=0x7fcec8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:34.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.702+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fced004ca00 con 0x7fcee0066090 2023-12-05T13:22:34.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.903+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fcee004bb80 con 0x7fcee0066090 2023-12-05T13:22:34.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.907+0000 7fced7fff700 1 -- 172.21.15.29:0/2786045427 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fced0084e60 con 0x7fcee0066090 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcecc068f60 msgr2=0x7fcecc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcecc068f60 0x7fcecc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcec8004890 tx=0x7fcec8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 msgr2=0x7fcee010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 0x7fcee010f7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fced0002a50 tx=0x7fced00046b0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 shutdown_connections 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fcecc068f60 0x7fcecc06b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcee0066090 0x7fcee010f7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 --2- 172.21.15.29:0/2786045427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcee01020e0 0x7fcee010fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 >> 172.21.15.29:0/2786045427 conn(0x7fcee00f7190 msgr2=0x7fcee00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 shutdown_connections 2023-12-05T13:22:34.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:34.910+0000 7fcee5ff7700 1 -- 172.21.15.29:0/2786045427 wait complete. 2023-12-05T13:22:35.352 INFO:teuthology.run_tasks:Running task print... 2023-12-05T13:22:35.361 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-05T13:22:35.361 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:22:35.370 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:22:35.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-05T13:22:35.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:35 smithi029 ceph-mon[112128]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:35 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2786045427' entity='client.admin' 2023-12-05T13:22:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:35 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:22:35.666 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:35 smithi052 ceph-mon[121072]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:35 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2786045427' entity='client.admin' 2023-12-05T13:22:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:35 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:22:36.551 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:36 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:36.552 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:36 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:22:36.552 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:36 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:36 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:36 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:22:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:36 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:36.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.744+0000 7f4a635f3700 1 -- 172.21.15.29:0/2281058500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 msgr2=0x7f4a5c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:36.746 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.744+0000 7f4a635f3700 1 --2- 172.21.15.29:0/2281058500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c0fd150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c004940 tx=0x7f4a4c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 -- 172.21.15.29:0/2281058500 shutdown_connections 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 --2- 172.21.15.29:0/2281058500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c0fd150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 --2- 172.21.15.29:0/2281058500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 0x7f4a5c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 -- 172.21.15.29:0/2281058500 >> 172.21.15.29:0/2281058500 conn(0x7f4a5c0f7190 msgr2=0x7f4a5c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 -- 172.21.15.29:0/2281058500 shutdown_connections 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 -- 172.21.15.29:0/2281058500 wait complete. 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 Processor -- start 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 -- start start 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 0x7f4a5c112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.745+0000 7f4a635f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a635f3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c066000 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a635f3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c066140 con 0x7f4a5c0fbaf0 2023-12-05T13:22:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c114be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57222/0 (socket says 172.21.15.29:57222) 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 -- 172.21.15.29:0/654096190 learned_addr learned my addr 172.21.15.29:0/654096190 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a6138f700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 0x7f4a5c112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 -- 172.21.15.29:0/654096190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 msgr2=0x7f4a5c112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 0x7f4a5c112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 -- 172.21.15.29:0/654096190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c005040 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a6138f700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 0x7f4a5c112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a60b8e700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c114be0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009380 tx=0x7f4a4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a4c00e040 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c115120 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a4c00bda0 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.746+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a4c01c630 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.747+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c115580 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.748+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c04bb80 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.748+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4a4c0139d0 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.748+0000 7f4a51ffb700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a48068f60 0x7f4a4806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:36.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.749+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4a4c087e90 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.749+0000 7f4a6138f700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a48068f60 0x7f4a4806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:36.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.749+0000 7f4a6138f700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a48068f60 0x7f4a4806b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a58006fd0 tx=0x7f4a58008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:36.754 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.753+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a4c0546a0 con 0x7f4a5c0fcd00 2023-12-05T13:22:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.973+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a5c101650 con 0x7f4a48068f60 2023-12-05T13:22:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.974+0000 7f4a51ffb700 1 -- 172.21.15.29:0/654096190 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4a5c101650 con 0x7f4a48068f60 2023-12-05T13:22:36.975 INFO:teuthology.orchestra.run.smithi029.stdout:Backend: cephadm 2023-12-05T13:22:36.975 INFO:teuthology.orchestra.run.smithi029.stdout:Available: Yes 2023-12-05T13:22:36.975 INFO:teuthology.orchestra.run.smithi029.stdout:Paused: No 2023-12-05T13:22:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a48068f60 msgr2=0x7f4a4806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a48068f60 0x7f4a4806b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a58006fd0 tx=0x7f4a58008040 comp rx=0 tx=0).stop 2023-12-05T13:22:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 msgr2=0x7f4a5c114be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c114be0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009380 tx=0x7f4a4c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 shutdown_connections 2023-12-05T13:22:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4a48068f60 0x7f4a4806b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a5c0fbaf0 0x7f4a5c112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 --2- 172.21.15.29:0/654096190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a5c0fcd00 0x7f4a5c114be0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 >> 172.21.15.29:0/654096190 conn(0x7f4a5c0f7190 msgr2=0x7f4a5c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 shutdown_connections 2023-12-05T13:22:36.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:36.976+0000 7f4a635f3700 1 -- 172.21.15.29:0/654096190 wait complete. 2023-12-05T13:22:37.419 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-05T13:22:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:37 smithi052 ceph-mon[121072]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:37.845 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:37 smithi029 ceph-mon[112128]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:37.845 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:38.582 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:38 smithi029 ceph-mon[112128]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:38 smithi052 ceph-mon[121072]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 -- 172.21.15.29:0/2631834644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 msgr2=0x7fae1c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 --2- 172.21.15.29:0/2631834644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0ffb10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae0c004940 tx=0x7fae0c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 -- 172.21.15.29:0/2631834644 shutdown_connections 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 --2- 172.21.15.29:0/2631834644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae1c100050 0x7fae1c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 --2- 172.21.15.29:0/2631834644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0ffb10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 -- 172.21.15.29:0/2631834644 >> 172.21.15.29:0/2631834644 conn(0x7fae1c0f7190 msgr2=0x7fae1c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 -- 172.21.15.29:0/2631834644 shutdown_connections 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.809+0000 7fae225e6700 1 -- 172.21.15.29:0/2631834644 wait complete. 2023-12-05T13:22:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae225e6700 1 Processor -- start 2023-12-05T13:22:38.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae225e6700 1 -- start start 2023-12-05T13:22:38.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae225e6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:38.812 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae225e6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae1c100050 0x7fae1c0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae225e6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0fbc40 con 0x7fae1c0fd730 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae225e6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0fbdb0 con 0x7fae1c100050 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae1bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.810+0000 7fae1bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54902/0 (socket says 172.21.15.29:54902) 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae1bfff700 1 -- 172.21.15.29:0/1327169168 learned_addr learned my addr 172.21.15.29:0/1327169168 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae1b7fe700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae1c100050 0x7fae1c0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae1bfff700 1 -- 172.21.15.29:0/1327169168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae1c100050 msgr2=0x7fae1c0fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae1bfff700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae1c100050 0x7fae1c0fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae1bfff700 1 -- 172.21.15.29:0/1327169168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c005040 con 0x7fae1c0fd730 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae1bfff700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0fd1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009360 tx=0x7fae0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0c00e040 con 0x7fae1c0fd730 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c0fc030 con 0x7fae1c0fd730 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae0c00bc50 con 0x7fae1c0fd730 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0c01c3f0 con 0x7fae1c0fd730 2023-12-05T13:22:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.811+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c115550 con 0x7fae1c0fd730 2023-12-05T13:22:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.812+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c1075e0 con 0x7fae1c0fd730 2023-12-05T13:22:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.813+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fae0c013420 con 0x7fae1c0fd730 2023-12-05T13:22:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.813+0000 7fae18ff9700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fae04068f60 0x7fae0406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.813+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fae0c087dd0 con 0x7fae1c0fd730 2023-12-05T13:22:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.813+0000 7fae1b7fe700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fae04068f60 0x7fae0406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.814+0000 7fae1b7fe700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fae04068f60 0x7fae0406b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae10004f60 tx=0x7fae1000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:38.818+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fae0c057ff0 con 0x7fae1c0fd730 2023-12-05T13:22:39.027 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.026+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae1c02b150 con 0x7fae04068f60 2023-12-05T13:22:39.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.035+0000 7fae18ff9700 1 -- 172.21.15.29:0/1327169168 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7fae1c02b150 con 0x7fae04068f60 2023-12-05T13:22:39.036 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:22:39.036 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (2m) 101s ago 3m 26.4M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (3m) 101s ago 3m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (3m) 44s ago 3m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (2m) 101s ago 3m 79.2M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (4m) 101s ago 4m 484M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (3m) 44s ago 3m 441M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0e5359a579b3 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (4m) 101s ago 5m 57.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (2m) 44s ago 2m 51.3M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (3m) 101s ago 3m 17.3M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (3m) 44s ago 3m 17.2M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (2m) 101s ago 2m 40.5M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (2m) 101s ago 2m 39.6M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:22:39.037 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (105s) 101s ago 105s 11.9M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:22:39.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (86s) 44s ago 86s 46.5M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:22:39.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (67s) 44s ago 67s 42.4M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:22:39.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (47s) 44s ago 47s 14.2M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:22:39.038 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (2m) 101s ago 3m 33.4M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:22:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fae04068f60 msgr2=0x7fae0406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fae04068f60 0x7fae0406b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae10004f60 tx=0x7fae1000b040 comp rx=0 tx=0).stop 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 msgr2=0x7fae1c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0fd1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009360 tx=0x7fae0c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 shutdown_connections 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fae04068f60 0x7fae0406b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae1c0fd730 0x7fae1c0fd1c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 --2- 172.21.15.29:0/1327169168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae1c100050 0x7fae1c0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.037+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 >> 172.21.15.29:0/1327169168 conn(0x7fae1c0f7190 msgr2=0x7fae1c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.038+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 shutdown_connections 2023-12-05T13:22:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:39.038+0000 7fae225e6700 1 -- 172.21.15.29:0/1327169168 wait complete. 2023-12-05T13:22:39.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-05T13:22:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:39 smithi052 ceph-mon[121072]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:39.746 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:39.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:39 smithi029 ceph-mon[112128]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:40.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:40 smithi029 ceph-mon[112128]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:40 smithi052 ceph-mon[121072]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 -- 172.21.15.29:0/3269933559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fcd00 msgr2=0x7f3d680fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 --2- 172.21.15.29:0/3269933559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fcd00 0x7f3d680fd150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c004940 tx=0x7f3d5c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 -- 172.21.15.29:0/3269933559 shutdown_connections 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 --2- 172.21.15.29:0/3269933559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fcd00 0x7f3d680fd150 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 --2- 172.21.15.29:0/3269933559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d680fbaf0 0x7f3d680fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 -- 172.21.15.29:0/3269933559 >> 172.21.15.29:0/3269933559 conn(0x7f3d680f71d0 msgr2=0x7f3d680f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 -- 172.21.15.29:0/3269933559 shutdown_connections 2023-12-05T13:22:40.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.858+0000 7f3d6d823700 1 -- 172.21.15.29:0/3269933559 wait complete. 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d6d823700 1 Processor -- start 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d6d823700 1 -- start start 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d6d823700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 0x7f3d68112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d6d823700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d680fcd00 0x7f3d68114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d6d823700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68066890 con 0x7f3d680fbaf0 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d6d823700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680669d0 con 0x7f3d680fcd00 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 0x7f3d68112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 0x7f3d68112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54918/0 (socket says 172.21.15.29:54918) 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 -- 172.21.15.29:0/820608058 learned_addr learned my addr 172.21.15.29:0/820608058 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d667fc700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d680fcd00 0x7f3d68114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 -- 172.21.15.29:0/820608058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d680fcd00 msgr2=0x7f3d68114b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:40.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d680fcd00 0x7f3d68114b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 -- 172.21.15.29:0/820608058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c005040 con 0x7f3d680fbaf0 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.859+0000 7f3d66ffd700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 0x7f3d68112610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c8e0 tx=0x7f3d580044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.860+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d5800a760 con 0x7f3d680fbaf0 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.860+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d5800ad70 con 0x7f3d680fbaf0 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.860+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d681150a0 con 0x7f3d680fbaf0 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.860+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d580113a0 con 0x7f3d680fbaf0 2023-12-05T13:22:40.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.860+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d681154a0 con 0x7f3d680fbaf0 2023-12-05T13:22:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.861+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6804bb80 con 0x7f3d680fbaf0 2023-12-05T13:22:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.862+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3d58012400 con 0x7f3d680fbaf0 2023-12-05T13:22:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.862+0000 7f3d4f7fe700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d50068f60 0x7f3d5006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.862+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d58086970 con 0x7f3d680fbaf0 2023-12-05T13:22:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.862+0000 7f3d667fc700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d50068f60 0x7f3d5006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:40.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.862+0000 7f3d667fc700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d50068f60 0x7f3d5006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c004890 tx=0x7f3d5c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:40.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:40.867+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3d58053220 con 0x7f3d680fbaf0 2023-12-05T13:22:41.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.076+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d68101650 con 0x7f3d50068f60 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.080+0000 7f3d4f7fe700 1 -- 172.21.15.29:0/820608058 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7f3d68101650 con 0x7f3d50068f60 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager ?:9093,9094 1/1 103s ago 4m count:1 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:crash 2/2 103s ago 4m * 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:grafana ?:3000 1/1 103s ago 4m count:1 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:mgr 2/2 103s ago 4m count:2 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:mon 2/2 103s ago 3m smithi029:172.21.15.29=smithi029;smithi052:172.21.15.52=smithi052;count:2 2023-12-05T13:22:41.081 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter ?:9100 2/2 103s ago 4m * 2023-12-05T13:22:41.082 INFO:teuthology.orchestra.run.smithi029.stdout:osd 6 103s ago - 2023-12-05T13:22:41.082 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus ?:9095 1/1 103s ago 4m count:1 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d50068f60 msgr2=0x7f3d5006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d50068f60 0x7f3d5006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c004890 tx=0x7f3d5c009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 msgr2=0x7f3d68112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 0x7f3d68112610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800c8e0 tx=0x7f3d580044c0 comp rx=0 tx=0).stop 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 shutdown_connections 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d50068f60 0x7f3d5006b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:41.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d680fbaf0 0x7f3d68112610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:41.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 --2- 172.21.15.29:0/820608058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d680fcd00 0x7f3d68114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:41.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 >> 172.21.15.29:0/820608058 conn(0x7f3d680f71d0 msgr2=0x7f3d680fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:41.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 shutdown_connections 2023-12-05T13:22:41.084 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:41.082+0000 7f3d6d823700 1 -- 172.21.15.29:0/820608058 wait complete. 2023-12-05T13:22:41.485 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-05T13:22:41.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:41 smithi052 ceph-mon[121072]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:41.782 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:41.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:41 smithi029 ceph-mon[112128]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:42.599 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:42 smithi029 ceph-mon[112128]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:42.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:42 smithi052 ceph-mon[121072]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.817+0000 7fa6102f9700 1 -- 172.21.15.29:0/674878454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 msgr2=0x7fa608100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.817+0000 7fa6102f9700 1 --2- 172.21.15.29:0/674878454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa608100400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8004940 tx=0x7fa5f8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.817+0000 7fa6102f9700 1 -- 172.21.15.29:0/674878454 shutdown_connections 2023-12-05T13:22:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.817+0000 7fa6102f9700 1 --2- 172.21.15.29:0/674878454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa608100400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 --2- 172.21.15.29:0/674878454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 0x7fa6080ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:42.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 -- 172.21.15.29:0/674878454 >> 172.21.15.29:0/674878454 conn(0x7fa6080fa5d0 msgr2=0x7fa6080fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 -- 172.21.15.29:0/674878454 shutdown_connections 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 -- 172.21.15.29:0/674878454 wait complete. 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 Processor -- start 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 -- start start 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 0x7fa60810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa60810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608110310 con 0x7fa6080fff90 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa6102f9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608110bb0 con 0x7fa6080fee20 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.818+0000 7fa60d894700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa60810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60d894700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa60810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54932/0 (socket says 172.21.15.29:54932) 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60d894700 1 -- 172.21.15.29:0/260066047 learned_addr learned my addr 172.21.15.29:0/260066047 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60e095700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 0x7fa60810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60d894700 1 -- 172.21.15.29:0/260066047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 msgr2=0x7fa60810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:42.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60d894700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 0x7fa60810f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60d894700 1 -- 172.21.15.29:0/260066047 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8005040 con 0x7fa6080fff90 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60e095700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 0x7fa60810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa60d894700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa60810fd10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009380 tx=0x7fa5f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f800e040 con 0x7fa6080fff90 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5f800bda0 con 0x7fa6080fff90 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa608110e30 con 0x7fa6080fff90 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f801c630 con 0x7fa6080fff90 2023-12-05T13:22:42.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.819+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa608111370 con 0x7fa6080fff90 2023-12-05T13:22:42.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.820+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60804bb80 con 0x7fa6080fff90 2023-12-05T13:22:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.821+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa5f80139d0 con 0x7fa6080fff90 2023-12-05T13:22:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.821+0000 7fa5feffd700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa5f4068f60 0x7fa5f406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.821+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa5f8087df0 con 0x7fa6080fff90 2023-12-05T13:22:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.821+0000 7fa60e095700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa5f4068f60 0x7fa5f406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:42.824 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.822+0000 7fa60e095700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa5f4068f60 0x7fa5f406b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa604007fd0 tx=0x7fa604009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:42.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:42.826+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa5f8058130 con 0x7fa6080fff90 2023-12-05T13:22:43.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.034+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa608111790 con 0x7fa5f4068f60 2023-12-05T13:22:43.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.036+0000 7fa5feffd700 1 -- 172.21.15.29:0/260066047 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7fa608111790 con 0x7fa5f4068f60 2023-12-05T13:22:43.037 INFO:teuthology.orchestra.run.smithi029.stdout:HOST ADDR LABELS STATUS 2023-12-05T13:22:43.037 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029 172.21.15.29 2023-12-05T13:22:43.037 INFO:teuthology.orchestra.run.smithi029.stdout:smithi052 172.21.15.52 2023-12-05T13:22:43.037 INFO:teuthology.orchestra.run.smithi029.stdout:2 hosts in cluster 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.038+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa5f4068f60 msgr2=0x7fa5f406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.038+0000 7fa6102f9700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa5f4068f60 0x7fa5f406b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa604007fd0 tx=0x7fa604009040 comp rx=0 tx=0).stop 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.038+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 msgr2=0x7fa60810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.038+0000 7fa6102f9700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa60810fd10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009380 tx=0x7fa5f8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.038+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 shutdown_connections 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.038+0000 7fa6102f9700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa5f4068f60 0x7fa5f406b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.039+0000 7fa6102f9700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6080fee20 0x7fa60810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.039+0000 7fa6102f9700 1 --2- 172.21.15.29:0/260066047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6080fff90 0x7fa60810fd10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.039+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 >> 172.21.15.29:0/260066047 conn(0x7fa6080fa5d0 msgr2=0x7fa608103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.039+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 shutdown_connections 2023-12-05T13:22:43.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:43.039+0000 7fa6102f9700 1 -- 172.21.15.29:0/260066047 wait complete. 2023-12-05T13:22:43.442 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-05T13:22:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:43 smithi052 ceph-mon[121072]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:43.742 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:43.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:43 smithi029 ceph-mon[112128]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:44.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:44 smithi029 ceph-mon[112128]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:44 smithi052 ceph-mon[121072]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3922692109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec00fec50 msgr2=0x7f2ec00fad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3922692109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec00fec50 0x7f2ec00fad00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4004940 tx=0x7f2eb4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3922692109 shutdown_connections 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3922692109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec00fec50 0x7f2ec00fad00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3922692109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec00fe270 0x7f2ec00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3922692109 >> 172.21.15.29:0/3922692109 conn(0x7f2ec00f6950 msgr2=0x7f2ec00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3922692109 shutdown_connections 2023-12-05T13:22:44.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.853+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3922692109 wait complete. 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec77e3700 1 Processor -- start 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec77e3700 1 -- start start 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec77e3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec00fe270 0x7f2ec010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec77e3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 0x7f2ec010ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec77e3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec010e020 con 0x7f2ec010db60 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec77e3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec010e160 con 0x7f2ec00fe270 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec4d7e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 0x7f2ec010ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec4d7e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 0x7f2ec010ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54942/0 (socket says 172.21.15.29:54942) 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec4d7e700 1 -- 172.21.15.29:0/3395602994 learned_addr learned my addr 172.21.15.29:0/3395602994 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.854+0000 7f2ec557f700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec00fe270 0x7f2ec010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:44.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2ec4d7e700 1 -- 172.21.15.29:0/3395602994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec00fe270 msgr2=0x7f2ec010d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2ec4d7e700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec00fe270 0x7f2ec010d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2ec4d7e700 1 -- 172.21.15.29:0/3395602994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb4005040 con 0x7f2ec010db60 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2ec4d7e700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 0x7f2ec010ea00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400b7d0 tx=0x7f2eb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb400e040 con 0x7f2ec010db60 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec010f000 con 0x7f2ec010db60 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2eb4013420 con 0x7f2ec010db60 2023-12-05T13:22:44.858 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb401c610 con 0x7f2ec010db60 2023-12-05T13:22:44.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.855+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec010f510 con 0x7f2ec010db60 2023-12-05T13:22:44.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.856+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec0107600 con 0x7f2ec010db60 2023-12-05T13:22:44.859 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.857+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2eb4013590 con 0x7f2ec010db60 2023-12-05T13:22:44.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.857+0000 7f2eb1ffb700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2eac068f60 0x7f2eac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:44.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.857+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2eb4087cd0 con 0x7f2ec010db60 2023-12-05T13:22:44.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.857+0000 7f2ec557f700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2eac068f60 0x7f2eac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:44.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.858+0000 7f2ec557f700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2eac068f60 0x7f2eac06b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0065010 tx=0x7f2ebc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:44.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:44.862+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2eb4057f70 con 0x7f2ec010db60 2023-12-05T13:22:45.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.069+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec0105730 con 0x7f2eac068f60 2023-12-05T13:22:45.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.071+0000 7f2eb1ffb700 1 -- 172.21.15.29:0/3395602994 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f2ec0105730 con 0x7f2eac068f60 2023-12-05T13:22:45.072 INFO:teuthology.orchestra.run.smithi029.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-05T13:22:45.072 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009B480DGN 447G No 104s ago Has a FileSystem, LVM detected 2023-12-05T13:22:45.073 INFO:teuthology.orchestra.run.smithi029.stdout:smithi052 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513010N480DGN 447G No 48s ago Has a FileSystem, LVM detected 2023-12-05T13:22:45.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2eac068f60 msgr2=0x7f2eac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:45.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2eac068f60 0x7f2eac06b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0065010 tx=0x7f2ebc00b040 comp rx=0 tx=0).stop 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 msgr2=0x7f2ec010ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 0x7f2ec010ea00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400b7d0 tx=0x7f2eb4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 shutdown_connections 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2eac068f60 0x7f2eac06b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec00fe270 0x7f2ec010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 --2- 172.21.15.29:0/3395602994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec010db60 0x7f2ec010ea00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 >> 172.21.15.29:0/3395602994 conn(0x7f2ec00f6950 msgr2=0x7f2ec00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 shutdown_connections 2023-12-05T13:22:45.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:45.073+0000 7f2ec77e3700 1 -- 172.21.15.29:0/3395602994 wait complete. 2023-12-05T13:22:45.517 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:22:45.527 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:22:45.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-05T13:22:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:45 smithi052 ceph-mon[121072]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:45.826 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:45.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:45 smithi029 ceph-mon[112128]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:46.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:46 smithi029 ceph-mon[112128]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:46 smithi052 ceph-mon[121072]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 -- 172.21.15.29:0/2427788187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 msgr2=0x7f29b80ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/2427788187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b80ff7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29b4004940 tx=0x7f29b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 -- 172.21.15.29:0/2427788187 shutdown_connections 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/2427788187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b80ffd70 0x7f29b81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/2427788187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b80ff7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 -- 172.21.15.29:0/2427788187 >> 172.21.15.29:0/2427788187 conn(0x7f29b80f7190 msgr2=0x7f29b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 -- 172.21.15.29:0/2427788187 shutdown_connections 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.937+0000 7f29bfd5f700 1 -- 172.21.15.29:0/2427788187 wait complete. 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bfd5f700 1 Processor -- start 2023-12-05T13:22:46.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bfd5f700 1 -- start start 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bfd5f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bfd5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b80ffd70 0x7f29b810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bfd5f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b810e0c0 con 0x7f29b8066090 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bfd5f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b810e960 con 0x7f29b80ffd70 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bdafb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bdafb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54964/0 (socket says 172.21.15.29:54964) 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bdafb700 1 -- 172.21.15.29:0/3327416977 learned_addr learned my addr 172.21.15.29:0/3327416977 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:46.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bd2fa700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b80ffd70 0x7f29b810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bdafb700 1 -- 172.21.15.29:0/3327416977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b80ffd70 msgr2=0x7f29b810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bdafb700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b80ffd70 0x7f29b810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.938+0000 7f29bdafb700 1 -- 172.21.15.29:0/3327416977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4005040 con 0x7f29b8066090 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.939+0000 7f29bdafb700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b810d580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009fd0 tx=0x7f29b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.939+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b400e040 con 0x7f29b8066090 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.939+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29b4004290 con 0x7f29b8066090 2023-12-05T13:22:46.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.939+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b810ebe0 con 0x7f29b8066090 2023-12-05T13:22:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.939+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b401c3f0 con 0x7f29b8066090 2023-12-05T13:22:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.939+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b810f120 con 0x7f29b8066090 2023-12-05T13:22:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.940+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b81075e0 con 0x7f29b8066090 2023-12-05T13:22:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.940+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f29b400bc50 con 0x7f29b8066090 2023-12-05T13:22:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.941+0000 7f29ae7fc700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f29a4068f70 0x7f29a406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:46.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.941+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29b4087e40 con 0x7f29b8066090 2023-12-05T13:22:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.941+0000 7f29bd2fa700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f29a4068f70 0x7f29a406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:46.943 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.941+0000 7f29bd2fa700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f29a4068f70 0x7f29a406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29a80041d0 tx=0x7f29a80043c0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:46.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:46.946+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f29b40580e0 con 0x7f29b8066090 2023-12-05T13:22:47.174 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:47.173+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f29b802b150 con 0x7f29a4068f70 2023-12-05T13:22:47.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:47 smithi052 ceph-mon[121072]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:48.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:47 smithi029 ceph-mon[112128]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:48.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.722+0000 7f29ae7fc700 1 -- 172.21.15.29:0/3327416977 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f29b802b150 con 0x7f29a4068f70 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.727+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f29a4068f70 msgr2=0x7f29a406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.727+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f29a4068f70 0x7f29a406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29a80041d0 tx=0x7f29a80043c0 comp rx=0 tx=0).stop 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.727+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 msgr2=0x7f29b810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.727+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b810d580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009fd0 tx=0x7f29b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.727+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 shutdown_connections 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.727+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f29a4068f70 0x7f29a406b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.728+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b8066090 0x7f29b810d580 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009fd0 tx=0x7f29b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.728+0000 7f29bfd5f700 1 --2- 172.21.15.29:0/3327416977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29b80ffd70 0x7f29b810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.728+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 >> 172.21.15.29:0/3327416977 conn(0x7f29b80f7190 msgr2=0x7f29b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.728+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 shutdown_connections 2023-12-05T13:22:48.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:48.728+0000 7f29bfd5f700 1 -- 172.21.15.29:0/3327416977 wait complete. 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-mon[112128]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-mon[112128]: osdmap e40: 6 total, 6 up, 6 in 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-mon[112128]: pgmap v131: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:48.963 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:48 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[112105]: 2023-12-05T13:22:48.696+0000 7f45d073f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T13:22:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:48 smithi052 ceph-mon[121072]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:22:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-05T13:22:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-05T13:22:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:48 smithi052 ceph-mon[121072]: osdmap e40: 6 total, 6 up, 6 in 2023-12-05T13:22:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:48 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-05T13:22:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:48 smithi052 ceph-mon[121072]: pgmap v131: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:49.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-05T13:22:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: osdmap e41: 6 total, 6 up, 6 in 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: osdmap e42: 6 total, 6 up, 6 in 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: fsmap cephfs:0 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: Saving service mds.cephfs spec with placement count:4 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:22:49.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:49.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:22:49.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:49.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:49 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.jdhffk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-05T13:22:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-05T13:22:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: osdmap e41: 6 total, 6 up, 6 in 2023-12-05T13:22:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-05T13:22:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T13:22:49.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: osdmap e42: 6 total, 6 up, 6 in 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: fsmap cephfs:0 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: Saving service mds.cephfs spec with placement count:4 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:49 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.jdhffk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.jdhffk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:50 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:50 smithi029 ceph-mon[112128]: Deploying daemon mds.cephfs.smithi029.jdhffk on smithi029 2023-12-05T13:22:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:50 smithi029 ceph-mon[112128]: osdmap e43: 6 total, 6 up, 6 in 2023-12-05T13:22:50.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:50 smithi029 ceph-mon[112128]: pgmap v135: 65 pgs: 3 creating+peering, 14 active+clean, 48 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.jdhffk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:50 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:50 smithi052 ceph-mon[121072]: Deploying daemon mds.cephfs.smithi029.jdhffk on smithi029 2023-12-05T13:22:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:50 smithi052 ceph-mon[121072]: osdmap e43: 6 total, 6 up, 6 in 2023-12-05T13:22:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:50 smithi052 ceph-mon[121072]: pgmap v135: 65 pgs: 3 creating+peering, 14 active+clean, 48 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 -- 172.21.15.29:0/1674407149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780faed0 msgr2=0x7fe7780fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 --2- 172.21.15.29:0/1674407149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780faed0 0x7fe7780fb2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe768004940 tx=0x7fe768009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 -- 172.21.15.29:0/1674407149 shutdown_connections 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 --2- 172.21.15.29:0/1674407149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780fdf60 0x7fe7780fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 --2- 172.21.15.29:0/1674407149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780faed0 0x7fe7780fb2e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 -- 172.21.15.29:0/1674407149 >> 172.21.15.29:0/1674407149 conn(0x7fe7780f6950 msgr2=0x7fe7780f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:51.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 -- 172.21.15.29:0/1674407149 shutdown_connections 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.256+0000 7fe77c968700 1 -- 172.21.15.29:0/1674407149 wait complete. 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77c968700 1 Processor -- start 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77c968700 1 -- start start 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77c968700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 0x7fe77810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77c968700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780fdf60 0x7fe77810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77c968700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77810e0c0 con 0x7fe7780faed0 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77c968700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77810e960 con 0x7fe7780fdf60 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 0x7fe77810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 0x7fe77810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43154/0 (socket says 172.21.15.29:43154) 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe77659c700 1 -- 172.21.15.29:0/2134928309 learned_addr learned my addr 172.21.15.29:0/2134928309 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:51.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.257+0000 7fe775d9b700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780fdf60 0x7fe77810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:51.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe77659c700 1 -- 172.21.15.29:0/2134928309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780fdf60 msgr2=0x7fe77810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:51.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe77659c700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780fdf60 0x7fe77810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:51.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe77659c700 1 -- 172.21.15.29:0/2134928309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768005040 con 0x7fe7780faed0 2023-12-05T13:22:51.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe77659c700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 0x7fe77810d580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe768008d80 tx=0x7fe768009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe768021070 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe76801c400 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77810ebe0 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76800e070 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.258+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77810f0c0 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.259+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7781075f0 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.260+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe76801c9c0 con 0x7fe7780faed0 2023-12-05T13:22:51.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.260+0000 7fe766ffd700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe760068f70 0x7fe76006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:51.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.260+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe768087e50 con 0x7fe7780faed0 2023-12-05T13:22:51.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.260+0000 7fe775d9b700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe760068f70 0x7fe76006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:51.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.261+0000 7fe775d9b700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe760068f70 0x7fe76006b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009b80 tx=0x7fe76c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:51.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.265+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe768057e50 con 0x7fe7780faed0 2023-12-05T13:22:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.527+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe77810f3f0 con 0x7fe7780faed0 2023-12-05T13:22:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.528+0000 7fe766ffd700 1 -- 172.21.15.29:0/2134928309 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fe7680579e0 con 0x7fe7780faed0 2023-12-05T13:22:51.529 INFO:teuthology.orchestra.run.smithi029.stdout:e2 2023-12-05T13:22:51.529 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:22:51.529 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 2 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:22:48.696828+0000 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:22:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:in 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:up {} 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 0 2023-12-05T13:22:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:22:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe760068f70 msgr2=0x7fe76006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe760068f70 0x7fe76006b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009b80 tx=0x7fe76c00b040 comp rx=0 tx=0).stop 2023-12-05T13:22:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 msgr2=0x7fe77810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 0x7fe77810d580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe768008d80 tx=0x7fe768009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 shutdown_connections 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe760068f70 0x7fe76006b420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7780faed0 0x7fe77810d580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 --2- 172.21.15.29:0/2134928309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7780fdf60 0x7fe77810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.530+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 >> 172.21.15.29:0/2134928309 conn(0x7fe7780f6950 msgr2=0x7fe7780f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.531+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 shutdown_connections 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:51.531+0000 7fe77c968700 1 -- 172.21.15.29:0/2134928309 wait complete. 2023-12-05T13:22:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2023-12-05T13:22:51.905 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:51 smithi029 ceph-mon[112128]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-05T13:22:51.905 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:51 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2134928309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:22:51.952 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:22:51.962 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:22:51.963 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2023-12-05T13:22:51.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:51 smithi052 ceph-mon[121072]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-05T13:22:51.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:51 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2134928309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:22:52.374 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: pgmap v136: 65 pgs: 3 creating+peering, 59 active+clean, 3 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.nbpymg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:53.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.nbpymg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:53.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:53.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:52 smithi029 ceph-mon[112128]: Deploying daemon mds.cephfs.smithi052.nbpymg on smithi052 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: pgmap v136: 65 pgs: 3 creating+peering, 59 active+clean, 3 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.nbpymg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.nbpymg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:53.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:52 smithi052 ceph-mon[121072]: Deploying daemon mds.cephfs.smithi052.nbpymg on smithi052 2023-12-05T13:22:53.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 -- 172.21.15.29:0/551484660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640faed0 msgr2=0x7f93640fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:53.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 --2- 172.21.15.29:0/551484660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640faed0 0x7f93640fb2e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9360004940 tx=0x7f9360009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:53.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 -- 172.21.15.29:0/551484660 shutdown_connections 2023-12-05T13:22:53.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 --2- 172.21.15.29:0/551484660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93640fdf60 0x7f93640fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 --2- 172.21.15.29:0/551484660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640faed0 0x7f93640fb2e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 -- 172.21.15.29:0/551484660 >> 172.21.15.29:0/551484660 conn(0x7f93640f6950 msgr2=0x7f93640f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 -- 172.21.15.29:0/551484660 shutdown_connections 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.418+0000 7f936c308700 1 -- 172.21.15.29:0/551484660 wait complete. 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.419+0000 7f936c308700 1 Processor -- start 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.419+0000 7f936c308700 1 -- start start 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f936c308700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93640faed0 0x7f93640fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f936c308700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 0x7f93640fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f936c308700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640fc470 con 0x7f93640fdf60 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f936c308700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93640fc5e0 con 0x7f93640faed0 2023-12-05T13:22:53.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 0x7f93640fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 0x7f93640fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43172/0 (socket says 172.21.15.29:43172) 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 -- 172.21.15.29:0/3589060271 learned_addr learned my addr 172.21.15.29:0/3589060271 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f936a0a4700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93640faed0 0x7f93640fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 -- 172.21.15.29:0/3589060271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93640faed0 msgr2=0x7f93640fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93640faed0 0x7f93640fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 -- 172.21.15.29:0/3589060271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360005040 con 0x7f93640fdf60 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f93698a3700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 0x7f93640fbe70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9354002a50 tx=0x7f93540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9354007cc0 con 0x7f93640fdf60 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f935400f040 con 0x7f93640fdf60 2023-12-05T13:22:53.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93640fc8c0 con 0x7f93640fdf60 2023-12-05T13:22:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.420+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f935400d9c0 con 0x7f93640fdf60 2023-12-05T13:22:53.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.421+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9364115660 con 0x7f93640fdf60 2023-12-05T13:22:53.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.421+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9364107610 con 0x7f93640fdf60 2023-12-05T13:22:53.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.422+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f935400db20 con 0x7f93640fdf60 2023-12-05T13:22:53.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.423+0000 7f935affd700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9350068f60 0x7f935006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:53.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.423+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f93540865d0 con 0x7f93640fdf60 2023-12-05T13:22:53.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.423+0000 7f936a0a4700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9350068f60 0x7f935006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:53.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.423+0000 7f936a0a4700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9350068f60 0x7f935006b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93640fd780 tx=0x7f9360009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:53.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.427+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9354056550 con 0x7f93640fdf60 2023-12-05T13:22:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.675+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f93641055d0 con 0x7f93640fdf60 2023-12-05T13:22:53.914 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.913+0000 7f935affd700 1 -- 172.21.15.29:0/3589060271 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f93540560e0 con 0x7f93640fdf60 2023-12-05T13:22:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9350068f60 msgr2=0x7f935006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9350068f60 0x7f935006b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93640fd780 tx=0x7f9360009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 msgr2=0x7f93640fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 0x7f93640fbe70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9354002a50 tx=0x7f93540046b0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 shutdown_connections 2023-12-05T13:22:53.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f9350068f60 0x7f935006b410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93640faed0 0x7f93640fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 --2- 172.21.15.29:0/3589060271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93640fdf60 0x7f93640fbe70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:53.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.916+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 >> 172.21.15.29:0/3589060271 conn(0x7f93640f6950 msgr2=0x7f93640f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:53.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.917+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 shutdown_connections 2023-12-05T13:22:53.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:53.917+0000 7f936c308700 1 -- 172.21.15.29:0/3589060271 wait complete. 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] up:boot 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: daemon mds.cephfs.smithi029.jdhffk assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: Cluster is now healthy 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: fsmap cephfs:0 1 up:standby 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:creating} 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: daemon mds.cephfs.smithi029.jdhffk is now active in filesystem cephfs as rank 0 2023-12-05T13:22:54.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:53 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3589060271' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] up:boot 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: daemon mds.cephfs.smithi029.jdhffk assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: Cluster is now healthy 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: fsmap cephfs:0 1 up:standby 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:creating} 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: daemon mds.cephfs.smithi029.jdhffk is now active in filesystem cephfs as rank 0 2023-12-05T13:22:54.311 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:53 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3589060271' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2023-12-05T13:22:54.338 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:22:54.348 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:22:54.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-05T13:22:54.655 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: pgmap v137: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] up:active 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3589060271' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:55.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.pbbvzt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:55.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.pbbvzt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:55.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:55.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:54 smithi029 ceph-mon[112128]: Deploying daemon mds.cephfs.smithi029.pbbvzt on smithi029 2023-12-05T13:22:55.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: pgmap v137: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:22:55.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] up:active 2023-12-05T13:22:55.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3589060271' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2023-12-05T13:22:55.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.pbbvzt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.pbbvzt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:55.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:54 smithi052 ceph-mon[121072]: Deploying daemon mds.cephfs.smithi029.pbbvzt on smithi029 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 -- 172.21.15.29:0/3431217212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 msgr2=0x7f85b4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 --2- 172.21.15.29:0/3431217212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b4102430 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f85a8004940 tx=0x7f85a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 -- 172.21.15.29:0/3431217212 shutdown_connections 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 --2- 172.21.15.29:0/3431217212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b4102430 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 --2- 172.21.15.29:0/3431217212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b40fd730 0x7f85b40ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 -- 172.21.15.29:0/3431217212 >> 172.21.15.29:0/3431217212 conn(0x7f85b40f7190 msgr2=0x7f85b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 -- 172.21.15.29:0/3431217212 shutdown_connections 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 -- 172.21.15.29:0/3431217212 wait complete. 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.205+0000 7f85ba577700 1 Processor -- start 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85ba577700 1 -- start start 2023-12-05T13:22:56.207 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85ba577700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b40fd730 0x7f85b410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85ba577700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85ba577700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b410e000 con 0x7f85b4100050 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85ba577700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b410e8a0 con 0x7f85b40fd730 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85b37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85b37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43188/0 (socket says 172.21.15.29:43188) 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85b37fe700 1 -- 172.21.15.29:0/3565518219 learned_addr learned my addr 172.21.15.29:0/3565518219 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:56.208 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.206+0000 7f85b3fff700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b40fd730 0x7f85b410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b37fe700 1 -- 172.21.15.29:0/3565518219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b40fd730 msgr2=0x7f85b410d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b37fe700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b40fd730 0x7f85b410d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b37fe700 1 -- 172.21.15.29:0/3565518219 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8005040 con 0x7f85b4100050 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b37fe700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b410da00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009fd0 tx=0x7f85a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a8021070 con 0x7f85b4100050 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85a801c400 con 0x7f85b4100050 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a800e070 con 0x7f85b4100050 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b410eb20 con 0x7f85b4100050 2023-12-05T13:22:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.207+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b410efb0 con 0x7f85b4100050 2023-12-05T13:22:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.209+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b404bb80 con 0x7f85b4100050 2023-12-05T13:22:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.209+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f85a801ca00 con 0x7f85b4100050 2023-12-05T13:22:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.209+0000 7f85b0ff9700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f859c068f60 0x7f859c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.209+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f85a8087f90 con 0x7f85b4100050 2023-12-05T13:22:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.209+0000 7f85b3fff700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f859c068f60 0x7f859c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.210+0000 7f85b3fff700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f859c068f60 0x7f859c06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009b80 tx=0x7f85a400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:56.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.214+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f85a8057ef0 con 0x7f85b4100050 2023-12-05T13:22:56.221 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:55 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] up:boot 2023-12-05T13:22:56.221 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:55 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 1 up:standby 2023-12-05T13:22:56.221 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:55 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:22:56.221 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:55 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 1 up:standby 2023-12-05T13:22:56.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:55 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] up:boot 2023-12-05T13:22:56.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:55 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 1 up:standby 2023-12-05T13:22:56.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:55 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:22:56.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:55 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 1 up:standby 2023-12-05T13:22:56.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.486+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f85b41055a0 con 0x7f85b4100050 2023-12-05T13:22:56.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.935+0000 7f85b0ff9700 1 -- 172.21.15.29:0/3565518219 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85a8057a80 con 0x7f85b4100050 2023-12-05T13:22:56.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.938+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f859c068f60 msgr2=0x7f859c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:56.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.938+0000 7f85ba577700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f859c068f60 0x7f859c06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009b80 tx=0x7f85a400b040 comp rx=0 tx=0).stop 2023-12-05T13:22:56.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.938+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 msgr2=0x7f85b410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:56.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.938+0000 7f85ba577700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b410da00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009fd0 tx=0x7f85a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:56.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 shutdown_connections 2023-12-05T13:22:56.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f859c068f60 0x7f859c06b410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:56.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b40fd730 0x7f85b410d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:56.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 --2- 172.21.15.29:0/3565518219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85b4100050 0x7f85b410da00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:56.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 >> 172.21.15.29:0/3565518219 conn(0x7f85b40f7190 msgr2=0x7f85b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:56.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 shutdown_connections 2023-12-05T13:22:56.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:56.939+0000 7f85ba577700 1 -- 172.21.15.29:0/3565518219 wait complete. 2023-12-05T13:22:57.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2023-12-05T13:22:57.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3565518219' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-05T13:22:57.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:57.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:57.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:57.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dsxvue", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:57.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dsxvue", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:57.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: pgmap v138: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3565518219' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dsxvue", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dsxvue", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T13:22:57.304 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:22:57.396 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:22:57.407 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:22:57.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-05T13:22:57.716 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:22:58.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:57 smithi029 ceph-mon[112128]: Deploying daemon mds.cephfs.smithi052.dsxvue on smithi052 2023-12-05T13:22:58.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:57 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3565518219' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-05T13:22:58.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:57 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] up:boot 2023-12-05T13:22:58.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:57 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 2 up:standby 2023-12-05T13:22:58.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:57 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:22:58.130 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:57 smithi052 ceph-mon[121072]: Deploying daemon mds.cephfs.smithi052.dsxvue on smithi052 2023-12-05T13:22:58.130 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:57 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3565518219' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-05T13:22:58.130 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:57 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] up:boot 2023-12-05T13:22:58.130 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:57 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 2 up:standby 2023-12-05T13:22:58.130 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:57 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:22:58.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 -- 172.21.15.29:0/232828618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fff70 msgr2=0x7fd6e41003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:58.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 --2- 172.21.15.29:0/232828618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fff70 0x7fd6e41003e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4004940 tx=0x7fd6d4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 -- 172.21.15.29:0/232828618 shutdown_connections 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 --2- 172.21.15.29:0/232828618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fff70 0x7fd6e41003e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 --2- 172.21.15.29:0/232828618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fee00 0x7fd6e40ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 -- 172.21.15.29:0/232828618 >> 172.21.15.29:0/232828618 conn(0x7fd6e40fa5d0 msgr2=0x7fd6e40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 -- 172.21.15.29:0/232828618 shutdown_connections 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.793+0000 7fd6eb316700 1 -- 172.21.15.29:0/232828618 wait complete. 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6eb316700 1 Processor -- start 2023-12-05T13:22:58.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6eb316700 1 -- start start 2023-12-05T13:22:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6eb316700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fee00 0x7fd6e410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6eb316700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 0x7fd6e410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:58.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6eb316700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41102a0 con 0x7fd6e40fee00 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6eb316700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4110b40 con 0x7fd6e40fff70 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.794+0000 7fd6e88b1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 0x7fd6e410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6e88b1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 0x7fd6e410fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:43986/0 (socket says 172.21.15.29:43986) 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6e88b1700 1 -- 172.21.15.29:0/2881149541 learned_addr learned my addr 172.21.15.29:0/2881149541 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6e88b1700 1 -- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fee00 msgr2=0x7fd6e410f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6e88b1700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fee00 0x7fd6e410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6e88b1700 1 -- 172.21.15.29:0/2881149541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4005040 con 0x7fd6e40fff70 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6e88b1700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 0x7fd6e410fca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009360 tx=0x7fd6d4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d400e040 con 0x7fd6e40fff70 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.795+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e4110dc0 con 0x7fd6e40fff70 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.796+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e4111300 con 0x7fd6e40fff70 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.796+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd6d400bcd0 con 0x7fd6e40fff70 2023-12-05T13:22:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.796+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4025400 con 0x7fd6e40fff70 2023-12-05T13:22:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.797+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c80052e0 con 0x7fd6e40fff70 2023-12-05T13:22:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.797+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd6d4025560 con 0x7fd6e40fff70 2023-12-05T13:22:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.797+0000 7fd6d9ffb700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd6d0068f60 0x7fd6d006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:22:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.798+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd6d40881f0 con 0x7fd6e40fff70 2023-12-05T13:22:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.798+0000 7fd6e90b2700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd6d0068f60 0x7fd6d006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:22:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.798+0000 7fd6e90b2700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd6d0068f60 0x7fd6d006b410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0004b70 tx=0x7fd6e0007cc0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:22:58.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:58.803+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd6d40582a0 con 0x7fd6e40fff70 2023-12-05T13:22:59.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.065+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fd6c8005630 con 0x7fd6e40fff70 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: pgmap v139: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:58 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: pgmap v139: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:22:59.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:58 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:22:59.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.951+0000 7fd6d9ffb700 1 -- 172.21.15.29:0/2881149541 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v10) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd6d4057e30 con 0x7fd6e40fff70 2023-12-05T13:22:59.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd6d0068f60 msgr2=0x7fd6d006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd6d0068f60 0x7fd6d006b410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0004b70 tx=0x7fd6e0007cc0 comp rx=0 tx=0).stop 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 msgr2=0x7fd6e410fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 0x7fd6e410fca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009360 tx=0x7fd6d4009e30 comp rx=0 tx=0).stop 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 shutdown_connections 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd6d0068f60 0x7fd6d006b410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6e40fee00 0x7fd6e410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 --2- 172.21.15.29:0/2881149541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6e40fff70 0x7fd6e410fca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 >> 172.21.15.29:0/2881149541 conn(0x7fd6e40fa5d0 msgr2=0x7fd6e4103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 shutdown_connections 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:22:59.954+0000 7fd6eb316700 1 -- 172.21.15.29:0/2881149541 wait complete. 2023-12-05T13:22:59.955 INFO:teuthology.orchestra.run.smithi029.stderr:inline data disabled 2023-12-05T13:23:00.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:59 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] up:boot 2023-12-05T13:23:00.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:59 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:00.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:59 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:23:00.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:59 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2881149541' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T13:23:00.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:22:59 smithi052 ceph-mon[121072]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T13:23:00.294 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:59 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] up:boot 2023-12-05T13:23:00.295 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:59 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:00.295 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:59 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:23:00.295 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:59 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2881149541' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T13:23:00.295 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:22:59 smithi029 ceph-mon[112128]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T13:23:00.471 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T13:23:00.482 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:23:00.482 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-05T13:23:00.899 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:01.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:00 smithi052 ceph-mon[121072]: pgmap v140: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-05T13:23:01.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:00 smithi052 ceph-mon[121072]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-05T13:23:01.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:00 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:01.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:01.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:01.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:00 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:00 smithi029 ceph-mon[112128]: pgmap v140: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2023-12-05T13:23:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:00 smithi029 ceph-mon[112128]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-05T13:23:01.252 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:00 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:01.253 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:01.253 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:01.253 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:00 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:02.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.134+0000 7f3db8961700 1 -- 172.21.15.29:0/2303315236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fcbf0 msgr2=0x7f3db40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.134+0000 7f3db8961700 1 --2- 172.21.15.29:0/2303315236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fcbf0 0x7f3db40fd000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3da4004940 tx=0x7f3da4009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.134+0000 7f3db8961700 1 -- 172.21.15.29:0/2303315236 shutdown_connections 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.134+0000 7f3db8961700 1 --2- 172.21.15.29:0/2303315236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db40fde00 0x7f3db40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.134+0000 7f3db8961700 1 --2- 172.21.15.29:0/2303315236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fcbf0 0x7f3db40fd000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.134+0000 7f3db8961700 1 -- 172.21.15.29:0/2303315236 >> 172.21.15.29:0/2303315236 conn(0x7f3db40f82d0 msgr2=0x7f3db40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.135+0000 7f3db8961700 1 -- 172.21.15.29:0/2303315236 shutdown_connections 2023-12-05T13:23:02.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.135+0000 7f3db8961700 1 -- 172.21.15.29:0/2303315236 wait complete. 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.135+0000 7f3db8961700 1 Processor -- start 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db8961700 1 -- start start 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db8961700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db40fcbf0 0x7f3db4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db8961700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 0x7f3db406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db8961700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4070590 con 0x7f3db40fde00 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db8961700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4070700 con 0x7f3db40fcbf0 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 0x7f3db406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 0x7f3db406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41634/0 (socket says 172.21.15.29:41634) 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 -- 172.21.15.29:0/3228308636 learned_addr learned my addr 172.21.15.29:0/3228308636 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db259c700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db40fcbf0 0x7f3db4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 -- 172.21.15.29:0/3228308636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db40fcbf0 msgr2=0x7f3db4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db40fcbf0 0x7f3db4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 -- 172.21.15.29:0/3228308636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4005040 con 0x7f3db40fde00 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.136+0000 7f3db1d9b700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 0x7f3db406ff90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3da8002a80 tx=0x7f3da80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.137+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3da8007cc0 con 0x7f3db40fde00 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.137+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db40709e0 con 0x7f3db40fde00 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.137+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3da800f040 con 0x7f3db40fde00 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.137+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3da800da60 con 0x7f3db40fde00 2023-12-05T13:23:02.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.137+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db4115500 con 0x7f3db40fde00 2023-12-05T13:23:02.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.138+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db404bb80 con 0x7f3db40fde00 2023-12-05T13:23:02.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.138+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3da800dbc0 con 0x7f3db40fde00 2023-12-05T13:23:02.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.139+0000 7f3da2ffd700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d9c068f60 0x7f3d9c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:02.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.139+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3da8086760 con 0x7f3db40fde00 2023-12-05T13:23:02.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.139+0000 7f3db259c700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d9c068f60 0x7f3d9c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:02.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.139+0000 7f3db259c700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d9c068f60 0x7f3d9c06b410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3da400b7d0 tx=0x7f3da4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:02.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.144+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3da80566c0 con 0x7f3db40fde00 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.410+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3db4105590 con 0x7f3db40fde00 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.410+0000 7f3da2ffd700 1 -- 172.21.15.29:0/3228308636 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f3da8056250 con 0x7f3db40fde00 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:e11 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:23:02.411 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:23:02.412 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:23:02.413 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:23:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:23:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:23:02.414 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:23:02.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d9c068f60 msgr2=0x7f3d9c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:02.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d9c068f60 0x7f3d9c06b410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3da400b7d0 tx=0x7f3da4009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 msgr2=0x7f3db406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 0x7f3db406ff90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3da8002a80 tx=0x7f3da80046b0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 shutdown_connections 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3d9c068f60 0x7f3d9c06b410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3db40fcbf0 0x7f3db4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 --2- 172.21.15.29:0/3228308636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3db40fde00 0x7f3db406ff90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 >> 172.21.15.29:0/3228308636 conn(0x7f3db40f82d0 msgr2=0x7f3db4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.412+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 shutdown_connections 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:02.413+0000 7f3db8961700 1 -- 172.21.15.29:0/3228308636 wait complete. 2023-12-05T13:23:02.415 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 11 2023-12-05T13:23:02.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:02 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] up:standby 2023-12-05T13:23:02.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:02 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] up:active 2023-12-05T13:23:02.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:02 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:02.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:02 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3228308636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:23:02.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:02 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] up:standby 2023-12-05T13:23:02.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:02 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] up:active 2023-12-05T13:23:02.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:02 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:02.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:02 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3228308636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:23:02.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-05T13:23:03.205 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: pgmap v141: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] up:standby 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:03 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:23:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: pgmap v141: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2023-12-05T13:23:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] up:standby 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:03 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:23:04.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:04 smithi029 ceph-mon[112128]: mds.? [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] up:standby 2023-12-05T13:23:04.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:04 smithi029 ceph-mon[112128]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:04.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 -- 172.21.15.29:0/827033840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fcd10 msgr2=0x7fa1380fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:04.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 --2- 172.21.15.29:0/827033840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fcd10 0x7fa1380fd160 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa128004940 tx=0x7fa128009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:04.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 -- 172.21.15.29:0/827033840 shutdown_connections 2023-12-05T13:23:04.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 --2- 172.21.15.29:0/827033840 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fcd10 0x7fa1380fd160 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:04.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 --2- 172.21.15.29:0/827033840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1380fbb00 0x7fa1380fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:04.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 -- 172.21.15.29:0/827033840 >> 172.21.15.29:0/827033840 conn(0x7fa1380f71c0 msgr2=0x7fa1380f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:04.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 -- 172.21.15.29:0/827033840 shutdown_connections 2023-12-05T13:23:04.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.664+0000 7fa13f445700 1 -- 172.21.15.29:0/827033840 wait complete. 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13f445700 1 Processor -- start 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13f445700 1 -- start start 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13f445700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 0x7fa13810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13f445700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1380fcd10 0x7fa13810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13f445700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13810dfd0 con 0x7fa1380fbb00 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13f445700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13810e870 con 0x7fa1380fcd10 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13d1e1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 0x7fa13810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:04.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13d1e1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 0x7fa13810d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41644/0 (socket says 172.21.15.29:41644) 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13d1e1700 1 -- 172.21.15.29:0/1252718130 learned_addr learned my addr 172.21.15.29:0/1252718130 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13c9e0700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1380fcd10 0x7fa13810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13d1e1700 1 -- 172.21.15.29:0/1252718130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1380fcd10 msgr2=0x7fa13810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13d1e1700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1380fcd10 0x7fa13810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.665+0000 7fa13d1e1700 1 -- 172.21.15.29:0/1252718130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128005040 con 0x7fa1380fbb00 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.666+0000 7fa13d1e1700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 0x7fa13810d490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa13400eb70 tx=0x7fa13400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.666+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa134007cc0 con 0x7fa1380fbb00 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.666+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa13400f040 con 0x7fa1380fbb00 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.666+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13810eaf0 con 0x7fa1380fbb00 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.666+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa13400c9d0 con 0x7fa1380fbb00 2023-12-05T13:23:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.666+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13810f030 con 0x7fa1380fbb00 2023-12-05T13:23:04.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.667+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13804bb80 con 0x7fa1380fbb00 2023-12-05T13:23:04.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.667+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa13400cb30 con 0x7fa1380fbb00 2023-12-05T13:23:04.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.668+0000 7fa12dffb700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa124068f60 0x7fa12406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:04.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.668+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa1340867b0 con 0x7fa1380fbb00 2023-12-05T13:23:04.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.668+0000 7fa13c9e0700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa124068f60 0x7fa12406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:04.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.669+0000 7fa13c9e0700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa124068f60 0x7fa12406b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa128000c00 tx=0x7fa128009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:04.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.673+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa13404da00 con 0x7fa1380fbb00 2023-12-05T13:23:04.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:04 smithi052 ceph-mon[121072]: mds.? [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] up:standby 2023-12-05T13:23:04.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:04 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:23:04.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.947+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1381055a0 con 0x7fa1380fbb00 2023-12-05T13:23:04.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.947+0000 7fa12dffb700 1 -- 172.21.15.29:0/1252718130 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4680 (secure 0 0 0) 0x7fa1340567c0 con 0x7fa1380fbb00 2023-12-05T13:23:04.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa124068f60 msgr2=0x7fa12406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa124068f60 0x7fa12406b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa128000c00 tx=0x7fa128009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 msgr2=0x7fa13810d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 0x7fa13810d490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa13400eb70 tx=0x7fa13400b040 comp rx=0 tx=0).stop 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 shutdown_connections 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa124068f60 0x7fa12406b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa1380fbb00 0x7fa13810d490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 --2- 172.21.15.29:0/1252718130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1380fcd10 0x7fa13810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 >> 172.21.15.29:0/1252718130 conn(0x7fa1380f71c0 msgr2=0x7fa1380fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 shutdown_connections 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:04.950+0000 7fa13f445700 1 -- 172.21.15.29:0/1252718130 wait complete. 2023-12-05T13:23:04.951 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:23:04.962 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:23:05.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-05T13:23:05.591 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:05 smithi029 ceph-mon[112128]: pgmap v142: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2023-12-05T13:23:05.591 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:05 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:05.591 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:05 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:05.591 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:05 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1252718130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T13:23:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:05 smithi052 ceph-mon[121072]: pgmap v142: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2023-12-05T13:23:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:05 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:05 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:05 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1252718130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T13:23:05.807 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.254+0000 7f385468e700 1 -- 172.21.15.29:0/1622481509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c0fb950 msgr2=0x7f384c0fe200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.254+0000 7f385468e700 1 --2- 172.21.15.29:0/1622481509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c0fb950 0x7f384c0fe200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f383c004940 tx=0x7f383c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.254+0000 7f385468e700 1 -- 172.21.15.29:0/1622481509 shutdown_connections 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.254+0000 7f385468e700 1 --2- 172.21.15.29:0/1622481509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c0fb950 0x7f384c0fe200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.254+0000 7f385468e700 1 --2- 172.21.15.29:0/1622481509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f384c0faf70 0x7f384c0fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.254+0000 7f385468e700 1 -- 172.21.15.29:0/1622481509 >> 172.21.15.29:0/1622481509 conn(0x7f384c0f6950 msgr2=0x7f384c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.255+0000 7f385468e700 1 -- 172.21.15.29:0/1622481509 shutdown_connections 2023-12-05T13:23:07.257 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.255+0000 7f385468e700 1 -- 172.21.15.29:0/1622481509 wait complete. 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385468e700 1 Processor -- start 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385468e700 1 -- start start 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385468e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f384c0faf70 0x7f384c10d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385468e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 0x7f384c10ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385468e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c10e210 con 0x7f384c10dd50 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385468e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c10e350 con 0x7f384c0faf70 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f3851c29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 0x7f384c10ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f3851c29700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 0x7f384c10ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41658/0 (socket says 172.21.15.29:41658) 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f3851c29700 1 -- 172.21.15.29:0/1830124350 learned_addr learned my addr 172.21.15.29:0/1830124350 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f385242a700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f384c0faf70 0x7f384c10d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f3851c29700 1 -- 172.21.15.29:0/1830124350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f384c0faf70 msgr2=0x7f384c10d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f3851c29700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f384c0faf70 0x7f384c10d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:07.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.256+0000 7f3851c29700 1 -- 172.21.15.29:0/1830124350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c005040 con 0x7f384c10dd50 2023-12-05T13:23:07.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.257+0000 7f3851c29700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 0x7f384c10ebf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f383c00b3b0 tx=0x7f383c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:07.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.257+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383c00e040 con 0x7f384c10dd50 2023-12-05T13:23:07.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.257+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c10f1f0 con 0x7f384c10dd50 2023-12-05T13:23:07.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.257+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f383c013420 con 0x7f384c10dd50 2023-12-05T13:23:07.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.257+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383c01c650 con 0x7f384c10dd50 2023-12-05T13:23:07.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.257+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c10f700 con 0x7f384c10dd50 2023-12-05T13:23:07.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.258+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c04bb80 con 0x7f384c10dd50 2023-12-05T13:23:07.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.259+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f383c013590 con 0x7f384c10dd50 2023-12-05T13:23:07.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.259+0000 7f3842ffd700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3838068f60 0x7f383806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:07.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.259+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f383c088bb0 con 0x7f384c10dd50 2023-12-05T13:23:07.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.259+0000 7f385242a700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3838068f60 0x7f383806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:07.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.260+0000 7f385242a700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3838068f60 0x7f383806b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3848004f40 tx=0x7f384800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:07.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.263+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f383c058ba0 con 0x7f384c10dd50 2023-12-05T13:23:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.573+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f384c105920 con 0x7f384c10dd50 2023-12-05T13:23:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.574+0000 7f3842ffd700 1 -- 172.21.15.29:0/1830124350 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+99 (secure 0 0 0) 0x7f383c058730 con 0x7f384c10dd50 2023-12-05T13:23:07.576 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3838068f60 msgr2=0x7f383806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3838068f60 0x7f383806b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3848004f40 tx=0x7f384800b040 comp rx=0 tx=0).stop 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 msgr2=0x7f384c10ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 0x7f384c10ebf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f383c00b3b0 tx=0x7f383c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 shutdown_connections 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f3838068f60 0x7f383806b410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f384c0faf70 0x7f384c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 --2- 172.21.15.29:0/1830124350 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f384c10dd50 0x7f384c10ebf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 >> 172.21.15.29:0/1830124350 conn(0x7f384c0f6950 msgr2=0x7f384c1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 shutdown_connections 2023-12-05T13:23:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:07.576+0000 7f385468e700 1 -- 172.21.15.29:0/1830124350 wait complete. 2023-12-05T13:23:07.588 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:23:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: pgmap v143: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 3 op/s 2023-12-05T13:23:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:07.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:23:07.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:23:07.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: pgmap v143: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 3 op/s 2023-12-05T13:23:07.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:07.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:23:07.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:23:07.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:07.964 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-05T13:23:07.978 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T13:23:08.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 -- 172.21.15.29:0/3107975836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 msgr2=0x7f54d00fd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.129 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3107975836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d00fd080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f54c4004940 tx=0x7f54c4009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:08.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 -- 172.21.15.29:0/3107975836 shutdown_connections 2023-12-05T13:23:08.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3107975836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d00fd080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3107975836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00fb960 0x7f54d00fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 -- 172.21.15.29:0/3107975836 >> 172.21.15.29:0/3107975836 conn(0x7f54d00f70a0 msgr2=0x7f54d00f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:08.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 -- 172.21.15.29:0/3107975836 shutdown_connections 2023-12-05T13:23:08.130 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.128+0000 7f54d57e3700 1 -- 172.21.15.29:0/3107975836 wait complete. 2023-12-05T13:23:08.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54d57e3700 1 Processor -- start 2023-12-05T13:23:08.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54d57e3700 1 -- start start 2023-12-05T13:23:08.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54d57e3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00fb960 0x7f54d010c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.132 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54d57e3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d010c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54d57e3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d010cd50 con 0x7f54d00fcc10 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54d57e3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d010cec0 con 0x7f54d00fb960 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d010c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d010c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41688/0 (socket says 172.21.15.29:41688) 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 -- 172.21.15.29:0/3057903129 learned_addr learned my addr 172.21.15.29:0/3057903129 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ceffd700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00fb960 0x7f54d010c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 -- 172.21.15.29:0/3057903129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00fb960 msgr2=0x7f54d010c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00fb960 0x7f54d010c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 -- 172.21.15.29:0/3057903129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4005040 con 0x7f54d00fcc10 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.129+0000 7f54ce7fc700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d010c750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009360 tx=0x7f54c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.130+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c400e040 con 0x7f54d00fcc10 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.130+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54c4004290 con 0x7f54d00fcc10 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.130+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d0065df0 con 0x7f54d00fcc10 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.130+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c4013660 con 0x7f54d00fcc10 2023-12-05T13:23:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.130+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d00662d0 con 0x7f54d00fcc10 2023-12-05T13:23:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.131+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0104320 con 0x7f54d00fcc10 2023-12-05T13:23:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.131+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f54c401e420 con 0x7f54d00fcc10 2023-12-05T13:23:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.132+0000 7f54b77fe700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f54b8068f70 0x7f54b806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.132+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f54c408acd0 con 0x7f54d00fcc10 2023-12-05T13:23:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.132+0000 7f54ceffd700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f54b8068f70 0x7f54b806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.132+0000 7f54ceffd700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f54b8068f70 0x7f54b806b420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54c0004f40 tx=0x7f54c000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:08.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.136+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f54c405abb0 con 0x7f54d00fcc10 2023-12-05T13:23:08.344 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.344+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54d00664f0 con 0x7f54d00fcc10 2023-12-05T13:23:08.345 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.345+0000 7f54b77fe700 1 -- 172.21.15.29:0/3057903129 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14193 (secure 0 0 0) 0x7f54c405a740 con 0x7f54d00fcc10 2023-12-05T13:23:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:23:08.346 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":43,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","created":"2023-12-05T13:17:36.045441+0000","modified":"2023-12-05T13:22:49.703598+0000","last_up_change":"2023-12-05T13:21:58.006915+0000","last_in_change":"2023-12-05T13:21:41.541471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T13:21:02.367176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T13:22:47.619908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T13:22:48.124625+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc29bb5c-04bc-4518-a111-9d849c4f0d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6803","nonce":3753865905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6805","nonce":3753865905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6809","nonce":3753865905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":3753865905},{"type":"v1","addr":"172.21.15.29:6807","nonce":3753865905}]},"public_addr":"172.21.15.29:6803/3753865905","cluster_addr":"172.21.15.29:6805/3753865905","heartbeat_back_addr":"172.21.15.29:6809/3753865905","heartbeat_front_addr":"172.21.15.29:6807/3753865905","state":["exists","up"]},{"osd":1,"uuid":"3a6e62e0-e01c-442e-9edc-e84c329ccd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6811","nonce":526482960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6813","nonce":526482960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6817","nonce":526482960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":526482960},{"type":"v1","addr":"172.21.15.29:6815","nonce":526482960}]},"public_addr":"172.21.15.29:6811/526482960","cluster_addr":"172.21.15.29:6813/526482960","heartbeat_back_addr":"172.21.15.29:6817/526482960","heartbeat_front_addr":"172.21.15.29:6815/526482960","state":["exists","up"]},{"osd":2,"uuid":"3002b9e9-bd72-42cc-ae96-94d56978a07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6819","nonce":958560708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6821","nonce":958560708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6825","nonce":958560708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":958560708},{"type":"v1","addr":"172.21.15.29:6823","nonce":958560708}]},"public_addr":"172.21.15.29:6819/958560708","cluster_addr":"172.21.15.29:6821/958560708","heartbeat_back_addr":"172.21.15.29:6825/958560708","heartbeat_front_addr":"172.21.15.29:6823/958560708","state":["exists","up"]},{"osd":3,"uuid":"e250cbd9-ad56-4a7b-babf-fdb3cabab073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6801","nonce":428901563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6803","nonce":428901563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6807","nonce":428901563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":428901563},{"type":"v1","addr":"172.21.15.52:6805","nonce":428901563}]},"public_addr":"172.21.15.52:6801/428901563","cluster_addr":"172.21.15.52:6803/428901563","heartbeat_back_addr":"172.21.15.52:6807/428901563","heartbeat_front_addr":"172.21.15.52:6805/428901563","state":["exists","up"]},{"osd":4,"uuid":"89646f3e-7cb0-46b5-b821-1fb42aeb152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6809","nonce":845940001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6811","nonce":845940001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6815","nonce":845940001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":845940001},{"type":"v1","addr":"172.21.15.52:6813","nonce":845940001}]},"public_addr":"172.21.15.52:6809/845940001","cluster_addr":"172.21.15.52:6811/845940001","heartbeat_back_addr":"172.21.15.52:6815/845940001","heartbeat_front_addr":"172.21.15.52:6813/845940001","state":["exists","up"]},{"osd":5,"uuid":"bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6817","nonce":4188463667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6819","nonce":4188463667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6823","nonce":4188463667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4188463667},{"type":"v1","addr":"172.21.15.52:6821","nonce":4188463667}]},"public_addr":"172.21.15.52:6817/4188463667","cluster_addr":"172.21.15.52:6819/4188463667","heartbeat_back_addr":"172.21.15.52:6823/4188463667","heartbeat_front_addr":"172.21.15.52:6821/4188463667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:18.340381+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:38.341916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:58.622396+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:17.619538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:36.860723+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:56.648279+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/3643035279":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/2512512522":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/4099120105":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/2782816162":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6801/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1756367778":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/2026205753":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6800/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.29:0/599938718":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6801/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/3972762513":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1009526803":"2023-12-06T13:18:27.235853+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f54b8068f70 msgr2=0x7f54b806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f54b8068f70 0x7f54b806b420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54c0004f40 tx=0x7f54c000b040 comp rx=0 tx=0).stop 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 msgr2=0x7f54d010c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d010c750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009360 tx=0x7f54c4009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 shutdown_connections 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f54b8068f70 0x7f54b806b420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00fb960 0x7f54d010c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 --2- 172.21.15.29:0/3057903129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d00fcc10 0x7f54d010c750 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 >> 172.21.15.29:0/3057903129 conn(0x7f54d00f70a0 msgr2=0x7f54d00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 shutdown_connections 2023-12-05T13:23:08.349 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.347+0000 7f54d57e3700 1 -- 172.21.15.29:0/3057903129 wait complete. 2023-12-05T13:23:08.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T13:21:02.367176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T13:22:47.619908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T13:22:48.124625+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-05T13:23:08.363 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.499+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/3453943857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 msgr2=0x7f0e580fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.499+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/3453943857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e580fbdb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0e48004940 tx=0x7f0e48009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.499+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/3453943857 shutdown_connections 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.499+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/3453943857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e580fcbb0 0x7f0e580fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.499+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/3453943857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e580fbdb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.500+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/3453943857 >> 172.21.15.29:0/3453943857 conn(0x7f0e580f7060 msgr2=0x7f0e580f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.500+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/3453943857 shutdown_connections 2023-12-05T13:23:08.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.500+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/3453943857 wait complete. 2023-12-05T13:23:08.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.500+0000 7f0e5ddb6700 1 Processor -- start 2023-12-05T13:23:08.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.500+0000 7f0e5ddb6700 1 -- start start 2023-12-05T13:23:08.503 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e5ddb6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e5810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e5ddb6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e580fcbb0 0x7f0e5810c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e5ddb6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5810cc70 con 0x7f0e580fb9a0 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e5ddb6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5810cde0 con 0x7f0e580fcbb0 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e5810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e5810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55250/0 (socket says 172.21.15.29:55250) 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 -- 172.21.15.29:0/2911961094 learned_addr learned my addr 172.21.15.29:0/2911961094 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e56ffd700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e580fcbb0 0x7f0e5810c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 -- 172.21.15.29:0/2911961094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e580fcbb0 msgr2=0x7f0e5810c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e580fcbb0 0x7f0e5810c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 -- 172.21.15.29:0/2911961094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48005040 con 0x7f0e580fb9a0 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e577fe700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e5810c130 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0e48008f80 tx=0x7f0e48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:08.504 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e48021070 con 0x7f0e580fb9a0 2023-12-05T13:23:08.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e4801c400 con 0x7f0e580fb9a0 2023-12-05T13:23:08.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e58111830 con 0x7f0e580fb9a0 2023-12-05T13:23:08.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4800e070 con 0x7f0e580fb9a0 2023-12-05T13:23:08.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.501+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58111d90 con 0x7f0e580fb9a0 2023-12-05T13:23:08.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.503+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e58104340 con 0x7f0e580fb9a0 2023-12-05T13:23:08.505 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.503+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0e4801c950 con 0x7f0e580fb9a0 2023-12-05T13:23:08.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.503+0000 7f0e3ffff700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e40068f70 0x7f0e4006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.503+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0e48087fc0 con 0x7f0e580fb9a0 2023-12-05T13:23:08.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.503+0000 7f0e56ffd700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e40068f70 0x7f0e4006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.506 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.504+0000 7f0e56ffd700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e40068f70 0x7f0e4006b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009b80 tx=0x7f0e4c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:08.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.508+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0e48057f20 con 0x7f0e580fb9a0 2023-12-05T13:23:08.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.712+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e58112140 con 0x7f0e580fb9a0 2023-12-05T13:23:08.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.713+0000 7f0e3ffff700 1 -- 172.21.15.29:0/2911961094 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e48057ab0 con 0x7f0e580fb9a0 2023-12-05T13:23:08.716 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-12-05T13:23:08.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e40068f70 msgr2=0x7f0e4006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.716 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e40068f70 0x7f0e4006b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009b80 tx=0x7f0e4c00b040 comp rx=0 tx=0).stop 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 msgr2=0x7f0e5810c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e5810c130 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0e48008f80 tx=0x7f0e48009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 shutdown_connections 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f0e40068f70 0x7f0e4006b420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e580fb9a0 0x7f0e5810c130 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 --2- 172.21.15.29:0/2911961094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e580fcbb0 0x7f0e5810c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 >> 172.21.15.29:0/2911961094 conn(0x7f0e580f7060 msgr2=0x7f0e580ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.715+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 shutdown_connections 2023-12-05T13:23:08.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.716+0000 7f0e5ddb6700 1 -- 172.21.15.29:0/2911961094 wait complete. 2023-12-05T13:23:08.729 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:08 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1830124350' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-05T13:23:08.729 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:08 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3057903129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:23:08.730 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 -- 172.21.15.29:0/1160828893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fcb80 msgr2=0x7ff0340fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 --2- 172.21.15.29:0/1160828893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fcb80 0x7ff0340fcfd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff020004940 tx=0x7ff020009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 -- 172.21.15.29:0/1160828893 shutdown_connections 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 --2- 172.21.15.29:0/1160828893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fcb80 0x7ff0340fcfd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 --2- 172.21.15.29:0/1160828893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fb970 0x7ff0340fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 -- 172.21.15.29:0/1160828893 >> 172.21.15.29:0/1160828893 conn(0x7ff0340f7010 msgr2=0x7ff0340f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:08.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 -- 172.21.15.29:0/1160828893 shutdown_connections 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.864+0000 7ff038bf8700 1 -- 172.21.15.29:0/1160828893 wait complete. 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff038bf8700 1 Processor -- start 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff038bf8700 1 -- start start 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff038bf8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 0x7ff03410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff038bf8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fcb80 0x7ff03410c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff038bf8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03410cc60 con 0x7ff0340fb970 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff038bf8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03410cdd0 con 0x7ff0340fcb80 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff03259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 0x7ff03410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff03259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 0x7ff03410c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55266/0 (socket says 172.21.15.29:55266) 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff03259c700 1 -- 172.21.15.29:0/3047991189 learned_addr learned my addr 172.21.15.29:0/3047991189 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff031d9b700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fcb80 0x7ff03410c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff03259c700 1 -- 172.21.15.29:0/3047991189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fcb80 msgr2=0x7ff03410c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff03259c700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fcb80 0x7ff03410c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff03259c700 1 -- 172.21.15.29:0/3047991189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff024005040 con 0x7ff0340fb970 2023-12-05T13:23:08.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.865+0000 7ff031d9b700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fcb80 0x7ff03410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:23:08.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.866+0000 7ff03259c700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 0x7ff03410c120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff0240096d0 tx=0x7ff024009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:08.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.866+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff02400e7e0 con 0x7ff0340fb970 2023-12-05T13:23:08.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.866+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff020005040 con 0x7ff0340fb970 2023-12-05T13:23:08.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.866+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff02400f040 con 0x7ff0340fb970 2023-12-05T13:23:08.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.866+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff024013d00 con 0x7ff0340fb970 2023-12-05T13:23:08.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.866+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff034111cb0 con 0x7ff0340fb970 2023-12-05T13:23:08.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.867+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff034104310 con 0x7ff0340fb970 2023-12-05T13:23:08.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.867+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff02400e940 con 0x7ff0340fb970 2023-12-05T13:23:08.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.868+0000 7ff02affd700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff018068f60 0x7ff01806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:08.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.868+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff024086bd0 con 0x7ff0340fb970 2023-12-05T13:23:08.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.868+0000 7ff031d9b700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff018068f60 0x7ff01806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:08.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.868+0000 7ff031d9b700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff018068f60 0x7ff01806b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff020013600 tx=0x7ff020009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:08.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:08.872+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff024056ab0 con 0x7ff0340fb970 2023-12-05T13:23:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:08 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1830124350' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-05T13:23:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:08 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3057903129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:23:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.077+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff034111ed0 con 0x7ff0340fb970 2023-12-05T13:23:09.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.078+0000 7ff02affd700 1 -- 172.21.15.29:0/3047991189 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff024056640 con 0x7ff0340fb970 2023-12-05T13:23:09.078 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-12-05T13:23:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff018068f60 msgr2=0x7ff01806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff018068f60 0x7ff01806b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff020013600 tx=0x7ff020009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 msgr2=0x7ff03410c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 0x7ff03410c120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff0240096d0 tx=0x7ff024009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 shutdown_connections 2023-12-05T13:23:09.081 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff018068f60 0x7ff01806b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0340fb970 0x7ff03410c120 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 --2- 172.21.15.29:0/3047991189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0340fcb80 0x7ff03410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 >> 172.21.15.29:0/3047991189 conn(0x7ff0340f7010 msgr2=0x7ff0340ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 shutdown_connections 2023-12-05T13:23:09.082 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.080+0000 7ff038bf8700 1 -- 172.21.15.29:0/3047991189 wait complete. 2023-12-05T13:23:09.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T13:23:09.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 -- 172.21.15.29:0/3120206225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 msgr2=0x7f17580fcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 --2- 172.21.15.29:0/3120206225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f17580fcff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1748004940 tx=0x7f1748009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 -- 172.21.15.29:0/3120206225 shutdown_connections 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 --2- 172.21.15.29:0/3120206225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f17580fcff0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 --2- 172.21.15.29:0/3120206225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580fb990 0x7f17580fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 -- 172.21.15.29:0/3120206225 >> 172.21.15.29:0/3120206225 conn(0x7f17580f7030 msgr2=0x7f17580f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 -- 172.21.15.29:0/3120206225 shutdown_connections 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.231+0000 7f175f70d700 1 -- 172.21.15.29:0/3120206225 wait complete. 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175f70d700 1 Processor -- start 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175f70d700 1 -- start start 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175f70d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580fb990 0x7f1758066360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:09.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175f70d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f1758112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175f70d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17581125d0 con 0x7f17580fcba0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175f70d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758112710 con 0x7f17580fb990 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175cca8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f1758112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175cca8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f1758112090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55286/0 (socket says 172.21.15.29:55286) 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175cca8700 1 -- 172.21.15.29:0/2005002513 learned_addr learned my addr 172.21.15.29:0/2005002513 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175d4a9700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580fb990 0x7f1758066360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175cca8700 1 -- 172.21.15.29:0/2005002513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580fb990 msgr2=0x7f1758066360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175cca8700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580fb990 0x7f1758066360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.232+0000 7f175cca8700 1 -- 172.21.15.29:0/2005002513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748005040 con 0x7f17580fcba0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.233+0000 7f175cca8700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f1758112090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f1748009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.233+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1748021070 con 0x7f17580fcba0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.233+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1758112960 con 0x7f17580fcba0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.233+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f174801c400 con 0x7f17580fcba0 2023-12-05T13:23:09.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.233+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f174800e070 con 0x7f17580fcba0 2023-12-05T13:23:09.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.233+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1758112ec0 con 0x7f17580fcba0 2023-12-05T13:23:09.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.234+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1758104330 con 0x7f17580fcba0 2023-12-05T13:23:09.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.235+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f174801c9c0 con 0x7f17580fcba0 2023-12-05T13:23:09.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.235+0000 7f174dffb700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1744068f60 0x7f174406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.235+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1748087ff0 con 0x7f17580fcba0 2023-12-05T13:23:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.235+0000 7f175d4a9700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1744068f60 0x7f174406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.236+0000 7f175d4a9700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1744068f60 0x7f174406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1754009b80 tx=0x7f175400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.239+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1748057f50 con 0x7f17580fcba0 2023-12-05T13:23:09.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.439+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f17581132f0 con 0x7f17580fcba0 2023-12-05T13:23:09.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.440+0000 7f174dffb700 1 -- 172.21.15.29:0/2005002513 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1748057ae0 con 0x7f17580fcba0 2023-12-05T13:23:09.441 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-12-05T13:23:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1744068f60 msgr2=0x7f174406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1744068f60 0x7f174406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1754009b80 tx=0x7f175400b040 comp rx=0 tx=0).stop 2023-12-05T13:23:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 msgr2=0x7f1758112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f1758112090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f1748009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 shutdown_connections 2023-12-05T13:23:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1744068f60 0x7f174406b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580fb990 0x7f1758066360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 --2- 172.21.15.29:0/2005002513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580fcba0 0x7f1758112090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 >> 172.21.15.29:0/2005002513 conn(0x7f17580f7030 msgr2=0x7f17580ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:09.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 shutdown_connections 2023-12-05T13:23:09.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.442+0000 7f175f70d700 1 -- 172.21.15.29:0/2005002513 wait complete. 2023-12-05T13:23:09.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.590+0000 7fa67ea06700 1 -- 172.21.15.29:0/1215947094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 msgr2=0x7fa6780fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.590+0000 7fa67ea06700 1 --2- 172.21.15.29:0/1215947094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa6780fbe00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa668004940 tx=0x7fa668009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 -- 172.21.15.29:0/1215947094 shutdown_connections 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 --2- 172.21.15.29:0/1215947094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 0x7fa6780fd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 --2- 172.21.15.29:0/1215947094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa6780fbe00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 -- 172.21.15.29:0/1215947094 >> 172.21.15.29:0/1215947094 conn(0x7fa6780f7070 msgr2=0x7fa6780f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 -- 172.21.15.29:0/1215947094 shutdown_connections 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 -- 172.21.15.29:0/1215947094 wait complete. 2023-12-05T13:23:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.591+0000 7fa67ea06700 1 Processor -- start 2023-12-05T13:23:09.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa67ea06700 1 -- start start 2023-12-05T13:23:09.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa67ea06700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa67810c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:09.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa67ea06700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 0x7fa67810c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa67ea06700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67810cd10 con 0x7fa6780fb9f0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa67ea06700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67810ce80 con 0x7fa6780fcc00 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa67810c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa67810c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55306/0 (socket says 172.21.15.29:55306) 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 -- 172.21.15.29:0/3545482459 learned_addr learned my addr 172.21.15.29:0/3545482459 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa6777fe700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 0x7fa67810c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 -- 172.21.15.29:0/3545482459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 msgr2=0x7fa67810c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 0x7fa67810c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 -- 172.21.15.29:0/3545482459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668005040 con 0x7fa6780fb9f0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa6777fe700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 0x7fa67810c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.592+0000 7fa677fff700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa67810c1d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa668004f90 tx=0x7fa668009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.593+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66800e040 con 0x7fa6780fb9f0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.593+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6781118d0 con 0x7fa6780fb9f0 2023-12-05T13:23:09.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.593+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa66800bcd0 con 0x7fa6780fb9f0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.593+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66801c630 con 0x7fa6780fb9f0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.593+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa678111e10 con 0x7fa6780fb9f0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.594+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa678104390 con 0x7fa6780fb9f0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.594+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa668013960 con 0x7fa6780fb9f0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.594+0000 7fa674ff9700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa660068f60 0x7fa66006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.595+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa668088230 con 0x7fa6780fb9f0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.595+0000 7fa6777fe700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa660068f60 0x7fa66006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:09.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.595+0000 7fa6777fe700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa660068f60 0x7fa66006b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa66c007fd0 tx=0x7fa66c009f60 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:09.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.599+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa668058190 con 0x7fa6780fb9f0 2023-12-05T13:23:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.852+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6781121c0 con 0x7fa6780fb9f0 2023-12-05T13:23:09.853 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.852+0000 7fa674ff9700 1 -- 172.21.15.29:0/3545482459 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4680 (secure 0 0 0) 0x7fa668057d20 con 0x7fa6780fb9f0 2023-12-05T13:23:09.853 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:23:09.853 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14494,"name":"cephfs.smithi029.pbbvzt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.29:6829/3542977531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3542977531},{"type":"v1","addr":"172.21.15.29:6829","nonce":3542977531}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24299,"name":"cephfs.smithi052.nbpymg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.52:6825/3151047542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3151047542},{"type":"v1","addr":"172.21.15.52:6825","nonce":3151047542}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24309,"name":"cephfs.smithi052.dsxvue","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.52:6827/352543055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":352543055},{"type":"v1","addr":"172.21.15.52:6827","nonce":352543055}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-05T13:22:48.696752+0000","modified":"2023-12-05T13:23:01.451752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi029.jdhffk","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.29:6827/858522061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":858522061},{"type":"v1","addr":"172.21.15.29:6827","nonce":858522061}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-05T13:23:09.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:09 smithi029 ceph-mon[112128]: pgmap v144: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:09.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:09 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2911961094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:23:09.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:09 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3047991189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T13:23:09.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:09 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2005002513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T13:23:09.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa660068f60 msgr2=0x7fa66006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa660068f60 0x7fa66006b410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa66c007fd0 tx=0x7fa66c009f60 comp rx=0 tx=0).stop 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 msgr2=0x7fa67810c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa67810c1d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa668004f90 tx=0x7fa668009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 shutdown_connections 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fa660068f60 0x7fa66006b410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6780fb9f0 0x7fa67810c1d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 --2- 172.21.15.29:0/3545482459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6780fcc00 0x7fa67810c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 >> 172.21.15.29:0/3545482459 conn(0x7fa6780f7070 msgr2=0x7fa6780ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 shutdown_connections 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:09.855+0000 7fa67ea06700 1 -- 172.21.15.29:0/3545482459 wait complete. 2023-12-05T13:23:09.856 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:23:09.869 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 18} 2023-12-05T13:23:09.869 INFO:teuthology.run_tasks:Running task kclient... 2023-12-05T13:23:09.896 INFO:tasks.kclient:Mounting kernel clients... 2023-12-05T13:23:09.896 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-05T13:23:09.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:09.896 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-12-05T13:23:09.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:09.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-12-05T13:23:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:09 smithi052 ceph-mon[121072]: pgmap v144: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:09 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2911961094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:23:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:09 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3047991189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T13:23:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:09 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2005002513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T13:23:09.996 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-12-05T13:23:09.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:23:09.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:09.998 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-12-05T13:23:10.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:10.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-12-05T13:23:10.106 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2023-12-05T13:23:10.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:23:10.107 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-05T13:23:10.107 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-05T13:23:10.107 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:10.108 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-05T13:23:10.409 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:10.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:10 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3545482459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T13:23:10.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:10 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3545482459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 -- 172.21.15.29:0/2811039278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 msgr2=0x7f2c280fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/2811039278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c280fcc10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2c18004940 tx=0x7f2c18009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 -- 172.21.15.29:0/2811039278 shutdown_connections 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/2811039278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c280fcc10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/2811039278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c28102c00 0x7f2c28102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 -- 172.21.15.29:0/2811039278 >> 172.21.15.29:0/2811039278 conn(0x7f2c280f8790 msgr2=0x7f2c280faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:11.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 -- 172.21.15.29:0/2811039278 shutdown_connections 2023-12-05T13:23:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 -- 172.21.15.29:0/2811039278 wait complete. 2023-12-05T13:23:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 Processor -- start 2023-12-05T13:23:11.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.478+0000 7f2c2fce5700 1 -- start start 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2fce5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c28102c00 0x7f2c28113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2fce5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c28113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2fce5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28114210 con 0x7f2c281035a0 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2fce5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2810d500 con 0x7f2c28102c00 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c28113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c28113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55334/0 (socket says 172.21.15.29:55334) 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 -- 172.21.15.29:0/1669902763 learned_addr learned my addr 172.21.15.29:0/1669902763 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2da81700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c28102c00 0x7f2c28113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 -- 172.21.15.29:0/1669902763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c28102c00 msgr2=0x7f2c28113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c28102c00 0x7f2c28113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 -- 172.21.15.29:0/1669902763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18005040 con 0x7f2c281035a0 2023-12-05T13:23:11.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c2d280700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c28113bc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009380 tx=0x7f2c18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.479+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1800e040 con 0x7f2c281035a0 2023-12-05T13:23:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.480+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c18013420 con 0x7f2c281035a0 2023-12-05T13:23:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.480+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2810d780 con 0x7f2c281035a0 2023-12-05T13:23:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.480+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1801c630 con 0x7f2c281035a0 2023-12-05T13:23:11.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.480+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2810dcc0 con 0x7f2c281035a0 2023-12-05T13:23:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.481+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28113310 con 0x7f2c281035a0 2023-12-05T13:23:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.481+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2c18013590 con 0x7f2c281035a0 2023-12-05T13:23:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.482+0000 7f2c1e7fc700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2c14068f60 0x7f2c1406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.482+0000 7f2c2da81700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2c14068f60 0x7f2c1406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.482+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2c18087fa0 con 0x7f2c281035a0 2023-12-05T13:23:11.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.482+0000 7f2c2da81700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2c14068f60 0x7f2c1406b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c24004f40 tx=0x7f2c2400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:11.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.487+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2c18057f00 con 0x7f2c281035a0 2023-12-05T13:23:11.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:11 smithi029 ceph-mon[112128]: pgmap v145: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:23:11.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.737+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c281050d0 con 0x7f2c281035a0 2023-12-05T13:23:11.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.738+0000 7f2c1e7fc700 1 -- 172.21.15.29:0/1669902763 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2c18057a90 con 0x7f2c281035a0 2023-12-05T13:23:11.739 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2c14068f60 msgr2=0x7f2c1406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2c14068f60 0x7f2c1406b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c24004f40 tx=0x7f2c2400b040 comp rx=0 tx=0).stop 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 msgr2=0x7f2c28113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c28113bc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009380 tx=0x7f2c18009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 shutdown_connections 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f2c14068f60 0x7f2c1406b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c28102c00 0x7f2c28113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 --2- 172.21.15.29:0/1669902763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c281035a0 0x7f2c28113bc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 >> 172.21.15.29:0/1669902763 conn(0x7f2c280f8790 msgr2=0x7f2c280fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 shutdown_connections 2023-12-05T13:23:11.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:11.740+0000 7f2c2fce5700 1 -- 172.21.15.29:0/1669902763 wait complete. 2023-12-05T13:23:11.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:11 smithi052 ceph-mon[121072]: pgmap v145: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:23:12.172 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-05T13:23:12.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-05T13:23:12.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-12-05T13:23:12.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-05T13:23:12.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:12.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-05T13:23:12.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-05T13:23:12.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-05T13:23:12.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-05T13:23:12.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.173 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T13:23:12.197 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 41326sec preferred_lft 41326sec 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:12.198 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-12-05T13:23:12.199 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-05T13:23:12.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-05T13:23:12.199 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-12-05T13:23:12.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.385 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-05T13:23:12.420 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-12-05T13:23:12.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.422 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-12-05T13:23:12.503 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-12-05T13:23:12.504 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-05T13:23:12.504 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-05T13:23:12.504 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-05T13:23:12.504 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-05T13:23:12.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.504 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-12-05T13:23:12.504 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-12-05T13:23:12.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-05T13:23:12.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-05T13:23:12.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-05T13:23:12.505 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-12-05T13:23:12.743 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:12 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1669902763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T13:23:12.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.832 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-12-05T13:23:12.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.855 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-12-05T13:23:12.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:12.918 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-12-05T13:23:12.918 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-12-05T13:23:12.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-05T13:23:12.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-05T13:23:12.918 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-12-05T13:23:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:12 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1669902763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T13:23:13.028 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-05T13:23:13.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-05T13:23:13.029 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-12-05T13:23:13.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:13.298 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-12-05T13:23:13.298 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-12-05T13:23:13.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-12-05T13:23:13.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2023-12-05T13:23:13.298 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-12-05T13:23:13.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T13:23:13.410 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:13.431 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-05T13:23:13.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T13:23:13.431 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:13.494 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-05T13:23:13.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:13.494 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T13:23:13.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:13 smithi029 ceph-mon[112128]: pgmap v146: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:23:13.618 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T13:23:13.618 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T13:23:13.618 INFO:teuthology.orchestra.run.smithi029.stdout:invalid new device string format 2023-12-05T13:23:13.721 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T13:23:13.721 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T13:23:13.721 INFO:teuthology.orchestra.run.smithi029.stdout:invalid new device string format 2023-12-05T13:23:13.721 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300" 2023-12-05T13:23:13.722 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T13:23:13.740 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T13:23:13.740 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T13:23:13.741 INFO:teuthology.orchestra.run.smithi029.stdout:invalid new device string format 2023-12-05T13:23:13.741 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300" 2023-12-05T13:23:13.741 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T13:23:13.741 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.52:6789" 2023-12-05T13:23:13.741 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.52:6789:/ 2023-12-05T13:23:13.741 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=34f4f484-9370-11ee-95a2-87774f69a715" will pass to kernel 2023-12-05T13:23:13.744 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-05T13:23:13.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:13.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:13.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:13.819 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T13:23:13.921 INFO:teuthology.orchestra.run.smithi029.stdout:client14538 2023-12-05T13:23:13.921 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:23:13.922 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T13:23:13.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:13.944 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T13:23:13.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:13 smithi052 ceph-mon[121072]: pgmap v146: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:23:14.047 INFO:teuthology.orchestra.run.smithi029.stdout:client14538 2023-12-05T13:23:14.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:14.048 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T13:23:14.105 INFO:teuthology.orchestra.run.smithi029.stdout:client14538 2023-12-05T13:23:14.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:14.105 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/34f4f484-9370-11ee-95a2-87774f69a715.client14538/status') 2023-12-05T13:23:14.171 INFO:teuthology.orchestra.run.smithi029.stdout:instance: client.14538 (3)192.168.0.1:0/3691975641 2023-12-05T13:23:14.171 INFO:teuthology.orchestra.run.smithi029.stdout:blocklisted: false 2023-12-05T13:23:14.172 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records in 2023-12-05T13:23:14.172 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records out 2023-12-05T13:23:14.172 INFO:teuthology.orchestra.run.smithi029.stderr:70 bytes copied, 3.091e-05 s, 2.3 MB/s 2023-12-05T13:23:14.173 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-05T13:23:14.173 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-05T13:23:14.173 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:14.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-05T13:23:14.471 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.536+0000 7fc000a7d700 1 -- 172.21.15.29:0/3826194251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc0fb1e0 msgr2=0x7fbffc0fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.536+0000 7fc000a7d700 1 --2- 172.21.15.29:0/3826194251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc0fb630 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbff0004940 tx=0x7fbff0009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 -- 172.21.15.29:0/3826194251 shutdown_connections 2023-12-05T13:23:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 --2- 172.21.15.29:0/3826194251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc0fb630 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 --2- 172.21.15.29:0/3826194251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc102c70 0x7fbffc103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:15.539 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 -- 172.21.15.29:0/3826194251 >> 172.21.15.29:0/3826194251 conn(0x7fbffc0711a0 msgr2=0x7fbffc0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 -- 172.21.15.29:0/3826194251 shutdown_connections 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 -- 172.21.15.29:0/3826194251 wait complete. 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 Processor -- start 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.537+0000 7fc000a7d700 1 -- start start 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fc000a7d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fc000a7d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 0x7fbffc113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fc000a7d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc114200 con 0x7fbffc102c70 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fc000a7d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc10d4f0 con 0x7fbffc0fb1e0 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 0x7fbffc113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 0x7fbffc113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55356/0 (socket says 172.21.15.29:55356) 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 -- 172.21.15.29:0/1386106413 learned_addr learned my addr 172.21.15.29:0/1386106413 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbffa59c700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 -- 172.21.15.29:0/1386106413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc0fb1e0 msgr2=0x7fbffc113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:15.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:15.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 -- 172.21.15.29:0/1386106413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0005040 con 0x7fbffc102c70 2023-12-05T13:23:15.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbffa59c700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:23:15.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbff9d9b700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 0x7fbffc113bb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbff000b3b0 tx=0x7fbff0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:15.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff000e040 con 0x7fbffc102c70 2023-12-05T13:23:15.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbff000bc50 con 0x7fbffc102c70 2023-12-05T13:23:15.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.538+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc10d720 con 0x7fbffc102c70 2023-12-05T13:23:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.539+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff0013420 con 0x7fbffc102c70 2023-12-05T13:23:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.539+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc10dc60 con 0x7fbffc102c70 2023-12-05T13:23:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.540+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc105050 con 0x7fbffc102c70 2023-12-05T13:23:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.540+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbff001c430 con 0x7fbffc102c70 2023-12-05T13:23:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.540+0000 7fbfeaffd700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbfe4068f60 0x7fbfe406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.541+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbff0087c30 con 0x7fbffc102c70 2023-12-05T13:23:15.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.541+0000 7fbffa59c700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbfe4068f60 0x7fbfe406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:15.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.541+0000 7fbffa59c700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbfe4068f60 0x7fbfe406b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009fd0 tx=0x7fbfec009f00 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:15.546 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.546+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbff0057ba0 con 0x7fbffc102c70 2023-12-05T13:23:15.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:15 smithi029 ceph-mon[112128]: pgmap v147: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:15.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.795+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbffc072cc0 con 0x7fbffc102c70 2023-12-05T13:23:15.796 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.795+0000 7fbfeaffd700 1 -- 172.21.15.29:0/1386106413 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7fbff0057730 con 0x7fbffc102c70 2023-12-05T13:23:15.796 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbfe4068f60 msgr2=0x7fbfe406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbfe4068f60 0x7fbfe406b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009fd0 tx=0x7fbfec009f00 comp rx=0 tx=0).stop 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 msgr2=0x7fbffc113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 0x7fbffc113bb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbff000b3b0 tx=0x7fbff0009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 shutdown_connections 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbfe4068f60 0x7fbfe406b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbffc0fb1e0 0x7fbffc113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 --2- 172.21.15.29:0/1386106413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbffc102c70 0x7fbffc113bb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 >> 172.21.15.29:0/1386106413 conn(0x7fbffc0711a0 msgr2=0x7fbffc0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 shutdown_connections 2023-12-05T13:23:15.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:15.798+0000 7fc000a7d700 1 -- 172.21.15.29:0/1386106413 wait complete. 2023-12-05T13:23:15.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:15 smithi052 ceph-mon[121072]: pgmap v147: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-05T13:23:16.188 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-05T13:23:16.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.189 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T13:23:16.213 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41309sec preferred_lft 41309sec 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2023-12-05T13:23:16.214 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2023-12-05T13:23:16.214 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-05T13:23:16.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-05T13:23:16.215 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-12-05T13:23:16.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.412 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-05T13:23:16.445 INFO:teuthology.orchestra.run.smithi052.stdout:1 2023-12-05T13:23:16.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.447 DEBUG:teuthology.orchestra.run.smithi052:> route 2023-12-05T13:23:16.555 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2023-12-05T13:23:16.555 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-05T13:23:16.555 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-05T13:23:16.555 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-05T13:23:16.555 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-05T13:23:16.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.556 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-12-05T13:23:16.556 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-12-05T13:23:16.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-05T13:23:16.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-05T13:23:16.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-05T13:23:16.556 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-12-05T13:23:16.607 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:16 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1386106413' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T13:23:16.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.798 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-12-05T13:23:16.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.820 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2023-12-05T13:23:16.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:16 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1386106413' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T13:23:16.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.883 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-12-05T13:23:16.883 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-12-05T13:23:16.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-05T13:23:16.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-05T13:23:16.883 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-12-05T13:23:16.993 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-05T13:23:16.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-05T13:23:16.994 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-12-05T13:23:17.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.239 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec bash -c ' 2023-12-05T13:23:17.239 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2023-12-05T13:23:17.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2023-12-05T13:23:17.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2023-12-05T13:23:17.239 DEBUG:teuthology.orchestra.run.smithi052:> ') 2023-12-05T13:23:17.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T13:23:17.351 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:17.371 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-05T13:23:17.371 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T13:23:17.371 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:17.432 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-05T13:23:17.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.433 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T13:23:17.542 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T13:23:17.543 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T13:23:17.543 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2023-12-05T13:23:17.629 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T13:23:17.629 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T13:23:17.629 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2023-12-05T13:23:17.629 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300" 2023-12-05T13:23:17.629 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T13:23:17.647 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:invalid new device string format 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300" 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.29:6789,172.21.15.52:6789" 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.29:6789,172.21.15.52:6789:/ 2023-12-05T13:23:17.648 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=34f4f484-9370-11ee-95a2-87774f69a715" will pass to kernel 2023-12-05T13:23:17.651 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-05T13:23:17.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:17.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.682 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T13:23:17.765 INFO:teuthology.orchestra.run.smithi052.stdout:client24353 2023-12-05T13:23:17.765 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:23:17.766 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T13:23:17.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.829 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T13:23:17.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:17 smithi029 ceph-mon[112128]: pgmap v148: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:17.914 INFO:teuthology.orchestra.run.smithi052.stdout:client24353 2023-12-05T13:23:17.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.915 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T13:23:17.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:17 smithi052 ceph-mon[121072]: pgmap v148: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:17.998 INFO:teuthology.orchestra.run.smithi052.stdout:client24353 2023-12-05T13:23:17.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:23:17.998 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/34f4f484-9370-11ee-95a2-87774f69a715.client24353/status') 2023-12-05T13:23:18.090 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.24353 (3)192.168.0.1:0/3689267759 2023-12-05T13:23:18.091 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2023-12-05T13:23:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2023-12-05T13:23:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2023-12-05T13:23:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:70 bytes copied, 2.751e-05 s, 2.5 MB/s 2023-12-05T13:23:18.092 INFO:teuthology.run_tasks:Running task print... 2023-12-05T13:23:18.103 INFO:teuthology.task.print:**** done client 2023-12-05T13:23:18.104 INFO:teuthology.run_tasks:Running task parallel... 2023-12-05T13:23:18.131 INFO:teuthology.task.parallel:starting parallel... 2023-12-05T13:23:18.131 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-05T13:23:18.132 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T13:23:18.132 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:23:18.133 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-05T13:23:18.133 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-05T13:23:18.133 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-05T13:23:18.136 INFO:tasks.workunit:Pulling workunits from ref e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:18.137 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-05T13:23:18.137 INFO:tasks.workunit:timeout=3h 2023-12-05T13:23:18.137 INFO:tasks.workunit:cleanup=True 2023-12-05T13:23:18.137 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:18.162 INFO:teuthology.orchestra.run.smithi029.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 8eh/142d Inode: 1 Links: 2 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-12-05 13:22:52.908630958 +0000 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-12-05 13:23:13.816168283 +0000 2023-12-05T13:23:18.163 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2023-12-05 13:22:52.908630958 +0000 2023-12-05T13:23:18.163 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-05T13:23:18.163 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-05T13:23:18.240 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:18.264 INFO:teuthology.orchestra.run.smithi052.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:18.264 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-12-05 13:23:18.233096393 +0000 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-12-05 13:23:18.233096393 +0000 2023-12-05T13:23:18.265 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2023-12-05 13:22:52.908630958 +0000 2023-12-05T13:23:18.265 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-05T13:23:18.265 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-05T13:23:18.346 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:18.346 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:18.367 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-05T13:23:18.410 INFO:tasks.workunit.client.1.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-05T13:23:18.449 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 -- 172.21.15.29:0/2510708905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 msgr2=0x7fe9381021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 --2- 172.21.15.29:0/2510708905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe9381021d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe92c004940 tx=0x7fe92c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 -- 172.21.15.29:0/2510708905 shutdown_connections 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 --2- 172.21.15.29:0/2510708905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe9381021d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 --2- 172.21.15.29:0/2510708905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe938066070 0x7fe9380ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 -- 172.21.15.29:0/2510708905 >> 172.21.15.29:0/2510708905 conn(0x7fe9380f7190 msgr2=0x7fe9380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 -- 172.21.15.29:0/2510708905 shutdown_connections 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.575+0000 7fe93cede700 1 -- 172.21.15.29:0/2510708905 wait complete. 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93cede700 1 Processor -- start 2023-12-05T13:23:19.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93cede700 1 -- start start 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93cede700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe938066070 0x7fe93810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93cede700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe93810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93cede700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93810e0b0 con 0x7fe9380ffd90 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93cede700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93810e950 con 0x7fe938066070 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe935d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe93810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe935d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe93810dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33924/0 (socket says 172.21.15.29:33924) 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe935d9b700 1 -- 172.21.15.29:0/1790245673 learned_addr learned my addr 172.21.15.29:0/1790245673 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe93659c700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe938066070 0x7fe93810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe935d9b700 1 -- 172.21.15.29:0/1790245673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe938066070 msgr2=0x7fe93810d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe935d9b700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe938066070 0x7fe93810d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.576+0000 7fe935d9b700 1 -- 172.21.15.29:0/1790245673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c005040 con 0x7fe9380ffd90 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.577+0000 7fe935d9b700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe93810dab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe92c004f90 tx=0x7fe92c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.577+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92c00e040 con 0x7fe9380ffd90 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.577+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe92c00bc50 con 0x7fe9380ffd90 2023-12-05T13:23:19.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.577+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93810ebd0 con 0x7fe9380ffd90 2023-12-05T13:23:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.577+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92c01c630 con 0x7fe9380ffd90 2023-12-05T13:23:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.577+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93810f110 con 0x7fe9380ffd90 2023-12-05T13:23:19.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.578+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9381075c0 con 0x7fe9380ffd90 2023-12-05T13:23:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.578+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe92c013420 con 0x7fe9380ffd90 2023-12-05T13:23:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.579+0000 7fe926ffd700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe920068f60 0x7fe92006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.579+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe92c088060 con 0x7fe9380ffd90 2023-12-05T13:23:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.579+0000 7fe93659c700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe920068f60 0x7fe92006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:19.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.579+0000 7fe93659c700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe920068f60 0x7fe92006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe928004f40 tx=0x7fe92800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:19.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.584+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe92c058060 con 0x7fe9380ffd90 2023-12-05T13:23:19.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.783+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fe93804bb80 con 0x7fe9380ffd90 2023-12-05T13:23:19.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.784+0000 7fe926ffd700 1 -- 172.21.15.29:0/1790245673 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fe92c057bf0 con 0x7fe9380ffd90 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe920068f60 msgr2=0x7fe92006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe920068f60 0x7fe92006b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe928004f40 tx=0x7fe92800b040 comp rx=0 tx=0).stop 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 msgr2=0x7fe93810dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe93810dab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe92c004f90 tx=0x7fe92c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 shutdown_connections 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe920068f60 0x7fe92006b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe938066070 0x7fe93810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 --2- 172.21.15.29:0/1790245673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9380ffd90 0x7fe93810dab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 >> 172.21.15.29:0/1790245673 conn(0x7fe9380f7190 msgr2=0x7fe9380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 shutdown_connections 2023-12-05T13:23:19.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:19.786+0000 7fe93cede700 1 -- 172.21.15.29:0/1790245673 wait complete. 2023-12-05T13:23:19.814 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:19 smithi029 ceph-mon[112128]: pgmap v149: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:19.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:19 smithi052 ceph-mon[121072]: pgmap v149: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:20.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-05T13:23:20.597 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 -- 172.21.15.29:0/1148414346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fbaf0 msgr2=0x7f117c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1148414346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fbaf0 0x7f117c0fbf00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f116c004940 tx=0x7f116c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:21.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 -- 172.21.15.29:0/1148414346 shutdown_connections 2023-12-05T13:23:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1148414346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f117c0fcd00 0x7f117c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1148414346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fbaf0 0x7f117c0fbf00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 -- 172.21.15.29:0/1148414346 >> 172.21.15.29:0/1148414346 conn(0x7f117c0f7190 msgr2=0x7f117c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 -- 172.21.15.29:0/1148414346 shutdown_connections 2023-12-05T13:23:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.685+0000 7f1181dcd700 1 -- 172.21.15.29:0/1148414346 wait complete. 2023-12-05T13:23:21.687 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f1181dcd700 1 Processor -- start 2023-12-05T13:23:21.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f1181dcd700 1 -- start start 2023-12-05T13:23:21.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f1181dcd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f117c0fbaf0 0x7f117c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f1181dcd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 0x7f117c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f1181dcd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c10e030 con 0x7f117c0fcd00 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f1181dcd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c10e8d0 con 0x7f117c0fbaf0 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 0x7f117c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 0x7f117c10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33954/0 (socket says 172.21.15.29:33954) 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117affd700 1 -- 172.21.15.29:0/1890885950 learned_addr learned my addr 172.21.15.29:0/1890885950 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117b7fe700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f117c0fbaf0 0x7f117c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117affd700 1 -- 172.21.15.29:0/1890885950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f117c0fbaf0 msgr2=0x7f117c10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117affd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f117c0fbaf0 0x7f117c10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.686+0000 7f117affd700 1 -- 172.21.15.29:0/1890885950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c005040 con 0x7f117c0fcd00 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.687+0000 7f117affd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 0x7f117c10da30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f117000eb40 tx=0x7f117000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:21.691 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.687+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1170007cc0 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.687+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f117000f040 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.687+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117000c990 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.687+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c10eb50 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.687+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c10f040 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.688+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c04bb80 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.689+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f117000cc00 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.689+0000 7f1163fff700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1164068f60 0x7f116406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.689+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1170086990 con 0x7f117c0fcd00 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.689+0000 7f117b7fe700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1164068f60 0x7f116406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:21.692 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.690+0000 7f117b7fe700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1164068f60 0x7f116406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f116c013680 tx=0x7f116c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:21.694 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.694+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f117004da00 con 0x7f117c0fcd00 2023-12-05T13:23:21.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:21 smithi029 ceph-mon[112128]: pgmap v150: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:21.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.896+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f117c104490 con 0x7f117c0fcd00 2023-12-05T13:23:21.897 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.897+0000 7f1163fff700 1 -- 172.21.15.29:0/1890885950 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1170056920 con 0x7f117c0fcd00 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1164068f60 msgr2=0x7f116406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1164068f60 0x7f116406b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f116c013680 tx=0x7f116c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 msgr2=0x7f117c10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 0x7f117c10da30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f117000eb40 tx=0x7f117000b040 comp rx=0 tx=0).stop 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 shutdown_connections 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1164068f60 0x7f116406b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f117c0fbaf0 0x7f117c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:21.900 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 --2- 172.21.15.29:0/1890885950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f117c0fcd00 0x7f117c10da30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 >> 172.21.15.29:0/1890885950 conn(0x7f117c0f7190 msgr2=0x7f117c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 shutdown_connections 2023-12-05T13:23:21.901 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:21.899+0000 7f1181dcd700 1 -- 172.21.15.29:0/1890885950 wait complete. 2023-12-05T13:23:21.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:21 smithi052 ceph-mon[121072]: pgmap v150: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:23:22.254 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-05T13:23:22.557 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:22.800 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:22 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:22.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:22 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:23.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 -- 172.21.15.29:0/2656217627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fcd00 msgr2=0x7f51c00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 --2- 172.21.15.29:0/2656217627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fcd00 0x7f51c00fd150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f51a8004940 tx=0x7f51a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 -- 172.21.15.29:0/2656217627 shutdown_connections 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 --2- 172.21.15.29:0/2656217627 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fcd00 0x7f51c00fd150 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 --2- 172.21.15.29:0/2656217627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51c00fbaf0 0x7f51c00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 -- 172.21.15.29:0/2656217627 >> 172.21.15.29:0/2656217627 conn(0x7f51c00f71b0 msgr2=0x7f51c00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.658+0000 7f51c494c700 1 -- 172.21.15.29:0/2656217627 shutdown_connections 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 -- 172.21.15.29:0/2656217627 wait complete. 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 Processor -- start 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 -- start start 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 0x7f51c0110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:23.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51c00fcd00 0x7f51c0112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0066a00 con 0x7f51c00fbaf0 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.659+0000 7f51c494c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0066b40 con 0x7f51c00fcd00 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 0x7f51c0110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 0x7f51c0110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33970/0 (socket says 172.21.15.29:33970) 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 -- 172.21.15.29:0/1246022275 learned_addr learned my addr 172.21.15.29:0/1246022275 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51bdd9b700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51c00fcd00 0x7f51c0112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 -- 172.21.15.29:0/1246022275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51c00fcd00 msgr2=0x7f51c0112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51c00fcd00 0x7f51c0112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 -- 172.21.15.29:0/1246022275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8005040 con 0x7f51c00fbaf0 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51be59c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 0x7f51c0110200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f51b0002a80 tx=0x7f51b0004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:23.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51b0007cc0 con 0x7f51c00fbaf0 2023-12-05T13:23:23.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51b000f040 con 0x7f51c00fbaf0 2023-12-05T13:23:23.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c0112db0 con 0x7f51c00fbaf0 2023-12-05T13:23:23.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51b000da20 con 0x7f51c00fbaf0 2023-12-05T13:23:23.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.660+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c0113260 con 0x7f51c00fbaf0 2023-12-05T13:23:23.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.661+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c004bb80 con 0x7f51c00fbaf0 2023-12-05T13:23:23.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.662+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f51b000dbc0 con 0x7f51c00fbaf0 2023-12-05T13:23:23.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.662+0000 7f51b6ffd700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f51ac068f60 0x7f51ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:23.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.663+0000 7f51bdd9b700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f51ac068f60 0x7f51ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:23.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.663+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f51b00863c0 con 0x7f51c00fbaf0 2023-12-05T13:23:23.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.663+0000 7f51bdd9b700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f51ac068f60 0x7f51ac06b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51a800b3b0 tx=0x7f51a8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:23.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.667+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f51b004ca00 con 0x7f51c00fbaf0 2023-12-05T13:23:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:23 smithi029 ceph-mon[112128]: pgmap v151: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T13:23:23.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.866+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f51c01044b0 con 0x7f51c00fbaf0 2023-12-05T13:23:23.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.867+0000 7f51b6ffd700 1 -- 172.21.15.29:0/1246022275 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f51b0052890 con 0x7f51c00fbaf0 2023-12-05T13:23:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f51ac068f60 msgr2=0x7f51ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:23.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f51ac068f60 0x7f51ac06b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51a800b3b0 tx=0x7f51a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 msgr2=0x7f51c0110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 0x7f51c0110200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f51b0002a80 tx=0x7f51b0004630 comp rx=0 tx=0).stop 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 shutdown_connections 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f51ac068f60 0x7f51ac06b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51c00fbaf0 0x7f51c0110200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 --2- 172.21.15.29:0/1246022275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51c00fcd00 0x7f51c0112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 >> 172.21.15.29:0/1246022275 conn(0x7f51c00f71b0 msgr2=0x7f51c00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 shutdown_connections 2023-12-05T13:23:23.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:23.869+0000 7f51c494c700 1 -- 172.21.15.29:0/1246022275 wait complete. 2023-12-05T13:23:23.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:23 smithi052 ceph-mon[121072]: pgmap v151: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T13:23:24.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-05T13:23:24.594 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:25.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:25 smithi029 ceph-mon[112128]: pgmap v152: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T13:23:25.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:25 smithi052 ceph-mon[121072]: pgmap v152: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T13:23:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 -- 172.21.15.29:0/3688082596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 msgr2=0x7fd06c0ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 --2- 172.21.15.29:0/3688082596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c0ff7e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd068004940 tx=0x7fd068009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 -- 172.21.15.29:0/3688082596 shutdown_connections 2023-12-05T13:23:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 --2- 172.21.15.29:0/3688082596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 0x7fd06c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:26.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 --2- 172.21.15.29:0/3688082596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c0ff7e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 -- 172.21.15.29:0/3688082596 >> 172.21.15.29:0/3688082596 conn(0x7fd06c0f7190 msgr2=0x7fd06c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 -- 172.21.15.29:0/3688082596 shutdown_connections 2023-12-05T13:23:26.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 -- 172.21.15.29:0/3688082596 wait complete. 2023-12-05T13:23:26.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.101+0000 7fd07376d700 1 Processor -- start 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd07376d700 1 -- start start 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd07376d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd07376d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 0x7fd06c10db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd07376d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c10e110 con 0x7fd06c066050 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd07376d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c10e960 con 0x7fd06c0ffdb0 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c10d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33990/0 (socket says 172.21.15.29:33990) 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 -- 172.21.15.29:0/903059122 learned_addr learned my addr 172.21.15.29:0/903059122 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:26.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd070d08700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 0x7fd06c10db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 -- 172.21.15.29:0/903059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 msgr2=0x7fd06c10db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 0x7fd06c10db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 -- 172.21.15.29:0/903059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068005040 con 0x7fd06c066050 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd070d08700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 0x7fd06c10db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.102+0000 7fd071509700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c10d5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd068009360 tx=0x7fd068009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.103+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06800e040 con 0x7fd06c066050 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.103+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd06800bcd0 con 0x7fd06c066050 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.103+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c10ebe0 con 0x7fd06c066050 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.103+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06801c630 con 0x7fd06c066050 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.103+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c10f120 con 0x7fd06c066050 2023-12-05T13:23:26.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.104+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c1075e0 con 0x7fd06c066050 2023-12-05T13:23:26.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.104+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd068013960 con 0x7fd06c066050 2023-12-05T13:23:26.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.105+0000 7fd061ffb700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd058068f60 0x7fd05806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:26.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.105+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd0680881c0 con 0x7fd06c066050 2023-12-05T13:23:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.105+0000 7fd070d08700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd058068f60 0x7fd05806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:26.109 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.105+0000 7fd070d08700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd058068f60 0x7fd05806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0041d0 tx=0x7fd05c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.110+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd068058270 con 0x7fd06c066050 2023-12-05T13:23:26.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:26.328+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd06c02b150 con 0x7fd058068f60 2023-12-05T13:23:27.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:27 smithi029 ceph-mon[112128]: pgmap v153: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T13:23:27.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:27 smithi029 ceph-mon[112128]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:27 smithi052 ceph-mon[121072]: pgmap v153: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-05T13:23:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:27 smithi052 ceph-mon[121072]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:29.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:29 smithi029 ceph-mon[112128]: pgmap v154: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:23:29.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:29 smithi052 ceph-mon[121072]: pgmap v154: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:23:31.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:31 smithi029 ceph-mon[112128]: pgmap v155: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:23:31.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:31 smithi052 ceph-mon[121072]: pgmap v155: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:23:33.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:33 smithi029 ceph-mon[112128]: pgmap v156: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:23:33.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:33 smithi052 ceph-mon[121072]: pgmap v156: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:23:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:35 smithi029 ceph-mon[112128]: pgmap v157: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:23:35.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:35 smithi052 ceph-mon[121072]: pgmap v157: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:23:37.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:37 smithi029 ceph-mon[112128]: pgmap v158: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:23:37.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:37 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:37.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:37 smithi052 ceph-mon[121072]: pgmap v158: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:23:37.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:37 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:39.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:39 smithi029 ceph-mon[112128]: pgmap v159: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:23:39.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:39 smithi052 ceph-mon[121072]: pgmap v159: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:23:41.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:41 smithi029 ceph-mon[112128]: pgmap v160: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:41.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:41 smithi052 ceph-mon[121072]: pgmap v160: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:43.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:43 smithi029 ceph-mon[112128]: pgmap v161: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:43.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:43 smithi052 ceph-mon[121072]: pgmap v161: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:45.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:45 smithi029 ceph-mon[112128]: pgmap v162: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:45 smithi052 ceph-mon[121072]: pgmap v162: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:47.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:47 smithi029 ceph-mon[112128]: pgmap v163: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:47.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:47 smithi052 ceph-mon[121072]: pgmap v163: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:49.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:49 smithi029 ceph-mon[112128]: pgmap v164: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:49.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:49 smithi052 ceph-mon[121072]: pgmap v164: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:51.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:51 smithi029 ceph-mon[112128]: pgmap v165: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:51.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:51 smithi052 ceph-mon[121072]: pgmap v165: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:52.682 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:52.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:23:53.087 INFO:teuthology.orchestra.run.smithi029.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:53.088 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.086+0000 7fd061ffb700 1 -- 172.21.15.29:0/903059122 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fd06c02b150 con 0x7fd058068f60 2023-12-05T13:23:53.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd058068f60 msgr2=0x7fd05806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:53.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd058068f60 0x7fd05806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0041d0 tx=0x7fd05c009040 comp rx=0 tx=0).stop 2023-12-05T13:23:53.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 msgr2=0x7fd06c10d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:53.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c10d5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd068009360 tx=0x7fd068009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:53.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 shutdown_connections 2023-12-05T13:23:53.090 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fd058068f60 0x7fd05806b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:53.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06c066050 0x7fd06c10d5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:53.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 --2- 172.21.15.29:0/903059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd06c0ffdb0 0x7fd06c10db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:53.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 >> 172.21.15.29:0/903059122 conn(0x7fd06c0f7190 msgr2=0x7fd06c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:53.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 shutdown_connections 2023-12-05T13:23:53.091 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:53.089+0000 7fd07376d700 1 -- 172.21.15.29:0/903059122 wait complete. 2023-12-05T13:23:53.474 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-05T13:23:53.827 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:23:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:53 smithi029 ceph-mon[112128]: pgmap v166: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:53 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:53 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:23:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:53 smithi052 ceph-mon[121072]: pgmap v166: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:53 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:53 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:23:54.554 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:54 smithi029 ceph-mon[112128]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:54.554 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:23:54.555 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:23:54.555 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:54 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 -- 172.21.15.29:0/3964872370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 msgr2=0x7ff5140fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 --2- 172.21.15.29:0/3964872370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff5140fc8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff508004880 tx=0x7ff508009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 -- 172.21.15.29:0/3964872370 shutdown_connections 2023-12-05T13:23:54.972 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 --2- 172.21.15.29:0/3964872370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff5140fc8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:54.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 --2- 172.21.15.29:0/3964872370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff5140fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:54.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 -- 172.21.15.29:0/3964872370 >> 172.21.15.29:0/3964872370 conn(0x7ff5140f6950 msgr2=0x7ff5140f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:54.973 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 -- 172.21.15.29:0/3964872370 shutdown_connections 2023-12-05T13:23:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:54 smithi052 ceph-mon[121072]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:23:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:23:54.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:54 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.971+0000 7ff519461700 1 -- 172.21.15.29:0/3964872370 wait complete. 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff519461700 1 Processor -- start 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff519461700 1 -- start start 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff519461700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff51406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff519461700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff51406f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff519461700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51406f880 con 0x7ff5140fb290 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff519461700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514114f40 con 0x7ff5140fc4a0 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff512ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff51406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff5127fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff51406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff512ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff51406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38216/0 (socket says 172.21.15.29:38216) 2023-12-05T13:23:54.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.972+0000 7ff512ffd700 1 -- 172.21.15.29:0/3331160351 learned_addr learned my addr 172.21.15.29:0/3331160351 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff5127fc700 1 -- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 msgr2=0x7ff51406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff5127fc700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff51406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff5127fc700 1 -- 172.21.15.29:0/3331160351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508005040 con 0x7ff5140fc4a0 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff512ffd700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff51406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff5127fc700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff51406f200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff508004880 tx=0x7ff508009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50800e030 con 0x7ff5140fc4a0 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff50801c400 con 0x7ff5140fc4a0 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff514115140 con 0x7ff5140fc4a0 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.973+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff508012600 con 0x7ff5140fc4a0 2023-12-05T13:23:54.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.974+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff514115680 con 0x7ff5140fc4a0 2023-12-05T13:23:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.975+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff514068dc0 con 0x7ff5140fc4a0 2023-12-05T13:23:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.975+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff508013a20 con 0x7ff5140fc4a0 2023-12-05T13:23:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.976+0000 7ff4fb7fe700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4fc069030 0x7ff4fc06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.976+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff5080886d0 con 0x7ff5140fc4a0 2023-12-05T13:23:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.976+0000 7ff512ffd700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4fc069030 0x7ff4fc06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:54.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.977+0000 7ff512ffd700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4fc069030 0x7ff4fc06b4e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff51406fb20 tx=0x7ff50400c040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:54.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:54.980+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff508054b00 con 0x7ff5140fc4a0 2023-12-05T13:23:55.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.245+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff51402b1f0 con 0x7ff4fc069030 2023-12-05T13:23:55.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.247+0000 7ff4fb7fe700 1 -- 172.21.15.29:0/3331160351 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7ff51402b1f0 con 0x7ff4fc069030 2023-12-05T13:23:55.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4fc069030 msgr2=0x7ff4fc06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4fc069030 0x7ff4fc06b4e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff51406fb20 tx=0x7ff50400c040 comp rx=0 tx=0).stop 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 msgr2=0x7ff51406f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff51406f200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff508004880 tx=0x7ff508009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 shutdown_connections 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4fc069030 0x7ff4fc06b4e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5140fb290 0x7ff51406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 --2- 172.21.15.29:0/3331160351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5140fc4a0 0x7ff51406f200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 >> 172.21.15.29:0/3331160351 conn(0x7ff5140f6950 msgr2=0x7ff5140f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 shutdown_connections 2023-12-05T13:23:55.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.250+0000 7ff519461700 1 -- 172.21.15.29:0/3331160351 wait complete. 2023-12-05T13:23:55.267 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:23:55.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 -- 172.21.15.29:0/2018129820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 msgr2=0x7f98a00fd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.382 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 --2- 172.21.15.29:0/2018129820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fd4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f989c004940 tx=0x7f989c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 -- 172.21.15.29:0/2018129820 shutdown_connections 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 --2- 172.21.15.29:0/2018129820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 0x7f98a00fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 --2- 172.21.15.29:0/2018129820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fd4f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 -- 172.21.15.29:0/2018129820 >> 172.21.15.29:0/2018129820 conn(0x7f98a00f6950 msgr2=0x7f98a00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 -- 172.21.15.29:0/2018129820 shutdown_connections 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.381+0000 7f98a75bb700 1 -- 172.21.15.29:0/2018129820 wait complete. 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a75bb700 1 Processor -- start 2023-12-05T13:23:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a75bb700 1 -- start start 2023-12-05T13:23:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a75bb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 0x7f98a00ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:55.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a75bb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a75bb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00fe6a0 con 0x7f98a00fbd50 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a75bb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00fe810 con 0x7f98a00fd0e0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.382+0000 7f98a4b56700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a4b56700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:43632/0 (socket says 172.21.15.29:43632) 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a4b56700 1 -- 172.21.15.29:0/3351890991 learned_addr learned my addr 172.21.15.29:0/3351890991 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a5357700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 0x7f98a00ffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a4b56700 1 -- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 msgr2=0x7f98a00ffc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a4b56700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 0x7f98a00ffc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a4b56700 1 -- 172.21.15.29:0/3351890991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c005040 con 0x7f98a00fd0e0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a5357700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 0x7f98a00ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a4b56700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fe0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f989000eb70 tx=0x7f989000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9890007cc0 con 0x7f98a00fd0e0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f989000f040 con 0x7f98a00fd0e0 2023-12-05T13:23:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a00fea90 con 0x7f98a00fd0e0 2023-12-05T13:23:55.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.383+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989000cad0 con 0x7f98a00fd0e0 2023-12-05T13:23:55.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.384+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a01155c0 con 0x7f98a00fd0e0 2023-12-05T13:23:55.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.385+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f989000cc30 con 0x7f98a00fd0e0 2023-12-05T13:23:55.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.385+0000 7f9895ffb700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f988c068f60 0x7f988c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:55.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.386+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9890086930 con 0x7f98a00fd0e0 2023-12-05T13:23:55.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.386+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a004bb80 con 0x7f98a00fd0e0 2023-12-05T13:23:55.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.386+0000 7f98a5357700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f988c068f60 0x7f988c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:55.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.386+0000 7f98a5357700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f988c068f60 0x7f988c06b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f989c00b0d0 tx=0x7f989c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:55.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.391+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f989004da00 con 0x7f98a00fd0e0 2023-12-05T13:23:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:55 smithi029 ceph-mon[112128]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:55 smithi029 ceph-mon[112128]: pgmap v167: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.627+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98a00fb350 con 0x7f988c068f60 2023-12-05T13:23:55.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.628+0000 7f9895ffb700 1 -- 172.21.15.29:0/3351890991 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f98a00fb350 con 0x7f988c068f60 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f988c068f60 msgr2=0x7f988c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f988c068f60 0x7f988c06b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f989c00b0d0 tx=0x7f989c009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 msgr2=0x7f98a00fe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fe0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f989000eb70 tx=0x7f989000b040 comp rx=0 tx=0).stop 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 shutdown_connections 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f988c068f60 0x7f988c06b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98a00fbd50 0x7f98a00ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 --2- 172.21.15.29:0/3351890991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98a00fd0e0 0x7f98a00fe0a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 >> 172.21.15.29:0/3351890991 conn(0x7f98a00f6950 msgr2=0x7f98a00fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 shutdown_connections 2023-12-05T13:23:55.633 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.631+0000 7f98a75bb700 1 -- 172.21.15.29:0/3351890991 wait complete. 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 -- 172.21.15.29:0/1396743173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b80fd730 msgr2=0x7f83b80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 --2- 172.21.15.29:0/1396743173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b80fd730 0x7f83b80ffb10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83a8004940 tx=0x7f83a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 -- 172.21.15.29:0/1396743173 shutdown_connections 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 --2- 172.21.15.29:0/1396743173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b8100050 0x7f83b8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 --2- 172.21.15.29:0/1396743173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b80fd730 0x7f83b80ffb10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 -- 172.21.15.29:0/1396743173 >> 172.21.15.29:0/1396743173 conn(0x7f83b80f7190 msgr2=0x7f83b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:55.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 -- 172.21.15.29:0/1396743173 shutdown_connections 2023-12-05T13:23:55.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.774+0000 7f83bd024700 1 -- 172.21.15.29:0/1396743173 wait complete. 2023-12-05T13:23:55.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83bd024700 1 Processor -- start 2023-12-05T13:23:55.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83bd024700 1 -- start start 2023-12-05T13:23:55.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83bd024700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b80fd730 0x7f83b810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:55.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83bd024700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 0x7f83b810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:55.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83bd024700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b810dfd0 con 0x7f83b8100050 2023-12-05T13:23:55.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83bd024700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b810e870 con 0x7f83b80fd730 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83b659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 0x7f83b810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83b659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 0x7f83b810d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38248/0 (socket says 172.21.15.29:38248) 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83b659c700 1 -- 172.21.15.29:0/1604529767 learned_addr learned my addr 172.21.15.29:0/1604529767 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.775+0000 7f83b6d9d700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b80fd730 0x7f83b810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f83b659c700 1 -- 172.21.15.29:0/1604529767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b80fd730 msgr2=0x7f83b810d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f83b659c700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b80fd730 0x7f83b810d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f83b659c700 1 -- 172.21.15.29:0/1604529767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8005040 con 0x7f83b8100050 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f83b659c700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 0x7f83b810d9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00eb40 tx=0x7f83ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ac007cc0 con 0x7f83b8100050 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b810eaf0 con 0x7f83b8100050 2023-12-05T13:23:55.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83ac00f040 con 0x7f83b8100050 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ac00c990 con 0x7f83b8100050 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.776+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b810f030 con 0x7f83b8100050 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.777+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b804bb80 con 0x7f83b8100050 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.778+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f83ac00cc00 con 0x7f83b8100050 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.778+0000 7f839f7fe700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f83a0068f60 0x7f83a006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.778+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f83ac086970 con 0x7f83b8100050 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.778+0000 7f83b6d9d700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f83a0068f60 0x7f83a006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:55.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.779+0000 7f83b6d9d700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f83a0068f60 0x7f83a006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83a8000c00 tx=0x7f83a8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:55.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:55.784+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f83ac04da00 con 0x7f83b8100050 2023-12-05T13:23:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:55 smithi052 ceph-mon[121072]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:23:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:55 smithi052 ceph-mon[121072]: pgmap v167: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:23:56.026 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.025+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b810f480 con 0x7f83a0068f60 2023-12-05T13:23:56.037 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.036+0000 7f839f7fe700 1 -- 172.21.15.29:0/1604529767 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f83b810f480 con 0x7f83a0068f60 2023-12-05T13:23:56.037 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:23:56.037 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (4m) 48s ago 5m 26.4M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:23:56.037 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (5m) 48s ago 5m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:23:56.037 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (4m) 51s ago 4m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:23:56.037 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (3m) 48s ago 4m 86.6M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (64s) 48s ago 63s 18.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (59s) 48s ago 59s 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (57s) 51s ago 57s 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (62s) 51s ago 61s 15.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (6m) 48s ago 6m 495M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (4m) 51s ago 4m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0e5359a579b3 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (6m) 48s ago 6m 76.2M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (4m) 51s ago 4m 58.5M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (5m) 48s ago 5m 18.2M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (4m) 51s ago 4m 17.8M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (3m) 48s ago 3m 56.2M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (3m) 48s ago 3m 59.1M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (3m) 48s ago 3m 53.6M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (2m) 51s ago 2m 56.3M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:23:56.038 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (2m) 51s ago 2m 50.4M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (2m) 51s ago 2m 51.1M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (3m) 48s ago 4m 48.7M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f83a0068f60 msgr2=0x7f83a006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f83a0068f60 0x7f83a006b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f83a8000c00 tx=0x7f83a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 msgr2=0x7f83b810d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 0x7f83b810d9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00eb40 tx=0x7f83ac00b040 comp rx=0 tx=0).stop 2023-12-05T13:23:56.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 shutdown_connections 2023-12-05T13:23:56.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f83a0068f60 0x7f83a006b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b80fd730 0x7f83b810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 --2- 172.21.15.29:0/1604529767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83b8100050 0x7f83b810d9d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 >> 172.21.15.29:0/1604529767 conn(0x7f83b80f7190 msgr2=0x7f83b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:56.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.038+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 shutdown_connections 2023-12-05T13:23:56.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.039+0000 7f83bd024700 1 -- 172.21.15.29:0/1604529767 wait complete. 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 -- 172.21.15.29:0/2375467415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c100050 msgr2=0x7fe74c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 --2- 172.21.15.29:0/2375467415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c100050 0x7fe74c102430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe740004940 tx=0x7fe740009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 -- 172.21.15.29:0/2375467415 shutdown_connections 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 --2- 172.21.15.29:0/2375467415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c100050 0x7fe74c102430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 --2- 172.21.15.29:0/2375467415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe74c0fd730 0x7fe74c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 -- 172.21.15.29:0/2375467415 >> 172.21.15.29:0/2375467415 conn(0x7fe74c0f7190 msgr2=0x7fe74c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:56.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 -- 172.21.15.29:0/2375467415 shutdown_connections 2023-12-05T13:23:56.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.153+0000 7fe7513c6700 1 -- 172.21.15.29:0/2375467415 wait complete. 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe7513c6700 1 Processor -- start 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe7513c6700 1 -- start start 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe7513c6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 0x7fe74c10d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe7513c6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe74c100050 0x7fe74c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe7513c6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c10dfe0 con 0x7fe74c0fd730 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe7513c6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c10e880 con 0x7fe74c100050 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe74affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 0x7fe74c10d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe74affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 0x7fe74c10d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38256/0 (socket says 172.21.15.29:38256) 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe74affd700 1 -- 172.21.15.29:0/1925011217 learned_addr learned my addr 172.21.15.29:0/1925011217 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.154+0000 7fe74a7fc700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe74c100050 0x7fe74c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:56.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe74affd700 1 -- 172.21.15.29:0/1925011217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe74c100050 msgr2=0x7fe74c10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe74affd700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe74c100050 0x7fe74c10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe74affd700 1 -- 172.21.15.29:0/1925011217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740005040 con 0x7fe74c0fd730 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe74affd700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 0x7fe74c10d4a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe73c002a80 tx=0x7fe73c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73c007cc0 con 0x7fe74c0fd730 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe73c00f040 con 0x7fe74c0fd730 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c10eb60 con 0x7fe74c0fd730 2023-12-05T13:23:56.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73c00da60 con 0x7fe74c0fd730 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.155+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c10f0a0 con 0x7fe74c0fd730 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.156+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c04bb80 con 0x7fe74c0fd730 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.157+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe73c00dbc0 con 0x7fe74c0fd730 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.157+0000 7fe7337fe700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe734068f60 0x7fe73406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.157+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe73c086950 con 0x7fe74c0fd730 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.157+0000 7fe74a7fc700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe734068f60 0x7fe73406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:56.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.158+0000 7fe74a7fc700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe734068f60 0x7fe73406b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe740004890 tx=0x7fe740009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.162+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe73c0568b0 con 0x7fe74c0fd730 2023-12-05T13:23:56.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.460+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe74c10f4a0 con 0x7fe74c0fd730 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.461+0000 7fe7337fe700 1 -- 172.21.15.29:0/1925011217 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fe73c056440 con 0x7fe74c0fd730 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:23:56.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:23:56.463 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe734068f60 msgr2=0x7fe73406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe734068f60 0x7fe73406b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe740004890 tx=0x7fe740009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 msgr2=0x7fe74c10d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 0x7fe74c10d4a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe73c002a80 tx=0x7fe73c0046b0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 shutdown_connections 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fe734068f60 0x7fe73406b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.464 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe74c0fd730 0x7fe74c10d4a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 --2- 172.21.15.29:0/1925011217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe74c100050 0x7fe74c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 >> 172.21.15.29:0/1925011217 conn(0x7fe74c0f7190 msgr2=0x7fe74c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:56.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 shutdown_connections 2023-12-05T13:23:56.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.463+0000 7fe7513c6700 1 -- 172.21.15.29:0/1925011217 wait complete. 2023-12-05T13:23:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 -- 172.21.15.29:0/4275835950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85900ffdb0 msgr2=0x7f85901021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 --2- 172.21.15.29:0/4275835950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85900ffdb0 0x7f85901021d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8584004940 tx=0x7f8584009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:56.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 -- 172.21.15.29:0/4275835950 shutdown_connections 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 --2- 172.21.15.29:0/4275835950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85900ffdb0 0x7f85901021d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 --2- 172.21.15.29:0/4275835950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8590066050 0x7f85900ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 -- 172.21.15.29:0/4275835950 >> 172.21.15.29:0/4275835950 conn(0x7f85900f7190 msgr2=0x7f85900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 -- 172.21.15.29:0/4275835950 shutdown_connections 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 -- 172.21.15.29:0/4275835950 wait complete. 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.588+0000 7f8596787700 1 Processor -- start 2023-12-05T13:23:56.590 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f8596787700 1 -- start start 2023-12-05T13:23:56.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f8596787700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 0x7f85900fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f8596787700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85900ffdb0 0x7f85900fb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f8596787700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900fbce0 con 0x7f8590066050 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f8596787700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900fbe50 con 0x7f85900ffdb0 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 0x7f85900fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 0x7f85900fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38270/0 (socket says 172.21.15.29:38270) 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 -- 172.21.15.29:0/3501331853 learned_addr learned my addr 172.21.15.29:0/3501331853 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858f7fe700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85900ffdb0 0x7f85900fb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:56.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 -- 172.21.15.29:0/3501331853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85900ffdb0 msgr2=0x7f85900fb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85900ffdb0 0x7f85900fb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 -- 172.21.15.29:0/3501331853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8584005040 con 0x7f8590066050 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.589+0000 7f858ffff700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 0x7f85900fd260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f858000eb40 tx=0x7f858000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.590+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8580007cc0 con 0x7f8590066050 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.590+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f858000f040 con 0x7f8590066050 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.590+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85900fc0d0 con 0x7f8590066050 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.590+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858000c990 con 0x7f8590066050 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.590+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8590115510 con 0x7f8590066050 2023-12-05T13:23:56.594 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.592+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85901075c0 con 0x7f8590066050 2023-12-05T13:23:56.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.592+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f858000caf0 con 0x7f8590066050 2023-12-05T13:23:56.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.593+0000 7f858cff9700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8578068f60 0x7f857806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:23:56.595 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.593+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f85800867c0 con 0x7f8590066050 2023-12-05T13:23:56.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.593+0000 7f858f7fe700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8578068f60 0x7f857806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:23:56.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.593+0000 7f858f7fe700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8578068f60 0x7f857806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8584013680 tx=0x7f8584009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:23:56.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.597+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8580056720 con 0x7f8590066050 2023-12-05T13:23:56.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.826+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f859002b1f0 con 0x7f8578068f60 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.827+0000 7f858cff9700 1 -- 172.21.15.29:0/3501331853 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f859002b1f0 con 0x7f8578068f60 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-12-05T13:23:56.828 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "0/2 daemons upgraded", 2023-12-05T13:23:56.829 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a image on host smithi052", 2023-12-05T13:23:56.829 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:23:56.829 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:23:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8578068f60 msgr2=0x7f857806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8578068f60 0x7f857806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8584013680 tx=0x7f8584009e30 comp rx=0 tx=0).stop 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 msgr2=0x7f85900fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 0x7f85900fd260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f858000eb40 tx=0x7f858000b040 comp rx=0 tx=0).stop 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 shutdown_connections 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f8578068f60 0x7f857806b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8590066050 0x7f85900fd260 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 --2- 172.21.15.29:0/3501331853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85900ffdb0 0x7f85900fb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 >> 172.21.15.29:0/3501331853 conn(0x7f85900f7190 msgr2=0x7f85900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 shutdown_connections 2023-12-05T13:23:56.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:23:56.830+0000 7f8596787700 1 -- 172.21.15.29:0/3501331853 wait complete. 2023-12-05T13:23:56.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:56 smithi029 ceph-mon[112128]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:23:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:56 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:56 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1925011217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:23:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:56 smithi052 ceph-mon[121072]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:23:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:56 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:23:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:56 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1925011217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: Upgrade: Target is version 19.0.0-13-ge6605fb8 (unknown) 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a'] 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: Upgrade: Need to upgrade myself (mgr.smithi029.eekhlu) 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: pgmap v168: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:57 smithi029 ceph-mon[112128]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a on smithi052 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: Upgrade: Target is version 19.0.0-13-ge6605fb8 (unknown) 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a'] 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: Upgrade: Need to upgrade myself (mgr.smithi029.eekhlu) 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: pgmap v168: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:57.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:57 smithi052 ceph-mon[121072]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a on smithi052 2023-12-05T13:23:58.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:58 smithi029 ceph-mon[112128]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:58.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:58 smithi052 ceph-mon[121072]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:23:59.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:23:59 smithi029 ceph-mon[112128]: pgmap v169: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T13:23:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:23:59 smithi052 ceph-mon[121072]: pgmap v169: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T13:24:01.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:01 smithi029 ceph-mon[112128]: pgmap v170: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T13:24:01.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:01 smithi052 ceph-mon[121072]: pgmap v170: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T13:24:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:03 smithi029 ceph-mon[112128]: pgmap v171: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:24:03.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:03 smithi052 ceph-mon[121072]: pgmap v171: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:24:05.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:05 smithi029 ceph-mon[112128]: pgmap v172: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:24:05.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:05 smithi052 ceph-mon[121072]: pgmap v172: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:24:07.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:07 smithi029 ceph-mon[112128]: pgmap v173: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:24:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:07 smithi052 ceph-mon[121072]: pgmap v173: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T13:24:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:09.574 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:09 smithi029 ceph-mon[112128]: pgmap v174: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:24:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:09 smithi052 ceph-mon[121072]: pgmap v174: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:24:11.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:10 smithi052 ceph-mon[121072]: pgmap v175: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:24:11.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:10 smithi029 ceph-mon[112128]: pgmap v175: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:24:13.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:12 smithi052 ceph-mon[121072]: pgmap v176: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:24:13.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:12 smithi029 ceph-mon[112128]: pgmap v176: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T13:24:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:14 smithi052 ceph-mon[121072]: pgmap v177: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:24:15.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:14 smithi029 ceph-mon[112128]: pgmap v177: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:24:17.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:16 smithi052 ceph-mon[121072]: pgmap v178: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:24:17.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:16 smithi029 ceph-mon[112128]: pgmap v178: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:24:19.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:18 smithi052 ceph-mon[121072]: pgmap v179: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:24:19.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:18 smithi029 ceph-mon[112128]: pgmap v179: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T13:24:21.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:20 smithi052 ceph-mon[121072]: pgmap v180: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:21.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:20 smithi029 ceph-mon[112128]: pgmap v180: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:22.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:22.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:23.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:22 smithi052 ceph-mon[121072]: pgmap v181: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:23.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:22 smithi029 ceph-mon[112128]: pgmap v181: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:25.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:24 smithi052 ceph-mon[121072]: pgmap v182: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:25.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:24 smithi029 ceph-mon[112128]: pgmap v182: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 -- 172.21.15.29:0/395145397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 msgr2=0x7fafd80fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 --2- 172.21.15.29:0/395145397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd80fe3b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fafc8004940 tx=0x7fafc8009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 -- 172.21.15.29:0/395145397 shutdown_connections 2023-12-05T13:24:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 --2- 172.21.15.29:0/395145397 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd80fe3b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 --2- 172.21.15.29:0/395145397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd80faed0 0x7fafd80fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 -- 172.21.15.29:0/395145397 >> 172.21.15.29:0/395145397 conn(0x7fafd80f6950 msgr2=0x7fafd80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 -- 172.21.15.29:0/395145397 shutdown_connections 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.951+0000 7fafe01f8700 1 -- 172.21.15.29:0/395145397 wait complete. 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafe01f8700 1 Processor -- start 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafe01f8700 1 -- start start 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafe01f8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd80faed0 0x7fafd810d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafe01f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd810da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafe01f8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd810e090 con 0x7fafd80fdf60 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafe01f8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd810e930 con 0x7fafd80faed0 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafdd793700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd810da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafdd793700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd810da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57704/0 (socket says 172.21.15.29:57704) 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafdd793700 1 -- 172.21.15.29:0/1031731433 learned_addr learned my addr 172.21.15.29:0/1031731433 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.952+0000 7fafddf94700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd80faed0 0x7fafd810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafdd793700 1 -- 172.21.15.29:0/1031731433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd80faed0 msgr2=0x7fafd810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafdd793700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd80faed0 0x7fafd810d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafdd793700 1 -- 172.21.15.29:0/1031731433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc8005040 con 0x7fafd80fdf60 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafdd793700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd810da90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009360 tx=0x7fafc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc800e040 con 0x7fafd80fdf60 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafc8013420 con 0x7fafd80fdf60 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd810ebb0 con 0x7fafd80fdf60 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc801c610 con 0x7fafd80fdf60 2023-12-05T13:24:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.953+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd810f0f0 con 0x7fafd80fdf60 2023-12-05T13:24:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.954+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd804bb80 con 0x7fafd80fdf60 2023-12-05T13:24:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.955+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fafc8013a00 con 0x7fafd80fdf60 2023-12-05T13:24:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.955+0000 7fafce7fc700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fafc4068f70 0x7fafc406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.955+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fafc8087f70 con 0x7fafd80fdf60 2023-12-05T13:24:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.955+0000 7fafddf94700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fafc4068f70 0x7fafc406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.956+0000 7fafddf94700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fafc4068f70 0x7fafc406b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009fd0 tx=0x7fafd400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:26.961 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:26.960+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fafc80b9a00 con 0x7fafd80fdf60 2023-12-05T13:24:27.099 INFO:tasks.workunit.client.1.smithi052.stderr:Updating files: 90% (10919/12123) Updating files: 91% (11032/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-05T13:24:27.181 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.180+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafd810f590 con 0x7fafc4068f70 2023-12-05T13:24:27.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.181+0000 7fafce7fc700 1 -- 172.21.15.29:0/1031731433 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fafd810f590 con 0x7fafc4068f70 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fafc4068f70 msgr2=0x7fafc406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fafc4068f70 0x7fafc406b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009fd0 tx=0x7fafd400b040 comp rx=0 tx=0).stop 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 msgr2=0x7fafd810da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd810da90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009360 tx=0x7fafc8009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 shutdown_connections 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fafc4068f70 0x7fafc406b420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd80faed0 0x7fafd810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 --2- 172.21.15.29:0/1031731433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fafd80fdf60 0x7fafd810da90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 >> 172.21.15.29:0/1031731433 conn(0x7fafd80f6950 msgr2=0x7fafd8101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:27.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 shutdown_connections 2023-12-05T13:24:27.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.183+0000 7fafe01f8700 1 -- 172.21.15.29:0/1031731433 wait complete. 2023-12-05T13:24:27.196 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:24:27.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:26 smithi052 ceph-mon[121072]: pgmap v183: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr:Note: switching to 'e6605fb8725c25c4838cef6a39f30df73f1ed149'. 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr:state without impacting any branches by switching back to a branch. 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr: git switch -c 2023-12-05T13:24:27.260 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr:Or undo this operation with: 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr: git switch - 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr: 2023-12-05T13:24:27.261 INFO:tasks.workunit.client.1.smithi052.stderr:HEAD is now at e6605fb8725 Merge branch 'main' of https://github.com/dillona/ceph into wip-guits-testing-2023-12-05-0857 2023-12-05T13:24:27.263 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-05T13:24:27.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.296+0000 7f48663af700 1 -- 172.21.15.29:0/2596825462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 msgr2=0x7f48600fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.296+0000 7f48663af700 1 --2- 172.21.15.29:0/2596825462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f48600fd000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4850004940 tx=0x7f4850009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:27.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.296+0000 7f48663af700 1 -- 172.21.15.29:0/2596825462 shutdown_connections 2023-12-05T13:24:27.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.296+0000 7f48663af700 1 --2- 172.21.15.29:0/2596825462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48600fde00 0x7f48600fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.296+0000 7f48663af700 1 --2- 172.21.15.29:0/2596825462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f48600fd000 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.296+0000 7f48663af700 1 -- 172.21.15.29:0/2596825462 >> 172.21.15.29:0/2596825462 conn(0x7f48600f82d0 msgr2=0x7f48600fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:27.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.297+0000 7f48663af700 1 -- 172.21.15.29:0/2596825462 shutdown_connections 2023-12-05T13:24:27.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.297+0000 7f48663af700 1 -- 172.21.15.29:0/2596825462 wait complete. 2023-12-05T13:24:27.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.297+0000 7f48663af700 1 Processor -- start 2023-12-05T13:24:27.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f48663af700 1 -- start start 2023-12-05T13:24:27.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f48663af700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f486010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f48663af700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48600fde00 0x7f486010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f48663af700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486010e0a0 con 0x7f48600fcbf0 2023-12-05T13:24:27.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f48663af700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486010e940 con 0x7f48600fde00 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f486010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f486010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57728/0 (socket says 172.21.15.29:57728) 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485ffff700 1 -- 172.21.15.29:0/784140944 learned_addr learned my addr 172.21.15.29:0/784140944 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485f7fe700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48600fde00 0x7f486010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485ffff700 1 -- 172.21.15.29:0/784140944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48600fde00 msgr2=0x7f486010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485ffff700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48600fde00 0x7f486010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.298+0000 7f485ffff700 1 -- 172.21.15.29:0/784140944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850005040 con 0x7f48600fcbf0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.299+0000 7f485ffff700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f486010d560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4850000c00 tx=0x7f4850009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.299+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485000e040 con 0x7f48600fcbf0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.299+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486010ebc0 con 0x7f48600fcbf0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.299+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4850009af0 con 0x7f48600fcbf0 2023-12-05T13:24:27.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.299+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485001c630 con 0x7f48600fcbf0 2023-12-05T13:24:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.299+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486010f100 con 0x7f48600fcbf0 2023-12-05T13:24:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.300+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486004bb80 con 0x7f48600fcbf0 2023-12-05T13:24:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.300+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f485000bc50 con 0x7f48600fcbf0 2023-12-05T13:24:27.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.301+0000 7f485cff9700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4848068f60 0x7f484806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.301+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f48500880f0 con 0x7f48600fcbf0 2023-12-05T13:24:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.301+0000 7f485f7fe700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4848068f60 0x7f484806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.301+0000 7f485f7fe700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4848068f60 0x7f484806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4854004f40 tx=0x7f485400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:27.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.305+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4850058050 con 0x7f48600fcbf0 2023-12-05T13:24:27.332 INFO:tasks.workunit.client.1.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-05T13:24:27.334 INFO:tasks.workunit.client.1.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-05T13:24:27.334 INFO:tasks.workunit.client.1.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-05T13:24:27.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:26 smithi029 ceph-mon[112128]: pgmap v183: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:27.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.524+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f486010f550 con 0x7f4848068f60 2023-12-05T13:24:27.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.525+0000 7f485cff9700 1 -- 172.21.15.29:0/784140944 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f486010f550 con 0x7f4848068f60 2023-12-05T13:24:27.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4848068f60 msgr2=0x7f484806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4848068f60 0x7f484806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4854004f40 tx=0x7f485400b040 comp rx=0 tx=0).stop 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 msgr2=0x7f486010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f486010d560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4850000c00 tx=0x7f4850009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 shutdown_connections 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f4848068f60 0x7f484806b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48600fcbf0 0x7f486010d560 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 --2- 172.21.15.29:0/784140944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48600fde00 0x7f486010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 >> 172.21.15.29:0/784140944 conn(0x7f48600f82d0 msgr2=0x7f4860101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 shutdown_connections 2023-12-05T13:24:27.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.527+0000 7f48663af700 1 -- 172.21.15.29:0/784140944 wait complete. 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 -- 172.21.15.29:0/1204013782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 msgr2=0x7ff8940ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 --2- 172.21.15.29:0/1204013782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff8940ff230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff884004940 tx=0x7ff884009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 -- 172.21.15.29:0/1204013782 shutdown_connections 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 --2- 172.21.15.29:0/1204013782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8940fff90 0x7ff894100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 --2- 172.21.15.29:0/1204013782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff8940ff230 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 -- 172.21.15.29:0/1204013782 >> 172.21.15.29:0/1204013782 conn(0x7ff8940fa5d0 msgr2=0x7ff8940fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 -- 172.21.15.29:0/1204013782 shutdown_connections 2023-12-05T13:24:27.641 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 -- 172.21.15.29:0/1204013782 wait complete. 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.639+0000 7ff899a81700 1 Processor -- start 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff899a81700 1 -- start start 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff899a81700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff89410f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff899a81700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8940fff90 0x7ff89410fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff899a81700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894110320 con 0x7ff8940fee20 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff899a81700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894110b60 con 0x7ff8940fff90 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff8937fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff89410f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff8937fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff89410f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57744/0 (socket says 172.21.15.29:57744) 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff8937fe700 1 -- 172.21.15.29:0/2976698482 learned_addr learned my addr 172.21.15.29:0/2976698482 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff892ffd700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8940fff90 0x7ff89410fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff8937fe700 1 -- 172.21.15.29:0/2976698482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8940fff90 msgr2=0x7ff89410fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff8937fe700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8940fff90 0x7ff89410fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.643 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.640+0000 7ff8937fe700 1 -- 172.21.15.29:0/2976698482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884005040 con 0x7ff8940fee20 2023-12-05T13:24:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.641+0000 7ff8937fe700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff89410f750 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff884009380 tx=0x7ff884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.641+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88400e040 con 0x7ff8940fee20 2023-12-05T13:24:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.641+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff894110de0 con 0x7ff8940fee20 2023-12-05T13:24:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.641+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff88400bd20 con 0x7ff8940fee20 2023-12-05T13:24:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.641+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88401c630 con 0x7ff8940fee20 2023-12-05T13:24:27.644 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.641+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff894111320 con 0x7ff8940fee20 2023-12-05T13:24:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.642+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89404bb80 con 0x7ff8940fee20 2023-12-05T13:24:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.643+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff884013420 con 0x7ff8940fee20 2023-12-05T13:24:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.643+0000 7ff87bfff700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff87c068f60 0x7ff87c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.643+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff884088cb0 con 0x7ff8940fee20 2023-12-05T13:24:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.643+0000 7ff892ffd700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff87c068f60 0x7ff87c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.645 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.644+0000 7ff892ffd700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff87c068f60 0x7ff87c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff888009bf0 tx=0x7ff8880091a0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:27.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.647+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff884058bf0 con 0x7ff8940fee20 2023-12-05T13:24:27.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.861+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff894104970 con 0x7ff87c068f60 2023-12-05T13:24:27.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.872+0000 7ff87bfff700 1 -- 172.21.15.29:0/2976698482 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7ff894104970 con 0x7ff87c068f60 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (4m) 80s ago 5m 26.4M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (5m) 80s ago 5m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (4m) 83s ago 4m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (4m) 80s ago 5m 86.6M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (95s) 80s ago 95s 18.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (91s) 80s ago 91s 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (89s) 83s ago 89s 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (94s) 83s ago 93s 15.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (6m) 80s ago 6m 495M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (4m) 83s ago 4m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0e5359a579b3 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (6m) 80s ago 6m 76.2M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:24:27.874 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (4m) 83s ago 4m 58.5M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (5m) 80s ago 5m 18.2M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (4m) 83s ago 4m 17.8M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (4m) 80s ago 4m 56.2M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (3m) 80s ago 3m 59.1M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (3m) 80s ago 3m 53.6M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (3m) 83s ago 3m 56.3M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (2m) 83s ago 2m 50.4M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (2m) 83s ago 2m 51.1M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:24:27.875 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (4m) 80s ago 5m 48.7M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff87c068f60 msgr2=0x7ff87c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff87c068f60 0x7ff87c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff888009bf0 tx=0x7ff8880091a0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 msgr2=0x7ff89410f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff89410f750 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff884009380 tx=0x7ff884009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 shutdown_connections 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff87c068f60 0x7ff87c06b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8940fee20 0x7ff89410f750 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 --2- 172.21.15.29:0/2976698482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8940fff90 0x7ff89410fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 >> 172.21.15.29:0/2976698482 conn(0x7ff8940fa5d0 msgr2=0x7ff894103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 shutdown_connections 2023-12-05T13:24:27.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.874+0000 7ff899a81700 1 -- 172.21.15.29:0/2976698482 wait complete. 2023-12-05T13:24:27.904 INFO:tasks.workunit.client.1.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-05T13:24:27.968 INFO:tasks.workunit.client.1.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-05T13:24:27.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 -- 172.21.15.29:0/2579523166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0faed0 msgr2=0x7fb02c0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 --2- 172.21.15.29:0/2579523166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0faed0 0x7fb02c0fb2e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb014004940 tx=0x7fb014009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:27.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 -- 172.21.15.29:0/2579523166 shutdown_connections 2023-12-05T13:24:27.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 --2- 172.21.15.29:0/2579523166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb02c0fdf60 0x7fb02c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 --2- 172.21.15.29:0/2579523166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0faed0 0x7fb02c0fb2e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 -- 172.21.15.29:0/2579523166 >> 172.21.15.29:0/2579523166 conn(0x7fb02c0f6950 msgr2=0x7fb02c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 -- 172.21.15.29:0/2579523166 shutdown_connections 2023-12-05T13:24:27.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.986+0000 7fb031759700 1 -- 172.21.15.29:0/2579523166 wait complete. 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb031759700 1 Processor -- start 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb031759700 1 -- start start 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb031759700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb02c0faed0 0x7fb02c10d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb031759700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 0x7fb02c10da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb031759700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c10e080 con 0x7fb02c0fdf60 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb031759700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c10e920 con 0x7fb02c0faed0 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 0x7fb02c10da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 0x7fb02c10da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57754/0 (socket says 172.21.15.29:57754) 2023-12-05T13:24:27.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb02affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb02c0faed0 0x7fb02c10d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.987+0000 7fb02a7fc700 1 -- 172.21.15.29:0/1406981781 learned_addr learned my addr 172.21.15.29:0/1406981781 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb02a7fc700 1 -- 172.21.15.29:0/1406981781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb02c0faed0 msgr2=0x7fb02c10d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb02a7fc700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb02c0faed0 0x7fb02c10d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb02a7fc700 1 -- 172.21.15.29:0/1406981781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014005040 con 0x7fb02c0fdf60 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb02a7fc700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 0x7fb02c10da80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00eb40 tx=0x7fb01c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01c007cc0 con 0x7fb02c0fdf60 2023-12-05T13:24:27.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb01c00f040 con 0x7fb02c0fdf60 2023-12-05T13:24:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c10eba0 con 0x7fb02c0fdf60 2023-12-05T13:24:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01c00c990 con 0x7fb02c0fdf60 2023-12-05T13:24:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.988+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c10f0e0 con 0x7fb02c0fdf60 2023-12-05T13:24:27.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.989+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c04bb80 con 0x7fb02c0fdf60 2023-12-05T13:24:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.990+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb01c00cc00 con 0x7fb02c0fdf60 2023-12-05T13:24:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.990+0000 7fb0237fe700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb018068f70 0x7fb01806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.991+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb01c086bd0 con 0x7fb02c0fdf60 2023-12-05T13:24:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.991+0000 7fb02affd700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb018068f70 0x7fb01806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:27.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.991+0000 7fb02affd700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb018068f70 0x7fb01806b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb014009fd0 tx=0x7fb014009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:27.994+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb01c056be0 con 0x7fb02c0fdf60 2023-12-05T13:24:28.010 INFO:tasks.workunit.client.1.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-05T13:24:28.011 INFO:tasks.workunit.client.1.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-05T13:24:28.011 INFO:tasks.workunit.client.1.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-05T13:24:28.052 INFO:tasks.workunit.client.1.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-05T13:24:28.056 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:24:28.056 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-05T13:24:28.118 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-05T13:24:28.119 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-05T13:24:28.119 DEBUG:teuthology.orchestra.run.smithi052:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e6605fb8725c25c4838cef6a39f30df73f1ed149 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-05T13:24:28.187 INFO:tasks.workunit.client.1.smithi052.stderr:+ mkdir -p fsstress 2023-12-05T13:24:28.189 INFO:tasks.workunit.client.1.smithi052.stderr:+ pushd fsstress 2023-12-05T13:24:28.189 INFO:tasks.workunit.client.1.smithi052.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T13:24:28.190 INFO:tasks.workunit.client.1.smithi052.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-05T13:24:28.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:27 smithi052 ceph-mon[121072]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:28.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:27 smithi052 ceph-mon[121072]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:28.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.280+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb02c1055b0 con 0x7fb02c0fdf60 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.280+0000 7fb0237fe700 1 -- 172.21.15.29:0/1406981781 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fb01c056770 con 0x7fb02c0fdf60 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:24:28.282 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:24:28.283 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:24:28.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb018068f70 msgr2=0x7fb01806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:28.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb018068f70 0x7fb01806b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb014009fd0 tx=0x7fb014009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:28.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 msgr2=0x7fb02c10da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:28.284 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 0x7fb02c10da80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00eb40 tx=0x7fb01c00b040 comp rx=0 tx=0).stop 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 shutdown_connections 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fb018068f70 0x7fb01806b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb02c0faed0 0x7fb02c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 --2- 172.21.15.29:0/1406981781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb02c0fdf60 0x7fb02c10da80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 >> 172.21.15.29:0/1406981781 conn(0x7fb02c0f6950 msgr2=0x7fb02c101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 shutdown_connections 2023-12-05T13:24:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.283+0000 7fb031759700 1 -- 172.21.15.29:0/1406981781 wait complete. 2023-12-05T13:24:28.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:27 smithi029 ceph-mon[112128]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:28.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:27 smithi029 ceph-mon[112128]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 -- 172.21.15.29:0/20740033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fbaf0 msgr2=0x7ff5100fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 --2- 172.21.15.29:0/20740033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fbaf0 0x7ff5100fbf00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff500004940 tx=0x7ff500009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 -- 172.21.15.29:0/20740033 shutdown_connections 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 --2- 172.21.15.29:0/20740033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5100fcd00 0x7ff5100fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 --2- 172.21.15.29:0/20740033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fbaf0 0x7ff5100fbf00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 -- 172.21.15.29:0/20740033 >> 172.21.15.29:0/20740033 conn(0x7ff5100f7190 msgr2=0x7ff5100f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 -- 172.21.15.29:0/20740033 shutdown_connections 2023-12-05T13:24:28.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.396+0000 7ff5161fa700 1 -- 172.21.15.29:0/20740033 wait complete. 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff5161fa700 1 Processor -- start 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff5161fa700 1 -- start start 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff5161fa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5100fbaf0 0x7ff51010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff5161fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 0x7ff51010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff5161fa700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51010e0c0 con 0x7ff5100fcd00 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff5161fa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51010e960 con 0x7ff5100fbaf0 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff50effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 0x7ff51010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff50effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 0x7ff51010dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57778/0 (socket says 172.21.15.29:57778) 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff50effd700 1 -- 172.21.15.29:0/3353715129 learned_addr learned my addr 172.21.15.29:0/3353715129 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.397+0000 7ff50f7fe700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5100fbaf0 0x7ff51010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff50effd700 1 -- 172.21.15.29:0/3353715129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5100fbaf0 msgr2=0x7ff51010d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff50effd700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5100fbaf0 0x7ff51010d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff50effd700 1 -- 172.21.15.29:0/3353715129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500005040 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff50effd700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 0x7ff51010dac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c8c0 tx=0x7ff5040044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50400a760 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff50400ad70 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51010ec40 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5040113a0 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.398+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51010f180 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.399+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51004bb80 con 0x7ff5100fcd00 2023-12-05T13:24:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.400+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff504012400 con 0x7ff5100fcd00 2023-12-05T13:24:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.400+0000 7ff4f7fff700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4f8068f60 0x7ff4f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.400+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff504087a10 con 0x7ff5100fcd00 2023-12-05T13:24:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.400+0000 7ff50f7fe700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4f8068f60 0x7ff4f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.401+0000 7ff50f7fe700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4f8068f60 0x7ff4f806b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff500004890 tx=0x7ff500009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:28.406 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.404+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff504057950 con 0x7ff5100fcd00 2023-12-05T13:24:28.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.624+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff51010f680 con 0x7ff4f8068f60 2023-12-05T13:24:28.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.625+0000 7ff4f7fff700 1 -- 172.21.15.29:0/3353715129 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff51010f680 con 0x7ff4f8068f60 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "0/2 daemons upgraded", 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a image on host smithi052", 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:24:28.627 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4f8068f60 msgr2=0x7ff4f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4f8068f60 0x7ff4f806b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff500004890 tx=0x7ff500009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 msgr2=0x7ff51010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 0x7ff51010dac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c8c0 tx=0x7ff5040044c0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 shutdown_connections 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7ff4f8068f60 0x7ff4f806b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5100fbaf0 0x7ff51010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 --2- 172.21.15.29:0/3353715129 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5100fcd00 0x7ff51010dac0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 >> 172.21.15.29:0/3353715129 conn(0x7ff5100f7190 msgr2=0x7ff510065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 shutdown_connections 2023-12-05T13:24:28.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:28.627+0000 7ff5161fa700 1 -- 172.21.15.29:0/3353715129 wait complete. 2023-12-05T13:24:29.069 INFO:tasks.workunit.client.1.smithi052.stderr:+ tar xzf ltp-full.tgz 2023-12-05T13:24:29.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:28 smithi052 ceph-mon[121072]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:29.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:28 smithi052 ceph-mon[121072]: pgmap v184: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:29.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:28 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1406981781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:24:29.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:28 smithi029 ceph-mon[112128]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:29.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:28 smithi029 ceph-mon[112128]: pgmap v184: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:29.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:28 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1406981781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:24:30.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:29 smithi029 ceph-mon[112128]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:30.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:29 smithi052 ceph-mon[121072]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:24:31.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:30 smithi029 ceph-mon[112128]: pgmap v185: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:30 smithi052 ceph-mon[121072]: pgmap v185: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:24:33.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:32 smithi029 ceph-mon[112128]: pgmap v186: 65 pgs: 65 active+clean; 2.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 173 KiB/s wr, 0 op/s 2023-12-05T13:24:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:32 smithi052 ceph-mon[121072]: pgmap v186: 65 pgs: 65 active+clean; 2.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 173 KiB/s wr, 0 op/s 2023-12-05T13:24:35.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:34 smithi029 ceph-mon[112128]: pgmap v187: 65 pgs: 65 active+clean; 2.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 173 KiB/s wr, 0 op/s 2023-12-05T13:24:35.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:34 smithi052 ceph-mon[121072]: pgmap v187: 65 pgs: 65 active+clean; 2.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 173 KiB/s wr, 0 op/s 2023-12-05T13:24:37.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:36 smithi029 ceph-mon[112128]: pgmap v188: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s wr, 189 op/s 2023-12-05T13:24:37.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:36 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:37.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:36 smithi052 ceph-mon[121072]: pgmap v188: 65 pgs: 65 active+clean; 23 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s wr, 189 op/s 2023-12-05T13:24:37.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:36 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:38.547 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 78% (9510/12123) Updating files: 79% (9578/12123) Updating files: 80% (9699/12123) Updating files: 81% (9820/12123) Updating files: 82% (9941/12123) Updating files: 83% (10063/12123) Updating files: 84% (10184/12123) Updating files: 85% (10305/12123) Updating files: 86% (10426/12123) Updating files: 87% (10548/12123) Updating files: 88% (10669/12123) Updating files: 89% (10790/12123) Updating files: 90% (10911/12123) Updating files: 91% (11032/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-05T13:24:39.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:38 smithi029 ceph-mon[112128]: pgmap v189: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 240 op/s 2023-12-05T13:24:39.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:38 smithi052 ceph-mon[121072]: pgmap v189: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 240 op/s 2023-12-05T13:24:39.482 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to 'e6605fb8725c25c4838cef6a39f30df73f1ed149'. 2023-12-05T13:24:39.482 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.482 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-05T13:24:39.483 INFO:tasks.workunit.client.0.smithi029.stderr: 2023-12-05T13:24:39.484 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at e6605fb8725 Merge branch 'main' of https://github.com/dillona/ceph into wip-guits-testing-2023-12-05-0857 2023-12-05T13:24:39.485 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-05T13:24:39.567 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-05T13:24:39.569 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-05T13:24:39.569 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-05T13:24:41.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:40 smithi029 ceph-mon[112128]: pgmap v190: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 310 op/s 2023-12-05T13:24:41.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:40 smithi052 ceph-mon[121072]: pgmap v190: 65 pgs: 65 active+clean; 43 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s wr, 310 op/s 2023-12-05T13:24:43.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:42 smithi029 ceph-mon[112128]: pgmap v191: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s wr, 319 op/s 2023-12-05T13:24:43.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:42 smithi052 ceph-mon[121072]: pgmap v191: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s wr, 319 op/s 2023-12-05T13:24:45.052 INFO:tasks.workunit.client.1.smithi052.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-05T13:24:45.053 INFO:tasks.workunit.client.1.smithi052.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T13:24:45.053 INFO:tasks.workunit.client.1.smithi052.stderr:+ make 2023-12-05T13:24:45.169 INFO:tasks.workunit.client.1.smithi052.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-05T13:24:45.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:45 smithi029 ceph-mon[112128]: pgmap v192: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s wr, 319 op/s 2023-12-05T13:24:45.453 INFO:tasks.workunit.client.1.smithi052.stderr:++ readlink -f fsstress 2023-12-05T13:24:45.454 INFO:tasks.workunit.client.1.smithi052.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-05T13:24:45.454 INFO:tasks.workunit.client.1.smithi052.stderr:+ popd 2023-12-05T13:24:45.454 INFO:tasks.workunit.client.1.smithi052.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T13:24:45.454 INFO:tasks.workunit.client.1.smithi052.stderr:+ popd 2023-12-05T13:24:45.455 INFO:tasks.workunit.client.1.smithi052.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-05T13:24:45.455 INFO:tasks.workunit.client.1.smithi052.stderr:++ mktemp -d -p . 2023-12-05T13:24:45.455 INFO:tasks.workunit.client.1.smithi052.stderr:+ T=./tmp.BCBXe5ys8a 2023-12-05T13:24:45.455 INFO:tasks.workunit.client.1.smithi052.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.BCBXe5ys8a -l 1 -n 1000 -p 10 -v 2023-12-05T13:24:45.456 INFO:tasks.workunit.client.1.smithi052.stdout:seed = 1701434332 2023-12-05T13:24:45.459 INFO:tasks.workunit.client.1.smithi052.stdout:1/0: getdents . 0 2023-12-05T13:24:45.459 INFO:tasks.workunit.client.1.smithi052.stdout:1/1: unlink - no file 2023-12-05T13:24:45.459 INFO:tasks.workunit.client.1.smithi052.stdout:0/0: mkdir d0 0 2023-12-05T13:24:45.459 INFO:tasks.workunit.client.1.smithi052.stdout:0/1: dwrite - no filename 2023-12-05T13:24:45.460 INFO:tasks.workunit.client.1.smithi052.stdout:0/2: dread - no filename 2023-12-05T13:24:45.460 INFO:tasks.workunit.client.1.smithi052.stdout:0/3: dwrite - no filename 2023-12-05T13:24:45.460 INFO:tasks.workunit.client.1.smithi052.stdout:0/4: rename d0 to d0/d1 22 2023-12-05T13:24:45.460 INFO:tasks.workunit.client.1.smithi052.stdout:2/0: write - no filename 2023-12-05T13:24:45.460 INFO:tasks.workunit.client.1.smithi052.stdout:2/1: dread - no filename 2023-12-05T13:24:45.460 INFO:tasks.workunit.client.1.smithi052.stdout:2/2: unlink - no file 2023-12-05T13:24:45.461 INFO:tasks.workunit.client.1.smithi052.stdout:1/2: mknod c0 0 2023-12-05T13:24:45.461 INFO:tasks.workunit.client.1.smithi052.stdout:1/3: write - no filename 2023-12-05T13:24:45.461 INFO:tasks.workunit.client.1.smithi052.stdout:1/4: dwrite - no filename 2023-12-05T13:24:45.461 INFO:tasks.workunit.client.1.smithi052.stdout:1/5: chown c0 1 1 2023-12-05T13:24:45.461 INFO:tasks.workunit.client.1.smithi052.stdout:1/6: fsync - no filename 2023-12-05T13:24:45.461 INFO:tasks.workunit.client.1.smithi052.stdout:0/5: symlink d0/l2 0 2023-12-05T13:24:45.462 INFO:tasks.workunit.client.1.smithi052.stdout:0/6: chown d0/l2 5116862 1 2023-12-05T13:24:45.462 INFO:tasks.workunit.client.1.smithi052.stdout:3/0: write - no filename 2023-12-05T13:24:45.462 INFO:tasks.workunit.client.1.smithi052.stdout:3/1: chown . 118676 1 2023-12-05T13:24:45.462 INFO:tasks.workunit.client.1.smithi052.stdout:3/2: rmdir - no directory 2023-12-05T13:24:45.462 INFO:tasks.workunit.client.1.smithi052.stdout:3/3: dwrite - no filename 2023-12-05T13:24:45.463 INFO:tasks.workunit.client.1.smithi052.stdout:2/3: symlink l0 0 2023-12-05T13:24:45.463 INFO:tasks.workunit.client.1.smithi052.stdout:2/4: write - no filename 2023-12-05T13:24:45.463 INFO:tasks.workunit.client.1.smithi052.stdout:1/7: mknod c1 0 2023-12-05T13:24:45.463 INFO:tasks.workunit.client.1.smithi052.stdout:1/8: stat c1 0 2023-12-05T13:24:45.463 INFO:tasks.workunit.client.1.smithi052.stdout:1/9: dwrite - no filename 2023-12-05T13:24:45.465 INFO:tasks.workunit.client.1.smithi052.stdout:3/4: mknod c0 0 2023-12-05T13:24:45.467 INFO:tasks.workunit.client.1.smithi052.stdout:2/5: creat f1 x:0 0 0 2023-12-05T13:24:45.467 INFO:tasks.workunit.client.1.smithi052.stdout:2/6: rmdir - no directory 2023-12-05T13:24:45.467 INFO:tasks.workunit.client.1.smithi052.stdout:2/7: fdatasync f1 0 2023-12-05T13:24:45.467 INFO:tasks.workunit.client.1.smithi052.stdout:2/8: truncate f1 702075 0 2023-12-05T13:24:45.467 INFO:tasks.workunit.client.1.smithi052.stdout:1/10: mknod c2 0 2023-12-05T13:24:45.467 INFO:tasks.workunit.client.1.smithi052.stdout:1/11: dwrite - no filename 2023-12-05T13:24:45.468 INFO:tasks.workunit.client.1.smithi052.stdout:1/12: stat c2 0 2023-12-05T13:24:45.468 INFO:tasks.workunit.client.1.smithi052.stdout:1/13: truncate - no filename 2023-12-05T13:24:45.469 INFO:tasks.workunit.client.1.smithi052.stdout:3/5: symlink l1 0 2023-12-05T13:24:45.469 INFO:tasks.workunit.client.1.smithi052.stdout:3/6: write - no filename 2023-12-05T13:24:45.469 INFO:tasks.workunit.client.1.smithi052.stdout:3/7: read - no filename 2023-12-05T13:24:45.469 INFO:tasks.workunit.client.1.smithi052.stdout:3/8: dread - no filename 2023-12-05T13:24:45.469 INFO:tasks.workunit.client.1.smithi052.stdout:3/9: dread - no filename 2023-12-05T13:24:45.470 INFO:tasks.workunit.client.1.smithi052.stdout:4/0: fsync - no filename 2023-12-05T13:24:45.470 INFO:tasks.workunit.client.1.smithi052.stdout:4/1: chown . 0 1 2023-12-05T13:24:45.471 INFO:tasks.workunit.client.1.smithi052.stdout:2/9: mkdir d2 0 2023-12-05T13:24:45.472 INFO:tasks.workunit.client.1.smithi052.stdout:1/14: link c2 c3 0 2023-12-05T13:24:45.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:45 smithi052 ceph-mon[121072]: pgmap v192: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s wr, 319 op/s 2023-12-05T13:24:45.473 INFO:tasks.workunit.client.1.smithi052.stdout:3/10: link l1 l2 0 2023-12-05T13:24:45.473 INFO:tasks.workunit.client.1.smithi052.stdout:3/11: chown l2 272 1 2023-12-05T13:24:45.473 INFO:tasks.workunit.client.1.smithi052.stdout:3/12: write - no filename 2023-12-05T13:24:45.473 INFO:tasks.workunit.client.1.smithi052.stdout:3/13: write - no filename 2023-12-05T13:24:45.474 INFO:tasks.workunit.client.1.smithi052.stdout:5/0: fdatasync - no filename 2023-12-05T13:24:45.475 INFO:tasks.workunit.client.1.smithi052.stdout:4/2: symlink l0 0 2023-12-05T13:24:45.476 INFO:tasks.workunit.client.1.smithi052.stdout:4/3: dwrite - no filename 2023-12-05T13:24:45.477 INFO:tasks.workunit.client.1.smithi052.stdout:1/15: creat f4 x:0 0 0 2023-12-05T13:24:45.477 INFO:tasks.workunit.client.1.smithi052.stdout:1/16: write f4 [611464,67550] 0 2023-12-05T13:24:45.477 INFO:tasks.workunit.client.1.smithi052.stdout:1/17: chown c0 4 1 2023-12-05T13:24:45.478 INFO:tasks.workunit.client.1.smithi052.stdout:1/18: write f4 [1409338,36644] 0 2023-12-05T13:24:45.478 INFO:tasks.workunit.client.1.smithi052.stdout:0/7: getdents d0 0 2023-12-05T13:24:45.480 INFO:tasks.workunit.client.1.smithi052.stdout:3/14: symlink l3 0 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/0: link - no file 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/1: write - no filename 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/2: dread - no filename 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/3: dwrite - no filename 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/4: rmdir - no directory 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/5: link - no file 2023-12-05T13:24:45.482 INFO:tasks.workunit.client.1.smithi052.stdout:6/6: rmdir - no directory 2023-12-05T13:24:45.484 INFO:tasks.workunit.client.1.smithi052.stdout:5/1: symlink l0 0 2023-12-05T13:24:45.487 INFO:tasks.workunit.client.1.smithi052.stdout:1/19: dread f4 [0,4194304] 0 2023-12-05T13:24:45.488 INFO:tasks.workunit.client.1.smithi052.stdout:4/4: creat f1 x:0 0 0 2023-12-05T13:24:45.488 INFO:tasks.workunit.client.1.smithi052.stdout:0/8: mknod d0/c3 0 2023-12-05T13:24:45.488 INFO:tasks.workunit.client.1.smithi052.stdout:3/15: creat f4 x:0 0 0 2023-12-05T13:24:45.489 INFO:tasks.workunit.client.1.smithi052.stdout:3/16: write f4 [116462,65088] 0 2023-12-05T13:24:45.489 INFO:tasks.workunit.client.1.smithi052.stdout:3/17: readlink l3 0 2023-12-05T13:24:45.489 INFO:tasks.workunit.client.1.smithi052.stdout:7/0: fdatasync - no filename 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:2/10: dwrite f1 [0,4194304] 0 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:2/11: chown l0 10260345 1 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:6/7: mknod c0 0 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:6/8: chown c0 3154 1 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:6/9: dread - no filename 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:6/10: fsync - no filename 2023-12-05T13:24:45.490 INFO:tasks.workunit.client.1.smithi052.stdout:6/11: rmdir - no directory 2023-12-05T13:24:45.491 INFO:tasks.workunit.client.1.smithi052.stdout:6/12: fsync - no filename 2023-12-05T13:24:45.491 INFO:tasks.workunit.client.1.smithi052.stdout:5/2: creat f1 x:0 0 0 2023-12-05T13:24:45.491 INFO:tasks.workunit.client.1.smithi052.stdout:2/12: write f1 [66114,42585] 0 2023-12-05T13:24:45.491 INFO:tasks.workunit.client.1.smithi052.stdout:1/20: dread f4 [0,4194304] 0 2023-12-05T13:24:45.491 INFO:tasks.workunit.client.1.smithi052.stdout:4/5: mknod c2 0 2023-12-05T13:24:45.492 INFO:tasks.workunit.client.1.smithi052.stdout:0/9: creat d0/f4 x:0 0 0 2023-12-05T13:24:45.493 INFO:tasks.workunit.client.1.smithi052.stdout:3/18: creat f5 x:0 0 0 2023-12-05T13:24:45.494 INFO:tasks.workunit.client.1.smithi052.stdout:8/0: dread - no filename 2023-12-05T13:24:45.494 INFO:tasks.workunit.client.1.smithi052.stdout:8/1: fsync - no filename 2023-12-05T13:24:45.494 INFO:tasks.workunit.client.1.smithi052.stdout:8/2: fdatasync - no filename 2023-12-05T13:24:45.494 INFO:tasks.workunit.client.1.smithi052.stdout:8/3: dread - no filename 2023-12-05T13:24:45.494 INFO:tasks.workunit.client.1.smithi052.stdout:8/4: write - no filename 2023-12-05T13:24:45.495 INFO:tasks.workunit.client.1.smithi052.stdout:8/5: rename - no filename 2023-12-05T13:24:45.495 INFO:tasks.workunit.client.1.smithi052.stdout:8/6: rename - no filename 2023-12-05T13:24:45.495 INFO:tasks.workunit.client.1.smithi052.stdout:8/7: getdents . 0 2023-12-05T13:24:45.495 INFO:tasks.workunit.client.1.smithi052.stdout:8/8: write - no filename 2023-12-05T13:24:45.496 INFO:tasks.workunit.client.1.smithi052.stdout:1/21: dread f4 [0,4194304] 0 2023-12-05T13:24:45.496 INFO:tasks.workunit.client.1.smithi052.stdout:1/22: chown f4 24619 1 2023-12-05T13:24:45.496 INFO:tasks.workunit.client.1.smithi052.stdout:7/1: creat f0 x:0 0 0 2023-12-05T13:24:45.498 INFO:tasks.workunit.client.1.smithi052.stdout:6/13: mknod c1 0 2023-12-05T13:24:45.498 INFO:tasks.workunit.client.1.smithi052.stdout:6/14: dread - no filename 2023-12-05T13:24:45.498 INFO:tasks.workunit.client.1.smithi052.stdout:6/15: write - no filename 2023-12-05T13:24:45.498 INFO:tasks.workunit.client.1.smithi052.stdout:6/16: write - no filename 2023-12-05T13:24:45.498 INFO:tasks.workunit.client.1.smithi052.stdout:6/17: dwrite - no filename 2023-12-05T13:24:45.499 INFO:tasks.workunit.client.1.smithi052.stdout:5/3: creat f2 x:0 0 0 2023-12-05T13:24:45.499 INFO:tasks.workunit.client.1.smithi052.stdout:5/4: dread - f2 zero size 2023-12-05T13:24:45.501 INFO:tasks.workunit.client.1.smithi052.stdout:4/6: rename l0 to l3 0 2023-12-05T13:24:45.501 INFO:tasks.workunit.client.1.smithi052.stdout:4/7: readlink l3 0 2023-12-05T13:24:45.501 INFO:tasks.workunit.client.1.smithi052.stdout:4/8: chown f1 58 1 2023-12-05T13:24:45.501 INFO:tasks.workunit.client.1.smithi052.stdout:4/9: write f1 [1007303,27455] 0 2023-12-05T13:24:45.501 INFO:tasks.workunit.client.1.smithi052.stdout:4/10: chown c2 1051791660 1 2023-12-05T13:24:45.501 INFO:tasks.workunit.client.1.smithi052.stdout:0/10: readlink d0/l2 0 2023-12-05T13:24:45.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/0: fdatasync - no filename 2023-12-05T13:24:45.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/1: rename - no filename 2023-12-05T13:24:45.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/2: truncate - no filename 2023-12-05T13:24:45.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/3: write - no filename 2023-12-05T13:24:45.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/4: dwrite - no filename 2023-12-05T13:24:45.504 INFO:tasks.workunit.client.1.smithi052.stdout:8/9: mkdir d0 0 2023-12-05T13:24:45.504 INFO:tasks.workunit.client.1.smithi052.stdout:8/10: readlink - no filename 2023-12-05T13:24:45.504 INFO:tasks.workunit.client.1.smithi052.stdout:8/11: write - no filename 2023-12-05T13:24:45.506 INFO:tasks.workunit.client.1.smithi052.stdout:2/13: dread f1 [0,4194304] 0 2023-12-05T13:24:45.508 INFO:tasks.workunit.client.1.smithi052.stdout:7/2: mknod c1 0 2023-12-05T13:24:45.508 INFO:tasks.workunit.client.1.smithi052.stdout:7/3: stat c1 0 2023-12-05T13:24:45.508 INFO:tasks.workunit.client.1.smithi052.stdout:7/4: chown f0 3175733 1 2023-12-05T13:24:45.508 INFO:tasks.workunit.client.1.smithi052.stdout:7/5: chown f0 419100863 1 2023-12-05T13:24:45.508 INFO:tasks.workunit.client.1.smithi052.stdout:7/6: dread - f0 zero size 2023-12-05T13:24:45.508 INFO:tasks.workunit.client.1.smithi052.stdout:7/7: write f0 [433747,121464] 0 2023-12-05T13:24:45.509 INFO:tasks.workunit.client.1.smithi052.stdout:6/18: mknod c2 0 2023-12-05T13:24:45.509 INFO:tasks.workunit.client.1.smithi052.stdout:6/19: dwrite - no filename 2023-12-05T13:24:45.512 INFO:tasks.workunit.client.1.smithi052.stdout:5/5: creat f3 x:0 0 0 2023-12-05T13:24:45.514 INFO:tasks.workunit.client.1.smithi052.stdout:1/23: getdents . 0 2023-12-05T13:24:45.515 INFO:tasks.workunit.client.1.smithi052.stdout:1/24: write f4 [2271317,14956] 0 2023-12-05T13:24:45.516 INFO:tasks.workunit.client.1.smithi052.stdout:9/5: symlink l0 0 2023-12-05T13:24:45.518 INFO:tasks.workunit.client.1.smithi052.stdout:8/12: mknod d0/c1 0 2023-12-05T13:24:45.519 INFO:tasks.workunit.client.1.smithi052.stdout:8/13: write - no filename 2023-12-05T13:24:45.520 INFO:tasks.workunit.client.1.smithi052.stdout:6/20: mkdir d3 0 2023-12-05T13:24:45.522 INFO:tasks.workunit.client.1.smithi052.stdout:5/6: rename f2 to f4 0 2023-12-05T13:24:45.523 INFO:tasks.workunit.client.1.smithi052.stdout:5/7: chown f3 1 1 2023-12-05T13:24:45.523 INFO:tasks.workunit.client.1.smithi052.stdout:4/11: dwrite f1 [0,4194304] 0 2023-12-05T13:24:45.524 INFO:tasks.workunit.client.1.smithi052.stdout:4/12: chown l3 5961426 1 2023-12-05T13:24:45.524 INFO:tasks.workunit.client.1.smithi052.stdout:0/11: mknod d0/c5 0 2023-12-05T13:24:45.524 INFO:tasks.workunit.client.1.smithi052.stdout:0/12: write d0/f4 [312395,53446] 0 2023-12-05T13:24:45.527 INFO:tasks.workunit.client.1.smithi052.stdout:2/14: dwrite f1 [0,4194304] 0 2023-12-05T13:24:45.528 INFO:tasks.workunit.client.1.smithi052.stdout:9/6: link l0 l1 0 2023-12-05T13:24:45.529 INFO:tasks.workunit.client.1.smithi052.stdout:9/7: write - no filename 2023-12-05T13:24:45.529 INFO:tasks.workunit.client.1.smithi052.stdout:9/8: dread - no filename 2023-12-05T13:24:45.529 INFO:tasks.workunit.client.1.smithi052.stdout:9/9: dread - no filename 2023-12-05T13:24:45.529 INFO:tasks.workunit.client.1.smithi052.stdout:9/10: truncate - no filename 2023-12-05T13:24:45.529 INFO:tasks.workunit.client.1.smithi052.stdout:9/11: dread - no filename 2023-12-05T13:24:45.530 INFO:tasks.workunit.client.1.smithi052.stdout:8/14: mknod d0/c2 0 2023-12-05T13:24:45.530 INFO:tasks.workunit.client.1.smithi052.stdout:8/15: chown d0 3043 1 2023-12-05T13:24:45.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/16: write - no filename 2023-12-05T13:24:45.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/17: dread - no filename 2023-12-05T13:24:45.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/18: dread - no filename 2023-12-05T13:24:45.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/19: write - no filename 2023-12-05T13:24:45.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/20: write - no filename 2023-12-05T13:24:45.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/21: fsync - no filename 2023-12-05T13:24:45.532 INFO:tasks.workunit.client.1.smithi052.stdout:3/19: fsync f5 0 2023-12-05T13:24:45.532 INFO:tasks.workunit.client.1.smithi052.stdout:6/21: mkdir d3/d4 0 2023-12-05T13:24:45.532 INFO:tasks.workunit.client.1.smithi052.stdout:6/22: dread - no filename 2023-12-05T13:24:45.532 INFO:tasks.workunit.client.1.smithi052.stdout:5/8: mkdir d5 0 2023-12-05T13:24:45.533 INFO:tasks.workunit.client.1.smithi052.stdout:7/8: fsync f0 0 2023-12-05T13:24:45.539 INFO:tasks.workunit.client.1.smithi052.stdout:9/12: mknod c2 0 2023-12-05T13:24:45.539 INFO:tasks.workunit.client.1.smithi052.stdout:9/13: dwrite - no filename 2023-12-05T13:24:45.539 INFO:tasks.workunit.client.1.smithi052.stdout:9/14: truncate - no filename 2023-12-05T13:24:45.539 INFO:tasks.workunit.client.1.smithi052.stdout:0/13: creat d0/f6 x:0 0 0 2023-12-05T13:24:45.539 INFO:tasks.workunit.client.1.smithi052.stdout:8/22: creat d0/f3 x:0 0 0 2023-12-05T13:24:45.540 INFO:tasks.workunit.client.1.smithi052.stdout:4/13: dread f1 [0,4194304] 0 2023-12-05T13:24:45.541 INFO:tasks.workunit.client.1.smithi052.stdout:6/23: mkdir d3/d5 0 2023-12-05T13:24:45.542 INFO:tasks.workunit.client.1.smithi052.stdout:5/9: creat d5/f6 x:0 0 0 2023-12-05T13:24:45.544 INFO:tasks.workunit.client.1.smithi052.stdout:7/9: link f0 f2 0 2023-12-05T13:24:45.546 INFO:tasks.workunit.client.1.smithi052.stdout:9/15: mkdir d3 0 2023-12-05T13:24:45.546 INFO:tasks.workunit.client.1.smithi052.stdout:9/16: write - no filename 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:8/23: symlink d0/l4 0 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:6/24: mkdir d3/d4/d6 0 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:5/10: mknod d5/c7 0 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:7/10: rename f0 to f3 0 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:7/11: chown c1 470211851 1 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:7/12: truncate f3 1190486 0 2023-12-05T13:24:45.557 INFO:tasks.workunit.client.1.smithi052.stdout:7/13: write f2 [2139026,7065] 0 2023-12-05T13:24:45.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/14: write f3 [2839907,105101] 0 2023-12-05T13:24:45.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/15: chown f2 6 1 2023-12-05T13:24:45.562 INFO:tasks.workunit.client.1.smithi052.stdout:4/14: dwrite f1 [0,4194304] 0 2023-12-05T13:24:45.581 INFO:tasks.workunit.client.1.smithi052.stdout:0/14: link d0/c3 d0/c7 0 2023-12-05T13:24:45.581 INFO:tasks.workunit.client.1.smithi052.stdout:8/24: creat d0/f5 x:0 0 0 2023-12-05T13:24:45.581 INFO:tasks.workunit.client.1.smithi052.stdout:8/25: rename d0 to d0/d6 22 2023-12-05T13:24:45.581 INFO:tasks.workunit.client.1.smithi052.stdout:5/11: symlink d5/l8 0 2023-12-05T13:24:45.581 INFO:tasks.workunit.client.1.smithi052.stdout:2/15: truncate f1 3869655 0 2023-12-05T13:24:45.586 INFO:tasks.workunit.client.1.smithi052.stdout:6/25: creat d3/d4/d6/f7 x:0 0 0 2023-12-05T13:24:45.586 INFO:tasks.workunit.client.1.smithi052.stdout:7/16: creat f4 x:0 0 0 2023-12-05T13:24:45.586 INFO:tasks.workunit.client.1.smithi052.stdout:8/26: creat d0/f7 x:0 0 0 2023-12-05T13:24:45.586 INFO:tasks.workunit.client.1.smithi052.stdout:8/27: write d0/f3 [128239,57894] 0 2023-12-05T13:24:45.590 INFO:tasks.workunit.client.1.smithi052.stdout:6/26: link c0 d3/d4/c8 0 2023-12-05T13:24:45.590 INFO:tasks.workunit.client.1.smithi052.stdout:6/27: read - d3/d4/d6/f7 zero size 2023-12-05T13:24:45.591 INFO:tasks.workunit.client.1.smithi052.stdout:4/15: rename f1 to f4 0 2023-12-05T13:24:45.607 INFO:tasks.workunit.client.1.smithi052.stdout:8/28: mknod d0/c8 0 2023-12-05T13:24:45.607 INFO:tasks.workunit.client.1.smithi052.stdout:8/29: stat d0/c8 0 2023-12-05T13:24:45.607 INFO:tasks.workunit.client.1.smithi052.stdout:8/30: chown d0/c1 35 1 2023-12-05T13:24:45.608 INFO:tasks.workunit.client.1.smithi052.stdout:6/28: mkdir d3/d5/d9 0 2023-12-05T13:24:45.608 INFO:tasks.workunit.client.1.smithi052.stdout:4/16: mknod c5 0 2023-12-05T13:24:45.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/25: dwrite f4 [0,4194304] 0 2023-12-05T13:24:45.625 INFO:tasks.workunit.client.1.smithi052.stdout:4/17: mknod c6 0 2023-12-05T13:24:45.705 INFO:tasks.workunit.client.1.smithi052.stdout:3/20: dwrite f5 [0,4194304] 0 2023-12-05T13:24:45.705 INFO:tasks.workunit.client.1.smithi052.stdout:3/21: truncate f4 961390 0 2023-12-05T13:24:45.740 INFO:tasks.workunit.client.1.smithi052.stdout:3/22: unlink c0 0 2023-12-05T13:24:46.118 INFO:tasks.workunit.client.1.smithi052.stdout:5/12: dwrite f3 [0,4194304] 0 2023-12-05T13:24:46.119 INFO:tasks.workunit.client.1.smithi052.stdout:5/13: write f1 [769081,110978] 0 2023-12-05T13:24:46.145 INFO:tasks.workunit.client.1.smithi052.stdout:0/15: read d0/f4 [75884,94705] 0 2023-12-05T13:24:46.530 INFO:tasks.workunit.client.1.smithi052.stdout:6/29: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:46.587 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-05T13:24:46.657 INFO:tasks.workunit.client.1.smithi052.stdout:2/16: write f1 [2788557,119760] 0 2023-12-05T13:24:46.684 INFO:tasks.workunit.client.1.smithi052.stdout:7/17: dwrite f2 [0,4194304] 0 2023-12-05T13:24:46.753 INFO:tasks.workunit.client.1.smithi052.stdout:8/31: dread d0/f3 [0,4194304] 0 2023-12-05T13:24:46.753 INFO:tasks.workunit.client.1.smithi052.stdout:8/32: chown d0/f7 914914542 1 2023-12-05T13:24:46.813 INFO:tasks.workunit.client.1.smithi052.stdout:6/30: read d3/d4/d6/f7 [2243323,2479] 0 2023-12-05T13:24:46.845 INFO:tasks.workunit.client.1.smithi052.stdout:6/31: dread d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:46.853 INFO:tasks.workunit.client.1.smithi052.stdout:6/32: dread d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:46.858 INFO:tasks.workunit.client.1.smithi052.stdout:6/33: write d3/d4/d6/f7 [665619,48601] 0 2023-12-05T13:24:46.872 INFO:tasks.workunit.client.1.smithi052.stdout:7/18: dwrite f3 [0,4194304] 0 2023-12-05T13:24:46.890 INFO:tasks.workunit.client.1.smithi052.stdout:4/18: write f4 [3309427,71561] 0 2023-12-05T13:24:46.890 INFO:tasks.workunit.client.1.smithi052.stdout:4/19: stat f4 0 2023-12-05T13:24:46.948 INFO:tasks.workunit.client.1.smithi052.stdout:0/16: write d0/f4 [186813,40391] 0 2023-12-05T13:24:46.952 INFO:tasks.workunit.client.1.smithi052.stdout:3/23: dwrite f5 [0,4194304] 0 2023-12-05T13:24:46.953 INFO:tasks.workunit.client.1.smithi052.stdout:3/24: truncate f4 1707706 0 2023-12-05T13:24:46.970 INFO:tasks.workunit.client.1.smithi052.stdout:0/17: dread d0/f4 [0,4194304] 0 2023-12-05T13:24:46.970 INFO:tasks.workunit.client.1.smithi052.stdout:0/18: dread - d0/f6 zero size 2023-12-05T13:24:46.970 INFO:tasks.workunit.client.1.smithi052.stdout:0/19: dread - d0/f6 zero size 2023-12-05T13:24:46.990 INFO:tasks.workunit.client.1.smithi052.stdout:3/25: dwrite f5 [0,4194304] 0 2023-12-05T13:24:46.991 INFO:tasks.workunit.client.1.smithi052.stdout:3/26: write f5 [4851456,91333] 0 2023-12-05T13:24:47.015 INFO:tasks.workunit.client.1.smithi052.stdout:1/26: dread f4 [0,4194304] 0 2023-12-05T13:24:47.021 INFO:tasks.workunit.client.1.smithi052.stdout:1/27: read f4 [3419371,111562] 0 2023-12-05T13:24:47.063 INFO:tasks.workunit.client.1.smithi052.stdout:1/28: dwrite f4 [0,4194304] 0 2023-12-05T13:24:47.063 INFO:tasks.workunit.client.1.smithi052.stdout:1/29: getdents . 0 2023-12-05T13:24:47.077 INFO:tasks.workunit.client.1.smithi052.stdout:7/19: dwrite f4 [0,4194304] 0 2023-12-05T13:24:47.242 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-05T13:24:47.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:47 smithi029 ceph-mon[112128]: pgmap v193: 65 pgs: 65 active+clean; 63 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 323 op/s 2023-12-05T13:24:47.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:47 smithi052 ceph-mon[121072]: pgmap v193: 65 pgs: 65 active+clean; 63 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s wr, 323 op/s 2023-12-05T13:24:47.588 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-05T13:24:47.590 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-05T13:24:47.590 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-05T13:24:47.792 INFO:tasks.workunit.client.1.smithi052.stdout:5/14: creat d5/f9 x:0 0 0 2023-12-05T13:24:47.913 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-05T13:24:47.914 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:24:47.914 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-05T13:24:47.935 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-05T13:24:47.936 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-05T13:24:47.937 DEBUG:teuthology.orchestra.run.smithi029:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e6605fb8725c25c4838cef6a39f30df73f1ed149 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-05T13:24:48.007 INFO:tasks.workunit.client.0.smithi029.stderr:+ mkdir -p fsstress 2023-12-05T13:24:48.011 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd fsstress 2023-12-05T13:24:48.012 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T13:24:48.012 INFO:tasks.workunit.client.0.smithi029.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-05T13:24:49.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:49 smithi029 ceph-mon[112128]: pgmap v194: 65 pgs: 65 active+clean; 77 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 694 KiB/s rd, 5.0 MiB/s wr, 182 op/s 2023-12-05T13:24:49.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:49 smithi052 ceph-mon[121072]: pgmap v194: 65 pgs: 65 active+clean; 77 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 694 KiB/s rd, 5.0 MiB/s wr, 182 op/s 2023-12-05T13:24:49.787 INFO:tasks.workunit.client.1.smithi052.stdout:2/17: link l0 d2/l3 0 2023-12-05T13:24:50.100 INFO:tasks.workunit.client.1.smithi052.stdout:8/33: mknod d0/c9 0 2023-12-05T13:24:50.100 INFO:tasks.workunit.client.1.smithi052.stdout:8/34: read - d0/f5 zero size 2023-12-05T13:24:50.100 INFO:tasks.workunit.client.1.smithi052.stdout:8/35: write d0/f5 [765735,66243] 0 2023-12-05T13:24:50.649 INFO:tasks.workunit.client.1.smithi052.stdout:4/20: creat f7 x:0 0 0 2023-12-05T13:24:50.895 INFO:tasks.workunit.client.0.smithi029.stderr:+ tar xzf ltp-full.tgz 2023-12-05T13:24:50.928 INFO:tasks.workunit.client.1.smithi052.stdout:3/27: mknod c6 0 2023-12-05T13:24:51.212 INFO:tasks.workunit.client.1.smithi052.stdout:1/30: mkdir d5 0 2023-12-05T13:24:51.313 INFO:tasks.workunit.client.1.smithi052.stdout:7/20: rename c1 to c5 0 2023-12-05T13:24:51.313 INFO:tasks.workunit.client.1.smithi052.stdout:7/21: truncate f4 4642648 0 2023-12-05T13:24:51.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:51 smithi029 ceph-mon[112128]: pgmap v195: 65 pgs: 65 active+clean; 96 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 709 KiB/s rd, 5.4 MiB/s wr, 329 op/s 2023-12-05T13:24:51.360 INFO:tasks.workunit.client.1.smithi052.stdout:5/15: creat d5/fa x:0 0 0 2023-12-05T13:24:51.360 INFO:tasks.workunit.client.1.smithi052.stdout:5/16: write f4 [1025346,94679] 0 2023-12-05T13:24:51.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:51 smithi052 ceph-mon[121072]: pgmap v195: 65 pgs: 65 active+clean; 96 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 709 KiB/s rd, 5.4 MiB/s wr, 329 op/s 2023-12-05T13:24:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:52 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:52.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:52 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:24:52.953 INFO:tasks.workunit.client.1.smithi052.stdout:2/18: mkdir d2/d4 0 2023-12-05T13:24:52.955 INFO:tasks.workunit.client.1.smithi052.stdout:8/36: creat d0/fa x:0 0 0 2023-12-05T13:24:52.955 INFO:tasks.workunit.client.1.smithi052.stdout:8/37: write d0/f5 [869006,63406] 0 2023-12-05T13:24:52.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/21: symlink l8 0 2023-12-05T13:24:52.958 INFO:tasks.workunit.client.1.smithi052.stdout:0/20: link d0/l2 d0/l8 0 2023-12-05T13:24:52.958 INFO:tasks.workunit.client.1.smithi052.stdout:0/21: write d0/f6 [31105,103488] 0 2023-12-05T13:24:52.958 INFO:tasks.workunit.client.1.smithi052.stdout:0/22: write d0/f4 [370574,22896] 0 2023-12-05T13:24:52.959 INFO:tasks.workunit.client.1.smithi052.stdout:3/28: symlink l7 0 2023-12-05T13:24:52.962 INFO:tasks.workunit.client.1.smithi052.stdout:1/31: symlink d5/l6 0 2023-12-05T13:24:52.971 INFO:tasks.workunit.client.1.smithi052.stdout:1/32: dread f4 [0,4194304] 0 2023-12-05T13:24:52.973 INFO:tasks.workunit.client.1.smithi052.stdout:2/19: symlink d2/d4/l5 0 2023-12-05T13:24:52.973 INFO:tasks.workunit.client.1.smithi052.stdout:2/20: rename d2 to d2/d4/d6 22 2023-12-05T13:24:52.974 INFO:tasks.workunit.client.1.smithi052.stdout:8/38: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:24:52.975 INFO:tasks.workunit.client.1.smithi052.stdout:8/39: write d0/f5 [3129062,61598] 0 2023-12-05T13:24:52.975 INFO:tasks.workunit.client.1.smithi052.stdout:4/22: symlink l9 0 2023-12-05T13:24:52.976 INFO:tasks.workunit.client.1.smithi052.stdout:0/23: creat d0/f9 x:0 0 0 2023-12-05T13:24:52.978 INFO:tasks.workunit.client.1.smithi052.stdout:3/29: link l7 l8 0 2023-12-05T13:24:52.979 INFO:tasks.workunit.client.1.smithi052.stdout:3/30: write f4 [1596992,62220] 0 2023-12-05T13:24:52.983 INFO:tasks.workunit.client.1.smithi052.stdout:1/33: mkdir d5/d7 0 2023-12-05T13:24:52.986 INFO:tasks.workunit.client.1.smithi052.stdout:2/21: rmdir d2 39 2023-12-05T13:24:52.988 INFO:tasks.workunit.client.1.smithi052.stdout:8/40: mknod d0/cb 0 2023-12-05T13:24:52.990 INFO:tasks.workunit.client.1.smithi052.stdout:4/23: creat fa x:0 0 0 2023-12-05T13:24:52.990 INFO:tasks.workunit.client.1.smithi052.stdout:4/24: rmdir - no directory 2023-12-05T13:24:52.992 INFO:tasks.workunit.client.1.smithi052.stdout:0/24: unlink d0/l2 0 2023-12-05T13:24:52.992 INFO:tasks.workunit.client.1.smithi052.stdout:0/25: write d0/f9 [86025,120337] 0 2023-12-05T13:24:52.993 INFO:tasks.workunit.client.1.smithi052.stdout:3/31: link l7 l9 0 2023-12-05T13:24:52.996 INFO:tasks.workunit.client.1.smithi052.stdout:1/34: creat d5/f8 x:0 0 0 2023-12-05T13:24:52.997 INFO:tasks.workunit.client.1.smithi052.stdout:0/26: dread d0/f9 [0,4194304] 0 2023-12-05T13:24:52.997 INFO:tasks.workunit.client.1.smithi052.stdout:0/27: write d0/f4 [862105,37297] 0 2023-12-05T13:24:52.997 INFO:tasks.workunit.client.1.smithi052.stdout:2/22: unlink f1 0 2023-12-05T13:24:52.997 INFO:tasks.workunit.client.1.smithi052.stdout:2/23: chown l0 79382525 1 2023-12-05T13:24:53.002 INFO:tasks.workunit.client.1.smithi052.stdout:4/25: mknod cb 0 2023-12-05T13:24:53.002 INFO:tasks.workunit.client.1.smithi052.stdout:4/26: fdatasync f7 0 2023-12-05T13:24:53.004 INFO:tasks.workunit.client.1.smithi052.stdout:3/32: mkdir da 0 2023-12-05T13:24:53.004 INFO:tasks.workunit.client.1.smithi052.stdout:3/33: readlink l8 0 2023-12-05T13:24:53.005 INFO:tasks.workunit.client.1.smithi052.stdout:1/35: rename c1 to d5/d7/c9 0 2023-12-05T13:24:53.015 INFO:tasks.workunit.client.1.smithi052.stdout:3/34: stat l9 0 2023-12-05T13:24:53.016 INFO:tasks.workunit.client.1.smithi052.stdout:1/36: link d5/l6 d5/d7/la 0 2023-12-05T13:24:53.016 INFO:tasks.workunit.client.1.smithi052.stdout:1/37: write f4 [5117418,120728] 0 2023-12-05T13:24:53.020 INFO:tasks.workunit.client.1.smithi052.stdout:0/28: link d0/f4 d0/fa 0 2023-12-05T13:24:53.021 INFO:tasks.workunit.client.1.smithi052.stdout:3/35: mknod da/cb 0 2023-12-05T13:24:53.029 INFO:tasks.workunit.client.1.smithi052.stdout:0/29: mkdir d0/db 0 2023-12-05T13:24:53.030 INFO:tasks.workunit.client.1.smithi052.stdout:3/36: dread f5 [0,4194304] 0 2023-12-05T13:24:53.032 INFO:tasks.workunit.client.1.smithi052.stdout:3/37: truncate f5 11374 0 2023-12-05T13:24:53.032 INFO:tasks.workunit.client.1.smithi052.stdout:3/38: chown l7 5047 1 2023-12-05T13:24:53.033 INFO:tasks.workunit.client.1.smithi052.stdout:0/30: mknod d0/db/cc 0 2023-12-05T13:24:53.034 INFO:tasks.workunit.client.1.smithi052.stdout:1/38: dwrite d5/f8 [0,4194304] 0 2023-12-05T13:24:53.034 INFO:tasks.workunit.client.1.smithi052.stdout:1/39: write d5/f8 [3988412,30980] 0 2023-12-05T13:24:53.038 INFO:tasks.workunit.client.1.smithi052.stdout:0/31: creat d0/fd x:0 0 0 2023-12-05T13:24:53.045 INFO:tasks.workunit.client.1.smithi052.stdout:1/40: dread f4 [0,4194304] 0 2023-12-05T13:24:53.049 INFO:tasks.workunit.client.1.smithi052.stdout:1/41: dread f4 [0,4194304] 0 2023-12-05T13:24:53.050 INFO:tasks.workunit.client.1.smithi052.stdout:1/42: write d5/f8 [3537741,37237] 0 2023-12-05T13:24:53.053 INFO:tasks.workunit.client.1.smithi052.stdout:1/43: mknod d5/cb 0 2023-12-05T13:24:53.074 INFO:tasks.workunit.client.1.smithi052.stdout:1/44: dwrite d5/f8 [0,4194304] 0 2023-12-05T13:24:53.075 INFO:tasks.workunit.client.1.smithi052.stdout:1/45: write d5/f8 [2899074,84711] 0 2023-12-05T13:24:53.075 INFO:tasks.workunit.client.1.smithi052.stdout:1/46: fsync f4 0 2023-12-05T13:24:53.076 INFO:tasks.workunit.client.1.smithi052.stdout:1/47: creat d5/fc x:0 0 0 2023-12-05T13:24:53.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:53 smithi029 ceph-mon[112128]: pgmap v196: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 607 op/s 2023-12-05T13:24:53.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:53 smithi052 ceph-mon[121072]: pgmap v196: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 607 op/s 2023-12-05T13:24:53.531 INFO:tasks.workunit.client.1.smithi052.stdout:9/17: sync 2023-12-05T13:24:53.531 INFO:tasks.workunit.client.1.smithi052.stdout:6/34: sync 2023-12-05T13:24:53.531 INFO:tasks.workunit.client.1.smithi052.stdout:9/18: truncate - no filename 2023-12-05T13:24:53.531 INFO:tasks.workunit.client.1.smithi052.stdout:9/19: truncate - no filename 2023-12-05T13:24:53.531 INFO:tasks.workunit.client.1.smithi052.stdout:6/35: write d3/d4/d6/f7 [4472513,100610] 0 2023-12-05T13:24:53.531 INFO:tasks.workunit.client.1.smithi052.stdout:6/36: readlink - no filename 2023-12-05T13:24:53.533 INFO:tasks.workunit.client.1.smithi052.stdout:9/20: unlink c2 0 2023-12-05T13:24:53.533 INFO:tasks.workunit.client.1.smithi052.stdout:9/21: truncate - no filename 2023-12-05T13:24:53.533 INFO:tasks.workunit.client.1.smithi052.stdout:9/22: truncate - no filename 2023-12-05T13:24:53.533 INFO:tasks.workunit.client.1.smithi052.stdout:9/23: truncate - no filename 2023-12-05T13:24:53.535 INFO:tasks.workunit.client.1.smithi052.stdout:9/24: creat d3/f4 x:0 0 0 2023-12-05T13:24:53.539 INFO:tasks.workunit.client.1.smithi052.stdout:6/37: dread d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.540 INFO:tasks.workunit.client.1.smithi052.stdout:6/38: write d3/d4/d6/f7 [4199207,120703] 0 2023-12-05T13:24:53.540 INFO:tasks.workunit.client.1.smithi052.stdout:9/25: rename l1 to d3/l5 0 2023-12-05T13:24:53.541 INFO:tasks.workunit.client.1.smithi052.stdout:9/26: mknod d3/c6 0 2023-12-05T13:24:53.543 INFO:tasks.workunit.client.1.smithi052.stdout:9/27: rename l0 to d3/l7 0 2023-12-05T13:24:53.543 INFO:tasks.workunit.client.1.smithi052.stdout:9/28: readlink d3/l5 0 2023-12-05T13:24:53.549 INFO:tasks.workunit.client.1.smithi052.stdout:7/22: truncate f4 2124961 0 2023-12-05T13:24:53.552 INFO:tasks.workunit.client.1.smithi052.stdout:7/23: mknod c6 0 2023-12-05T13:24:53.554 INFO:tasks.workunit.client.1.smithi052.stdout:7/24: mkdir d7 0 2023-12-05T13:24:53.555 INFO:tasks.workunit.client.1.smithi052.stdout:7/25: symlink d7/l8 0 2023-12-05T13:24:53.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/41: getdents d0 0 2023-12-05T13:24:53.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/42: fdatasync d0/f7 0 2023-12-05T13:24:53.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/43: getdents d0 0 2023-12-05T13:24:53.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/26: link c6 d7/c9 0 2023-12-05T13:24:53.560 INFO:tasks.workunit.client.1.smithi052.stdout:8/44: creat d0/fc x:0 0 0 2023-12-05T13:24:53.561 INFO:tasks.workunit.client.1.smithi052.stdout:6/39: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.562 INFO:tasks.workunit.client.1.smithi052.stdout:7/27: mkdir d7/da 0 2023-12-05T13:24:53.563 INFO:tasks.workunit.client.1.smithi052.stdout:8/45: write d0/f3 [672133,116223] 0 2023-12-05T13:24:53.564 INFO:tasks.workunit.client.1.smithi052.stdout:1/48: fsync d5/f8 0 2023-12-05T13:24:53.567 INFO:tasks.workunit.client.1.smithi052.stdout:7/28: creat d7/da/fb x:0 0 0 2023-12-05T13:24:53.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/27: getdents . 0 2023-12-05T13:24:53.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/28: fdatasync f7 0 2023-12-05T13:24:53.569 INFO:tasks.workunit.client.1.smithi052.stdout:8/46: chown d0/f7 410159 1 2023-12-05T13:24:53.569 INFO:tasks.workunit.client.1.smithi052.stdout:1/49: rmdir d5/d7 39 2023-12-05T13:24:53.571 INFO:tasks.workunit.client.1.smithi052.stdout:7/29: mknod d7/da/cc 0 2023-12-05T13:24:53.572 INFO:tasks.workunit.client.1.smithi052.stdout:8/47: creat d0/fd x:0 0 0 2023-12-05T13:24:53.575 INFO:tasks.workunit.client.1.smithi052.stdout:7/30: truncate f2 3192540 0 2023-12-05T13:24:53.576 INFO:tasks.workunit.client.1.smithi052.stdout:8/48: chown d0/c2 898793798 1 2023-12-05T13:24:53.579 INFO:tasks.workunit.client.1.smithi052.stdout:7/31: rename d7/da/cc to d7/cd 0 2023-12-05T13:24:53.583 INFO:tasks.workunit.client.1.smithi052.stdout:8/49: mkdir d0/de 0 2023-12-05T13:24:53.585 INFO:tasks.workunit.client.1.smithi052.stdout:8/50: read d0/f5 [3565781,34748] 0 2023-12-05T13:24:53.586 INFO:tasks.workunit.client.1.smithi052.stdout:8/51: mknod d0/cf 0 2023-12-05T13:24:53.586 INFO:tasks.workunit.client.1.smithi052.stdout:8/52: write d0/f7 [1044507,45831] 0 2023-12-05T13:24:53.587 INFO:tasks.workunit.client.1.smithi052.stdout:8/53: readlink d0/l4 0 2023-12-05T13:24:53.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/29: dwrite fa [0,4194304] 0 2023-12-05T13:24:53.588 INFO:tasks.workunit.client.1.smithi052.stdout:8/54: symlink d0/de/l10 0 2023-12-05T13:24:53.593 INFO:tasks.workunit.client.1.smithi052.stdout:4/30: link l9 lc 0 2023-12-05T13:24:53.598 INFO:tasks.workunit.client.1.smithi052.stdout:8/55: rename d0/fd to d0/f11 0 2023-12-05T13:24:53.600 INFO:tasks.workunit.client.1.smithi052.stdout:8/56: mkdir d0/de/d12 0 2023-12-05T13:24:53.601 INFO:tasks.workunit.client.1.smithi052.stdout:8/57: fdatasync d0/fa 0 2023-12-05T13:24:53.601 INFO:tasks.workunit.client.1.smithi052.stdout:8/58: truncate d0/f11 263546 0 2023-12-05T13:24:53.601 INFO:tasks.workunit.client.1.smithi052.stdout:8/59: truncate d0/fa 77179 0 2023-12-05T13:24:53.601 INFO:tasks.workunit.client.1.smithi052.stdout:8/60: getdents d0/de/d12 0 2023-12-05T13:24:53.602 INFO:tasks.workunit.client.1.smithi052.stdout:8/61: symlink d0/de/d12/l13 0 2023-12-05T13:24:53.602 INFO:tasks.workunit.client.1.smithi052.stdout:8/62: dread - d0/fc zero size 2023-12-05T13:24:53.602 INFO:tasks.workunit.client.1.smithi052.stdout:4/31: dread fa [0,4194304] 0 2023-12-05T13:24:53.603 INFO:tasks.workunit.client.1.smithi052.stdout:3/39: dwrite f5 [0,4194304] 0 2023-12-05T13:24:53.605 INFO:tasks.workunit.client.1.smithi052.stdout:3/40: symlink da/lc 0 2023-12-05T13:24:53.616 INFO:tasks.workunit.client.1.smithi052.stdout:1/50: getdents d5 0 2023-12-05T13:24:53.619 INFO:tasks.workunit.client.1.smithi052.stdout:1/51: symlink d5/ld 0 2023-12-05T13:24:53.620 INFO:tasks.workunit.client.1.smithi052.stdout:1/52: getdents d5/d7 0 2023-12-05T13:24:53.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/53: write d5/f8 [1610405,50619] 0 2023-12-05T13:24:53.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/54: chown d5/ld 1043 1 2023-12-05T13:24:53.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/55: readlink d5/ld 0 2023-12-05T13:24:53.625 INFO:tasks.workunit.client.1.smithi052.stdout:4/32: dwrite f4 [0,4194304] 0 2023-12-05T13:24:53.625 INFO:tasks.workunit.client.1.smithi052.stdout:3/41: dwrite f4 [0,4194304] 0 2023-12-05T13:24:53.632 INFO:tasks.workunit.client.1.smithi052.stdout:3/42: unlink l1 0 2023-12-05T13:24:53.632 INFO:tasks.workunit.client.1.smithi052.stdout:3/43: chown l2 32 1 2023-12-05T13:24:53.643 INFO:tasks.workunit.client.1.smithi052.stdout:1/56: dwrite f4 [4194304,4194304] 0 2023-12-05T13:24:53.644 INFO:tasks.workunit.client.1.smithi052.stdout:1/57: mkdir d5/d7/de 0 2023-12-05T13:24:53.667 INFO:tasks.workunit.client.1.smithi052.stdout:1/58: dwrite d5/fc [0,4194304] 0 2023-12-05T13:24:53.671 INFO:tasks.workunit.client.1.smithi052.stdout:1/59: rmdir d5 39 2023-12-05T13:24:53.673 INFO:tasks.workunit.client.1.smithi052.stdout:1/60: rename c3 to d5/d7/cf 0 2023-12-05T13:24:53.695 INFO:tasks.workunit.client.1.smithi052.stdout:1/61: dwrite f4 [0,4194304] 0 2023-12-05T13:24:53.724 INFO:tasks.workunit.client.1.smithi052.stdout:6/40: mknod d3/ca 0 2023-12-05T13:24:53.739 INFO:tasks.workunit.client.1.smithi052.stdout:6/41: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.739 INFO:tasks.workunit.client.1.smithi052.stdout:6/42: getdents d3/d5/d9 0 2023-12-05T13:24:53.739 INFO:tasks.workunit.client.1.smithi052.stdout:6/43: readlink - no filename 2023-12-05T13:24:53.739 INFO:tasks.workunit.client.1.smithi052.stdout:6/44: fsync d3/d4/d6/f7 0 2023-12-05T13:24:53.750 INFO:tasks.workunit.client.1.smithi052.stdout:9/29: fsync d3/f4 0 2023-12-05T13:24:53.754 INFO:tasks.workunit.client.1.smithi052.stdout:9/30: getdents d3 0 2023-12-05T13:24:53.755 INFO:tasks.workunit.client.1.smithi052.stdout:9/31: dread - d3/f4 zero size 2023-12-05T13:24:53.755 INFO:tasks.workunit.client.1.smithi052.stdout:6/45: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.758 INFO:tasks.workunit.client.1.smithi052.stdout:9/32: stat d3/l7 0 2023-12-05T13:24:53.758 INFO:tasks.workunit.client.1.smithi052.stdout:9/33: chown d3/l5 0 1 2023-12-05T13:24:53.758 INFO:tasks.workunit.client.1.smithi052.stdout:0/32: sync 2023-12-05T13:24:53.758 INFO:tasks.workunit.client.1.smithi052.stdout:2/24: sync 2023-12-05T13:24:53.758 INFO:tasks.workunit.client.1.smithi052.stdout:2/25: fdatasync - no filename 2023-12-05T13:24:53.759 INFO:tasks.workunit.client.1.smithi052.stdout:2/26: write - no filename 2023-12-05T13:24:53.759 INFO:tasks.workunit.client.1.smithi052.stdout:2/27: dwrite - no filename 2023-12-05T13:24:53.759 INFO:tasks.workunit.client.1.smithi052.stdout:2/28: dread - no filename 2023-12-05T13:24:53.759 INFO:tasks.workunit.client.1.smithi052.stdout:5/17: sync 2023-12-05T13:24:53.761 INFO:tasks.workunit.client.1.smithi052.stdout:6/46: symlink d3/d5/lb 0 2023-12-05T13:24:53.762 INFO:tasks.workunit.client.1.smithi052.stdout:7/32: dread f4 [0,4194304] 0 2023-12-05T13:24:53.764 INFO:tasks.workunit.client.1.smithi052.stdout:2/29: symlink d2/l7 0 2023-12-05T13:24:53.764 INFO:tasks.workunit.client.1.smithi052.stdout:2/30: fsync - no filename 2023-12-05T13:24:53.766 INFO:tasks.workunit.client.1.smithi052.stdout:5/18: mknod d5/cb 0 2023-12-05T13:24:53.766 INFO:tasks.workunit.client.1.smithi052.stdout:5/19: write d5/fa [684943,108379] 0 2023-12-05T13:24:53.766 INFO:tasks.workunit.client.1.smithi052.stdout:5/20: chown d5/l8 3 1 2023-12-05T13:24:53.770 INFO:tasks.workunit.client.1.smithi052.stdout:6/47: link c2 d3/d4/d6/cc 0 2023-12-05T13:24:53.770 INFO:tasks.workunit.client.1.smithi052.stdout:6/48: truncate d3/d4/d6/f7 5026952 0 2023-12-05T13:24:53.770 INFO:tasks.workunit.client.1.smithi052.stdout:6/49: chown d3/d5/d9 9 1 2023-12-05T13:24:53.770 INFO:tasks.workunit.client.1.smithi052.stdout:6/50: rename d3 to d3/d4/dd 22 2023-12-05T13:24:53.776 INFO:tasks.workunit.client.1.smithi052.stdout:7/33: getdents d7/da 0 2023-12-05T13:24:53.776 INFO:tasks.workunit.client.1.smithi052.stdout:0/33: truncate d0/f4 878736 0 2023-12-05T13:24:53.777 INFO:tasks.workunit.client.1.smithi052.stdout:2/31: creat d2/d4/f8 x:0 0 0 2023-12-05T13:24:53.782 INFO:tasks.workunit.client.1.smithi052.stdout:5/21: dwrite d5/f9 [0,4194304] 0 2023-12-05T13:24:53.782 INFO:tasks.workunit.client.1.smithi052.stdout:5/22: dread - d5/f6 zero size 2023-12-05T13:24:53.789 INFO:tasks.workunit.client.1.smithi052.stdout:7/34: mknod d7/ce 0 2023-12-05T13:24:53.790 INFO:tasks.workunit.client.1.smithi052.stdout:6/51: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.797 INFO:tasks.workunit.client.1.smithi052.stdout:2/32: symlink d2/d4/l9 0 2023-12-05T13:24:53.801 INFO:tasks.workunit.client.1.smithi052.stdout:3/44: truncate f5 4113883 0 2023-12-05T13:24:53.801 INFO:tasks.workunit.client.1.smithi052.stdout:3/45: chown l2 0 1 2023-12-05T13:24:53.802 INFO:tasks.workunit.client.1.smithi052.stdout:5/23: dwrite d5/f9 [0,4194304] 0 2023-12-05T13:24:53.807 INFO:tasks.workunit.client.1.smithi052.stdout:6/52: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.809 INFO:tasks.workunit.client.1.smithi052.stdout:1/62: link d5/d7/cf d5/d7/c10 0 2023-12-05T13:24:53.813 INFO:tasks.workunit.client.1.smithi052.stdout:3/46: mkdir da/dd 0 2023-12-05T13:24:53.816 INFO:tasks.workunit.client.1.smithi052.stdout:5/24: link f4 d5/fc 0 2023-12-05T13:24:53.818 INFO:tasks.workunit.client.1.smithi052.stdout:1/63: dread d5/fc [0,4194304] 0 2023-12-05T13:24:53.830 INFO:tasks.workunit.client.1.smithi052.stdout:6/53: link d3/d4/c8 d3/d4/d6/ce 0 2023-12-05T13:24:53.830 INFO:tasks.workunit.client.1.smithi052.stdout:6/54: chown d3/d5 2 1 2023-12-05T13:24:53.831 INFO:tasks.workunit.client.1.smithi052.stdout:6/55: write d3/d4/d6/f7 [4360762,59061] 0 2023-12-05T13:24:53.833 INFO:tasks.workunit.client.1.smithi052.stdout:0/34: rename d0/db/cc to d0/ce 0 2023-12-05T13:24:53.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/64: dwrite f4 [4194304,4194304] 0 2023-12-05T13:24:53.840 INFO:tasks.workunit.client.1.smithi052.stdout:6/56: unlink d3/d5/lb 0 2023-12-05T13:24:53.840 INFO:tasks.workunit.client.1.smithi052.stdout:6/57: readlink - no filename 2023-12-05T13:24:53.841 INFO:tasks.workunit.client.1.smithi052.stdout:0/35: rename d0 to d0/df 22 2023-12-05T13:24:53.843 INFO:tasks.workunit.client.1.smithi052.stdout:1/65: dread f4 [4194304,4194304] 0 2023-12-05T13:24:53.845 INFO:tasks.workunit.client.1.smithi052.stdout:3/47: truncate f4 2423409 0 2023-12-05T13:24:53.847 INFO:tasks.workunit.client.1.smithi052.stdout:6/58: mkdir d3/d4/df 0 2023-12-05T13:24:53.849 INFO:tasks.workunit.client.1.smithi052.stdout:0/36: write d0/f6 [132845,113040] 0 2023-12-05T13:24:53.851 INFO:tasks.workunit.client.1.smithi052.stdout:1/66: rename c2 to d5/d7/c11 0 2023-12-05T13:24:53.851 INFO:tasks.workunit.client.1.smithi052.stdout:1/67: chown d5/d7/cf 1 1 2023-12-05T13:24:53.854 INFO:tasks.workunit.client.1.smithi052.stdout:6/59: symlink d3/d4/df/l10 0 2023-12-05T13:24:53.855 INFO:tasks.workunit.client.1.smithi052.stdout:0/37: stat d0/c3 0 2023-12-05T13:24:53.857 INFO:tasks.workunit.client.1.smithi052.stdout:1/68: dread f4 [4194304,4194304] 0 2023-12-05T13:24:53.857 INFO:tasks.workunit.client.1.smithi052.stdout:1/69: getdents d5/d7/de 0 2023-12-05T13:24:53.862 INFO:tasks.workunit.client.1.smithi052.stdout:6/60: creat d3/d4/d6/f11 x:0 0 0 2023-12-05T13:24:53.865 INFO:tasks.workunit.client.1.smithi052.stdout:6/61: stat c0 0 2023-12-05T13:24:53.866 INFO:tasks.workunit.client.1.smithi052.stdout:0/38: write d0/fa [1522904,67416] 0 2023-12-05T13:24:53.869 INFO:tasks.workunit.client.1.smithi052.stdout:6/62: rename d3/ca to d3/c12 0 2023-12-05T13:24:53.869 INFO:tasks.workunit.client.1.smithi052.stdout:6/63: fdatasync d3/d4/d6/f11 0 2023-12-05T13:24:53.872 INFO:tasks.workunit.client.1.smithi052.stdout:6/64: rename c0 to d3/d5/c13 0 2023-12-05T13:24:53.874 INFO:tasks.workunit.client.1.smithi052.stdout:7/35: truncate f2 2822580 0 2023-12-05T13:24:53.876 INFO:tasks.workunit.client.1.smithi052.stdout:6/65: mknod d3/c14 0 2023-12-05T13:24:53.876 INFO:tasks.workunit.client.1.smithi052.stdout:6/66: chown d3/d4/df 0 1 2023-12-05T13:24:53.876 INFO:tasks.workunit.client.1.smithi052.stdout:6/67: write d3/d4/d6/f7 [5751134,50057] 0 2023-12-05T13:24:53.879 INFO:tasks.workunit.client.1.smithi052.stdout:2/33: getdents d2/d4 0 2023-12-05T13:24:53.879 INFO:tasks.workunit.client.1.smithi052.stdout:2/34: read - d2/d4/f8 zero size 2023-12-05T13:24:53.879 INFO:tasks.workunit.client.1.smithi052.stdout:1/70: dwrite d5/f8 [4194304,4194304] 0 2023-12-05T13:24:53.884 INFO:tasks.workunit.client.1.smithi052.stdout:0/39: dwrite d0/fa [0,4194304] 0 2023-12-05T13:24:53.884 INFO:tasks.workunit.client.1.smithi052.stdout:6/68: mknod d3/c15 0 2023-12-05T13:24:53.887 INFO:tasks.workunit.client.1.smithi052.stdout:8/63: sync 2023-12-05T13:24:53.887 INFO:tasks.workunit.client.1.smithi052.stdout:4/33: sync 2023-12-05T13:24:53.894 INFO:tasks.workunit.client.1.smithi052.stdout:6/69: dread d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:53.894 INFO:tasks.workunit.client.1.smithi052.stdout:6/70: fdatasync d3/d4/d6/f7 0 2023-12-05T13:24:53.894 INFO:tasks.workunit.client.1.smithi052.stdout:6/71: fdatasync d3/d4/d6/f7 0 2023-12-05T13:24:53.894 INFO:tasks.workunit.client.1.smithi052.stdout:6/72: chown c2 1 1 2023-12-05T13:24:53.894 INFO:tasks.workunit.client.1.smithi052.stdout:5/25: getdents d5 0 2023-12-05T13:24:53.897 INFO:tasks.workunit.client.1.smithi052.stdout:1/71: creat d5/d7/f12 x:0 0 0 2023-12-05T13:24:53.902 INFO:tasks.workunit.client.1.smithi052.stdout:0/40: mknod d0/db/c10 0 2023-12-05T13:24:53.906 INFO:tasks.workunit.client.1.smithi052.stdout:4/34: dwrite fa [0,4194304] 0 2023-12-05T13:24:53.910 INFO:tasks.workunit.client.1.smithi052.stdout:0/41: dread d0/f4 [0,4194304] 0 2023-12-05T13:24:53.910 INFO:tasks.workunit.client.1.smithi052.stdout:1/72: creat d5/d7/f13 x:0 0 0 2023-12-05T13:24:53.910 INFO:tasks.workunit.client.1.smithi052.stdout:6/73: creat d3/f16 x:0 0 0 2023-12-05T13:24:53.914 INFO:tasks.workunit.client.1.smithi052.stdout:8/64: symlink d0/l14 0 2023-12-05T13:24:53.919 INFO:tasks.workunit.client.1.smithi052.stdout:4/35: creat fd x:0 0 0 2023-12-05T13:24:53.920 INFO:tasks.workunit.client.1.smithi052.stdout:0/42: creat d0/f11 x:0 0 0 2023-12-05T13:24:53.921 INFO:tasks.workunit.client.1.smithi052.stdout:0/43: write d0/f6 [1210628,85248] 0 2023-12-05T13:24:53.924 INFO:tasks.workunit.client.1.smithi052.stdout:1/73: dwrite d5/d7/f12 [0,4194304] 0 2023-12-05T13:24:53.924 INFO:tasks.workunit.client.1.smithi052.stdout:1/74: readlink d5/d7/la 0 2023-12-05T13:24:53.926 INFO:tasks.workunit.client.1.smithi052.stdout:8/65: symlink d0/l15 0 2023-12-05T13:24:53.926 INFO:tasks.workunit.client.1.smithi052.stdout:8/66: stat d0/f7 0 2023-12-05T13:24:53.926 INFO:tasks.workunit.client.1.smithi052.stdout:8/67: fdatasync d0/f7 0 2023-12-05T13:24:53.930 INFO:tasks.workunit.client.1.smithi052.stdout:4/36: dread f4 [0,4194304] 0 2023-12-05T13:24:53.930 INFO:tasks.workunit.client.1.smithi052.stdout:4/37: chown c6 129434 1 2023-12-05T13:24:53.930 INFO:tasks.workunit.client.1.smithi052.stdout:4/38: truncate fd 684653 0 2023-12-05T13:24:53.932 INFO:tasks.workunit.client.1.smithi052.stdout:1/75: mkdir d5/d7/de/d14 0 2023-12-05T13:24:53.945 INFO:tasks.workunit.client.1.smithi052.stdout:8/68: dwrite d0/f7 [0,4194304] 0 2023-12-05T13:24:53.950 INFO:tasks.workunit.client.1.smithi052.stdout:4/39: dwrite fa [0,4194304] 0 2023-12-05T13:24:53.951 INFO:tasks.workunit.client.1.smithi052.stdout:3/48: truncate f5 287611 0 2023-12-05T13:24:53.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/40: mkdir de 0 2023-12-05T13:24:53.956 INFO:tasks.workunit.client.1.smithi052.stdout:4/41: getdents de 0 2023-12-05T13:24:53.962 INFO:tasks.workunit.client.1.smithi052.stdout:3/49: creat da/fe x:0 0 0 2023-12-05T13:24:53.962 INFO:tasks.workunit.client.1.smithi052.stdout:3/50: fdatasync f5 0 2023-12-05T13:24:53.963 INFO:tasks.workunit.client.1.smithi052.stdout:1/76: fsync d5/d7/f13 0 2023-12-05T13:24:53.965 INFO:tasks.workunit.client.1.smithi052.stdout:3/51: creat da/ff x:0 0 0 2023-12-05T13:24:53.966 INFO:tasks.workunit.client.1.smithi052.stdout:1/77: symlink d5/d7/l15 0 2023-12-05T13:24:53.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/42: dwrite fa [4194304,4194304] 0 2023-12-05T13:24:53.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/43: truncate f7 839245 0 2023-12-05T13:24:53.969 INFO:tasks.workunit.client.1.smithi052.stdout:4/44: write f4 [676317,119] 0 2023-12-05T13:24:53.969 INFO:tasks.workunit.client.1.smithi052.stdout:4/45: chown fd 260625 1 2023-12-05T13:24:53.970 INFO:tasks.workunit.client.1.smithi052.stdout:4/46: read f4 [1098946,38485] 0 2023-12-05T13:24:53.970 INFO:tasks.workunit.client.1.smithi052.stdout:1/78: rmdir d5/d7/de 39 2023-12-05T13:24:53.975 INFO:tasks.workunit.client.1.smithi052.stdout:3/52: rename l9 to da/dd/l10 0 2023-12-05T13:24:53.975 INFO:tasks.workunit.client.1.smithi052.stdout:3/53: fdatasync da/fe 0 2023-12-05T13:24:53.976 INFO:tasks.workunit.client.1.smithi052.stdout:3/54: write f4 [208440,33485] 0 2023-12-05T13:24:53.976 INFO:tasks.workunit.client.1.smithi052.stdout:3/55: fdatasync f5 0 2023-12-05T13:24:53.977 INFO:tasks.workunit.client.1.smithi052.stdout:8/69: rmdir d0 39 2023-12-05T13:24:53.981 INFO:tasks.workunit.client.1.smithi052.stdout:1/79: mknod d5/d7/de/d14/c16 0 2023-12-05T13:24:53.981 INFO:tasks.workunit.client.1.smithi052.stdout:4/47: rename c6 to de/cf 0 2023-12-05T13:24:53.982 INFO:tasks.workunit.client.1.smithi052.stdout:4/48: write f7 [1346197,86535] 0 2023-12-05T13:24:53.993 INFO:tasks.workunit.client.1.smithi052.stdout:1/80: dread d5/f8 [0,4194304] 0 2023-12-05T13:24:53.994 INFO:tasks.workunit.client.1.smithi052.stdout:8/70: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:24:53.999 INFO:tasks.workunit.client.1.smithi052.stdout:1/81: dread d5/f8 [0,4194304] 0 2023-12-05T13:24:53.999 INFO:tasks.workunit.client.1.smithi052.stdout:4/49: rename l3 to de/l10 0 2023-12-05T13:24:54.001 INFO:tasks.workunit.client.1.smithi052.stdout:8/71: mknod d0/de/d12/c16 0 2023-12-05T13:24:54.001 INFO:tasks.workunit.client.1.smithi052.stdout:9/34: sync 2023-12-05T13:24:54.002 INFO:tasks.workunit.client.1.smithi052.stdout:8/72: dread d0/fa [0,4194304] 0 2023-12-05T13:24:54.003 INFO:tasks.workunit.client.1.smithi052.stdout:1/82: mkdir d5/d7/de/d14/d17 0 2023-12-05T13:24:54.009 INFO:tasks.workunit.client.1.smithi052.stdout:7/36: dwrite f3 [0,4194304] 0 2023-12-05T13:24:54.009 INFO:tasks.workunit.client.1.smithi052.stdout:7/37: chown d7 270 1 2023-12-05T13:24:54.009 INFO:tasks.workunit.client.1.smithi052.stdout:4/50: unlink cb 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:8/73: rmdir d0/de 39 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:3/56: stat l7 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:8/74: fdatasync d0/fc 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:8/75: fsync d0/f5 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:8/76: fsync d0/f11 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:8/77: readlink d0/l14 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:3/57: write f5 [753780,121154] 0 2023-12-05T13:24:54.010 INFO:tasks.workunit.client.1.smithi052.stdout:1/83: mkdir d5/d7/de/d18 0 2023-12-05T13:24:54.011 INFO:tasks.workunit.client.1.smithi052.stdout:4/51: write f7 [1061946,10934] 0 2023-12-05T13:24:54.012 INFO:tasks.workunit.client.1.smithi052.stdout:4/52: write fa [3499482,45439] 0 2023-12-05T13:24:54.012 INFO:tasks.workunit.client.1.smithi052.stdout:4/53: fdatasync fd 0 2023-12-05T13:24:54.015 INFO:tasks.workunit.client.1.smithi052.stdout:8/78: creat d0/de/d12/f17 x:0 0 0 2023-12-05T13:24:54.018 INFO:tasks.workunit.client.1.smithi052.stdout:3/58: stat l2 0 2023-12-05T13:24:54.018 INFO:tasks.workunit.client.1.smithi052.stdout:1/84: chown d5/cb 5432183 1 2023-12-05T13:24:54.022 INFO:tasks.workunit.client.1.smithi052.stdout:9/35: dwrite d3/f4 [0,4194304] 0 2023-12-05T13:24:54.023 INFO:tasks.workunit.client.1.smithi052.stdout:4/54: creat de/f11 x:0 0 0 2023-12-05T13:24:54.023 INFO:tasks.workunit.client.1.smithi052.stdout:4/55: fdatasync f4 0 2023-12-05T13:24:54.025 INFO:tasks.workunit.client.1.smithi052.stdout:3/59: dread f4 [0,4194304] 0 2023-12-05T13:24:54.025 INFO:tasks.workunit.client.1.smithi052.stdout:3/60: truncate da/ff 234945 0 2023-12-05T13:24:54.026 INFO:tasks.workunit.client.1.smithi052.stdout:3/61: dread da/ff [0,4194304] 0 2023-12-05T13:24:54.029 INFO:tasks.workunit.client.1.smithi052.stdout:3/62: dread f5 [0,4194304] 0 2023-12-05T13:24:54.029 INFO:tasks.workunit.client.1.smithi052.stdout:3/63: chown da 2291797 1 2023-12-05T13:24:54.037 INFO:tasks.workunit.client.1.smithi052.stdout:2/35: sync 2023-12-05T13:24:54.043 INFO:tasks.workunit.client.1.smithi052.stdout:3/64: dread da/ff [0,4194304] 0 2023-12-05T13:24:54.044 INFO:tasks.workunit.client.1.smithi052.stdout:4/56: creat de/f12 x:0 0 0 2023-12-05T13:24:54.045 INFO:tasks.workunit.client.1.smithi052.stdout:2/36: symlink d2/d4/la 0 2023-12-05T13:24:54.048 INFO:tasks.workunit.client.1.smithi052.stdout:8/79: link d0/c9 d0/c18 0 2023-12-05T13:24:54.051 INFO:tasks.workunit.client.1.smithi052.stdout:3/65: creat da/f11 x:0 0 0 2023-12-05T13:24:54.052 INFO:tasks.workunit.client.1.smithi052.stdout:2/37: rmdir d2/d4 39 2023-12-05T13:24:54.052 INFO:tasks.workunit.client.1.smithi052.stdout:2/38: readlink d2/d4/l9 0 2023-12-05T13:24:54.053 INFO:tasks.workunit.client.1.smithi052.stdout:4/57: unlink fd 0 2023-12-05T13:24:54.053 INFO:tasks.workunit.client.1.smithi052.stdout:4/58: fdatasync de/f12 0 2023-12-05T13:24:54.059 INFO:tasks.workunit.client.1.smithi052.stdout:8/80: symlink d0/l19 0 2023-12-05T13:24:54.059 INFO:tasks.workunit.client.1.smithi052.stdout:8/81: stat d0/de/d12/f17 0 2023-12-05T13:24:54.066 INFO:tasks.workunit.client.1.smithi052.stdout:2/39: creat d2/fb x:0 0 0 2023-12-05T13:24:54.067 INFO:tasks.workunit.client.1.smithi052.stdout:3/66: rename c6 to da/c12 0 2023-12-05T13:24:54.067 INFO:tasks.workunit.client.1.smithi052.stdout:3/67: chown da/dd/l10 42508262 1 2023-12-05T13:24:54.067 INFO:tasks.workunit.client.1.smithi052.stdout:2/40: rename d2 to d2/dc 22 2023-12-05T13:24:54.074 INFO:tasks.workunit.client.1.smithi052.stdout:2/41: unlink d2/d4/f8 0 2023-12-05T13:24:54.080 INFO:tasks.workunit.client.1.smithi052.stdout:7/38: dwrite d7/da/fb [0,4194304] 0 2023-12-05T13:24:54.094 INFO:tasks.workunit.client.1.smithi052.stdout:2/42: mkdir d2/d4/dd 0 2023-12-05T13:24:54.094 INFO:tasks.workunit.client.1.smithi052.stdout:2/43: fdatasync d2/fb 0 2023-12-05T13:24:54.094 INFO:tasks.workunit.client.1.smithi052.stdout:7/39: write f2 [2891375,86512] 0 2023-12-05T13:24:54.094 INFO:tasks.workunit.client.1.smithi052.stdout:7/40: fsync d7/da/fb 0 2023-12-05T13:24:54.094 INFO:tasks.workunit.client.1.smithi052.stdout:7/41: readlink d7/l8 0 2023-12-05T13:24:54.095 INFO:tasks.workunit.client.1.smithi052.stdout:3/68: dread da/ff [0,4194304] 0 2023-12-05T13:24:54.095 INFO:tasks.workunit.client.1.smithi052.stdout:3/69: read - da/f11 zero size 2023-12-05T13:24:54.106 INFO:tasks.workunit.client.1.smithi052.stdout:4/59: read f4 [1861519,78277] 0 2023-12-05T13:24:54.106 INFO:tasks.workunit.client.1.smithi052.stdout:3/70: symlink da/l13 0 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/71: mknod da/dd/c14 0 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:4/60: unlink c5 0 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:4/61: chown lc 1435 1 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:4/62: chown de/f11 50914754 1 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/72: mknod da/dd/c15 0 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/73: dread - da/fe zero size 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:4/63: symlink de/l13 0 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/74: mknod da/c16 0 2023-12-05T13:24:54.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/75: chown da/dd/l10 37073 1 2023-12-05T13:24:54.118 INFO:tasks.workunit.client.1.smithi052.stdout:3/76: creat da/dd/f17 x:0 0 0 2023-12-05T13:24:54.128 INFO:tasks.workunit.client.1.smithi052.stdout:3/77: creat da/f18 x:0 0 0 2023-12-05T13:24:54.139 INFO:tasks.workunit.client.1.smithi052.stdout:4/64: dread fa [0,4194304] 0 2023-12-05T13:24:54.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/65: creat de/f14 x:0 0 0 2023-12-05T13:24:54.150 INFO:tasks.workunit.client.1.smithi052.stdout:4/66: creat de/f15 x:0 0 0 2023-12-05T13:24:54.150 INFO:tasks.workunit.client.1.smithi052.stdout:4/67: dread - de/f12 zero size 2023-12-05T13:24:54.185 INFO:tasks.workunit.client.1.smithi052.stdout:7/42: fdatasync f3 0 2023-12-05T13:24:54.185 INFO:tasks.workunit.client.1.smithi052.stdout:7/43: rename d7 to d7/da/df 22 2023-12-05T13:24:54.194 INFO:tasks.workunit.client.1.smithi052.stdout:7/44: getdents d7 0 2023-12-05T13:24:54.194 INFO:tasks.workunit.client.1.smithi052.stdout:7/45: chown d7/ce 0 1 2023-12-05T13:24:54.224 INFO:tasks.workunit.client.1.smithi052.stdout:8/82: dwrite d0/fc [0,4194304] 0 2023-12-05T13:24:54.224 INFO:tasks.workunit.client.1.smithi052.stdout:8/83: readlink d0/l15 0 2023-12-05T13:24:54.224 INFO:tasks.workunit.client.1.smithi052.stdout:9/36: write d3/f4 [4426875,105348] 0 2023-12-05T13:24:54.224 INFO:tasks.workunit.client.1.smithi052.stdout:9/37: readlink d3/l5 0 2023-12-05T13:24:54.231 INFO:tasks.workunit.client.1.smithi052.stdout:8/84: rename d0/c2 to d0/de/d12/c1a 0 2023-12-05T13:24:54.237 INFO:tasks.workunit.client.1.smithi052.stdout:7/46: read f4 [740377,128229] 0 2023-12-05T13:24:54.237 INFO:tasks.workunit.client.1.smithi052.stdout:9/38: creat d3/f8 x:0 0 0 2023-12-05T13:24:54.238 INFO:tasks.workunit.client.1.smithi052.stdout:7/47: read f2 [1579033,86156] 0 2023-12-05T13:24:54.238 INFO:tasks.workunit.client.1.smithi052.stdout:7/48: chown d7/c9 319707 1 2023-12-05T13:24:54.239 INFO:tasks.workunit.client.1.smithi052.stdout:7/49: stat d7/cd 0 2023-12-05T13:24:54.239 INFO:tasks.workunit.client.1.smithi052.stdout:7/50: getdents d7/da 0 2023-12-05T13:24:54.239 INFO:tasks.workunit.client.1.smithi052.stdout:8/85: dread d0/fc [0,4194304] 0 2023-12-05T13:24:54.240 INFO:tasks.workunit.client.1.smithi052.stdout:9/39: mknod d3/c9 0 2023-12-05T13:24:54.240 INFO:tasks.workunit.client.1.smithi052.stdout:8/86: write d0/f7 [1783548,55069] 0 2023-12-05T13:24:54.245 INFO:tasks.workunit.client.1.smithi052.stdout:7/51: write f2 [2823026,9547] 0 2023-12-05T13:24:54.249 INFO:tasks.workunit.client.1.smithi052.stdout:7/52: unlink f3 0 2023-12-05T13:24:54.253 INFO:tasks.workunit.client.1.smithi052.stdout:7/53: rename d7/l8 to d7/da/l10 0 2023-12-05T13:24:54.256 INFO:tasks.workunit.client.1.smithi052.stdout:5/26: sync 2023-12-05T13:24:54.259 INFO:tasks.workunit.client.1.smithi052.stdout:7/54: unlink f2 0 2023-12-05T13:24:54.260 INFO:tasks.workunit.client.1.smithi052.stdout:9/40: dread d3/f4 [4194304,4194304] 0 2023-12-05T13:24:54.264 INFO:tasks.workunit.client.1.smithi052.stdout:7/55: truncate f4 1483812 0 2023-12-05T13:24:54.267 INFO:tasks.workunit.client.1.smithi052.stdout:5/27: dread f3 [0,4194304] 0 2023-12-05T13:24:54.270 INFO:tasks.workunit.client.1.smithi052.stdout:5/28: mkdir d5/dd 0 2023-12-05T13:24:54.270 INFO:tasks.workunit.client.1.smithi052.stdout:5/29: getdents d5/dd 0 2023-12-05T13:24:54.270 INFO:tasks.workunit.client.1.smithi052.stdout:5/30: chown d5/f6 2160 1 2023-12-05T13:24:54.270 INFO:tasks.workunit.client.1.smithi052.stdout:5/31: rename d5 to d5/dd/de 22 2023-12-05T13:24:54.275 INFO:tasks.workunit.client.1.smithi052.stdout:3/78: dwrite da/f11 [0,4194304] 0 2023-12-05T13:24:54.279 INFO:tasks.workunit.client.1.smithi052.stdout:8/87: dwrite d0/f7 [0,4194304] 0 2023-12-05T13:24:54.281 INFO:tasks.workunit.client.1.smithi052.stdout:3/79: creat da/dd/f19 x:0 0 0 2023-12-05T13:24:54.281 INFO:tasks.workunit.client.1.smithi052.stdout:3/80: readlink da/l13 0 2023-12-05T13:24:54.281 INFO:tasks.workunit.client.1.smithi052.stdout:3/81: dread - da/dd/f19 zero size 2023-12-05T13:24:54.285 INFO:tasks.workunit.client.1.smithi052.stdout:8/88: rename d0/l15 to d0/de/d12/l1b 0 2023-12-05T13:24:54.298 INFO:tasks.workunit.client.1.smithi052.stdout:3/82: dwrite f4 [0,4194304] 0 2023-12-05T13:24:54.304 INFO:tasks.workunit.client.1.smithi052.stdout:8/89: dwrite d0/de/d12/f17 [0,4194304] 0 2023-12-05T13:24:54.308 INFO:tasks.workunit.client.1.smithi052.stdout:3/83: dread f4 [0,4194304] 0 2023-12-05T13:24:54.311 INFO:tasks.workunit.client.1.smithi052.stdout:8/90: unlink d0/f7 0 2023-12-05T13:24:54.312 INFO:tasks.workunit.client.1.smithi052.stdout:8/91: write d0/f5 [1313450,63134] 0 2023-12-05T13:24:54.313 INFO:tasks.workunit.client.1.smithi052.stdout:3/84: creat da/f1a x:0 0 0 2023-12-05T13:24:54.313 INFO:tasks.workunit.client.1.smithi052.stdout:3/85: read - da/dd/f17 zero size 2023-12-05T13:24:54.318 INFO:tasks.workunit.client.1.smithi052.stdout:3/86: mknod da/c1b 0 2023-12-05T13:24:54.318 INFO:tasks.workunit.client.1.smithi052.stdout:3/87: chown da/lc 415 1 2023-12-05T13:24:54.318 INFO:tasks.workunit.client.1.smithi052.stdout:3/88: chown da/dd 804 1 2023-12-05T13:24:54.318 INFO:tasks.workunit.client.1.smithi052.stdout:3/89: chown da/c1b 1188161 1 2023-12-05T13:24:54.322 INFO:tasks.workunit.client.1.smithi052.stdout:8/92: mknod d0/c1c 0 2023-12-05T13:24:54.322 INFO:tasks.workunit.client.1.smithi052.stdout:8/93: fdatasync d0/f11 0 2023-12-05T13:24:54.322 INFO:tasks.workunit.client.1.smithi052.stdout:8/94: write d0/f3 [876365,115757] 0 2023-12-05T13:24:54.322 INFO:tasks.workunit.client.1.smithi052.stdout:8/95: readlink d0/l14 0 2023-12-05T13:24:54.323 INFO:tasks.workunit.client.1.smithi052.stdout:3/90: dread f4 [0,4194304] 0 2023-12-05T13:24:54.324 INFO:tasks.workunit.client.1.smithi052.stdout:8/96: write d0/fc [4086948,76901] 0 2023-12-05T13:24:54.328 INFO:tasks.workunit.client.1.smithi052.stdout:4/68: rmdir de 39 2023-12-05T13:24:54.328 INFO:tasks.workunit.client.1.smithi052.stdout:6/74: sync 2023-12-05T13:24:54.331 INFO:tasks.workunit.client.1.smithi052.stdout:0/44: sync 2023-12-05T13:24:54.331 INFO:tasks.workunit.client.1.smithi052.stdout:0/45: chown d0/f4 13131984 1 2023-12-05T13:24:54.332 INFO:tasks.workunit.client.1.smithi052.stdout:4/69: unlink de/f15 0 2023-12-05T13:24:54.336 INFO:tasks.workunit.client.1.smithi052.stdout:4/70: dread f7 [0,4194304] 0 2023-12-05T13:24:54.344 INFO:tasks.workunit.client.1.smithi052.stdout:3/91: dwrite da/f1a [0,4194304] 0 2023-12-05T13:24:54.350 INFO:tasks.workunit.client.1.smithi052.stdout:6/75: dwrite d3/d4/d6/f7 [4194304,4194304] 0 2023-12-05T13:24:54.354 INFO:tasks.workunit.client.1.smithi052.stdout:0/46: dwrite d0/fd [0,4194304] 0 2023-12-05T13:24:54.354 INFO:tasks.workunit.client.1.smithi052.stdout:0/47: chown d0/f6 454402463 1 2023-12-05T13:24:54.354 INFO:tasks.workunit.client.1.smithi052.stdout:3/92: link f5 da/f1c 0 2023-12-05T13:24:54.356 INFO:tasks.workunit.client.1.smithi052.stdout:6/76: link d3/f16 d3/d4/f17 0 2023-12-05T13:24:54.357 INFO:tasks.workunit.client.1.smithi052.stdout:6/77: stat c1 0 2023-12-05T13:24:54.358 INFO:tasks.workunit.client.1.smithi052.stdout:4/71: dwrite f4 [0,4194304] 0 2023-12-05T13:24:54.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/48: creat d0/f12 x:0 0 0 2023-12-05T13:24:54.363 INFO:tasks.workunit.client.1.smithi052.stdout:3/93: rename da/f1a to da/dd/f1d 0 2023-12-05T13:24:54.365 INFO:tasks.workunit.client.1.smithi052.stdout:6/78: mknod d3/d4/c18 0 2023-12-05T13:24:54.369 INFO:tasks.workunit.client.1.smithi052.stdout:0/49: creat d0/f13 x:0 0 0 2023-12-05T13:24:54.369 INFO:tasks.workunit.client.1.smithi052.stdout:3/94: mknod da/dd/c1e 0 2023-12-05T13:24:54.372 INFO:tasks.workunit.client.1.smithi052.stdout:6/79: getdents d3 0 2023-12-05T13:24:54.376 INFO:tasks.workunit.client.1.smithi052.stdout:3/95: creat da/f1f x:0 0 0 2023-12-05T13:24:54.377 INFO:tasks.workunit.client.1.smithi052.stdout:4/72: dwrite de/f11 [0,4194304] 0 2023-12-05T13:24:54.377 INFO:tasks.workunit.client.1.smithi052.stdout:4/73: dread - de/f14 zero size 2023-12-05T13:24:54.377 INFO:tasks.workunit.client.1.smithi052.stdout:3/96: read f5 [656840,8518] 0 2023-12-05T13:24:54.377 INFO:tasks.workunit.client.1.smithi052.stdout:6/80: creat d3/f19 x:0 0 0 2023-12-05T13:24:54.378 INFO:tasks.workunit.client.1.smithi052.stdout:6/81: read - d3/f19 zero size 2023-12-05T13:24:54.383 INFO:tasks.workunit.client.1.smithi052.stdout:0/50: dwrite d0/f13 [0,4194304] 0 2023-12-05T13:24:54.384 INFO:tasks.workunit.client.1.smithi052.stdout:4/74: dread fa [4194304,4194304] 0 2023-12-05T13:24:54.385 INFO:tasks.workunit.client.1.smithi052.stdout:6/82: mknod d3/d5/c1a 0 2023-12-05T13:24:54.385 INFO:tasks.workunit.client.1.smithi052.stdout:6/83: readlink d3/d4/df/l10 0 2023-12-05T13:24:54.391 INFO:tasks.workunit.client.1.smithi052.stdout:0/51: mkdir d0/db/d14 0 2023-12-05T13:24:54.391 INFO:tasks.workunit.client.1.smithi052.stdout:0/52: chown d0/db/d14 126504 1 2023-12-05T13:24:54.391 INFO:tasks.workunit.client.1.smithi052.stdout:0/53: write d0/f6 [92739,19314] 0 2023-12-05T13:24:54.393 INFO:tasks.workunit.client.1.smithi052.stdout:4/75: link de/f12 de/f16 0 2023-12-05T13:24:54.393 INFO:tasks.workunit.client.1.smithi052.stdout:4/76: fsync f7 0 2023-12-05T13:24:54.393 INFO:tasks.workunit.client.1.smithi052.stdout:4/77: chown lc 33 1 2023-12-05T13:24:54.394 INFO:tasks.workunit.client.1.smithi052.stdout:6/84: mknod d3/d4/df/c1b 0 2023-12-05T13:24:54.397 INFO:tasks.workunit.client.1.smithi052.stdout:4/78: creat de/f17 x:0 0 0 2023-12-05T13:24:54.397 INFO:tasks.workunit.client.1.smithi052.stdout:0/54: dread d0/fd [0,4194304] 0 2023-12-05T13:24:54.399 INFO:tasks.workunit.client.1.smithi052.stdout:1/85: sync 2023-12-05T13:24:54.401 INFO:tasks.workunit.client.1.smithi052.stdout:4/79: link f7 de/f18 0 2023-12-05T13:24:54.402 INFO:tasks.workunit.client.1.smithi052.stdout:0/55: truncate d0/f4 2953759 0 2023-12-05T13:24:54.403 INFO:tasks.workunit.client.1.smithi052.stdout:9/41: getdents d3 0 2023-12-05T13:24:54.403 INFO:tasks.workunit.client.1.smithi052.stdout:9/42: dread - d3/f8 zero size 2023-12-05T13:24:54.403 INFO:tasks.workunit.client.1.smithi052.stdout:9/43: fsync d3/f4 0 2023-12-05T13:24:54.403 INFO:tasks.workunit.client.1.smithi052.stdout:0/56: write d0/f13 [206925,104065] 0 2023-12-05T13:24:54.404 INFO:tasks.workunit.client.1.smithi052.stdout:1/86: truncate f4 3661190 0 2023-12-05T13:24:54.406 INFO:tasks.workunit.client.1.smithi052.stdout:4/80: link de/f18 de/f19 0 2023-12-05T13:24:54.408 INFO:tasks.workunit.client.1.smithi052.stdout:9/44: symlink d3/la 0 2023-12-05T13:24:54.409 INFO:tasks.workunit.client.1.smithi052.stdout:0/57: readlink d0/l8 0 2023-12-05T13:24:54.411 INFO:tasks.workunit.client.1.smithi052.stdout:4/81: symlink de/l1a 0 2023-12-05T13:24:54.411 INFO:tasks.workunit.client.1.smithi052.stdout:4/82: read - de/f14 zero size 2023-12-05T13:24:54.413 INFO:tasks.workunit.client.1.smithi052.stdout:9/45: creat d3/fb x:0 0 0 2023-12-05T13:24:54.413 INFO:tasks.workunit.client.1.smithi052.stdout:9/46: rename d3 to d3/dc 22 2023-12-05T13:24:54.415 INFO:tasks.workunit.client.1.smithi052.stdout:4/83: rename de/cf to de/c1b 0 2023-12-05T13:24:54.416 INFO:tasks.workunit.client.1.smithi052.stdout:9/47: creat d3/fd x:0 0 0 2023-12-05T13:24:54.418 INFO:tasks.workunit.client.1.smithi052.stdout:0/58: dread d0/f13 [0,4194304] 0 2023-12-05T13:24:54.419 INFO:tasks.workunit.client.1.smithi052.stdout:9/48: symlink d3/le 0 2023-12-05T13:24:54.421 INFO:tasks.workunit.client.1.smithi052.stdout:5/32: getdents d5 0 2023-12-05T13:24:54.422 INFO:tasks.workunit.client.1.smithi052.stdout:5/33: write d5/fc [856561,96446] 0 2023-12-05T13:24:54.423 INFO:tasks.workunit.client.1.smithi052.stdout:9/49: link d3/la d3/lf 0 2023-12-05T13:24:54.426 INFO:tasks.workunit.client.1.smithi052.stdout:5/34: mkdir d5/df 0 2023-12-05T13:24:54.428 INFO:tasks.workunit.client.1.smithi052.stdout:9/50: mknod d3/c10 0 2023-12-05T13:24:54.428 INFO:tasks.workunit.client.1.smithi052.stdout:9/51: dread - d3/fb zero size 2023-12-05T13:24:54.432 INFO:tasks.workunit.client.1.smithi052.stdout:9/52: mkdir d3/d11 0 2023-12-05T13:24:54.444 INFO:tasks.workunit.client.1.smithi052.stdout:2/44: sync 2023-12-05T13:24:54.444 INFO:tasks.workunit.client.1.smithi052.stdout:2/45: write d2/fb [506414,49641] 0 2023-12-05T13:24:54.444 INFO:tasks.workunit.client.1.smithi052.stdout:2/46: chown d2/l7 41 1 2023-12-05T13:24:54.447 INFO:tasks.workunit.client.1.smithi052.stdout:2/47: fsync d2/fb 0 2023-12-05T13:24:54.447 INFO:tasks.workunit.client.1.smithi052.stdout:2/48: rename d2/d4/dd to d2/d4/dd/de 22 2023-12-05T13:24:54.447 INFO:tasks.workunit.client.1.smithi052.stdout:2/49: chown d2/l3 4750 1 2023-12-05T13:24:54.448 INFO:tasks.workunit.client.1.smithi052.stdout:8/97: rmdir d0/de/d12 39 2023-12-05T13:24:54.448 INFO:tasks.workunit.client.1.smithi052.stdout:2/50: write d2/fb [252649,117156] 0 2023-12-05T13:24:54.448 INFO:tasks.workunit.client.1.smithi052.stdout:2/51: chown d2/d4/l5 3 1 2023-12-05T13:24:54.457 INFO:tasks.workunit.client.1.smithi052.stdout:8/98: mknod d0/c1d 0 2023-12-05T13:24:54.457 INFO:tasks.workunit.client.1.smithi052.stdout:2/52: dread d2/fb [0,4194304] 0 2023-12-05T13:24:54.457 INFO:tasks.workunit.client.1.smithi052.stdout:2/53: chown d2/d4 3 1 2023-12-05T13:24:54.457 INFO:tasks.workunit.client.1.smithi052.stdout:2/54: write d2/fb [877204,94880] 0 2023-12-05T13:24:54.459 INFO:tasks.workunit.client.1.smithi052.stdout:8/99: link d0/de/l10 d0/de/l1e 0 2023-12-05T13:24:54.459 INFO:tasks.workunit.client.1.smithi052.stdout:8/100: chown d0/de/l1e 3257866 1 2023-12-05T13:24:54.459 INFO:tasks.workunit.client.1.smithi052.stdout:8/101: write d0/fa [541208,52006] 0 2023-12-05T13:24:54.461 INFO:tasks.workunit.client.1.smithi052.stdout:2/55: unlink d2/d4/l5 0 2023-12-05T13:24:54.462 INFO:tasks.workunit.client.1.smithi052.stdout:9/53: dread d3/f4 [0,4194304] 0 2023-12-05T13:24:54.463 INFO:tasks.workunit.client.1.smithi052.stdout:8/102: creat d0/de/f1f x:0 0 0 2023-12-05T13:24:54.466 INFO:tasks.workunit.client.1.smithi052.stdout:9/54: rename d3/fb to d3/d11/f12 0 2023-12-05T13:24:54.468 INFO:tasks.workunit.client.1.smithi052.stdout:8/103: mkdir d0/de/d12/d20 0 2023-12-05T13:24:54.471 INFO:tasks.workunit.client.1.smithi052.stdout:9/55: creat d3/d11/f13 x:0 0 0 2023-12-05T13:24:54.474 INFO:tasks.workunit.client.1.smithi052.stdout:9/56: unlink d3/lf 0 2023-12-05T13:24:54.474 INFO:tasks.workunit.client.1.smithi052.stdout:9/57: write d3/d11/f13 [374963,87195] 0 2023-12-05T13:24:54.492 INFO:tasks.workunit.client.1.smithi052.stdout:9/58: dwrite d3/d11/f12 [0,4194304] 0 2023-12-05T13:24:54.493 INFO:tasks.workunit.client.1.smithi052.stdout:9/59: chown d3/c6 175 1 2023-12-05T13:24:54.497 INFO:tasks.workunit.client.1.smithi052.stdout:9/60: rename d3/c6 to d3/c14 0 2023-12-05T13:24:54.519 INFO:tasks.workunit.client.1.smithi052.stdout:8/104: read d0/fc [34689,105107] 0 2023-12-05T13:24:54.525 INFO:tasks.workunit.client.1.smithi052.stdout:8/105: rename d0/f3 to d0/f21 0 2023-12-05T13:24:54.526 INFO:tasks.workunit.client.1.smithi052.stdout:8/106: stat d0/f11 0 2023-12-05T13:24:54.529 INFO:tasks.workunit.client.1.smithi052.stdout:7/56: dwrite f4 [0,4194304] 0 2023-12-05T13:24:54.530 INFO:tasks.workunit.client.1.smithi052.stdout:6/85: rmdir d3/d5 39 2023-12-05T13:24:54.531 INFO:tasks.workunit.client.1.smithi052.stdout:5/35: dwrite f1 [0,4194304] 0 2023-12-05T13:24:54.531 INFO:tasks.workunit.client.1.smithi052.stdout:5/36: chown d5/df 200 1 2023-12-05T13:24:54.534 INFO:tasks.workunit.client.1.smithi052.stdout:7/57: unlink f4 0 2023-12-05T13:24:54.536 INFO:tasks.workunit.client.1.smithi052.stdout:6/86: mkdir d3/d5/d9/d1c 0 2023-12-05T13:24:54.536 INFO:tasks.workunit.client.1.smithi052.stdout:6/87: write d3/d4/f17 [367517,81916] 0 2023-12-05T13:24:54.541 INFO:tasks.workunit.client.1.smithi052.stdout:5/37: symlink d5/df/l10 0 2023-12-05T13:24:54.541 INFO:tasks.workunit.client.1.smithi052.stdout:5/38: fdatasync d5/fa 0 2023-12-05T13:24:54.543 INFO:tasks.workunit.client.1.smithi052.stdout:7/58: link d7/da/l10 d7/l11 0 2023-12-05T13:24:54.546 INFO:tasks.workunit.client.1.smithi052.stdout:4/84: fsync de/f17 0 2023-12-05T13:24:54.551 INFO:tasks.workunit.client.1.smithi052.stdout:6/88: creat d3/d4/d6/f1d x:0 0 0 2023-12-05T13:24:54.551 INFO:tasks.workunit.client.1.smithi052.stdout:6/89: dread - d3/f19 zero size 2023-12-05T13:24:54.554 INFO:tasks.workunit.client.1.smithi052.stdout:0/59: write d0/f4 [1326096,74970] 0 2023-12-05T13:24:54.554 INFO:tasks.workunit.client.1.smithi052.stdout:0/60: truncate d0/f11 643919 0 2023-12-05T13:24:54.554 INFO:tasks.workunit.client.1.smithi052.stdout:0/61: chown d0/db/d14 1 1 2023-12-05T13:24:54.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/59: mkdir d7/da/d12 0 2023-12-05T13:24:54.562 INFO:tasks.workunit.client.1.smithi052.stdout:6/90: symlink d3/d5/d9/l1e 0 2023-12-05T13:24:54.563 INFO:tasks.workunit.client.1.smithi052.stdout:0/62: chown d0/c5 320363 1 2023-12-05T13:24:54.564 INFO:tasks.workunit.client.1.smithi052.stdout:0/63: write d0/fa [2562585,53251] 0 2023-12-05T13:24:54.565 INFO:tasks.workunit.client.1.smithi052.stdout:7/60: stat d7/c9 0 2023-12-05T13:24:54.565 INFO:tasks.workunit.client.1.smithi052.stdout:7/61: fsync d7/da/fb 0 2023-12-05T13:24:54.567 INFO:tasks.workunit.client.1.smithi052.stdout:6/91: rename d3/d5/d9/d1c to d3/d1f 0 2023-12-05T13:24:54.569 INFO:tasks.workunit.client.1.smithi052.stdout:7/62: mkdir d7/da/d13 0 2023-12-05T13:24:54.570 INFO:tasks.workunit.client.1.smithi052.stdout:7/63: read d7/da/fb [1398002,62495] 0 2023-12-05T13:24:54.571 INFO:tasks.workunit.client.1.smithi052.stdout:7/64: truncate d7/da/fb 4298657 0 2023-12-05T13:24:54.571 INFO:tasks.workunit.client.1.smithi052.stdout:7/65: chown d7/c9 30438574 1 2023-12-05T13:24:54.571 INFO:tasks.workunit.client.1.smithi052.stdout:0/64: dread d0/fa [0,4194304] 0 2023-12-05T13:24:54.573 INFO:tasks.workunit.client.1.smithi052.stdout:7/66: unlink d7/cd 0 2023-12-05T13:24:54.573 INFO:tasks.workunit.client.1.smithi052.stdout:7/67: write d7/da/fb [4967030,86589] 0 2023-12-05T13:24:54.573 INFO:tasks.workunit.client.1.smithi052.stdout:5/39: getdents d5 0 2023-12-05T13:24:54.573 INFO:tasks.workunit.client.1.smithi052.stdout:5/40: fsync f3 0 2023-12-05T13:24:54.575 INFO:tasks.workunit.client.1.smithi052.stdout:7/68: fsync d7/da/fb 0 2023-12-05T13:24:54.577 INFO:tasks.workunit.client.1.smithi052.stdout:0/65: symlink d0/db/d14/l15 0 2023-12-05T13:24:54.580 INFO:tasks.workunit.client.1.smithi052.stdout:5/41: mkdir d5/df/d11 0 2023-12-05T13:24:54.582 INFO:tasks.workunit.client.1.smithi052.stdout:7/69: creat d7/da/f14 x:0 0 0 2023-12-05T13:24:54.582 INFO:tasks.workunit.client.1.smithi052.stdout:7/70: truncate d7/da/fb 5966002 0 2023-12-05T13:24:54.582 INFO:tasks.workunit.client.1.smithi052.stdout:7/71: dread - d7/da/f14 zero size 2023-12-05T13:24:54.582 INFO:tasks.workunit.client.1.smithi052.stdout:7/72: fsync d7/da/fb 0 2023-12-05T13:24:54.585 INFO:tasks.workunit.client.1.smithi052.stdout:0/66: rename d0/ce to d0/db/c16 0 2023-12-05T13:24:54.587 INFO:tasks.workunit.client.1.smithi052.stdout:5/42: mkdir d5/df/d12 0 2023-12-05T13:24:54.590 INFO:tasks.workunit.client.1.smithi052.stdout:7/73: link c5 d7/da/c15 0 2023-12-05T13:24:54.593 INFO:tasks.workunit.client.1.smithi052.stdout:7/74: mkdir d7/da/d13/d16 0 2023-12-05T13:24:54.604 INFO:tasks.workunit.client.1.smithi052.stdout:7/75: dread d7/da/fb [0,4194304] 0 2023-12-05T13:24:54.605 INFO:tasks.workunit.client.1.smithi052.stdout:9/61: unlink d3/d11/f12 0 2023-12-05T13:24:54.607 INFO:tasks.workunit.client.1.smithi052.stdout:7/76: creat d7/da/d13/f17 x:0 0 0 2023-12-05T13:24:54.607 INFO:tasks.workunit.client.1.smithi052.stdout:7/77: write d7/da/f14 [360606,113328] 0 2023-12-05T13:24:54.608 INFO:tasks.workunit.client.1.smithi052.stdout:2/56: truncate d2/fb 86718 0 2023-12-05T13:24:54.609 INFO:tasks.workunit.client.1.smithi052.stdout:9/62: creat d3/f15 x:0 0 0 2023-12-05T13:24:54.611 INFO:tasks.workunit.client.1.smithi052.stdout:7/78: dread d7/da/f14 [0,4194304] 0 2023-12-05T13:24:54.612 INFO:tasks.workunit.client.1.smithi052.stdout:2/57: link d2/d4/l9 d2/lf 0 2023-12-05T13:24:54.614 INFO:tasks.workunit.client.1.smithi052.stdout:9/63: creat d3/d11/f16 x:0 0 0 2023-12-05T13:24:54.618 INFO:tasks.workunit.client.1.smithi052.stdout:9/64: link d3/l5 d3/d11/l17 0 2023-12-05T13:24:54.622 INFO:tasks.workunit.client.1.smithi052.stdout:9/65: mknod d3/d11/c18 0 2023-12-05T13:24:54.632 INFO:tasks.workunit.client.1.smithi052.stdout:7/79: dwrite d7/da/f14 [0,4194304] 0 2023-12-05T13:24:54.632 INFO:tasks.workunit.client.1.smithi052.stdout:7/80: rename d7/da to d7/da/d18 22 2023-12-05T13:24:54.632 INFO:tasks.workunit.client.1.smithi052.stdout:7/81: dread - d7/da/d13/f17 zero size 2023-12-05T13:24:54.639 INFO:tasks.workunit.client.1.smithi052.stdout:9/66: dwrite d3/d11/f16 [0,4194304] 0 2023-12-05T13:24:54.639 INFO:tasks.workunit.client.1.smithi052.stdout:9/67: write d3/f8 [608720,96526] 0 2023-12-05T13:24:54.645 INFO:tasks.workunit.client.1.smithi052.stdout:9/68: mkdir d3/d11/d19 0 2023-12-05T13:24:54.646 INFO:tasks.workunit.client.1.smithi052.stdout:9/69: truncate d3/d11/f13 1114801 0 2023-12-05T13:24:54.646 INFO:tasks.workunit.client.1.smithi052.stdout:9/70: dread - d3/f15 zero size 2023-12-05T13:24:54.662 INFO:tasks.workunit.client.1.smithi052.stdout:9/71: dwrite d3/d11/f16 [0,4194304] 0 2023-12-05T13:24:54.697 INFO:tasks.workunit.client.1.smithi052.stdout:5/43: dread f1 [0,4194304] 0 2023-12-05T13:24:54.698 INFO:tasks.workunit.client.1.smithi052.stdout:1/87: dwrite f4 [0,4194304] 0 2023-12-05T13:24:54.699 INFO:tasks.workunit.client.1.smithi052.stdout:5/44: symlink d5/df/l13 0 2023-12-05T13:24:54.701 INFO:tasks.workunit.client.1.smithi052.stdout:0/67: dwrite d0/f11 [0,4194304] 0 2023-12-05T13:24:54.703 INFO:tasks.workunit.client.1.smithi052.stdout:5/45: creat d5/f14 x:0 0 0 2023-12-05T13:24:54.704 INFO:tasks.workunit.client.1.smithi052.stdout:5/46: chown d5/df/l10 1 1 2023-12-05T13:24:54.707 INFO:tasks.workunit.client.1.smithi052.stdout:1/88: dread d5/f8 [4194304,4194304] 0 2023-12-05T13:24:54.707 INFO:tasks.workunit.client.1.smithi052.stdout:1/89: chown d5/d7/l15 916 1 2023-12-05T13:24:54.707 INFO:tasks.workunit.client.1.smithi052.stdout:1/90: chown d5/d7/la 49 1 2023-12-05T13:24:54.715 INFO:tasks.workunit.client.1.smithi052.stdout:0/68: chown d0/f9 25 1 2023-12-05T13:24:54.715 INFO:tasks.workunit.client.1.smithi052.stdout:0/69: write d0/f9 [1049936,111911] 0 2023-12-05T13:24:54.718 INFO:tasks.workunit.client.1.smithi052.stdout:5/47: unlink f1 0 2023-12-05T13:24:54.720 INFO:tasks.workunit.client.1.smithi052.stdout:0/70: creat d0/f17 x:0 0 0 2023-12-05T13:24:54.721 INFO:tasks.workunit.client.1.smithi052.stdout:7/82: fsync d7/da/f14 0 2023-12-05T13:24:54.722 INFO:tasks.workunit.client.1.smithi052.stdout:0/71: rmdir d0/db/d14 39 2023-12-05T13:24:54.723 INFO:tasks.workunit.client.1.smithi052.stdout:0/72: dread - d0/f17 zero size 2023-12-05T13:24:54.728 INFO:tasks.workunit.client.1.smithi052.stdout:7/83: creat d7/da/d13/f19 x:0 0 0 2023-12-05T13:24:54.728 INFO:tasks.workunit.client.1.smithi052.stdout:7/84: dread - d7/da/d13/f17 zero size 2023-12-05T13:24:54.728 INFO:tasks.workunit.client.1.smithi052.stdout:1/91: dwrite f4 [0,4194304] 0 2023-12-05T13:24:54.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/85: creat d7/da/f1a x:0 0 0 2023-12-05T13:24:54.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/86: chown d7/da/d13/d16 54573939 1 2023-12-05T13:24:54.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/87: readlink d7/l11 0 2023-12-05T13:24:54.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/88: readlink d7/da/l10 0 2023-12-05T13:24:54.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/89: dread - d7/da/f1a zero size 2023-12-05T13:24:54.735 INFO:tasks.workunit.client.1.smithi052.stdout:1/92: mknod d5/d7/de/d14/d17/c19 0 2023-12-05T13:24:54.735 INFO:tasks.workunit.client.1.smithi052.stdout:1/93: read d5/fc [2332865,14202] 0 2023-12-05T13:24:54.739 INFO:tasks.workunit.client.1.smithi052.stdout:7/90: rename c6 to d7/da/c1b 0 2023-12-05T13:24:54.739 INFO:tasks.workunit.client.1.smithi052.stdout:7/91: chown d7/da/d13/f17 144800727 1 2023-12-05T13:24:54.739 INFO:tasks.workunit.client.1.smithi052.stdout:7/92: fdatasync d7/da/f1a 0 2023-12-05T13:24:54.741 INFO:tasks.workunit.client.1.smithi052.stdout:1/94: dread d5/f8 [0,4194304] 0 2023-12-05T13:24:54.741 INFO:tasks.workunit.client.1.smithi052.stdout:1/95: readlink d5/d7/la 0 2023-12-05T13:24:54.741 INFO:tasks.workunit.client.1.smithi052.stdout:1/96: chown d5/d7/de 1 1 2023-12-05T13:24:54.741 INFO:tasks.workunit.client.1.smithi052.stdout:7/93: mknod d7/da/d13/d16/c1c 0 2023-12-05T13:24:54.743 INFO:tasks.workunit.client.1.smithi052.stdout:0/73: dwrite d0/fd [4194304,4194304] 0 2023-12-05T13:24:54.744 INFO:tasks.workunit.client.1.smithi052.stdout:0/74: write d0/f11 [1109743,127016] 0 2023-12-05T13:24:54.744 INFO:tasks.workunit.client.1.smithi052.stdout:0/75: chown d0/db/d14 0 1 2023-12-05T13:24:54.744 INFO:tasks.workunit.client.1.smithi052.stdout:1/97: truncate d5/fc 695290 0 2023-12-05T13:24:54.746 INFO:tasks.workunit.client.1.smithi052.stdout:0/76: fdatasync d0/f11 0 2023-12-05T13:24:54.746 INFO:tasks.workunit.client.1.smithi052.stdout:7/94: truncate d7/da/fb 5350127 0 2023-12-05T13:24:54.748 INFO:tasks.workunit.client.1.smithi052.stdout:2/58: write d2/fb [647350,15672] 0 2023-12-05T13:24:54.750 INFO:tasks.workunit.client.1.smithi052.stdout:1/98: symlink d5/d7/l1a 0 2023-12-05T13:24:54.750 INFO:tasks.workunit.client.1.smithi052.stdout:1/99: chown d5/ld 50802595 1 2023-12-05T13:24:54.753 INFO:tasks.workunit.client.1.smithi052.stdout:0/77: unlink d0/db/d14/l15 0 2023-12-05T13:24:54.753 INFO:tasks.workunit.client.1.smithi052.stdout:0/78: read d0/fa [657540,65241] 0 2023-12-05T13:24:54.758 INFO:tasks.workunit.client.1.smithi052.stdout:2/59: unlink d2/l7 0 2023-12-05T13:24:54.762 INFO:tasks.workunit.client.1.smithi052.stdout:1/100: symlink d5/d7/l1b 0 2023-12-05T13:24:54.763 INFO:tasks.workunit.client.1.smithi052.stdout:2/60: mknod d2/d4/dd/c10 0 2023-12-05T13:24:54.763 INFO:tasks.workunit.client.1.smithi052.stdout:2/61: chown d2/d4/l9 59802 1 2023-12-05T13:24:54.766 INFO:tasks.workunit.client.1.smithi052.stdout:1/101: mkdir d5/d7/de/d14/d17/d1c 0 2023-12-05T13:24:54.769 INFO:tasks.workunit.client.1.smithi052.stdout:2/62: dread d2/fb [0,4194304] 0 2023-12-05T13:24:54.769 INFO:tasks.workunit.client.1.smithi052.stdout:7/95: dwrite d7/da/f1a [0,4194304] 0 2023-12-05T13:24:54.770 INFO:tasks.workunit.client.1.smithi052.stdout:1/102: rmdir d5/d7/de/d14/d17/d1c 0 2023-12-05T13:24:54.771 INFO:tasks.workunit.client.1.smithi052.stdout:0/79: dwrite d0/f9 [0,4194304] 0 2023-12-05T13:24:54.772 INFO:tasks.workunit.client.1.smithi052.stdout:2/63: creat d2/f11 x:0 0 0 2023-12-05T13:24:54.776 INFO:tasks.workunit.client.1.smithi052.stdout:7/96: mknod d7/da/c1d 0 2023-12-05T13:24:54.778 INFO:tasks.workunit.client.1.smithi052.stdout:1/103: unlink d5/ld 0 2023-12-05T13:24:54.779 INFO:tasks.workunit.client.1.smithi052.stdout:0/80: symlink d0/db/l18 0 2023-12-05T13:24:54.781 INFO:tasks.workunit.client.1.smithi052.stdout:2/64: mknod d2/c12 0 2023-12-05T13:24:54.781 INFO:tasks.workunit.client.1.smithi052.stdout:2/65: chown d2/lf 0 1 2023-12-05T13:24:54.782 INFO:tasks.workunit.client.1.smithi052.stdout:7/97: symlink d7/l1e 0 2023-12-05T13:24:54.784 INFO:tasks.workunit.client.1.smithi052.stdout:1/104: symlink d5/d7/de/d18/l1d 0 2023-12-05T13:24:54.786 INFO:tasks.workunit.client.1.smithi052.stdout:0/81: symlink d0/db/d14/l19 0 2023-12-05T13:24:54.786 INFO:tasks.workunit.client.1.smithi052.stdout:9/72: rmdir d3 39 2023-12-05T13:24:54.787 INFO:tasks.workunit.client.1.smithi052.stdout:0/82: write d0/f9 [3505125,30207] 0 2023-12-05T13:24:54.788 INFO:tasks.workunit.client.1.smithi052.stdout:2/66: mkdir d2/d13 0 2023-12-05T13:24:54.793 INFO:tasks.workunit.client.1.smithi052.stdout:2/67: write d2/fb [240103,62411] 0 2023-12-05T13:24:54.793 INFO:tasks.workunit.client.1.smithi052.stdout:2/68: dread - d2/f11 zero size 2023-12-05T13:24:54.793 INFO:tasks.workunit.client.1.smithi052.stdout:0/83: unlink d0/db/c10 0 2023-12-05T13:24:54.794 INFO:tasks.workunit.client.1.smithi052.stdout:7/98: dwrite d7/da/d13/f19 [0,4194304] 0 2023-12-05T13:24:54.795 INFO:tasks.workunit.client.1.smithi052.stdout:1/105: rename d5/d7/de/d14/c16 to d5/c1e 0 2023-12-05T13:24:54.798 INFO:tasks.workunit.client.1.smithi052.stdout:2/69: unlink d2/lf 0 2023-12-05T13:24:54.798 INFO:tasks.workunit.client.1.smithi052.stdout:0/84: dread d0/fd [0,4194304] 0 2023-12-05T13:24:54.801 INFO:tasks.workunit.client.1.smithi052.stdout:9/73: dwrite d3/f8 [0,4194304] 0 2023-12-05T13:24:54.801 INFO:tasks.workunit.client.1.smithi052.stdout:9/74: dread - d3/fd zero size 2023-12-05T13:24:54.802 INFO:tasks.workunit.client.1.smithi052.stdout:2/70: write d2/fb [641643,94651] 0 2023-12-05T13:24:54.808 INFO:tasks.workunit.client.1.smithi052.stdout:7/99: dwrite d7/da/d13/f17 [0,4194304] 0 2023-12-05T13:24:54.808 INFO:tasks.workunit.client.1.smithi052.stdout:7/100: readlink d7/l11 0 2023-12-05T13:24:54.816 INFO:tasks.workunit.client.1.smithi052.stdout:9/75: unlink d3/d11/f16 0 2023-12-05T13:24:54.816 INFO:tasks.workunit.client.1.smithi052.stdout:0/85: rename d0/f12 to d0/f1a 0 2023-12-05T13:24:54.816 INFO:tasks.workunit.client.1.smithi052.stdout:9/76: dread - d3/fd zero size 2023-12-05T13:24:54.816 INFO:tasks.workunit.client.1.smithi052.stdout:9/77: getdents d3/d11/d19 0 2023-12-05T13:24:54.816 INFO:tasks.workunit.client.1.smithi052.stdout:9/78: chown d3/f4 1738 1 2023-12-05T13:24:54.821 INFO:tasks.workunit.client.1.smithi052.stdout:7/101: creat d7/da/f1f x:0 0 0 2023-12-05T13:24:54.840 INFO:tasks.workunit.client.1.smithi052.stdout:7/102: dwrite d7/da/f1a [0,4194304] 0 2023-12-05T13:24:54.840 INFO:tasks.workunit.client.1.smithi052.stdout:7/103: chown d7/da/f1f 33817 1 2023-12-05T13:24:54.845 INFO:tasks.workunit.client.1.smithi052.stdout:7/104: symlink d7/da/d13/d16/l20 0 2023-12-05T13:24:54.845 INFO:tasks.workunit.client.1.smithi052.stdout:7/105: chown d7/da/d13/f17 33 1 2023-12-05T13:24:54.846 INFO:tasks.workunit.client.1.smithi052.stdout:7/106: read d7/da/f1a [2424202,126896] 0 2023-12-05T13:24:54.869 INFO:tasks.workunit.client.1.smithi052.stdout:3/97: sync 2023-12-05T13:24:54.869 INFO:tasks.workunit.client.1.smithi052.stdout:8/107: sync 2023-12-05T13:24:54.869 INFO:tasks.workunit.client.1.smithi052.stdout:3/98: fsync f4 0 2023-12-05T13:24:54.870 INFO:tasks.workunit.client.1.smithi052.stdout:3/99: dread da/ff [0,4194304] 0 2023-12-05T13:24:54.870 INFO:tasks.workunit.client.1.smithi052.stdout:8/108: creat d0/de/f22 x:0 0 0 2023-12-05T13:24:54.870 INFO:tasks.workunit.client.1.smithi052.stdout:8/109: readlink d0/l4 0 2023-12-05T13:24:54.871 INFO:tasks.workunit.client.1.smithi052.stdout:8/110: write d0/de/f22 [355965,51299] 0 2023-12-05T13:24:54.872 INFO:tasks.workunit.client.1.smithi052.stdout:3/100: mknod da/c20 0 2023-12-05T13:24:54.874 INFO:tasks.workunit.client.1.smithi052.stdout:8/111: symlink d0/de/l23 0 2023-12-05T13:24:54.877 INFO:tasks.workunit.client.1.smithi052.stdout:8/112: mknod d0/de/d12/d20/c24 0 2023-12-05T13:24:54.879 INFO:tasks.workunit.client.1.smithi052.stdout:8/113: symlink d0/de/l25 0 2023-12-05T13:24:54.880 INFO:tasks.workunit.client.1.smithi052.stdout:8/114: chown d0/de/d12/c1a 3 1 2023-12-05T13:24:54.906 INFO:tasks.workunit.client.1.smithi052.stdout:2/71: rename d2/d4/dd to d2/d14 0 2023-12-05T13:24:54.908 INFO:tasks.workunit.client.1.smithi052.stdout:9/79: rename d3/f8 to d3/d11/f1a 0 2023-12-05T13:24:54.917 INFO:tasks.workunit.client.1.smithi052.stdout:8/115: rename d0/de/d12/l1b to d0/l26 0 2023-12-05T13:24:54.921 INFO:tasks.workunit.client.1.smithi052.stdout:9/80: dwrite d3/f15 [0,4194304] 0 2023-12-05T13:24:54.923 INFO:tasks.workunit.client.1.smithi052.stdout:2/72: rename d2/l3 to d2/d14/l15 0 2023-12-05T13:24:54.932 INFO:tasks.workunit.client.1.smithi052.stdout:2/73: rename d2/f11 to d2/d13/f16 0 2023-12-05T13:24:54.932 INFO:tasks.workunit.client.1.smithi052.stdout:2/74: write d2/d13/f16 [984064,16384] 0 2023-12-05T13:24:54.932 INFO:tasks.workunit.client.1.smithi052.stdout:2/75: chown d2/fb 15 1 2023-12-05T13:24:54.932 INFO:tasks.workunit.client.1.smithi052.stdout:2/76: chown d2/d14 11279606 1 2023-12-05T13:24:54.935 INFO:tasks.workunit.client.1.smithi052.stdout:8/116: dwrite d0/f11 [0,4194304] 0 2023-12-05T13:24:54.937 INFO:tasks.workunit.client.1.smithi052.stdout:2/77: dread d2/d13/f16 [0,4194304] 0 2023-12-05T13:24:54.939 INFO:tasks.workunit.client.1.smithi052.stdout:2/78: dread d2/fb [0,4194304] 0 2023-12-05T13:24:54.943 INFO:tasks.workunit.client.1.smithi052.stdout:2/79: write d2/d13/f16 [785033,75668] 0 2023-12-05T13:24:54.945 INFO:tasks.workunit.client.1.smithi052.stdout:2/80: creat d2/d13/f17 x:0 0 0 2023-12-05T13:24:54.945 INFO:tasks.workunit.client.1.smithi052.stdout:2/81: truncate d2/fb 1386441 0 2023-12-05T13:24:54.945 INFO:tasks.workunit.client.1.smithi052.stdout:8/117: dread d0/f5 [0,4194304] 0 2023-12-05T13:24:54.948 INFO:tasks.workunit.client.1.smithi052.stdout:0/86: write d0/f9 [5203411,74917] 0 2023-12-05T13:24:54.949 INFO:tasks.workunit.client.1.smithi052.stdout:8/118: mkdir d0/de/d27 0 2023-12-05T13:24:54.958 INFO:tasks.workunit.client.1.smithi052.stdout:0/87: mkdir d0/db/d1b 0 2023-12-05T13:24:54.965 INFO:tasks.workunit.client.1.smithi052.stdout:8/119: mkdir d0/d28 0 2023-12-05T13:24:54.967 INFO:tasks.workunit.client.1.smithi052.stdout:0/88: mknod d0/c1c 0 2023-12-05T13:24:54.968 INFO:tasks.workunit.client.1.smithi052.stdout:9/81: dwrite d3/d11/f1a [4194304,4194304] 0 2023-12-05T13:24:54.968 INFO:tasks.workunit.client.1.smithi052.stdout:9/82: chown d3/d11 46 1 2023-12-05T13:24:54.968 INFO:tasks.workunit.client.1.smithi052.stdout:9/83: write d3/d11/f13 [1235601,59560] 0 2023-12-05T13:24:54.968 INFO:tasks.workunit.client.1.smithi052.stdout:8/120: mkdir d0/de/d12/d29 0 2023-12-05T13:24:54.970 INFO:tasks.workunit.client.1.smithi052.stdout:0/89: symlink d0/db/l1d 0 2023-12-05T13:24:54.980 INFO:tasks.workunit.client.1.smithi052.stdout:9/84: dread d3/f15 [0,4194304] 0 2023-12-05T13:24:54.980 INFO:tasks.workunit.client.1.smithi052.stdout:9/85: fdatasync d3/d11/f1a 0 2023-12-05T13:24:54.981 INFO:tasks.workunit.client.1.smithi052.stdout:9/86: write d3/f4 [3543789,95348] 0 2023-12-05T13:24:54.984 INFO:tasks.workunit.client.1.smithi052.stdout:8/121: dwrite d0/fa [0,4194304] 0 2023-12-05T13:24:54.987 INFO:tasks.workunit.client.1.smithi052.stdout:9/87: mknod d3/d11/c1b 0 2023-12-05T13:24:54.990 INFO:tasks.workunit.client.1.smithi052.stdout:0/90: dwrite d0/f11 [0,4194304] 0 2023-12-05T13:24:54.992 INFO:tasks.workunit.client.1.smithi052.stdout:8/122: creat d0/d28/f2a x:0 0 0 2023-12-05T13:24:54.994 INFO:tasks.workunit.client.1.smithi052.stdout:0/91: mknod d0/db/d1b/c1e 0 2023-12-05T13:24:55.002 INFO:tasks.workunit.client.1.smithi052.stdout:0/92: creat d0/db/f1f x:0 0 0 2023-12-05T13:24:55.002 INFO:tasks.workunit.client.1.smithi052.stdout:0/93: readlink d0/l8 0 2023-12-05T13:24:55.004 INFO:tasks.workunit.client.1.smithi052.stdout:0/94: stat d0/c7 0 2023-12-05T13:24:55.006 INFO:tasks.workunit.client.1.smithi052.stdout:9/88: dwrite d3/d11/f13 [0,4194304] 0 2023-12-05T13:24:55.007 INFO:tasks.workunit.client.1.smithi052.stdout:9/89: write d3/d11/f13 [3865687,5402] 0 2023-12-05T13:24:55.008 INFO:tasks.workunit.client.1.smithi052.stdout:9/90: write d3/f4 [148113,67513] 0 2023-12-05T13:24:55.012 INFO:tasks.workunit.client.1.smithi052.stdout:8/123: dwrite d0/f21 [0,4194304] 0 2023-12-05T13:24:55.012 INFO:tasks.workunit.client.1.smithi052.stdout:8/124: write d0/de/f1f [438762,77767] 0 2023-12-05T13:24:55.012 INFO:tasks.workunit.client.1.smithi052.stdout:9/91: symlink d3/l1c 0 2023-12-05T13:24:55.019 INFO:tasks.workunit.client.1.smithi052.stdout:8/125: mkdir d0/d28/d2b 0 2023-12-05T13:24:55.022 INFO:tasks.workunit.client.1.smithi052.stdout:9/92: rename d3/d11/l17 to d3/d11/d19/l1d 0 2023-12-05T13:24:55.022 INFO:tasks.workunit.client.1.smithi052.stdout:9/93: truncate d3/fd 954068 0 2023-12-05T13:24:55.022 INFO:tasks.workunit.client.1.smithi052.stdout:0/95: dwrite d0/f17 [0,4194304] 0 2023-12-05T13:24:55.023 INFO:tasks.workunit.client.1.smithi052.stdout:0/96: read d0/fd [2822271,57022] 0 2023-12-05T13:24:55.023 INFO:tasks.workunit.client.1.smithi052.stdout:0/97: fsync d0/f17 0 2023-12-05T13:24:55.025 INFO:tasks.workunit.client.1.smithi052.stdout:8/126: dread d0/f5 [0,4194304] 0 2023-12-05T13:24:55.025 INFO:tasks.workunit.client.1.smithi052.stdout:9/94: mkdir d3/d1e 0 2023-12-05T13:24:55.025 INFO:tasks.workunit.client.1.smithi052.stdout:9/95: fsync d3/f15 0 2023-12-05T13:24:55.029 INFO:tasks.workunit.client.1.smithi052.stdout:0/98: mkdir d0/db/d20 0 2023-12-05T13:24:55.033 INFO:tasks.workunit.client.1.smithi052.stdout:9/96: creat d3/d1e/f1f x:0 0 0 2023-12-05T13:24:55.033 INFO:tasks.workunit.client.1.smithi052.stdout:9/97: stat d3/d11/c1b 0 2023-12-05T13:24:55.035 INFO:tasks.workunit.client.1.smithi052.stdout:0/99: rename d0/f13 to d0/db/d20/f21 0 2023-12-05T13:24:55.041 INFO:tasks.workunit.client.1.smithi052.stdout:9/98: creat d3/f20 x:0 0 0 2023-12-05T13:24:55.043 INFO:tasks.workunit.client.1.smithi052.stdout:0/100: symlink d0/db/d1b/l22 0 2023-12-05T13:24:55.045 INFO:tasks.workunit.client.1.smithi052.stdout:8/127: link d0/c1 d0/c2c 0 2023-12-05T13:24:55.046 INFO:tasks.workunit.client.1.smithi052.stdout:8/128: write d0/f11 [3184669,77114] 0 2023-12-05T13:24:55.048 INFO:tasks.workunit.client.1.smithi052.stdout:9/99: dread d3/d11/f1a [0,4194304] 0 2023-12-05T13:24:55.052 INFO:tasks.workunit.client.1.smithi052.stdout:8/129: mknod d0/c2d 0 2023-12-05T13:24:55.052 INFO:tasks.workunit.client.1.smithi052.stdout:8/130: stat d0/de/f22 0 2023-12-05T13:24:55.052 INFO:tasks.workunit.client.1.smithi052.stdout:0/101: dread d0/f11 [0,4194304] 0 2023-12-05T13:24:55.056 INFO:tasks.workunit.client.1.smithi052.stdout:8/131: creat d0/de/d12/f2e x:0 0 0 2023-12-05T13:24:55.060 INFO:tasks.workunit.client.1.smithi052.stdout:0/102: creat d0/f23 x:0 0 0 2023-12-05T13:24:55.060 INFO:tasks.workunit.client.1.smithi052.stdout:0/103: write d0/f9 [5726242,48853] 0 2023-12-05T13:24:55.068 INFO:tasks.workunit.client.1.smithi052.stdout:0/104: symlink d0/db/d20/l24 0 2023-12-05T13:24:55.069 INFO:tasks.workunit.client.1.smithi052.stdout:0/105: chown d0/db/c16 24944 1 2023-12-05T13:24:55.069 INFO:tasks.workunit.client.1.smithi052.stdout:0/106: dread - d0/db/f1f zero size 2023-12-05T13:24:55.069 INFO:tasks.workunit.client.1.smithi052.stdout:0/107: fdatasync d0/db/f1f 0 2023-12-05T13:24:55.069 INFO:tasks.workunit.client.1.smithi052.stdout:0/108: readlink d0/db/d1b/l22 0 2023-12-05T13:24:55.072 INFO:tasks.workunit.client.1.smithi052.stdout:0/109: rename d0/l8 to d0/db/l25 0 2023-12-05T13:24:55.074 INFO:tasks.workunit.client.1.smithi052.stdout:6/92: sync 2023-12-05T13:24:55.074 INFO:tasks.workunit.client.1.smithi052.stdout:4/85: sync 2023-12-05T13:24:55.075 INFO:tasks.workunit.client.1.smithi052.stdout:0/110: creat d0/db/d14/f26 x:0 0 0 2023-12-05T13:24:55.077 INFO:tasks.workunit.client.1.smithi052.stdout:6/93: rmdir d3/d5 39 2023-12-05T13:24:55.080 INFO:tasks.workunit.client.1.smithi052.stdout:0/111: creat d0/db/d1b/f27 x:0 0 0 2023-12-05T13:24:55.092 INFO:tasks.workunit.client.1.smithi052.stdout:2/82: getdents d2/d14 0 2023-12-05T13:24:55.092 INFO:tasks.workunit.client.1.smithi052.stdout:0/112: rename d0/f9 to d0/db/d14/f28 0 2023-12-05T13:24:55.093 INFO:tasks.workunit.client.1.smithi052.stdout:0/113: chown d0/db/d1b/f27 60 1 2023-12-05T13:24:55.093 INFO:tasks.workunit.client.1.smithi052.stdout:0/114: stat d0/db/d1b/c1e 0 2023-12-05T13:24:55.094 INFO:tasks.workunit.client.1.smithi052.stdout:6/94: dwrite d3/d4/d6/f7 [4194304,4194304] 0 2023-12-05T13:24:55.094 INFO:tasks.workunit.client.1.smithi052.stdout:6/95: write d3/f19 [254607,99525] 0 2023-12-05T13:24:55.095 INFO:tasks.workunit.client.1.smithi052.stdout:2/83: link d2/c12 d2/d13/c18 0 2023-12-05T13:24:55.095 INFO:tasks.workunit.client.1.smithi052.stdout:2/84: dread - d2/d13/f17 zero size 2023-12-05T13:24:55.096 INFO:tasks.workunit.client.1.smithi052.stdout:0/115: mkdir d0/db/d1b/d29 0 2023-12-05T13:24:55.097 INFO:tasks.workunit.client.1.smithi052.stdout:0/116: readlink d0/db/l1d 0 2023-12-05T13:24:55.097 INFO:tasks.workunit.client.1.smithi052.stdout:0/117: chown d0/db/d1b/d29 28 1 2023-12-05T13:24:55.097 INFO:tasks.workunit.client.1.smithi052.stdout:0/118: readlink d0/db/d14/l19 0 2023-12-05T13:24:55.101 INFO:tasks.workunit.client.1.smithi052.stdout:6/96: link d3/c14 d3/d5/d9/c20 0 2023-12-05T13:24:55.103 INFO:tasks.workunit.client.1.smithi052.stdout:2/85: creat d2/f19 x:0 0 0 2023-12-05T13:24:55.104 INFO:tasks.workunit.client.1.smithi052.stdout:5/48: sync 2023-12-05T13:24:55.104 INFO:tasks.workunit.client.1.smithi052.stdout:1/106: sync 2023-12-05T13:24:55.104 INFO:tasks.workunit.client.1.smithi052.stdout:0/119: creat d0/db/f2a x:0 0 0 2023-12-05T13:24:55.106 INFO:tasks.workunit.client.1.smithi052.stdout:6/97: mkdir d3/d5/d9/d21 0 2023-12-05T13:24:55.109 INFO:tasks.workunit.client.1.smithi052.stdout:1/107: mknod d5/d7/de/d18/c1f 0 2023-12-05T13:24:55.114 INFO:tasks.workunit.client.1.smithi052.stdout:6/98: rename d3/d4/d6/cc to d3/c22 0 2023-12-05T13:24:55.114 INFO:tasks.workunit.client.1.smithi052.stdout:6/99: chown d3/d4/d6/f1d 1797992 1 2023-12-05T13:24:55.114 INFO:tasks.workunit.client.1.smithi052.stdout:6/100: dread - d3/d4/d6/f11 zero size 2023-12-05T13:24:55.115 INFO:tasks.workunit.client.1.smithi052.stdout:1/108: mknod d5/d7/de/d18/c20 0 2023-12-05T13:24:55.115 INFO:tasks.workunit.client.1.smithi052.stdout:1/109: chown d5/d7/l1b 4747024 1 2023-12-05T13:24:55.116 INFO:tasks.workunit.client.1.smithi052.stdout:1/110: dread - d5/d7/f13 zero size 2023-12-05T13:24:55.118 INFO:tasks.workunit.client.1.smithi052.stdout:0/120: link d0/fd d0/f2b 0 2023-12-05T13:24:55.118 INFO:tasks.workunit.client.1.smithi052.stdout:0/121: truncate d0/db/f2a 760242 0 2023-12-05T13:24:55.118 INFO:tasks.workunit.client.1.smithi052.stdout:0/122: dread - d0/f1a zero size 2023-12-05T13:24:55.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/123: write d0/db/f2a [1172502,97561] 0 2023-12-05T13:24:55.120 INFO:tasks.workunit.client.1.smithi052.stdout:6/101: dread d3/f16 [0,4194304] 0 2023-12-05T13:24:55.120 INFO:tasks.workunit.client.1.smithi052.stdout:6/102: chown d3/d5/c13 18805666 1 2023-12-05T13:24:55.120 INFO:tasks.workunit.client.1.smithi052.stdout:1/111: mknod d5/d7/c21 0 2023-12-05T13:24:55.120 INFO:tasks.workunit.client.1.smithi052.stdout:1/112: write d5/d7/f13 [862929,59145] 0 2023-12-05T13:24:55.120 INFO:tasks.workunit.client.1.smithi052.stdout:1/113: read d5/fc [384072,55301] 0 2023-12-05T13:24:55.121 INFO:tasks.workunit.client.1.smithi052.stdout:7/107: sync 2023-12-05T13:24:55.121 INFO:tasks.workunit.client.1.smithi052.stdout:3/101: sync 2023-12-05T13:24:55.122 INFO:tasks.workunit.client.1.smithi052.stdout:2/86: dwrite d2/fb [0,4194304] 0 2023-12-05T13:24:55.124 INFO:tasks.workunit.client.1.smithi052.stdout:5/49: dwrite d5/f9 [0,4194304] 0 2023-12-05T13:24:55.124 INFO:tasks.workunit.client.1.smithi052.stdout:5/50: write f4 [1259200,25177] 0 2023-12-05T13:24:55.124 INFO:tasks.workunit.client.1.smithi052.stdout:5/51: stat d5/f14 0 2023-12-05T13:24:55.124 INFO:tasks.workunit.client.1.smithi052.stdout:5/52: getdents d5/dd 0 2023-12-05T13:24:55.124 INFO:tasks.workunit.client.1.smithi052.stdout:1/114: symlink d5/d7/de/d14/d17/l22 0 2023-12-05T13:24:55.126 INFO:tasks.workunit.client.1.smithi052.stdout:5/53: dread d5/fa [0,4194304] 0 2023-12-05T13:24:55.126 INFO:tasks.workunit.client.1.smithi052.stdout:1/115: write d5/f8 [4353733,119318] 0 2023-12-05T13:24:55.126 INFO:tasks.workunit.client.1.smithi052.stdout:7/108: truncate d7/da/d13/f19 3040129 0 2023-12-05T13:24:55.126 INFO:tasks.workunit.client.1.smithi052.stdout:7/109: fsync d7/da/f14 0 2023-12-05T13:24:55.129 INFO:tasks.workunit.client.1.smithi052.stdout:1/116: dread d5/fc [0,4194304] 0 2023-12-05T13:24:55.129 INFO:tasks.workunit.client.1.smithi052.stdout:1/117: chown d5/d7/c9 479536 1 2023-12-05T13:24:55.129 INFO:tasks.workunit.client.1.smithi052.stdout:0/124: symlink d0/l2c 0 2023-12-05T13:24:55.129 INFO:tasks.workunit.client.1.smithi052.stdout:0/125: dread - d0/f23 zero size 2023-12-05T13:24:55.129 INFO:tasks.workunit.client.1.smithi052.stdout:0/126: readlink d0/db/l1d 0 2023-12-05T13:24:55.129 INFO:tasks.workunit.client.1.smithi052.stdout:1/118: write d5/fc [82885,90443] 0 2023-12-05T13:24:55.133 INFO:tasks.workunit.client.1.smithi052.stdout:2/87: creat d2/d14/f1a x:0 0 0 2023-12-05T13:24:55.137 INFO:tasks.workunit.client.1.smithi052.stdout:1/119: dread d5/f8 [0,4194304] 0 2023-12-05T13:24:55.140 INFO:tasks.workunit.client.1.smithi052.stdout:5/54: rename d5/dd to d5/d15 0 2023-12-05T13:24:55.142 INFO:tasks.workunit.client.1.smithi052.stdout:7/110: symlink d7/l21 0 2023-12-05T13:24:55.147 INFO:tasks.workunit.client.1.smithi052.stdout:2/88: unlink d2/f19 0 2023-12-05T13:24:55.147 INFO:tasks.workunit.client.1.smithi052.stdout:2/89: rename d2 to d2/d4/d1b 22 2023-12-05T13:24:55.147 INFO:tasks.workunit.client.1.smithi052.stdout:2/90: chown d2/d13/c18 1 1 2023-12-05T13:24:55.148 INFO:tasks.workunit.client.1.smithi052.stdout:1/120: stat d5/c1e 0 2023-12-05T13:24:55.149 INFO:tasks.workunit.client.1.smithi052.stdout:1/121: read d5/fc [187542,56428] 0 2023-12-05T13:24:55.151 INFO:tasks.workunit.client.1.smithi052.stdout:2/91: symlink d2/d4/l1c 0 2023-12-05T13:24:55.152 INFO:tasks.workunit.client.1.smithi052.stdout:7/111: dread d7/da/f14 [0,4194304] 0 2023-12-05T13:24:55.153 INFO:tasks.workunit.client.1.smithi052.stdout:5/55: dwrite d5/fa [0,4194304] 0 2023-12-05T13:24:55.153 INFO:tasks.workunit.client.1.smithi052.stdout:5/56: fsync d5/fa 0 2023-12-05T13:24:55.154 INFO:tasks.workunit.client.1.smithi052.stdout:1/122: rename d5/d7/de/d18/c1f to d5/d7/c23 0 2023-12-05T13:24:55.155 INFO:tasks.workunit.client.1.smithi052.stdout:2/92: symlink d2/d4/l1d 0 2023-12-05T13:24:55.156 INFO:tasks.workunit.client.1.smithi052.stdout:2/93: write d2/fb [821831,63015] 0 2023-12-05T13:24:55.156 INFO:tasks.workunit.client.1.smithi052.stdout:7/112: truncate d7/da/f1a 3460590 0 2023-12-05T13:24:55.157 INFO:tasks.workunit.client.1.smithi052.stdout:7/113: chown d7/l11 167095 1 2023-12-05T13:24:55.157 INFO:tasks.workunit.client.1.smithi052.stdout:7/114: chown d7/da/d13/d16/l20 124 1 2023-12-05T13:24:55.157 INFO:tasks.workunit.client.1.smithi052.stdout:7/115: write d7/da/fb [6050979,109867] 0 2023-12-05T13:24:55.161 INFO:tasks.workunit.client.1.smithi052.stdout:5/57: rename d5/f6 to d5/f16 0 2023-12-05T13:24:55.161 INFO:tasks.workunit.client.1.smithi052.stdout:5/58: read f4 [1160555,72777] 0 2023-12-05T13:24:55.164 INFO:tasks.workunit.client.1.smithi052.stdout:1/123: creat d5/f24 x:0 0 0 2023-12-05T13:24:55.164 INFO:tasks.workunit.client.1.smithi052.stdout:1/124: write d5/d7/f12 [4406193,61330] 0 2023-12-05T13:24:55.164 INFO:tasks.workunit.client.1.smithi052.stdout:1/125: chown f4 65 1 2023-12-05T13:24:55.164 INFO:tasks.workunit.client.1.smithi052.stdout:1/126: chown d5/f24 6323 1 2023-12-05T13:24:55.164 INFO:tasks.workunit.client.1.smithi052.stdout:1/127: stat d5/d7/de/d18 0 2023-12-05T13:24:55.165 INFO:tasks.workunit.client.1.smithi052.stdout:2/94: mkdir d2/d13/d1e 0 2023-12-05T13:24:55.166 INFO:tasks.workunit.client.1.smithi052.stdout:1/128: dread d5/d7/f13 [0,4194304] 0 2023-12-05T13:24:55.166 INFO:tasks.workunit.client.1.smithi052.stdout:1/129: write d5/f8 [3643919,23348] 0 2023-12-05T13:24:55.168 INFO:tasks.workunit.client.1.smithi052.stdout:7/116: link d7/da/c1d d7/da/d13/c22 0 2023-12-05T13:24:55.168 INFO:tasks.workunit.client.1.smithi052.stdout:7/117: chown d7/c9 3247689 1 2023-12-05T13:24:55.175 INFO:tasks.workunit.client.1.smithi052.stdout:2/95: rename d2/d4/la to d2/l1f 0 2023-12-05T13:24:55.178 INFO:tasks.workunit.client.1.smithi052.stdout:1/130: getdents d5/d7/de/d14 0 2023-12-05T13:24:55.180 INFO:tasks.workunit.client.1.smithi052.stdout:7/118: symlink d7/l23 0 2023-12-05T13:24:55.180 INFO:tasks.workunit.client.1.smithi052.stdout:7/119: write d7/da/f1f [327754,86383] 0 2023-12-05T13:24:55.182 INFO:tasks.workunit.client.1.smithi052.stdout:2/96: symlink d2/l20 0 2023-12-05T13:24:55.182 INFO:tasks.workunit.client.1.smithi052.stdout:2/97: write d2/d14/f1a [374999,73879] 0 2023-12-05T13:24:55.192 INFO:tasks.workunit.client.1.smithi052.stdout:1/131: rename d5/d7/l15 to d5/l25 0 2023-12-05T13:24:55.204 INFO:tasks.workunit.client.1.smithi052.stdout:2/98: dwrite d2/d13/f16 [0,4194304] 0 2023-12-05T13:24:55.204 INFO:tasks.workunit.client.1.smithi052.stdout:2/99: stat d2/d4 0 2023-12-05T13:24:55.208 INFO:tasks.workunit.client.1.smithi052.stdout:7/120: dwrite d7/da/f1f [0,4194304] 0 2023-12-05T13:24:55.210 INFO:tasks.workunit.client.1.smithi052.stdout:2/100: unlink d2/d4/l1c 0 2023-12-05T13:24:55.210 INFO:tasks.workunit.client.1.smithi052.stdout:2/101: read - d2/d13/f17 zero size 2023-12-05T13:24:55.212 INFO:tasks.workunit.client.1.smithi052.stdout:7/121: rename d7/da/d13/c22 to d7/da/d13/c24 0 2023-12-05T13:24:55.213 INFO:tasks.workunit.client.1.smithi052.stdout:1/132: dwrite d5/f8 [0,4194304] 0 2023-12-05T13:24:55.214 INFO:tasks.workunit.client.1.smithi052.stdout:8/132: getdents d0/de/d12 0 2023-12-05T13:24:55.215 INFO:tasks.workunit.client.1.smithi052.stdout:7/122: mknod d7/da/c25 0 2023-12-05T13:24:55.218 INFO:tasks.workunit.client.1.smithi052.stdout:1/133: unlink d5/f24 0 2023-12-05T13:24:55.220 INFO:tasks.workunit.client.1.smithi052.stdout:8/133: creat d0/de/f2f x:0 0 0 2023-12-05T13:24:55.221 INFO:tasks.workunit.client.1.smithi052.stdout:8/134: chown d0/fc 99286474 1 2023-12-05T13:24:55.221 INFO:tasks.workunit.client.1.smithi052.stdout:1/134: dread d5/fc [0,4194304] 0 2023-12-05T13:24:55.222 INFO:tasks.workunit.client.1.smithi052.stdout:7/123: mknod d7/c26 0 2023-12-05T13:24:55.223 INFO:tasks.workunit.client.1.smithi052.stdout:8/135: creat d0/f30 x:0 0 0 2023-12-05T13:24:55.226 INFO:tasks.workunit.client.1.smithi052.stdout:7/124: creat d7/f27 x:0 0 0 2023-12-05T13:24:55.229 INFO:tasks.workunit.client.1.smithi052.stdout:8/136: creat d0/d28/d2b/f31 x:0 0 0 2023-12-05T13:24:55.231 INFO:tasks.workunit.client.1.smithi052.stdout:1/135: mkdir d5/d26 0 2023-12-05T13:24:55.231 INFO:tasks.workunit.client.1.smithi052.stdout:0/127: fsync d0/db/d14/f26 0 2023-12-05T13:24:55.232 INFO:tasks.workunit.client.1.smithi052.stdout:0/128: read d0/f2b [1386785,86390] 0 2023-12-05T13:24:55.235 INFO:tasks.workunit.client.1.smithi052.stdout:8/137: creat d0/f32 x:0 0 0 2023-12-05T13:24:55.235 INFO:tasks.workunit.client.1.smithi052.stdout:8/138: dread - d0/d28/d2b/f31 zero size 2023-12-05T13:24:55.237 INFO:tasks.workunit.client.1.smithi052.stdout:0/129: truncate d0/f4 2218663 0 2023-12-05T13:24:55.239 INFO:tasks.workunit.client.1.smithi052.stdout:8/139: mknod d0/de/d27/c33 0 2023-12-05T13:24:55.241 INFO:tasks.workunit.client.1.smithi052.stdout:0/130: mknod d0/db/d1b/d29/c2d 0 2023-12-05T13:24:55.241 INFO:tasks.workunit.client.1.smithi052.stdout:0/131: truncate d0/db/f1f 370090 0 2023-12-05T13:24:55.248 INFO:tasks.workunit.client.1.smithi052.stdout:7/125: dwrite d7/da/d13/f17 [4194304,4194304] 0 2023-12-05T13:24:55.248 INFO:tasks.workunit.client.1.smithi052.stdout:7/126: fdatasync d7/da/d13/f19 0 2023-12-05T13:24:55.254 INFO:tasks.workunit.client.1.smithi052.stdout:8/140: dwrite d0/fc [0,4194304] 0 2023-12-05T13:24:55.255 INFO:tasks.workunit.client.1.smithi052.stdout:8/141: truncate d0/f5 5137852 0 2023-12-05T13:24:55.259 INFO:tasks.workunit.client.1.smithi052.stdout:0/132: dwrite d0/fd [0,4194304] 0 2023-12-05T13:24:55.262 INFO:tasks.workunit.client.1.smithi052.stdout:0/133: mkdir d0/db/d2e 0 2023-12-05T13:24:55.277 INFO:tasks.workunit.client.1.smithi052.stdout:0/134: dwrite d0/f1a [0,4194304] 0 2023-12-05T13:24:55.287 INFO:tasks.workunit.client.1.smithi052.stdout:2/102: dwrite d2/fb [4194304,4194304] 0 2023-12-05T13:24:55.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:55 smithi029 ceph-mon[112128]: pgmap v197: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 9.5 MiB/s wr, 598 op/s 2023-12-05T13:24:55.354 INFO:tasks.workunit.client.1.smithi052.stdout:9/100: sync 2023-12-05T13:24:55.357 INFO:tasks.workunit.client.1.smithi052.stdout:9/101: truncate d3/f15 2331545 0 2023-12-05T13:24:55.358 INFO:tasks.workunit.client.1.smithi052.stdout:9/102: write d3/f4 [4345022,35830] 0 2023-12-05T13:24:55.360 INFO:tasks.workunit.client.1.smithi052.stdout:2/103: dwrite d2/d13/f16 [4194304,4194304] 0 2023-12-05T13:24:55.360 INFO:tasks.workunit.client.1.smithi052.stdout:2/104: fsync d2/d13/f16 0 2023-12-05T13:24:55.360 INFO:tasks.workunit.client.1.smithi052.stdout:2/105: write d2/d13/f17 [459211,105662] 0 2023-12-05T13:24:55.360 INFO:tasks.workunit.client.1.smithi052.stdout:2/106: truncate d2/d14/f1a 878196 0 2023-12-05T13:24:55.360 INFO:tasks.workunit.client.1.smithi052.stdout:2/107: write d2/d14/f1a [1686554,100647] 0 2023-12-05T13:24:55.361 INFO:tasks.workunit.client.1.smithi052.stdout:2/108: write d2/fb [9304073,18932] 0 2023-12-05T13:24:55.365 INFO:tasks.workunit.client.1.smithi052.stdout:9/103: dread d3/d11/f1a [4194304,4194304] 0 2023-12-05T13:24:55.366 INFO:tasks.workunit.client.1.smithi052.stdout:2/109: mknod d2/d13/c21 0 2023-12-05T13:24:55.368 INFO:tasks.workunit.client.1.smithi052.stdout:2/110: unlink d2/l1f 0 2023-12-05T13:24:55.370 INFO:tasks.workunit.client.1.smithi052.stdout:2/111: fdatasync d2/d13/f17 0 2023-12-05T13:24:55.373 INFO:tasks.workunit.client.1.smithi052.stdout:9/104: dread d3/d11/f13 [0,4194304] 0 2023-12-05T13:24:55.373 INFO:tasks.workunit.client.1.smithi052.stdout:9/105: write d3/f20 [855043,82218] 0 2023-12-05T13:24:55.376 INFO:tasks.workunit.client.1.smithi052.stdout:2/112: dread d2/d14/f1a [0,4194304] 0 2023-12-05T13:24:55.376 INFO:tasks.workunit.client.1.smithi052.stdout:9/106: rename d3/f20 to d3/d11/f21 0 2023-12-05T13:24:55.376 INFO:tasks.workunit.client.1.smithi052.stdout:7/127: write d7/da/f1f [4427133,30460] 0 2023-12-05T13:24:55.377 INFO:tasks.workunit.client.1.smithi052.stdout:2/113: creat d2/d13/f22 x:0 0 0 2023-12-05T13:24:55.377 INFO:tasks.workunit.client.1.smithi052.stdout:2/114: write d2/d13/f22 [597969,104915] 0 2023-12-05T13:24:55.378 INFO:tasks.workunit.client.1.smithi052.stdout:2/115: write d2/d13/f17 [1113637,29465] 0 2023-12-05T13:24:55.390 INFO:tasks.workunit.client.1.smithi052.stdout:7/128: dwrite d7/f27 [0,4194304] 0 2023-12-05T13:24:55.404 INFO:tasks.workunit.client.1.smithi052.stdout:7/129: dwrite d7/da/d13/f19 [0,4194304] 0 2023-12-05T13:24:55.405 INFO:tasks.workunit.client.1.smithi052.stdout:8/142: truncate d0/f5 4616858 0 2023-12-05T13:24:55.410 INFO:tasks.workunit.client.1.smithi052.stdout:7/130: rename d7/da/f1f to d7/da/f28 0 2023-12-05T13:24:55.415 INFO:tasks.workunit.client.1.smithi052.stdout:7/131: dread d7/da/f14 [0,4194304] 0 2023-12-05T13:24:55.424 INFO:tasks.workunit.client.1.smithi052.stdout:8/143: dwrite d0/de/d12/f17 [0,4194304] 0 2023-12-05T13:24:55.428 INFO:tasks.workunit.client.1.smithi052.stdout:8/144: link d0/de/l25 d0/d28/d2b/l34 0 2023-12-05T13:24:55.428 INFO:tasks.workunit.client.1.smithi052.stdout:8/145: readlink d0/de/l25 0 2023-12-05T13:24:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:55 smithi052 ceph-mon[121072]: pgmap v197: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 9.5 MiB/s wr, 598 op/s 2023-12-05T13:24:55.511 INFO:tasks.workunit.client.1.smithi052.stdout:9/107: getdents d3/d11 0 2023-12-05T13:24:55.514 INFO:tasks.workunit.client.1.smithi052.stdout:9/108: mknod d3/d1e/c22 0 2023-12-05T13:24:55.514 INFO:tasks.workunit.client.1.smithi052.stdout:9/109: truncate d3/d1e/f1f 277483 0 2023-12-05T13:24:55.514 INFO:tasks.workunit.client.1.smithi052.stdout:2/116: fsync d2/d13/f22 0 2023-12-05T13:24:55.514 INFO:tasks.workunit.client.1.smithi052.stdout:2/117: stat d2/d13/c21 0 2023-12-05T13:24:55.514 INFO:tasks.workunit.client.1.smithi052.stdout:2/118: stat d2/d13/f22 0 2023-12-05T13:24:55.527 INFO:tasks.workunit.client.1.smithi052.stdout:2/119: dwrite d2/d13/f22 [0,4194304] 0 2023-12-05T13:24:55.534 INFO:tasks.workunit.client.1.smithi052.stdout:2/120: dread d2/d13/f22 [0,4194304] 0 2023-12-05T13:24:55.535 INFO:tasks.workunit.client.1.smithi052.stdout:4/86: sync 2023-12-05T13:24:55.535 INFO:tasks.workunit.client.1.smithi052.stdout:2/121: creat d2/d4/f23 x:0 0 0 2023-12-05T13:24:55.537 INFO:tasks.workunit.client.1.smithi052.stdout:4/87: symlink de/l1c 0 2023-12-05T13:24:55.538 INFO:tasks.workunit.client.1.smithi052.stdout:7/132: fsync d7/da/f28 0 2023-12-05T13:24:55.539 INFO:tasks.workunit.client.1.smithi052.stdout:2/122: creat d2/d14/f24 x:0 0 0 2023-12-05T13:24:55.539 INFO:tasks.workunit.client.1.smithi052.stdout:2/123: truncate d2/d14/f24 948205 0 2023-12-05T13:24:55.539 INFO:tasks.workunit.client.1.smithi052.stdout:2/124: write d2/d14/f24 [624862,86908] 0 2023-12-05T13:24:55.541 INFO:tasks.workunit.client.1.smithi052.stdout:4/88: unlink de/f19 0 2023-12-05T13:24:55.542 INFO:tasks.workunit.client.1.smithi052.stdout:7/133: creat d7/da/d12/f29 x:0 0 0 2023-12-05T13:24:55.543 INFO:tasks.workunit.client.1.smithi052.stdout:7/134: write d7/da/f14 [3674573,125951] 0 2023-12-05T13:24:55.546 INFO:tasks.workunit.client.1.smithi052.stdout:4/89: mknod de/c1d 0 2023-12-05T13:24:55.550 INFO:tasks.workunit.client.1.smithi052.stdout:7/135: creat d7/f2a x:0 0 0 2023-12-05T13:24:55.551 INFO:tasks.workunit.client.1.smithi052.stdout:4/90: mkdir de/d1e 0 2023-12-05T13:24:55.553 INFO:tasks.workunit.client.1.smithi052.stdout:7/136: rename d7/da/d13/f17 to d7/da/f2b 0 2023-12-05T13:24:55.555 INFO:tasks.workunit.client.1.smithi052.stdout:4/91: unlink f7 0 2023-12-05T13:24:55.555 INFO:tasks.workunit.client.1.smithi052.stdout:4/92: write de/f14 [59478,82446] 0 2023-12-05T13:24:55.556 INFO:tasks.workunit.client.1.smithi052.stdout:4/93: read - de/f12 zero size 2023-12-05T13:24:55.556 INFO:tasks.workunit.client.1.smithi052.stdout:4/94: write de/f17 [906060,120134] 0 2023-12-05T13:24:55.557 INFO:tasks.workunit.client.1.smithi052.stdout:4/95: symlink de/d1e/l1f 0 2023-12-05T13:24:55.559 INFO:tasks.workunit.client.1.smithi052.stdout:9/110: truncate d3/f4 1930571 0 2023-12-05T13:24:55.562 INFO:tasks.workunit.client.1.smithi052.stdout:9/111: creat d3/d1e/f23 x:0 0 0 2023-12-05T13:24:55.562 INFO:tasks.workunit.client.1.smithi052.stdout:0/135: truncate d0/fa 250931 0 2023-12-05T13:24:55.566 INFO:tasks.workunit.client.1.smithi052.stdout:0/136: creat d0/db/d14/f2f x:0 0 0 2023-12-05T13:24:55.566 INFO:tasks.workunit.client.1.smithi052.stdout:0/137: chown d0/db/d14/f2f 75 1 2023-12-05T13:24:55.570 INFO:tasks.workunit.client.1.smithi052.stdout:0/138: truncate d0/db/d14/f28 4872375 0 2023-12-05T13:24:55.575 INFO:tasks.workunit.client.1.smithi052.stdout:4/96: dwrite de/f16 [0,4194304] 0 2023-12-05T13:24:55.575 INFO:tasks.workunit.client.1.smithi052.stdout:4/97: write f4 [4833625,42399] 0 2023-12-05T13:24:55.583 INFO:tasks.workunit.client.1.smithi052.stdout:4/98: rename de/f16 to de/d1e/f20 0 2023-12-05T13:24:55.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/99: creat de/d1e/f21 x:0 0 0 2023-12-05T13:24:55.639 INFO:tasks.workunit.client.1.smithi052.stdout:2/125: rmdir d2 39 2023-12-05T13:24:55.641 INFO:tasks.workunit.client.1.smithi052.stdout:2/126: creat d2/d13/d1e/f25 x:0 0 0 2023-12-05T13:24:55.645 INFO:tasks.workunit.client.1.smithi052.stdout:2/127: rename d2/fb to d2/d13/f26 0 2023-12-05T13:24:55.645 INFO:tasks.workunit.client.1.smithi052.stdout:2/128: chown d2/d14/f24 80 1 2023-12-05T13:24:55.647 INFO:tasks.workunit.client.1.smithi052.stdout:2/129: creat d2/d13/d1e/f27 x:0 0 0 2023-12-05T13:24:55.647 INFO:tasks.workunit.client.1.smithi052.stdout:7/137: truncate d7/da/f14 3326622 0 2023-12-05T13:24:55.650 INFO:tasks.workunit.client.1.smithi052.stdout:2/130: truncate d2/d13/f22 3936249 0 2023-12-05T13:24:55.650 INFO:tasks.workunit.client.1.smithi052.stdout:2/131: write d2/d13/f17 [1244801,1449] 0 2023-12-05T13:24:55.651 INFO:tasks.workunit.client.1.smithi052.stdout:7/138: rename d7/da/d13/d16/l20 to d7/da/d12/l2c 0 2023-12-05T13:24:55.653 INFO:tasks.workunit.client.1.smithi052.stdout:2/132: mkdir d2/d28 0 2023-12-05T13:24:55.653 INFO:tasks.workunit.client.1.smithi052.stdout:2/133: chown d2/d14/f1a 73 1 2023-12-05T13:24:55.658 INFO:tasks.workunit.client.1.smithi052.stdout:2/134: rename d2/d14/c10 to d2/d4/c29 0 2023-12-05T13:24:55.659 INFO:tasks.workunit.client.1.smithi052.stdout:9/112: write d3/f4 [1293124,77613] 0 2023-12-05T13:24:55.661 INFO:tasks.workunit.client.1.smithi052.stdout:2/135: creat d2/f2a x:0 0 0 2023-12-05T13:24:55.663 INFO:tasks.workunit.client.1.smithi052.stdout:9/113: rename d3/d11/f1a to d3/f24 0 2023-12-05T13:24:55.665 INFO:tasks.workunit.client.1.smithi052.stdout:2/136: creat d2/f2b x:0 0 0 2023-12-05T13:24:55.665 INFO:tasks.workunit.client.1.smithi052.stdout:2/137: write d2/f2b [566463,100870] 0 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:2/138: fsync d2/d4/f23 0 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:2/139: chown d2/d4 9392 1 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:6/103: sync 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:3/102: sync 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:8/146: sync 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:5/59: sync 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:3/103: dread - da/f1f zero size 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:5/60: readlink l0 0 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:5/61: chown l0 7 1 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:1/136: sync 2023-12-05T13:24:55.666 INFO:tasks.workunit.client.1.smithi052.stdout:5/62: write d5/f14 [400417,126076] 0 2023-12-05T13:24:55.667 INFO:tasks.workunit.client.1.smithi052.stdout:9/114: mknod d3/d1e/c25 0 2023-12-05T13:24:55.667 INFO:tasks.workunit.client.1.smithi052.stdout:9/115: chown d3/d11/d19/l1d 110 1 2023-12-05T13:24:55.668 INFO:tasks.workunit.client.1.smithi052.stdout:1/137: dread d5/fc [0,4194304] 0 2023-12-05T13:24:55.673 INFO:tasks.workunit.client.1.smithi052.stdout:6/104: unlink d3/c22 0 2023-12-05T13:24:55.673 INFO:tasks.workunit.client.1.smithi052.stdout:8/147: creat d0/de/f35 x:0 0 0 2023-12-05T13:24:55.673 INFO:tasks.workunit.client.1.smithi052.stdout:8/148: dread - d0/de/f2f zero size 2023-12-05T13:24:55.676 INFO:tasks.workunit.client.1.smithi052.stdout:3/104: creat da/f21 x:0 0 0 2023-12-05T13:24:55.676 INFO:tasks.workunit.client.1.smithi052.stdout:3/105: readlink da/lc 0 2023-12-05T13:24:55.678 INFO:tasks.workunit.client.1.smithi052.stdout:5/63: rmdir d5/df/d12 0 2023-12-05T13:24:55.681 INFO:tasks.workunit.client.1.smithi052.stdout:1/138: creat d5/d7/de/d14/d17/f27 x:0 0 0 2023-12-05T13:24:55.683 INFO:tasks.workunit.client.1.smithi052.stdout:6/105: creat d3/d5/d9/d21/f23 x:0 0 0 2023-12-05T13:24:55.684 INFO:tasks.workunit.client.1.smithi052.stdout:2/140: dwrite d2/d13/f26 [0,4194304] 0 2023-12-05T13:24:55.684 INFO:tasks.workunit.client.1.smithi052.stdout:9/116: dwrite d3/d1e/f23 [0,4194304] 0 2023-12-05T13:24:55.685 INFO:tasks.workunit.client.1.smithi052.stdout:4/100: getdents de 0 2023-12-05T13:24:55.685 INFO:tasks.workunit.client.1.smithi052.stdout:4/101: getdents de 0 2023-12-05T13:24:55.686 INFO:tasks.workunit.client.1.smithi052.stdout:3/106: creat da/f22 x:0 0 0 2023-12-05T13:24:55.688 INFO:tasks.workunit.client.1.smithi052.stdout:1/139: creat d5/d7/de/d14/d17/f28 x:0 0 0 2023-12-05T13:24:55.691 INFO:tasks.workunit.client.1.smithi052.stdout:6/106: mkdir d3/d4/df/d24 0 2023-12-05T13:24:55.701 INFO:tasks.workunit.client.1.smithi052.stdout:2/141: creat d2/d14/f2c x:0 0 0 2023-12-05T13:24:55.701 INFO:tasks.workunit.client.1.smithi052.stdout:2/142: chown d2/d14 660488 1 2023-12-05T13:24:55.701 INFO:tasks.workunit.client.1.smithi052.stdout:2/143: truncate d2/d13/d1e/f25 464662 0 2023-12-05T13:24:55.701 INFO:tasks.workunit.client.1.smithi052.stdout:2/144: write d2/d14/f1a [1787905,11008] 0 2023-12-05T13:24:55.704 INFO:tasks.workunit.client.1.smithi052.stdout:2/145: dread d2/f2b [0,4194304] 0 2023-12-05T13:24:55.705 INFO:tasks.workunit.client.1.smithi052.stdout:3/107: dwrite da/f22 [0,4194304] 0 2023-12-05T13:24:55.705 INFO:tasks.workunit.client.1.smithi052.stdout:3/108: write da/f1f [111125,17817] 0 2023-12-05T13:24:55.707 INFO:tasks.workunit.client.1.smithi052.stdout:4/102: symlink de/d1e/l22 0 2023-12-05T13:24:55.711 INFO:tasks.workunit.client.1.smithi052.stdout:8/149: rename d0/cb to d0/de/d12/c36 0 2023-12-05T13:24:55.712 INFO:tasks.workunit.client.1.smithi052.stdout:6/107: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:24:55.716 INFO:tasks.workunit.client.1.smithi052.stdout:1/140: mkdir d5/d7/de/d14/d17/d29 0 2023-12-05T13:24:55.716 INFO:tasks.workunit.client.1.smithi052.stdout:1/141: chown c0 76412 1 2023-12-05T13:24:55.719 INFO:tasks.workunit.client.1.smithi052.stdout:2/146: symlink d2/d13/d1e/l2d 0 2023-12-05T13:24:55.721 INFO:tasks.workunit.client.1.smithi052.stdout:2/147: dread d2/d13/f17 [0,4194304] 0 2023-12-05T13:24:55.722 INFO:tasks.workunit.client.1.smithi052.stdout:2/148: write d2/d13/d1e/f27 [511729,54118] 0 2023-12-05T13:24:55.722 INFO:tasks.workunit.client.1.smithi052.stdout:2/149: write d2/f2a [376751,60219] 0 2023-12-05T13:24:55.726 INFO:tasks.workunit.client.1.smithi052.stdout:3/109: creat da/f23 x:0 0 0 2023-12-05T13:24:55.726 INFO:tasks.workunit.client.1.smithi052.stdout:4/103: readlink de/l10 0 2023-12-05T13:24:55.726 INFO:tasks.workunit.client.1.smithi052.stdout:4/104: write f4 [2144482,34576] 0 2023-12-05T13:24:55.727 INFO:tasks.workunit.client.1.smithi052.stdout:8/150: mknod d0/de/d12/c37 0 2023-12-05T13:24:55.735 INFO:tasks.workunit.client.1.smithi052.stdout:6/108: creat d3/d4/d6/f25 x:0 0 0 2023-12-05T13:24:55.738 INFO:tasks.workunit.client.1.smithi052.stdout:1/142: mkdir d5/d7/de/d14/d2a 0 2023-12-05T13:24:55.738 INFO:tasks.workunit.client.1.smithi052.stdout:1/143: chown d5/d7/de/d14/d17/d29 1030588 1 2023-12-05T13:24:55.738 INFO:tasks.workunit.client.1.smithi052.stdout:1/144: stat d5/fc 0 2023-12-05T13:24:55.742 INFO:tasks.workunit.client.1.smithi052.stdout:4/105: readlink de/l13 0 2023-12-05T13:24:55.743 INFO:tasks.workunit.client.1.smithi052.stdout:2/150: dwrite d2/d13/d1e/f27 [0,4194304] 0 2023-12-05T13:24:55.744 INFO:tasks.workunit.client.1.smithi052.stdout:6/109: mkdir d3/d4/d6/d26 0 2023-12-05T13:24:55.746 INFO:tasks.workunit.client.1.smithi052.stdout:8/151: dwrite d0/fa [0,4194304] 0 2023-12-05T13:24:55.751 INFO:tasks.workunit.client.1.smithi052.stdout:6/110: rmdir d3/d1f 0 2023-12-05T13:24:55.753 INFO:tasks.workunit.client.1.smithi052.stdout:6/111: mkdir d3/d4/df/d27 0 2023-12-05T13:24:55.755 INFO:tasks.workunit.client.1.smithi052.stdout:8/152: dread d0/f21 [0,4194304] 0 2023-12-05T13:24:55.756 INFO:tasks.workunit.client.1.smithi052.stdout:6/112: mknod d3/d4/d6/d26/c28 0 2023-12-05T13:24:55.760 INFO:tasks.workunit.client.1.smithi052.stdout:1/145: dwrite d5/fc [0,4194304] 0 2023-12-05T13:24:55.760 INFO:tasks.workunit.client.1.smithi052.stdout:1/146: fdatasync d5/fc 0 2023-12-05T13:24:55.760 INFO:tasks.workunit.client.1.smithi052.stdout:8/153: creat d0/de/f38 x:0 0 0 2023-12-05T13:24:55.764 INFO:tasks.workunit.client.1.smithi052.stdout:2/151: dwrite d2/f2a [0,4194304] 0 2023-12-05T13:24:55.765 INFO:tasks.workunit.client.1.smithi052.stdout:6/113: creat d3/f29 x:0 0 0 2023-12-05T13:24:55.770 INFO:tasks.workunit.client.1.smithi052.stdout:8/154: mkdir d0/d28/d39 0 2023-12-05T13:24:55.770 INFO:tasks.workunit.client.1.smithi052.stdout:8/155: fdatasync d0/f30 0 2023-12-05T13:24:55.774 INFO:tasks.workunit.client.1.smithi052.stdout:2/152: link l0 d2/l2e 0 2023-12-05T13:24:55.774 INFO:tasks.workunit.client.1.smithi052.stdout:6/114: link d3/d4/d6/f25 d3/d4/df/f2a 0 2023-12-05T13:24:55.775 INFO:tasks.workunit.client.1.smithi052.stdout:6/115: rename d3/d4 to d3/d4/df/d24/d2b 22 2023-12-05T13:24:55.777 INFO:tasks.workunit.client.1.smithi052.stdout:8/156: mkdir d0/d28/d39/d3a 0 2023-12-05T13:24:55.777 INFO:tasks.workunit.client.1.smithi052.stdout:8/157: read - d0/d28/f2a zero size 2023-12-05T13:24:55.777 INFO:tasks.workunit.client.1.smithi052.stdout:2/153: dread d2/d13/f22 [0,4194304] 0 2023-12-05T13:24:55.778 INFO:tasks.workunit.client.1.smithi052.stdout:6/116: link d3/c15 d3/d4/d6/d26/c2c 0 2023-12-05T13:24:55.780 INFO:tasks.workunit.client.1.smithi052.stdout:1/147: dwrite d5/d7/f13 [0,4194304] 0 2023-12-05T13:24:55.781 INFO:tasks.workunit.client.1.smithi052.stdout:8/158: mknod d0/de/d12/d20/c3b 0 2023-12-05T13:24:55.781 INFO:tasks.workunit.client.1.smithi052.stdout:2/154: dread d2/d13/f22 [0,4194304] 0 2023-12-05T13:24:55.781 INFO:tasks.workunit.client.1.smithi052.stdout:2/155: chown d2/d4/l9 1047754 1 2023-12-05T13:24:55.783 INFO:tasks.workunit.client.1.smithi052.stdout:6/117: rename d3/d5/d9/c20 to d3/d4/d6/d26/c2d 0 2023-12-05T13:24:55.790 INFO:tasks.workunit.client.1.smithi052.stdout:1/148: dread d5/fc [0,4194304] 0 2023-12-05T13:24:55.790 INFO:tasks.workunit.client.1.smithi052.stdout:2/156: rename d2/d14/f24 to d2/f2f 0 2023-12-05T13:24:55.794 INFO:tasks.workunit.client.1.smithi052.stdout:6/118: creat d3/d5/d9/f2e x:0 0 0 2023-12-05T13:24:55.794 INFO:tasks.workunit.client.1.smithi052.stdout:6/119: fsync d3/f16 0 2023-12-05T13:24:55.794 INFO:tasks.workunit.client.1.smithi052.stdout:6/120: truncate d3/d4/d6/f11 972248 0 2023-12-05T13:24:55.795 INFO:tasks.workunit.client.1.smithi052.stdout:1/149: symlink d5/d7/de/d14/d2a/l2b 0 2023-12-05T13:24:55.797 INFO:tasks.workunit.client.1.smithi052.stdout:2/157: symlink d2/d4/l30 0 2023-12-05T13:24:55.797 INFO:tasks.workunit.client.1.smithi052.stdout:8/159: dwrite d0/de/f22 [0,4194304] 0 2023-12-05T13:24:55.798 INFO:tasks.workunit.client.1.smithi052.stdout:6/121: creat d3/d5/d9/f2f x:0 0 0 2023-12-05T13:24:55.804 INFO:tasks.workunit.client.1.smithi052.stdout:2/158: mkdir d2/d31 0 2023-12-05T13:24:55.805 INFO:tasks.workunit.client.1.smithi052.stdout:8/160: mknod d0/d28/d2b/c3c 0 2023-12-05T13:24:55.805 INFO:tasks.workunit.client.1.smithi052.stdout:8/161: write d0/de/f38 [581199,23999] 0 2023-12-05T13:24:55.810 INFO:tasks.workunit.client.1.smithi052.stdout:1/150: rename d5/d7/de/d14/d17/f27 to d5/f2c 0 2023-12-05T13:24:55.810 INFO:tasks.workunit.client.1.smithi052.stdout:6/122: rename d3/d5 to d3/d5/d30 22 2023-12-05T13:24:55.811 INFO:tasks.workunit.client.1.smithi052.stdout:1/151: write f4 [3574230,30140] 0 2023-12-05T13:24:55.811 INFO:tasks.workunit.client.1.smithi052.stdout:1/152: read d5/d7/f12 [2379205,2861] 0 2023-12-05T13:24:55.812 INFO:tasks.workunit.client.1.smithi052.stdout:1/153: write d5/d7/f12 [2251917,32192] 0 2023-12-05T13:24:55.818 INFO:tasks.workunit.client.1.smithi052.stdout:2/159: link d2/d4/l1d d2/d13/l32 0 2023-12-05T13:24:55.818 INFO:tasks.workunit.client.1.smithi052.stdout:8/162: rename d0/de/l25 to d0/d28/d2b/l3d 0 2023-12-05T13:24:55.819 INFO:tasks.workunit.client.1.smithi052.stdout:6/123: creat d3/d4/df/d27/f31 x:0 0 0 2023-12-05T13:24:55.827 INFO:tasks.workunit.client.1.smithi052.stdout:3/110: rmdir da 39 2023-12-05T13:24:55.828 INFO:tasks.workunit.client.1.smithi052.stdout:3/111: write da/f11 [4163724,5893] 0 2023-12-05T13:24:55.828 INFO:tasks.workunit.client.1.smithi052.stdout:3/112: truncate da/dd/f19 60116 0 2023-12-05T13:24:55.828 INFO:tasks.workunit.client.1.smithi052.stdout:4/106: truncate de/f18 89799 0 2023-12-05T13:24:55.831 INFO:tasks.workunit.client.1.smithi052.stdout:2/160: mknod d2/d31/c33 0 2023-12-05T13:24:55.831 INFO:tasks.workunit.client.1.smithi052.stdout:2/161: dread - d2/d4/f23 zero size 2023-12-05T13:24:55.831 INFO:tasks.workunit.client.1.smithi052.stdout:2/162: readlink d2/d14/l15 0 2023-12-05T13:24:55.834 INFO:tasks.workunit.client.1.smithi052.stdout:6/124: creat d3/d4/d6/d26/f32 x:0 0 0 2023-12-05T13:24:55.834 INFO:tasks.workunit.client.1.smithi052.stdout:6/125: dread - d3/d4/df/d27/f31 zero size 2023-12-05T13:24:55.836 INFO:tasks.workunit.client.1.smithi052.stdout:3/113: dread da/f22 [0,4194304] 0 2023-12-05T13:24:55.839 INFO:tasks.workunit.client.1.smithi052.stdout:2/163: rmdir d2/d28 0 2023-12-05T13:24:55.841 INFO:tasks.workunit.client.1.smithi052.stdout:8/163: rename d0/f30 to d0/f3e 0 2023-12-05T13:24:55.841 INFO:tasks.workunit.client.1.smithi052.stdout:8/164: truncate d0/de/d12/f2e 412659 0 2023-12-05T13:24:55.842 INFO:tasks.workunit.client.1.smithi052.stdout:6/126: symlink d3/d4/d6/d26/l33 0 2023-12-05T13:24:55.842 INFO:tasks.workunit.client.1.smithi052.stdout:6/127: getdents d3/d4/df/d24 0 2023-12-05T13:24:55.842 INFO:tasks.workunit.client.1.smithi052.stdout:6/128: write d3/d4/d6/d26/f32 [387540,122643] 0 2023-12-05T13:24:55.843 INFO:tasks.workunit.client.1.smithi052.stdout:6/129: write d3/f16 [400473,115068] 0 2023-12-05T13:24:55.845 INFO:tasks.workunit.client.1.smithi052.stdout:3/114: link da/c1b da/c24 0 2023-12-05T13:24:55.846 INFO:tasks.workunit.client.1.smithi052.stdout:4/107: rmdir de/d1e 39 2023-12-05T13:24:55.847 INFO:tasks.workunit.client.1.smithi052.stdout:2/164: dread d2/f2a [0,4194304] 0 2023-12-05T13:24:55.850 INFO:tasks.workunit.client.1.smithi052.stdout:8/165: link d0/de/l1e d0/de/d27/l3f 0 2023-12-05T13:24:55.851 INFO:tasks.workunit.client.1.smithi052.stdout:6/130: creat d3/d5/f34 x:0 0 0 2023-12-05T13:24:55.851 INFO:tasks.workunit.client.1.smithi052.stdout:6/131: dread - d3/d5/d9/d21/f23 zero size 2023-12-05T13:24:55.852 INFO:tasks.workunit.client.1.smithi052.stdout:6/132: truncate d3/d4/f17 1024612 0 2023-12-05T13:24:55.852 INFO:tasks.workunit.client.1.smithi052.stdout:6/133: truncate d3/d4/d6/f25 94807 0 2023-12-05T13:24:55.854 INFO:tasks.workunit.client.1.smithi052.stdout:3/115: mkdir da/d25 0 2023-12-05T13:24:55.855 INFO:tasks.workunit.client.1.smithi052.stdout:6/134: dread d3/f16 [0,4194304] 0 2023-12-05T13:24:55.855 INFO:tasks.workunit.client.1.smithi052.stdout:6/135: dread - d3/d4/df/d27/f31 zero size 2023-12-05T13:24:55.856 INFO:tasks.workunit.client.1.smithi052.stdout:6/136: dread d3/d4/d6/f25 [0,4194304] 0 2023-12-05T13:24:55.856 INFO:tasks.workunit.client.1.smithi052.stdout:4/108: creat de/d1e/f23 x:0 0 0 2023-12-05T13:24:55.857 INFO:tasks.workunit.client.1.smithi052.stdout:4/109: write f4 [177260,101705] 0 2023-12-05T13:24:55.859 INFO:tasks.workunit.client.1.smithi052.stdout:2/165: mknod d2/d13/d1e/c34 0 2023-12-05T13:24:55.864 INFO:tasks.workunit.client.1.smithi052.stdout:3/116: rmdir da 39 2023-12-05T13:24:55.864 INFO:tasks.workunit.client.1.smithi052.stdout:3/117: write da/f21 [801503,119631] 0 2023-12-05T13:24:55.866 INFO:tasks.workunit.client.1.smithi052.stdout:6/137: mkdir d3/d4/d6/d35 0 2023-12-05T13:24:55.866 INFO:tasks.workunit.client.1.smithi052.stdout:6/138: dread - d3/d4/df/d27/f31 zero size 2023-12-05T13:24:55.870 INFO:tasks.workunit.client.1.smithi052.stdout:4/110: mkdir de/d1e/d24 0 2023-12-05T13:24:55.873 INFO:tasks.workunit.client.1.smithi052.stdout:2/166: mknod d2/d13/c35 0 2023-12-05T13:24:55.878 INFO:tasks.workunit.client.1.smithi052.stdout:3/118: unlink da/f1f 0 2023-12-05T13:24:55.878 INFO:tasks.workunit.client.1.smithi052.stdout:3/119: stat da/ff 0 2023-12-05T13:24:55.881 INFO:tasks.workunit.client.1.smithi052.stdout:6/139: rmdir d3/d4/d6/d35 0 2023-12-05T13:24:55.881 INFO:tasks.workunit.client.1.smithi052.stdout:6/140: chown d3/d4/d6/f7 90708 1 2023-12-05T13:24:55.881 INFO:tasks.workunit.client.1.smithi052.stdout:6/141: truncate d3/d5/d9/f2e 322059 0 2023-12-05T13:24:55.885 INFO:tasks.workunit.client.1.smithi052.stdout:4/111: rename de/d1e/l1f to de/d1e/l25 0 2023-12-05T13:24:55.888 INFO:tasks.workunit.client.1.smithi052.stdout:7/139: truncate d7/da/f14 778928 0 2023-12-05T13:24:55.894 INFO:tasks.workunit.client.1.smithi052.stdout:3/120: dwrite da/f22 [0,4194304] 0 2023-12-05T13:24:55.902 INFO:tasks.workunit.client.1.smithi052.stdout:7/140: creat d7/da/d13/d16/f2d x:0 0 0 2023-12-05T13:24:55.905 INFO:tasks.workunit.client.1.smithi052.stdout:3/121: rename da/dd/f1d to da/dd/f26 0 2023-12-05T13:24:55.906 INFO:tasks.workunit.client.1.smithi052.stdout:7/141: mkdir d7/d2e 0 2023-12-05T13:24:55.907 INFO:tasks.workunit.client.1.smithi052.stdout:4/112: dread de/f11 [0,4194304] 0 2023-12-05T13:24:55.907 INFO:tasks.workunit.client.1.smithi052.stdout:7/142: read d7/da/f1a [2551030,87599] 0 2023-12-05T13:24:55.907 INFO:tasks.workunit.client.1.smithi052.stdout:7/143: readlink d7/l23 0 2023-12-05T13:24:55.908 INFO:tasks.workunit.client.1.smithi052.stdout:7/144: write d7/da/fb [635983,55973] 0 2023-12-05T13:24:55.909 INFO:tasks.workunit.client.1.smithi052.stdout:3/122: mkdir da/d27 0 2023-12-05T13:24:55.911 INFO:tasks.workunit.client.1.smithi052.stdout:7/145: mknod d7/c2f 0 2023-12-05T13:24:55.925 INFO:tasks.workunit.client.1.smithi052.stdout:4/113: write de/f18 [117116,62780] 0 2023-12-05T13:24:55.942 INFO:tasks.workunit.client.1.smithi052.stdout:4/114: dwrite de/f14 [0,4194304] 0 2023-12-05T13:24:55.946 INFO:tasks.workunit.client.1.smithi052.stdout:8/166: rmdir d0/de 39 2023-12-05T13:24:55.947 INFO:tasks.workunit.client.1.smithi052.stdout:6/142: rmdir d3/d5 39 2023-12-05T13:24:55.947 INFO:tasks.workunit.client.1.smithi052.stdout:6/143: dread - d3/d4/df/d27/f31 zero size 2023-12-05T13:24:55.947 INFO:tasks.workunit.client.1.smithi052.stdout:4/115: stat lc 0 2023-12-05T13:24:55.948 INFO:tasks.workunit.client.1.smithi052.stdout:6/144: dread d3/f19 [0,4194304] 0 2023-12-05T13:24:55.952 INFO:tasks.workunit.client.1.smithi052.stdout:6/145: mkdir d3/d4/d36 0 2023-12-05T13:24:55.956 INFO:tasks.workunit.client.1.smithi052.stdout:4/116: rename de/l1a to de/d1e/d24/l26 0 2023-12-05T13:24:55.958 INFO:tasks.workunit.client.1.smithi052.stdout:6/146: mkdir d3/d4/d6/d37 0 2023-12-05T13:24:55.958 INFO:tasks.workunit.client.1.smithi052.stdout:6/147: chown d3/d5/d9/f2f 6 1 2023-12-05T13:24:55.967 INFO:tasks.workunit.client.1.smithi052.stdout:4/117: dread f4 [0,4194304] 0 2023-12-05T13:24:55.967 INFO:tasks.workunit.client.1.smithi052.stdout:8/167: dwrite d0/de/d12/f2e [0,4194304] 0 2023-12-05T13:24:55.967 INFO:tasks.workunit.client.1.smithi052.stdout:4/118: chown de/d1e/f23 0 1 2023-12-05T13:24:55.970 INFO:tasks.workunit.client.1.smithi052.stdout:0/139: sync 2023-12-05T13:24:55.971 INFO:tasks.workunit.client.1.smithi052.stdout:9/117: sync 2023-12-05T13:24:55.971 INFO:tasks.workunit.client.1.smithi052.stdout:5/64: sync 2023-12-05T13:24:55.973 INFO:tasks.workunit.client.1.smithi052.stdout:4/119: truncate f4 3103446 0 2023-12-05T13:24:55.974 INFO:tasks.workunit.client.1.smithi052.stdout:3/123: truncate da/f21 735008 0 2023-12-05T13:24:55.976 INFO:tasks.workunit.client.1.smithi052.stdout:0/140: getdents d0/db 0 2023-12-05T13:24:55.977 INFO:tasks.workunit.client.1.smithi052.stdout:0/141: chown d0/db/d1b/d29/c2d 803 1 2023-12-05T13:24:55.977 INFO:tasks.workunit.client.1.smithi052.stdout:0/142: fsync d0/fa 0 2023-12-05T13:24:55.978 INFO:tasks.workunit.client.1.smithi052.stdout:9/118: creat d3/f26 x:0 0 0 2023-12-05T13:24:55.978 INFO:tasks.workunit.client.1.smithi052.stdout:9/119: stat d3/d11/f21 0 2023-12-05T13:24:55.978 INFO:tasks.workunit.client.1.smithi052.stdout:9/120: chown d3/l5 10217004 1 2023-12-05T13:24:55.979 INFO:tasks.workunit.client.1.smithi052.stdout:0/143: write d0/f2b [4811506,32644] 0 2023-12-05T13:24:55.979 INFO:tasks.workunit.client.1.smithi052.stdout:0/144: rename d0 to d0/db/d1b/d30 22 2023-12-05T13:24:55.980 INFO:tasks.workunit.client.1.smithi052.stdout:3/124: creat da/d27/f28 x:0 0 0 2023-12-05T13:24:55.981 INFO:tasks.workunit.client.1.smithi052.stdout:8/168: dread d0/de/f22 [0,4194304] 0 2023-12-05T13:24:55.983 INFO:tasks.workunit.client.1.smithi052.stdout:9/121: truncate d3/d11/f21 579119 0 2023-12-05T13:24:55.987 INFO:tasks.workunit.client.1.smithi052.stdout:7/146: rmdir d7/da/d13 39 2023-12-05T13:24:55.988 INFO:tasks.workunit.client.1.smithi052.stdout:5/65: dwrite d5/fa [0,4194304] 0 2023-12-05T13:24:55.988 INFO:tasks.workunit.client.1.smithi052.stdout:5/66: fsync d5/f14 0 2023-12-05T13:24:55.990 INFO:tasks.workunit.client.1.smithi052.stdout:0/145: dread d0/f2b [4194304,4194304] 0 2023-12-05T13:24:55.991 INFO:tasks.workunit.client.1.smithi052.stdout:8/169: link d0/de/d12/l13 d0/d28/d39/l40 0 2023-12-05T13:24:55.991 INFO:tasks.workunit.client.1.smithi052.stdout:0/146: write d0/db/d14/f28 [4216386,115357] 0 2023-12-05T13:24:55.992 INFO:tasks.workunit.client.1.smithi052.stdout:8/170: write d0/de/d12/f2e [2500246,4552] 0 2023-12-05T13:24:55.992 INFO:tasks.workunit.client.1.smithi052.stdout:1/154: sync 2023-12-05T13:24:55.992 INFO:tasks.workunit.client.1.smithi052.stdout:1/155: stat d5/d7/de/d18/c20 0 2023-12-05T13:24:55.993 INFO:tasks.workunit.client.1.smithi052.stdout:9/122: creat d3/d11/d19/f27 x:0 0 0 2023-12-05T13:24:55.993 INFO:tasks.workunit.client.1.smithi052.stdout:9/123: chown d3/d11/c1b 6218 1 2023-12-05T13:24:55.994 INFO:tasks.workunit.client.1.smithi052.stdout:7/147: creat d7/da/d13/d16/f30 x:0 0 0 2023-12-05T13:24:55.994 INFO:tasks.workunit.client.1.smithi052.stdout:7/148: stat d7/da/d12/f29 0 2023-12-05T13:24:55.994 INFO:tasks.workunit.client.1.smithi052.stdout:7/149: fsync d7/da/d13/d16/f2d 0 2023-12-05T13:24:55.997 INFO:tasks.workunit.client.1.smithi052.stdout:5/67: creat d5/df/f17 x:0 0 0 2023-12-05T13:24:55.998 INFO:tasks.workunit.client.1.smithi052.stdout:0/147: getdents d0/db/d1b/d29 0 2023-12-05T13:24:56.000 INFO:tasks.workunit.client.1.smithi052.stdout:8/171: creat d0/de/f41 x:0 0 0 2023-12-05T13:24:56.000 INFO:tasks.workunit.client.1.smithi052.stdout:5/68: dread f4 [0,4194304] 0 2023-12-05T13:24:56.003 INFO:tasks.workunit.client.1.smithi052.stdout:1/156: rename d5/d7/de/d14/d17/d29 to d5/d7/de/d18/d2d 0 2023-12-05T13:24:56.004 INFO:tasks.workunit.client.1.smithi052.stdout:1/157: write d5/fc [4615437,1967] 0 2023-12-05T13:24:56.006 INFO:tasks.workunit.client.1.smithi052.stdout:0/148: dread d0/f2b [4194304,4194304] 0 2023-12-05T13:24:56.006 INFO:tasks.workunit.client.1.smithi052.stdout:0/149: stat d0/f4 0 2023-12-05T13:24:56.007 INFO:tasks.workunit.client.1.smithi052.stdout:9/124: symlink d3/d11/l28 0 2023-12-05T13:24:56.010 INFO:tasks.workunit.client.1.smithi052.stdout:7/150: mkdir d7/d31 0 2023-12-05T13:24:56.010 INFO:tasks.workunit.client.1.smithi052.stdout:7/151: chown d7/ce 44404 1 2023-12-05T13:24:56.010 INFO:tasks.workunit.client.1.smithi052.stdout:7/152: dread - d7/da/d13/d16/f2d zero size 2023-12-05T13:24:56.011 INFO:tasks.workunit.client.1.smithi052.stdout:1/158: dread d5/fc [0,4194304] 0 2023-12-05T13:24:56.011 INFO:tasks.workunit.client.1.smithi052.stdout:1/159: dread - d5/f2c zero size 2023-12-05T13:24:56.012 INFO:tasks.workunit.client.1.smithi052.stdout:8/172: mknod d0/d28/d39/d3a/c42 0 2023-12-05T13:24:56.014 INFO:tasks.workunit.client.1.smithi052.stdout:5/69: creat d5/d15/f18 x:0 0 0 2023-12-05T13:24:56.020 INFO:tasks.workunit.client.1.smithi052.stdout:0/150: mknod d0/db/d14/c31 0 2023-12-05T13:24:56.022 INFO:tasks.workunit.client.1.smithi052.stdout:9/125: rmdir d3/d1e 39 2023-12-05T13:24:56.022 INFO:tasks.workunit.client.1.smithi052.stdout:9/126: readlink d3/la 0 2023-12-05T13:24:56.025 INFO:tasks.workunit.client.1.smithi052.stdout:1/160: dread d5/d7/f13 [0,4194304] 0 2023-12-05T13:24:56.025 INFO:tasks.workunit.client.1.smithi052.stdout:8/173: mkdir d0/de/d27/d43 0 2023-12-05T13:24:56.029 INFO:tasks.workunit.client.1.smithi052.stdout:5/70: link d5/l8 d5/df/d11/l19 0 2023-12-05T13:24:56.030 INFO:tasks.workunit.client.1.smithi052.stdout:0/151: mknod d0/db/d14/c32 0 2023-12-05T13:24:56.030 INFO:tasks.workunit.client.1.smithi052.stdout:0/152: write d0/db/d14/f26 [213820,89024] 0 2023-12-05T13:24:56.033 INFO:tasks.workunit.client.1.smithi052.stdout:1/161: mkdir d5/d7/de/d18/d2e 0 2023-12-05T13:24:56.033 INFO:tasks.workunit.client.1.smithi052.stdout:0/153: mkdir d0/db/d33 0 2023-12-05T13:24:56.034 INFO:tasks.workunit.client.1.smithi052.stdout:8/174: dread d0/f11 [0,4194304] 0 2023-12-05T13:24:56.034 INFO:tasks.workunit.client.1.smithi052.stdout:7/153: dwrite d7/da/f1a [0,4194304] 0 2023-12-05T13:24:56.036 INFO:tasks.workunit.client.1.smithi052.stdout:1/162: mkdir d5/d7/de/d18/d2d/d2f 0 2023-12-05T13:24:56.037 INFO:tasks.workunit.client.1.smithi052.stdout:9/127: dwrite d3/d1e/f1f [0,4194304] 0 2023-12-05T13:24:56.038 INFO:tasks.workunit.client.1.smithi052.stdout:5/71: dread d5/f9 [0,4194304] 0 2023-12-05T13:24:56.038 INFO:tasks.workunit.client.1.smithi052.stdout:7/154: stat d7/da/c1d 0 2023-12-05T13:24:56.039 INFO:tasks.workunit.client.1.smithi052.stdout:4/120: getdents de/d1e/d24 0 2023-12-05T13:24:56.041 INFO:tasks.workunit.client.1.smithi052.stdout:8/175: mkdir d0/de/d27/d43/d44 0 2023-12-05T13:24:56.047 INFO:tasks.workunit.client.1.smithi052.stdout:1/163: unlink d5/d7/c21 0 2023-12-05T13:24:56.048 INFO:tasks.workunit.client.1.smithi052.stdout:1/164: stat d5/d7/f13 0 2023-12-05T13:24:56.049 INFO:tasks.workunit.client.1.smithi052.stdout:1/165: dread d5/f8 [4194304,4194304] 0 2023-12-05T13:24:56.050 INFO:tasks.workunit.client.1.smithi052.stdout:5/72: symlink d5/d15/l1a 0 2023-12-05T13:24:56.053 INFO:tasks.workunit.client.1.smithi052.stdout:5/73: dread f4 [0,4194304] 0 2023-12-05T13:24:56.053 INFO:tasks.workunit.client.1.smithi052.stdout:5/74: write d5/d15/f18 [211046,31032] 0 2023-12-05T13:24:56.053 INFO:tasks.workunit.client.1.smithi052.stdout:7/155: symlink d7/l32 0 2023-12-05T13:24:56.055 INFO:tasks.workunit.client.1.smithi052.stdout:4/121: mknod de/d1e/c27 0 2023-12-05T13:24:56.055 INFO:tasks.workunit.client.1.smithi052.stdout:4/122: fsync fa 0 2023-12-05T13:24:56.055 INFO:tasks.workunit.client.1.smithi052.stdout:2/167: sync 2023-12-05T13:24:56.055 INFO:tasks.workunit.client.1.smithi052.stdout:2/168: write d2/d13/d1e/f25 [1050440,93584] 0 2023-12-05T13:24:56.058 INFO:tasks.workunit.client.1.smithi052.stdout:8/176: rename d0/de/d12/d20 to d0/de/d45 0 2023-12-05T13:24:56.058 INFO:tasks.workunit.client.1.smithi052.stdout:3/125: dread da/f21 [0,4194304] 0 2023-12-05T13:24:56.060 INFO:tasks.workunit.client.1.smithi052.stdout:1/166: mknod d5/d7/de/d14/d17/c30 0 2023-12-05T13:24:56.062 INFO:tasks.workunit.client.1.smithi052.stdout:5/75: link d5/cb d5/d15/c1b 0 2023-12-05T13:24:56.068 INFO:tasks.workunit.client.1.smithi052.stdout:8/177: rmdir d0/de/d12 39 2023-12-05T13:24:56.070 INFO:tasks.workunit.client.1.smithi052.stdout:3/126: getdents da/d27 0 2023-12-05T13:24:56.071 INFO:tasks.workunit.client.1.smithi052.stdout:3/127: dread da/dd/f19 [0,4194304] 0 2023-12-05T13:24:56.074 INFO:tasks.workunit.client.1.smithi052.stdout:1/167: symlink d5/d26/l31 0 2023-12-05T13:24:56.074 INFO:tasks.workunit.client.1.smithi052.stdout:4/123: dwrite de/f11 [0,4194304] 0 2023-12-05T13:24:56.076 INFO:tasks.workunit.client.1.smithi052.stdout:5/76: rename d5/df/d11/l19 to d5/df/d11/l1c 0 2023-12-05T13:24:56.079 INFO:tasks.workunit.client.1.smithi052.stdout:8/178: mknod d0/d28/d39/d3a/c46 0 2023-12-05T13:24:56.079 INFO:tasks.workunit.client.1.smithi052.stdout:8/179: write d0/f21 [5056249,63737] 0 2023-12-05T13:24:56.080 INFO:tasks.workunit.client.1.smithi052.stdout:3/128: mknod da/c29 0 2023-12-05T13:24:56.085 INFO:tasks.workunit.client.1.smithi052.stdout:1/168: creat d5/d7/de/d14/f32 x:0 0 0 2023-12-05T13:24:56.085 INFO:tasks.workunit.client.1.smithi052.stdout:1/169: dread - d5/f2c zero size 2023-12-05T13:24:56.088 INFO:tasks.workunit.client.1.smithi052.stdout:4/124: creat de/d1e/d24/f28 x:0 0 0 2023-12-05T13:24:56.095 INFO:tasks.workunit.client.1.smithi052.stdout:8/180: link d0/f11 d0/d28/d39/d3a/f47 0 2023-12-05T13:24:56.097 INFO:tasks.workunit.client.1.smithi052.stdout:3/129: symlink da/d25/l2a 0 2023-12-05T13:24:56.099 INFO:tasks.workunit.client.1.smithi052.stdout:1/170: symlink d5/d26/l33 0 2023-12-05T13:24:56.100 INFO:tasks.workunit.client.1.smithi052.stdout:4/125: rmdir de 39 2023-12-05T13:24:56.104 INFO:tasks.workunit.client.1.smithi052.stdout:3/130: creat da/d27/f2b x:0 0 0 2023-12-05T13:24:56.104 INFO:tasks.workunit.client.1.smithi052.stdout:1/171: symlink d5/d7/de/d18/l34 0 2023-12-05T13:24:56.106 INFO:tasks.workunit.client.1.smithi052.stdout:3/131: symlink da/d27/l2c 0 2023-12-05T13:24:56.109 INFO:tasks.workunit.client.1.smithi052.stdout:1/172: rename d5/d7/de/d18/d2d to d5/d7/d35 0 2023-12-05T13:24:56.109 INFO:tasks.workunit.client.1.smithi052.stdout:8/181: dwrite d0/f32 [0,4194304] 0 2023-12-05T13:24:56.110 INFO:tasks.workunit.client.1.smithi052.stdout:4/126: mkdir de/d29 0 2023-12-05T13:24:56.121 INFO:tasks.workunit.client.1.smithi052.stdout:1/173: unlink d5/fc 0 2023-12-05T13:24:56.124 INFO:tasks.workunit.client.1.smithi052.stdout:4/127: chown de/c1d 5729 1 2023-12-05T13:24:56.126 INFO:tasks.workunit.client.1.smithi052.stdout:4/128: creat de/d1e/f2a x:0 0 0 2023-12-05T13:24:56.127 INFO:tasks.workunit.client.1.smithi052.stdout:3/132: dwrite da/d27/f2b [0,4194304] 0 2023-12-05T13:24:56.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/129: truncate de/f12 4421257 0 2023-12-05T13:24:56.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/130: dread - de/d1e/f2a zero size 2023-12-05T13:24:56.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/131: write de/f18 [483355,123921] 0 2023-12-05T13:24:56.130 INFO:tasks.workunit.client.1.smithi052.stdout:8/182: dwrite d0/de/d12/f17 [0,4194304] 0 2023-12-05T13:24:56.131 INFO:tasks.workunit.client.1.smithi052.stdout:3/133: rmdir da/dd 39 2023-12-05T13:24:56.137 INFO:tasks.workunit.client.1.smithi052.stdout:1/174: dwrite d5/d7/de/d14/f32 [0,4194304] 0 2023-12-05T13:24:56.138 INFO:tasks.workunit.client.1.smithi052.stdout:8/183: mknod d0/de/d12/d29/c48 0 2023-12-05T13:24:56.138 INFO:tasks.workunit.client.1.smithi052.stdout:8/184: write d0/de/f41 [531926,59906] 0 2023-12-05T13:24:56.140 INFO:tasks.workunit.client.1.smithi052.stdout:5/77: getdents d5/d15 0 2023-12-05T13:24:56.141 INFO:tasks.workunit.client.1.smithi052.stdout:4/132: mkdir de/d2b 0 2023-12-05T13:24:56.145 INFO:tasks.workunit.client.1.smithi052.stdout:1/175: mknod d5/d7/de/d18/c36 0 2023-12-05T13:24:56.151 INFO:tasks.workunit.client.1.smithi052.stdout:5/78: truncate d5/fc 227603 0 2023-12-05T13:24:56.151 INFO:tasks.workunit.client.1.smithi052.stdout:5/79: truncate d5/f16 945224 0 2023-12-05T13:24:56.155 INFO:tasks.workunit.client.1.smithi052.stdout:3/134: getdents da 0 2023-12-05T13:24:56.169 INFO:tasks.workunit.client.1.smithi052.stdout:4/133: dread de/d1e/f20 [0,4194304] 0 2023-12-05T13:24:56.169 INFO:tasks.workunit.client.1.smithi052.stdout:1/176: dwrite d5/d7/de/d14/d17/f28 [0,4194304] 0 2023-12-05T13:24:56.170 INFO:tasks.workunit.client.1.smithi052.stdout:6/148: sync 2023-12-05T13:24:56.174 INFO:tasks.workunit.client.1.smithi052.stdout:3/135: dwrite f5 [0,4194304] 0 2023-12-05T13:24:56.176 INFO:tasks.workunit.client.1.smithi052.stdout:6/149: getdents d3/d5 0 2023-12-05T13:24:56.176 INFO:tasks.workunit.client.1.smithi052.stdout:5/80: dwrite d5/f16 [0,4194304] 0 2023-12-05T13:24:56.178 INFO:tasks.workunit.client.1.smithi052.stdout:3/136: getdents da/d25 0 2023-12-05T13:24:56.179 INFO:tasks.workunit.client.1.smithi052.stdout:6/150: dread d3/d4/df/f2a [0,4194304] 0 2023-12-05T13:24:56.179 INFO:tasks.workunit.client.1.smithi052.stdout:6/151: write d3/d4/df/f2a [344092,98880] 0 2023-12-05T13:24:56.183 INFO:tasks.workunit.client.1.smithi052.stdout:5/81: link d5/cb d5/d15/c1d 0 2023-12-05T13:24:56.183 INFO:tasks.workunit.client.1.smithi052.stdout:5/82: fdatasync d5/d15/f18 0 2023-12-05T13:24:56.185 INFO:tasks.workunit.client.1.smithi052.stdout:4/134: dwrite de/d1e/f20 [4194304,4194304] 0 2023-12-05T13:24:56.185 INFO:tasks.workunit.client.1.smithi052.stdout:4/135: stat de/d29 0 2023-12-05T13:24:56.187 INFO:tasks.workunit.client.1.smithi052.stdout:3/137: unlink da/c12 0 2023-12-05T13:24:56.187 INFO:tasks.workunit.client.1.smithi052.stdout:6/152: mknod d3/d5/c38 0 2023-12-05T13:24:56.187 INFO:tasks.workunit.client.1.smithi052.stdout:6/153: fsync d3/d4/f17 0 2023-12-05T13:24:56.191 INFO:tasks.workunit.client.1.smithi052.stdout:3/138: creat da/d27/f2d x:0 0 0 2023-12-05T13:24:56.196 INFO:tasks.workunit.client.1.smithi052.stdout:3/139: mkdir da/d2e 0 2023-12-05T13:24:56.212 INFO:tasks.workunit.client.1.smithi052.stdout:6/154: dwrite d3/f16 [0,4194304] 0 2023-12-05T13:24:56.212 INFO:tasks.workunit.client.1.smithi052.stdout:4/136: dwrite de/d1e/f23 [0,4194304] 0 2023-12-05T13:24:56.212 INFO:tasks.workunit.client.1.smithi052.stdout:4/137: fdatasync de/f14 0 2023-12-05T13:24:56.216 INFO:tasks.workunit.client.1.smithi052.stdout:6/155: rmdir d3/d4/d6/d26 39 2023-12-05T13:24:56.221 INFO:tasks.workunit.client.1.smithi052.stdout:4/138: rename lc to de/d1e/l2c 0 2023-12-05T13:24:56.223 INFO:tasks.workunit.client.1.smithi052.stdout:6/156: rename d3/d4/d6/d37 to d3/d4/d36/d39 0 2023-12-05T13:24:56.223 INFO:tasks.workunit.client.1.smithi052.stdout:6/157: write d3/d5/d9/f2e [637122,42297] 0 2023-12-05T13:24:56.223 INFO:tasks.workunit.client.1.smithi052.stdout:6/158: write d3/f19 [1250085,16759] 0 2023-12-05T13:24:56.225 INFO:tasks.workunit.client.1.smithi052.stdout:4/139: rename de/d1e/f23 to de/d2b/f2d 0 2023-12-05T13:24:56.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/140: creat de/d29/f2e x:0 0 0 2023-12-05T13:24:56.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/141: write de/d1e/f2a [800122,96691] 0 2023-12-05T13:24:56.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/142: chown de/d2b 518598 1 2023-12-05T13:24:56.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/143: chown de/f11 3820100 1 2023-12-05T13:24:56.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/144: fdatasync de/d1e/d24/f28 0 2023-12-05T13:24:56.245 INFO:tasks.workunit.client.1.smithi052.stdout:3/140: getdents da/d27 0 2023-12-05T13:24:56.245 INFO:tasks.workunit.client.1.smithi052.stdout:3/141: chown da/dd/f19 24150 1 2023-12-05T13:24:56.247 INFO:tasks.workunit.client.1.smithi052.stdout:3/142: chown l3 3980 1 2023-12-05T13:24:56.249 INFO:tasks.workunit.client.1.smithi052.stdout:3/143: readlink l8 0 2023-12-05T13:24:56.249 INFO:tasks.workunit.client.1.smithi052.stdout:3/144: chown da/c1b 0 1 2023-12-05T13:24:56.249 INFO:tasks.workunit.client.1.smithi052.stdout:3/145: chown da/fe 4114266 1 2023-12-05T13:24:56.249 INFO:tasks.workunit.client.1.smithi052.stdout:3/146: dread - da/dd/f17 zero size 2023-12-05T13:24:56.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/147: symlink da/d2e/l2f 0 2023-12-05T13:24:56.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/148: readlink l2 0 2023-12-05T13:24:56.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/149: chown da/dd/l10 67831 1 2023-12-05T13:24:56.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/150: stat da 0 2023-12-05T13:24:56.253 INFO:tasks.workunit.client.1.smithi052.stdout:3/151: creat da/dd/f30 x:0 0 0 2023-12-05T13:24:56.254 INFO:tasks.workunit.client.1.smithi052.stdout:3/152: read f4 [625283,26961] 0 2023-12-05T13:24:56.256 INFO:tasks.workunit.client.1.smithi052.stdout:3/153: rename da/f1c to da/d25/f31 0 2023-12-05T13:24:56.257 INFO:tasks.workunit.client.1.smithi052.stdout:3/154: fdatasync f4 0 2023-12-05T13:24:56.258 INFO:tasks.workunit.client.1.smithi052.stdout:3/155: rmdir da/d25 39 2023-12-05T13:24:56.258 INFO:tasks.workunit.client.1.smithi052.stdout:3/156: dread - da/dd/f30 zero size 2023-12-05T13:24:56.266 INFO:tasks.workunit.client.1.smithi052.stdout:0/154: sync 2023-12-05T13:24:56.268 INFO:tasks.workunit.client.1.smithi052.stdout:0/155: symlink d0/db/d2e/l34 0 2023-12-05T13:24:56.270 INFO:tasks.workunit.client.1.smithi052.stdout:3/157: dwrite da/dd/f19 [0,4194304] 0 2023-12-05T13:24:56.271 INFO:tasks.workunit.client.1.smithi052.stdout:0/156: creat d0/db/d33/f35 x:0 0 0 2023-12-05T13:24:56.271 INFO:tasks.workunit.client.1.smithi052.stdout:0/157: readlink d0/db/l18 0 2023-12-05T13:24:56.271 INFO:tasks.workunit.client.1.smithi052.stdout:0/158: chown d0/db/d1b 78746933 1 2023-12-05T13:24:56.271 INFO:tasks.workunit.client.1.smithi052.stdout:6/159: getdents d3/d4/d6 0 2023-12-05T13:24:56.279 INFO:tasks.workunit.client.1.smithi052.stdout:3/158: rename da/cb to da/dd/c32 0 2023-12-05T13:24:56.279 INFO:tasks.workunit.client.1.smithi052.stdout:3/159: chown da/d25 557727108 1 2023-12-05T13:24:56.281 INFO:tasks.workunit.client.1.smithi052.stdout:0/159: symlink d0/db/d1b/l36 0 2023-12-05T13:24:56.283 INFO:tasks.workunit.client.1.smithi052.stdout:0/160: creat d0/db/d1b/f37 x:0 0 0 2023-12-05T13:24:56.283 INFO:tasks.workunit.client.1.smithi052.stdout:0/161: write d0/db/f1f [1187057,97703] 0 2023-12-05T13:24:56.283 INFO:tasks.workunit.client.1.smithi052.stdout:0/162: dread - d0/db/d1b/f37 zero size 2023-12-05T13:24:56.285 INFO:tasks.workunit.client.1.smithi052.stdout:6/160: dwrite d3/d4/df/d27/f31 [0,4194304] 0 2023-12-05T13:24:56.285 INFO:tasks.workunit.client.1.smithi052.stdout:6/161: dread - d3/d4/d6/f1d zero size 2023-12-05T13:24:56.292 INFO:tasks.workunit.client.1.smithi052.stdout:6/162: creat d3/d5/d9/f3a x:0 0 0 2023-12-05T13:24:56.296 INFO:tasks.workunit.client.1.smithi052.stdout:6/163: link c2 d3/d4/d36/c3b 0 2023-12-05T13:24:56.297 INFO:tasks.workunit.client.1.smithi052.stdout:6/164: write d3/d5/d9/f2f [803145,103356] 0 2023-12-05T13:24:56.298 INFO:tasks.workunit.client.1.smithi052.stdout:3/160: dwrite da/f22 [4194304,4194304] 0 2023-12-05T13:24:56.298 INFO:tasks.workunit.client.1.smithi052.stdout:6/165: mknod d3/d4/df/d24/c3c 0 2023-12-05T13:24:56.300 INFO:tasks.workunit.client.1.smithi052.stdout:3/161: write da/dd/f19 [1110552,55170] 0 2023-12-05T13:24:56.303 INFO:tasks.workunit.client.1.smithi052.stdout:0/163: dwrite d0/db/f1f [0,4194304] 0 2023-12-05T13:24:56.305 INFO:tasks.workunit.client.1.smithi052.stdout:6/166: creat d3/f3d x:0 0 0 2023-12-05T13:24:56.310 INFO:tasks.workunit.client.1.smithi052.stdout:3/162: mkdir da/d25/d33 0 2023-12-05T13:24:56.310 INFO:tasks.workunit.client.1.smithi052.stdout:3/163: readlink da/dd/l10 0 2023-12-05T13:24:56.314 INFO:tasks.workunit.client.1.smithi052.stdout:0/164: getdents d0/db 0 2023-12-05T13:24:56.318 INFO:tasks.workunit.client.1.smithi052.stdout:6/167: rename d3/d5/c38 to d3/d5/d9/c3e 0 2023-12-05T13:24:56.318 INFO:tasks.workunit.client.1.smithi052.stdout:6/168: fdatasync d3/f19 0 2023-12-05T13:24:56.319 INFO:tasks.workunit.client.1.smithi052.stdout:3/164: mknod da/d27/c34 0 2023-12-05T13:24:56.319 INFO:tasks.workunit.client.1.smithi052.stdout:3/165: write da/d27/f28 [275424,119049] 0 2023-12-05T13:24:56.321 INFO:tasks.workunit.client.1.smithi052.stdout:0/165: symlink d0/db/d33/l38 0 2023-12-05T13:24:56.323 INFO:tasks.workunit.client.1.smithi052.stdout:3/166: rmdir da/d2e 39 2023-12-05T13:24:56.323 INFO:tasks.workunit.client.1.smithi052.stdout:3/167: rename da/d25 to da/d25/d35 22 2023-12-05T13:24:56.328 INFO:tasks.workunit.client.1.smithi052.stdout:0/166: symlink d0/l39 0 2023-12-05T13:24:56.328 INFO:tasks.workunit.client.1.smithi052.stdout:0/167: fsync d0/fa 0 2023-12-05T13:24:56.337 INFO:tasks.workunit.client.1.smithi052.stdout:6/169: dwrite d3/d5/d9/f2f [0,4194304] 0 2023-12-05T13:24:56.337 INFO:tasks.workunit.client.1.smithi052.stdout:6/170: chown d3/d4/df/d24/c3c 2736225 1 2023-12-05T13:24:56.337 INFO:tasks.workunit.client.1.smithi052.stdout:6/171: truncate d3/d4/d6/f1d 991985 0 2023-12-05T13:24:56.349 INFO:tasks.workunit.client.1.smithi052.stdout:8/185: sync 2023-12-05T13:24:56.349 INFO:tasks.workunit.client.1.smithi052.stdout:9/128: sync 2023-12-05T13:24:56.349 INFO:tasks.workunit.client.1.smithi052.stdout:7/156: sync 2023-12-05T13:24:56.349 INFO:tasks.workunit.client.1.smithi052.stdout:2/169: sync 2023-12-05T13:24:56.349 INFO:tasks.workunit.client.1.smithi052.stdout:8/186: write d0/f32 [4223093,128749] 0 2023-12-05T13:24:56.351 INFO:tasks.workunit.client.1.smithi052.stdout:9/129: unlink d3/d1e/f1f 0 2023-12-05T13:24:56.351 INFO:tasks.workunit.client.1.smithi052.stdout:9/130: stat d3/fd 0 2023-12-05T13:24:56.356 INFO:tasks.workunit.client.1.smithi052.stdout:8/187: getdents d0/d28/d2b 0 2023-12-05T13:24:56.356 INFO:tasks.workunit.client.1.smithi052.stdout:9/131: dread d3/f24 [4194304,4194304] 0 2023-12-05T13:24:56.360 INFO:tasks.workunit.client.1.smithi052.stdout:2/170: dread d2/d13/f16 [0,4194304] 0 2023-12-05T13:24:56.361 INFO:tasks.workunit.client.1.smithi052.stdout:2/171: fdatasync d2/d13/f17 0 2023-12-05T13:24:56.362 INFO:tasks.workunit.client.1.smithi052.stdout:7/157: dread d7/f27 [0,4194304] 0 2023-12-05T13:24:56.363 INFO:tasks.workunit.client.1.smithi052.stdout:2/172: getdents d2/d13 0 2023-12-05T13:24:56.367 INFO:tasks.workunit.client.1.smithi052.stdout:2/173: creat d2/d13/f36 x:0 0 0 2023-12-05T13:24:56.375 INFO:tasks.workunit.client.1.smithi052.stdout:8/188: dwrite d0/fc [0,4194304] 0 2023-12-05T13:24:56.375 INFO:tasks.workunit.client.1.smithi052.stdout:8/189: readlink d0/de/l1e 0 2023-12-05T13:24:56.375 INFO:tasks.workunit.client.1.smithi052.stdout:8/190: chown d0/de/d12/c37 47259 1 2023-12-05T13:24:56.377 INFO:tasks.workunit.client.1.smithi052.stdout:2/174: truncate d2/d13/d1e/f25 608601 0 2023-12-05T13:24:56.386 INFO:tasks.workunit.client.1.smithi052.stdout:7/158: dwrite d7/da/f14 [0,4194304] 0 2023-12-05T13:24:56.386 INFO:tasks.workunit.client.1.smithi052.stdout:7/159: truncate d7/da/d13/d16/f30 395656 0 2023-12-05T13:24:56.387 INFO:tasks.workunit.client.1.smithi052.stdout:2/175: mkdir d2/d13/d37 0 2023-12-05T13:24:56.387 INFO:tasks.workunit.client.1.smithi052.stdout:9/132: rmdir d3/d1e 39 2023-12-05T13:24:56.388 INFO:tasks.workunit.client.1.smithi052.stdout:8/191: dwrite d0/f32 [4194304,4194304] 0 2023-12-05T13:24:56.388 INFO:tasks.workunit.client.1.smithi052.stdout:7/160: write d7/da/f28 [1099635,74177] 0 2023-12-05T13:24:56.389 INFO:tasks.workunit.client.1.smithi052.stdout:2/176: symlink d2/d13/d37/l38 0 2023-12-05T13:24:56.389 INFO:tasks.workunit.client.1.smithi052.stdout:2/177: chown d2/d13/d1e/f25 19963 1 2023-12-05T13:24:56.390 INFO:tasks.workunit.client.1.smithi052.stdout:9/133: creat d3/d11/d19/f29 x:0 0 0 2023-12-05T13:24:56.393 INFO:tasks.workunit.client.1.smithi052.stdout:8/192: unlink d0/fc 0 2023-12-05T13:24:56.396 INFO:tasks.workunit.client.1.smithi052.stdout:7/161: rename d7/da/fb to d7/da/d13/d16/f33 0 2023-12-05T13:24:56.397 INFO:tasks.workunit.client.1.smithi052.stdout:7/162: truncate d7/f2a 792770 0 2023-12-05T13:24:56.399 INFO:tasks.workunit.client.1.smithi052.stdout:9/134: mkdir d3/d2a 0 2023-12-05T13:24:56.400 INFO:tasks.workunit.client.1.smithi052.stdout:8/193: rename d0/de/d12/f17 to d0/de/d27/d43/d44/f49 0 2023-12-05T13:24:56.402 INFO:tasks.workunit.client.1.smithi052.stdout:7/163: link d7/da/d13/d16/f2d d7/da/d12/f34 0 2023-12-05T13:24:56.402 INFO:tasks.workunit.client.1.smithi052.stdout:7/164: write d7/da/f14 [4585408,129713] 0 2023-12-05T13:24:56.402 INFO:tasks.workunit.client.1.smithi052.stdout:7/165: write d7/da/f28 [5015319,52360] 0 2023-12-05T13:24:56.405 INFO:tasks.workunit.client.1.smithi052.stdout:1/177: sync 2023-12-05T13:24:56.405 INFO:tasks.workunit.client.1.smithi052.stdout:5/83: sync 2023-12-05T13:24:56.405 INFO:tasks.workunit.client.1.smithi052.stdout:8/194: dread d0/f21 [0,4194304] 0 2023-12-05T13:24:56.405 INFO:tasks.workunit.client.1.smithi052.stdout:9/135: creat d3/d2a/f2b x:0 0 0 2023-12-05T13:24:56.407 INFO:tasks.workunit.client.1.smithi052.stdout:1/178: write d5/d7/de/d14/f32 [1408905,57932] 0 2023-12-05T13:24:56.407 INFO:tasks.workunit.client.1.smithi052.stdout:1/179: dread - d5/f2c zero size 2023-12-05T13:24:56.409 INFO:tasks.workunit.client.1.smithi052.stdout:5/84: dread d5/d15/f18 [0,4194304] 0 2023-12-05T13:24:56.421 INFO:tasks.workunit.client.1.smithi052.stdout:1/180: dread d5/d7/de/d14/f32 [0,4194304] 0 2023-12-05T13:24:56.431 INFO:tasks.workunit.client.1.smithi052.stdout:1/181: dread d5/d7/de/d14/d17/f28 [0,4194304] 0 2023-12-05T13:24:56.432 INFO:tasks.workunit.client.1.smithi052.stdout:1/182: mkdir d5/d7/d35/d37 0 2023-12-05T13:24:56.433 INFO:tasks.workunit.client.1.smithi052.stdout:1/183: truncate f4 1747856 0 2023-12-05T13:24:56.434 INFO:tasks.workunit.client.1.smithi052.stdout:1/184: chown d5/d26/l31 8 1 2023-12-05T13:24:56.435 INFO:tasks.workunit.client.1.smithi052.stdout:1/185: mknod d5/d7/de/d18/c38 0 2023-12-05T13:24:56.437 INFO:tasks.workunit.client.1.smithi052.stdout:5/85: dwrite d5/f9 [4194304,4194304] 0 2023-12-05T13:24:56.437 INFO:tasks.workunit.client.1.smithi052.stdout:8/195: dwrite d0/d28/d39/d3a/f47 [0,4194304] 0 2023-12-05T13:24:56.437 INFO:tasks.workunit.client.1.smithi052.stdout:9/136: dwrite d3/d11/f21 [0,4194304] 0 2023-12-05T13:24:56.437 INFO:tasks.workunit.client.1.smithi052.stdout:9/137: write d3/f15 [3076017,12857] 0 2023-12-05T13:24:56.437 INFO:tasks.workunit.client.1.smithi052.stdout:9/138: dread - d3/d11/d19/f29 zero size 2023-12-05T13:24:56.438 INFO:tasks.workunit.client.1.smithi052.stdout:9/139: fdatasync d3/d1e/f23 0 2023-12-05T13:24:56.438 INFO:tasks.workunit.client.1.smithi052.stdout:1/186: creat d5/d7/de/d14/d17/f39 x:0 0 0 2023-12-05T13:24:56.442 INFO:tasks.workunit.client.1.smithi052.stdout:5/86: unlink d5/f16 0 2023-12-05T13:24:56.448 INFO:tasks.workunit.client.1.smithi052.stdout:8/196: mknod d0/de/d27/d43/d44/c4a 0 2023-12-05T13:24:56.448 INFO:tasks.workunit.client.1.smithi052.stdout:8/197: fsync d0/de/f22 0 2023-12-05T13:24:56.451 INFO:tasks.workunit.client.1.smithi052.stdout:9/140: link d3/d11/d19/f29 d3/f2c 0 2023-12-05T13:24:56.452 INFO:tasks.workunit.client.1.smithi052.stdout:1/187: creat d5/f3a x:0 0 0 2023-12-05T13:24:56.453 INFO:tasks.workunit.client.1.smithi052.stdout:4/145: sync 2023-12-05T13:24:56.454 INFO:tasks.workunit.client.1.smithi052.stdout:5/87: symlink d5/d15/l1e 0 2023-12-05T13:24:56.455 INFO:tasks.workunit.client.1.smithi052.stdout:8/198: dread d0/fa [0,4194304] 0 2023-12-05T13:24:56.455 INFO:tasks.workunit.client.1.smithi052.stdout:8/199: write d0/de/f35 [966869,104578] 0 2023-12-05T13:24:56.457 INFO:tasks.workunit.client.1.smithi052.stdout:1/188: creat d5/d7/de/d14/d2a/f3b x:0 0 0 2023-12-05T13:24:56.459 INFO:tasks.workunit.client.1.smithi052.stdout:4/146: symlink de/d1e/d24/l2f 0 2023-12-05T13:24:56.459 INFO:tasks.workunit.client.1.smithi052.stdout:4/147: stat de/l13 0 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:4/148: read de/f11 [2592023,100166] 0 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:4/149: readlink de/d1e/l22 0 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:4/150: readlink de/d1e/d24/l26 0 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:5/88: mknod d5/d15/c1f 0 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:5/89: read - d5/df/f17 zero size 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:5/90: chown d5/fa 2771290 1 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:5/91: write f4 [449061,111133] 0 2023-12-05T13:24:56.460 INFO:tasks.workunit.client.1.smithi052.stdout:5/92: write d5/d15/f18 [754197,70051] 0 2023-12-05T13:24:56.462 INFO:tasks.workunit.client.1.smithi052.stdout:1/189: mkdir d5/d7/de/d14/d17/d3c 0 2023-12-05T13:24:56.465 INFO:tasks.workunit.client.1.smithi052.stdout:5/93: creat d5/df/f20 x:0 0 0 2023-12-05T13:24:56.468 INFO:tasks.workunit.client.1.smithi052.stdout:4/151: mkdir de/d30 0 2023-12-05T13:24:56.468 INFO:tasks.workunit.client.1.smithi052.stdout:1/190: dread d5/f8 [4194304,4194304] 0 2023-12-05T13:24:56.472 INFO:tasks.workunit.client.1.smithi052.stdout:1/191: unlink d5/d7/de/d18/c20 0 2023-12-05T13:24:56.476 INFO:tasks.workunit.client.1.smithi052.stdout:5/94: fdatasync d5/fc 0 2023-12-05T13:24:56.478 INFO:tasks.workunit.client.1.smithi052.stdout:1/192: rename d5/d7/de/d14/d17/f28 to d5/d7/d35/f3d 0 2023-12-05T13:24:56.478 INFO:tasks.workunit.client.1.smithi052.stdout:1/193: chown d5/d7/de/d14/f32 6129180 1 2023-12-05T13:24:56.482 INFO:tasks.workunit.client.1.smithi052.stdout:5/95: getdents d5 0 2023-12-05T13:24:56.484 INFO:tasks.workunit.client.1.smithi052.stdout:4/152: dwrite de/f14 [0,4194304] 0 2023-12-05T13:24:56.484 INFO:tasks.workunit.client.1.smithi052.stdout:1/194: mkdir d5/d7/d35/d2f/d3e 0 2023-12-05T13:24:56.485 INFO:tasks.workunit.client.1.smithi052.stdout:4/153: read fa [3372313,73415] 0 2023-12-05T13:24:56.486 INFO:tasks.workunit.client.1.smithi052.stdout:5/96: mkdir d5/d15/d21 0 2023-12-05T13:24:56.488 INFO:tasks.workunit.client.1.smithi052.stdout:8/200: rmdir d0/de 39 2023-12-05T13:24:56.490 INFO:tasks.workunit.client.1.smithi052.stdout:1/195: symlink d5/d26/l3f 0 2023-12-05T13:24:56.491 INFO:tasks.workunit.client.1.smithi052.stdout:9/141: fsync d3/d11/d19/f29 0 2023-12-05T13:24:56.496 INFO:tasks.workunit.client.1.smithi052.stdout:4/154: symlink de/d30/l31 0 2023-12-05T13:24:56.497 INFO:tasks.workunit.client.1.smithi052.stdout:5/97: creat d5/df/f22 x:0 0 0 2023-12-05T13:24:56.499 INFO:tasks.workunit.client.1.smithi052.stdout:8/201: rmdir d0/de 39 2023-12-05T13:24:56.499 INFO:tasks.workunit.client.1.smithi052.stdout:8/202: write d0/d28/d39/d3a/f47 [4749007,102886] 0 2023-12-05T13:24:56.500 INFO:tasks.workunit.client.1.smithi052.stdout:1/196: symlink d5/d7/d35/d37/l40 0 2023-12-05T13:24:56.502 INFO:tasks.workunit.client.1.smithi052.stdout:9/142: unlink d3/d1e/c25 0 2023-12-05T13:24:56.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/143: stat d3/f26 0 2023-12-05T13:24:56.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/144: fdatasync d3/fd 0 2023-12-05T13:24:56.503 INFO:tasks.workunit.client.1.smithi052.stdout:9/145: write d3/d11/d19/f29 [438060,113866] 0 2023-12-05T13:24:56.505 INFO:tasks.workunit.client.1.smithi052.stdout:4/155: dread de/f14 [0,4194304] 0 2023-12-05T13:24:56.506 INFO:tasks.workunit.client.1.smithi052.stdout:8/203: getdents d0/de/d12/d29 0 2023-12-05T13:24:56.508 INFO:tasks.workunit.client.1.smithi052.stdout:1/197: dread d5/d7/f12 [0,4194304] 0 2023-12-05T13:24:56.508 INFO:tasks.workunit.client.1.smithi052.stdout:1/198: truncate d5/d7/de/d14/d2a/f3b 173548 0 2023-12-05T13:24:56.508 INFO:tasks.workunit.client.1.smithi052.stdout:1/199: fsync d5/d7/f13 0 2023-12-05T13:24:56.513 INFO:tasks.workunit.client.1.smithi052.stdout:9/146: mknod d3/c2d 0 2023-12-05T13:24:56.514 INFO:tasks.workunit.client.1.smithi052.stdout:4/156: creat de/d29/f32 x:0 0 0 2023-12-05T13:24:56.516 INFO:tasks.workunit.client.1.smithi052.stdout:4/157: stat de/f17 0 2023-12-05T13:24:56.516 INFO:tasks.workunit.client.1.smithi052.stdout:4/158: write de/d29/f32 [557532,71226] 0 2023-12-05T13:24:56.517 INFO:tasks.workunit.client.1.smithi052.stdout:4/159: stat de/d1e/l25 0 2023-12-05T13:24:56.517 INFO:tasks.workunit.client.1.smithi052.stdout:4/160: chown de/d1e 0 1 2023-12-05T13:24:56.526 INFO:tasks.workunit.client.1.smithi052.stdout:8/204: dwrite d0/d28/f2a [0,4194304] 0 2023-12-05T13:24:56.526 INFO:tasks.workunit.client.1.smithi052.stdout:8/205: stat d0/de/d45/c24 0 2023-12-05T13:24:56.531 INFO:tasks.workunit.client.1.smithi052.stdout:5/98: getdents d5/df 0 2023-12-05T13:24:56.531 INFO:tasks.workunit.client.1.smithi052.stdout:1/200: dwrite d5/d7/f12 [4194304,4194304] 0 2023-12-05T13:24:56.533 INFO:tasks.workunit.client.1.smithi052.stdout:8/206: symlink d0/d28/d39/d3a/l4b 0 2023-12-05T13:24:56.533 INFO:tasks.workunit.client.1.smithi052.stdout:5/99: dread f4 [0,4194304] 0 2023-12-05T13:24:56.533 INFO:tasks.workunit.client.1.smithi052.stdout:4/161: dwrite de/d29/f2e [0,4194304] 0 2023-12-05T13:24:56.533 INFO:tasks.workunit.client.1.smithi052.stdout:8/207: write d0/d28/d39/d3a/f47 [2310731,392] 0 2023-12-05T13:24:56.534 INFO:tasks.workunit.client.1.smithi052.stdout:4/162: write de/d29/f32 [69530,96400] 0 2023-12-05T13:24:56.534 INFO:tasks.workunit.client.1.smithi052.stdout:4/163: chown de/d1e/l2c 102341 1 2023-12-05T13:24:56.540 INFO:tasks.workunit.client.1.smithi052.stdout:3/168: sync 2023-12-05T13:24:56.540 INFO:tasks.workunit.client.1.smithi052.stdout:6/172: sync 2023-12-05T13:24:56.540 INFO:tasks.workunit.client.1.smithi052.stdout:0/168: sync 2023-12-05T13:24:56.540 INFO:tasks.workunit.client.1.smithi052.stdout:9/147: getdents d3 0 2023-12-05T13:24:56.541 INFO:tasks.workunit.client.1.smithi052.stdout:1/201: mkdir d5/d26/d41 0 2023-12-05T13:24:56.546 INFO:tasks.workunit.client.1.smithi052.stdout:5/100: creat d5/d15/d21/f23 x:0 0 0 2023-12-05T13:24:56.546 INFO:tasks.workunit.client.1.smithi052.stdout:5/101: dread - d5/df/f20 zero size 2023-12-05T13:24:56.546 INFO:tasks.workunit.client.1.smithi052.stdout:4/164: dread de/f12 [4194304,4194304] 0 2023-12-05T13:24:56.550 INFO:tasks.workunit.client.1.smithi052.stdout:6/173: stat d3/d5/c13 0 2023-12-05T13:24:56.551 INFO:tasks.workunit.client.1.smithi052.stdout:3/169: symlink da/d27/l36 0 2023-12-05T13:24:56.551 INFO:tasks.workunit.client.1.smithi052.stdout:6/174: fdatasync d3/f3d 0 2023-12-05T13:24:56.551 INFO:tasks.workunit.client.1.smithi052.stdout:6/175: write d3/d4/f17 [5197411,88026] 0 2023-12-05T13:24:56.556 INFO:tasks.workunit.client.1.smithi052.stdout:1/202: rename d5/d7/c23 to d5/d7/de/d14/d17/c42 0 2023-12-05T13:24:56.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/208: dwrite d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:24:56.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/209: truncate d0/de/f38 939663 0 2023-12-05T13:24:56.557 INFO:tasks.workunit.client.1.smithi052.stdout:9/148: dwrite d3/f15 [0,4194304] 0 2023-12-05T13:24:56.559 INFO:tasks.workunit.client.1.smithi052.stdout:5/102: link d5/d15/l1e d5/l24 0 2023-12-05T13:24:56.559 INFO:tasks.workunit.client.1.smithi052.stdout:5/103: chown d5/fc 92818 1 2023-12-05T13:24:56.560 INFO:tasks.workunit.client.1.smithi052.stdout:5/104: write d5/fc [674937,43258] 0 2023-12-05T13:24:56.560 INFO:tasks.workunit.client.1.smithi052.stdout:5/105: fdatasync d5/d15/d21/f23 0 2023-12-05T13:24:56.560 INFO:tasks.workunit.client.1.smithi052.stdout:7/166: sync 2023-12-05T13:24:56.561 INFO:tasks.workunit.client.1.smithi052.stdout:1/203: dread d5/d7/de/d14/f32 [0,4194304] 0 2023-12-05T13:24:56.561 INFO:tasks.workunit.client.1.smithi052.stdout:5/106: write d5/d15/f18 [477435,97704] 0 2023-12-05T13:24:56.561 INFO:tasks.workunit.client.1.smithi052.stdout:5/107: truncate d5/f14 1134322 0 2023-12-05T13:24:56.562 INFO:tasks.workunit.client.1.smithi052.stdout:2/178: sync 2023-12-05T13:24:56.562 INFO:tasks.workunit.client.1.smithi052.stdout:2/179: fdatasync d2/d13/d1e/f25 0 2023-12-05T13:24:56.566 INFO:tasks.workunit.client.1.smithi052.stdout:0/169: mknod d0/c3a 0 2023-12-05T13:24:56.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/176: rename d3/d4/c8 to d3/d4/d36/c3f 0 2023-12-05T13:24:56.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/165: write de/d29/f2e [4219543,93016] 0 2023-12-05T13:24:56.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/166: write de/d1e/d24/f28 [896296,77065] 0 2023-12-05T13:24:56.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/177: write d3/d4/d6/f11 [743247,92981] 0 2023-12-05T13:24:56.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/178: stat d3/c12 0 2023-12-05T13:24:56.571 INFO:tasks.workunit.client.1.smithi052.stdout:8/210: creat d0/de/d45/f4c x:0 0 0 2023-12-05T13:24:56.571 INFO:tasks.workunit.client.1.smithi052.stdout:8/211: chown d0/de/d27/l3f 45 1 2023-12-05T13:24:56.572 INFO:tasks.workunit.client.1.smithi052.stdout:8/212: readlink d0/de/l1e 0 2023-12-05T13:24:56.572 INFO:tasks.workunit.client.1.smithi052.stdout:9/149: dwrite d3/d11/f21 [0,4194304] 0 2023-12-05T13:24:56.572 INFO:tasks.workunit.client.1.smithi052.stdout:9/150: fdatasync d3/d11/d19/f29 0 2023-12-05T13:24:56.572 INFO:tasks.workunit.client.1.smithi052.stdout:8/213: write d0/f11 [3587801,25360] 0 2023-12-05T13:24:56.575 INFO:tasks.workunit.client.1.smithi052.stdout:7/167: mknod d7/da/d13/d16/c35 0 2023-12-05T13:24:56.575 INFO:tasks.workunit.client.1.smithi052.stdout:1/204: mkdir d5/d7/d35/d37/d43 0 2023-12-05T13:24:56.577 INFO:tasks.workunit.client.1.smithi052.stdout:5/108: mkdir d5/d15/d21/d25 0 2023-12-05T13:24:56.578 INFO:tasks.workunit.client.1.smithi052.stdout:0/170: rename d0/db/d20/l24 to d0/db/d20/l3b 0 2023-12-05T13:24:56.578 INFO:tasks.workunit.client.1.smithi052.stdout:4/167: dread de/d2b/f2d [0,4194304] 0 2023-12-05T13:24:56.579 INFO:tasks.workunit.client.1.smithi052.stdout:6/179: dread d3/d4/df/f2a [0,4194304] 0 2023-12-05T13:24:56.583 INFO:tasks.workunit.client.1.smithi052.stdout:9/151: creat d3/d11/d19/f2e x:0 0 0 2023-12-05T13:24:56.585 INFO:tasks.workunit.client.1.smithi052.stdout:7/168: creat d7/da/f36 x:0 0 0 2023-12-05T13:24:56.589 INFO:tasks.workunit.client.1.smithi052.stdout:5/109: creat d5/df/d11/f26 x:0 0 0 2023-12-05T13:24:56.589 INFO:tasks.workunit.client.1.smithi052.stdout:5/110: chown d5 23002669 1 2023-12-05T13:24:56.590 INFO:tasks.workunit.client.1.smithi052.stdout:0/171: mknod d0/db/d1b/d29/c3c 0 2023-12-05T13:24:56.591 INFO:tasks.workunit.client.1.smithi052.stdout:4/168: creat de/f33 x:0 0 0 2023-12-05T13:24:56.592 INFO:tasks.workunit.client.1.smithi052.stdout:6/180: link d3/d4/d6/f7 d3/d4/df/d27/f40 0 2023-12-05T13:24:56.593 INFO:tasks.workunit.client.1.smithi052.stdout:9/152: mkdir d3/d1e/d2f 0 2023-12-05T13:24:56.598 INFO:tasks.workunit.client.1.smithi052.stdout:7/169: stat d7/l11 0 2023-12-05T13:24:56.600 INFO:tasks.workunit.client.1.smithi052.stdout:1/205: link d5/d7/d35/d37/l40 d5/l44 0 2023-12-05T13:24:56.603 INFO:tasks.workunit.client.1.smithi052.stdout:0/172: mknod d0/db/d2e/c3d 0 2023-12-05T13:24:56.604 INFO:tasks.workunit.client.1.smithi052.stdout:6/181: rmdir d3/d4/d6 39 2023-12-05T13:24:56.604 INFO:tasks.workunit.client.1.smithi052.stdout:4/169: dwrite de/f33 [0,4194304] 0 2023-12-05T13:24:56.604 INFO:tasks.workunit.client.1.smithi052.stdout:6/182: write d3/d5/d9/f2f [3022731,57067] 0 2023-12-05T13:24:56.606 INFO:tasks.workunit.client.1.smithi052.stdout:9/153: creat d3/d2a/f30 x:0 0 0 2023-12-05T13:24:56.607 INFO:tasks.workunit.client.1.smithi052.stdout:7/170: getdents d7/da/d12 0 2023-12-05T13:24:56.608 INFO:tasks.workunit.client.1.smithi052.stdout:9/154: dread d3/fd [0,4194304] 0 2023-12-05T13:24:56.608 INFO:tasks.workunit.client.1.smithi052.stdout:9/155: getdents d3/d1e/d2f 0 2023-12-05T13:24:56.611 INFO:tasks.workunit.client.1.smithi052.stdout:1/206: rmdir d5/d7/de/d14/d2a 39 2023-12-05T13:24:56.616 INFO:tasks.workunit.client.1.smithi052.stdout:7/171: mknod d7/d2e/c37 0 2023-12-05T13:24:56.620 INFO:tasks.workunit.client.1.smithi052.stdout:4/170: dwrite de/d1e/f2a [0,4194304] 0 2023-12-05T13:24:56.620 INFO:tasks.workunit.client.1.smithi052.stdout:4/171: chown de/d2b 2200 1 2023-12-05T13:24:56.621 INFO:tasks.workunit.client.1.smithi052.stdout:8/214: rename d0/de/d45 to d0/d4d 0 2023-12-05T13:24:56.621 INFO:tasks.workunit.client.1.smithi052.stdout:8/215: truncate d0/d28/d2b/f31 839099 0 2023-12-05T13:24:56.621 INFO:tasks.workunit.client.1.smithi052.stdout:8/216: dread - d0/de/f2f zero size 2023-12-05T13:24:56.627 INFO:tasks.workunit.client.1.smithi052.stdout:4/172: symlink de/d1e/l34 0 2023-12-05T13:24:56.628 INFO:tasks.workunit.client.1.smithi052.stdout:1/207: getdents d5/d7/d35/d37 0 2023-12-05T13:24:56.631 INFO:tasks.workunit.client.1.smithi052.stdout:0/173: rename d0/f23 to d0/db/d20/f3e 0 2023-12-05T13:24:56.631 INFO:tasks.workunit.client.1.smithi052.stdout:0/174: truncate d0/db/d1b/f37 446127 0 2023-12-05T13:24:56.634 INFO:tasks.workunit.client.1.smithi052.stdout:8/217: creat d0/de/d27/f4e x:0 0 0 2023-12-05T13:24:56.634 INFO:tasks.workunit.client.1.smithi052.stdout:8/218: read - d0/f3e zero size 2023-12-05T13:24:56.636 INFO:tasks.workunit.client.1.smithi052.stdout:1/208: unlink d5/d7/de/d18/c38 0 2023-12-05T13:24:56.636 INFO:tasks.workunit.client.1.smithi052.stdout:1/209: readlink d5/d26/l31 0 2023-12-05T13:24:56.640 INFO:tasks.workunit.client.1.smithi052.stdout:7/172: dwrite d7/f2a [0,4194304] 0 2023-12-05T13:24:56.641 INFO:tasks.workunit.client.1.smithi052.stdout:0/175: creat d0/db/d33/f3f x:0 0 0 2023-12-05T13:24:56.641 INFO:tasks.workunit.client.1.smithi052.stdout:6/183: rename c2 to d3/d5/d9/d21/c41 0 2023-12-05T13:24:56.643 INFO:tasks.workunit.client.1.smithi052.stdout:6/184: dread d3/d4/df/f2a [0,4194304] 0 2023-12-05T13:24:56.643 INFO:tasks.workunit.client.1.smithi052.stdout:1/210: mknod d5/d7/de/d14/d17/d3c/c45 0 2023-12-05T13:24:56.644 INFO:tasks.workunit.client.1.smithi052.stdout:1/211: readlink d5/d7/l1a 0 2023-12-05T13:24:56.644 INFO:tasks.workunit.client.1.smithi052.stdout:6/185: write d3/f16 [5094958,120836] 0 2023-12-05T13:24:56.650 INFO:tasks.workunit.client.1.smithi052.stdout:7/173: rmdir d7/da/d13 39 2023-12-05T13:24:56.650 INFO:tasks.workunit.client.1.smithi052.stdout:7/174: write d7/da/f1a [5137985,80460] 0 2023-12-05T13:24:56.652 INFO:tasks.workunit.client.1.smithi052.stdout:8/219: dwrite d0/de/d27/f4e [0,4194304] 0 2023-12-05T13:24:56.653 INFO:tasks.workunit.client.1.smithi052.stdout:8/220: write d0/fa [2887619,54485] 0 2023-12-05T13:24:56.653 INFO:tasks.workunit.client.1.smithi052.stdout:8/221: truncate d0/de/f2f 613411 0 2023-12-05T13:24:56.653 INFO:tasks.workunit.client.1.smithi052.stdout:9/156: rename d3/d1e/d2f to d3/d31 0 2023-12-05T13:24:56.656 INFO:tasks.workunit.client.1.smithi052.stdout:0/176: creat d0/db/d14/f40 x:0 0 0 2023-12-05T13:24:56.663 INFO:tasks.workunit.client.1.smithi052.stdout:9/157: dread d3/d11/f13 [0,4194304] 0 2023-12-05T13:24:56.666 INFO:tasks.workunit.client.1.smithi052.stdout:1/212: dwrite d5/f3a [0,4194304] 0 2023-12-05T13:24:56.666 INFO:tasks.workunit.client.1.smithi052.stdout:8/222: mkdir d0/d28/d39/d3a/d4f 0 2023-12-05T13:24:56.666 INFO:tasks.workunit.client.1.smithi052.stdout:1/213: chown c0 46708 1 2023-12-05T13:24:56.670 INFO:tasks.workunit.client.1.smithi052.stdout:7/175: dwrite d7/da/f2b [0,4194304] 0 2023-12-05T13:24:56.670 INFO:tasks.workunit.client.1.smithi052.stdout:7/176: read - d7/da/d12/f34 zero size 2023-12-05T13:24:56.671 INFO:tasks.workunit.client.1.smithi052.stdout:0/177: dwrite d0/db/d1b/f27 [0,4194304] 0 2023-12-05T13:24:56.672 INFO:tasks.workunit.client.1.smithi052.stdout:1/214: mknod d5/d7/d35/d2f/c46 0 2023-12-05T13:24:56.676 INFO:tasks.workunit.client.1.smithi052.stdout:7/177: mknod d7/d31/c38 0 2023-12-05T13:24:56.676 INFO:tasks.workunit.client.1.smithi052.stdout:7/178: truncate d7/da/f36 575744 0 2023-12-05T13:24:56.680 INFO:tasks.workunit.client.1.smithi052.stdout:0/178: mknod d0/db/d2e/c41 0 2023-12-05T13:24:56.681 INFO:tasks.workunit.client.1.smithi052.stdout:8/223: dwrite d0/de/f41 [0,4194304] 0 2023-12-05T13:24:56.685 INFO:tasks.workunit.client.1.smithi052.stdout:7/179: symlink d7/l39 0 2023-12-05T13:24:56.685 INFO:tasks.workunit.client.1.smithi052.stdout:8/224: dread d0/fa [0,4194304] 0 2023-12-05T13:24:56.691 INFO:tasks.workunit.client.1.smithi052.stdout:0/179: mkdir d0/db/d1b/d42 0 2023-12-05T13:24:56.697 INFO:tasks.workunit.client.1.smithi052.stdout:8/225: creat d0/de/d12/d29/f50 x:0 0 0 2023-12-05T13:24:56.698 INFO:tasks.workunit.client.1.smithi052.stdout:8/226: read d0/d28/f2a [675241,124677] 0 2023-12-05T13:24:56.698 INFO:tasks.workunit.client.1.smithi052.stdout:8/227: readlink d0/de/l23 0 2023-12-05T13:24:56.698 INFO:tasks.workunit.client.1.smithi052.stdout:8/228: fsync d0/d28/d39/d3a/f47 0 2023-12-05T13:24:56.700 INFO:tasks.workunit.client.1.smithi052.stdout:0/180: dread d0/db/d14/f28 [0,4194304] 0 2023-12-05T13:24:56.703 INFO:tasks.workunit.client.1.smithi052.stdout:8/229: mkdir d0/d51 0 2023-12-05T13:24:56.703 INFO:tasks.workunit.client.1.smithi052.stdout:0/181: write d0/db/d14/f28 [3254546,113018] 0 2023-12-05T13:24:56.704 INFO:tasks.workunit.client.1.smithi052.stdout:8/230: write d0/d4d/f4c [950462,86747] 0 2023-12-05T13:24:56.704 INFO:tasks.workunit.client.1.smithi052.stdout:8/231: chown d0/d28/d39/d3a/f47 1 1 2023-12-05T13:24:56.706 INFO:tasks.workunit.client.1.smithi052.stdout:7/180: dwrite d7/da/d13/d16/f33 [0,4194304] 0 2023-12-05T13:24:56.707 INFO:tasks.workunit.client.1.smithi052.stdout:8/232: creat d0/d51/f52 x:0 0 0 2023-12-05T13:24:56.711 INFO:tasks.workunit.client.1.smithi052.stdout:7/181: mknod d7/da/d13/d16/c3a 0 2023-12-05T13:24:56.711 INFO:tasks.workunit.client.1.smithi052.stdout:7/182: readlink d7/l39 0 2023-12-05T13:24:56.715 INFO:tasks.workunit.client.1.smithi052.stdout:0/182: rename d0/c3 to d0/c43 0 2023-12-05T13:24:56.715 INFO:tasks.workunit.client.1.smithi052.stdout:0/183: chown d0/db/d1b/d29/c2d 16307812 1 2023-12-05T13:24:56.719 INFO:tasks.workunit.client.1.smithi052.stdout:8/233: mkdir d0/d28/d2b/d53 0 2023-12-05T13:24:56.719 INFO:tasks.workunit.client.1.smithi052.stdout:7/183: dread d7/da/d13/d16/f33 [0,4194304] 0 2023-12-05T13:24:56.721 INFO:tasks.workunit.client.1.smithi052.stdout:0/184: truncate d0/db/f1f 3403818 0 2023-12-05T13:24:56.729 INFO:tasks.workunit.client.1.smithi052.stdout:8/234: symlink d0/d28/d39/l54 0 2023-12-05T13:24:56.729 INFO:tasks.workunit.client.1.smithi052.stdout:7/184: symlink d7/da/d13/d16/l3b 0 2023-12-05T13:24:56.729 INFO:tasks.workunit.client.1.smithi052.stdout:0/185: link d0/c5 d0/db/d33/c44 0 2023-12-05T13:24:56.729 INFO:tasks.workunit.client.1.smithi052.stdout:7/185: truncate d7/da/d13/f19 4667476 0 2023-12-05T13:24:56.735 INFO:tasks.workunit.client.1.smithi052.stdout:8/235: creat d0/d28/d39/d3a/d4f/f55 x:0 0 0 2023-12-05T13:24:56.735 INFO:tasks.workunit.client.1.smithi052.stdout:8/236: chown d0/cf 1 1 2023-12-05T13:24:56.736 INFO:tasks.workunit.client.1.smithi052.stdout:7/186: getdents d7/d31 0 2023-12-05T13:24:56.737 INFO:tasks.workunit.client.1.smithi052.stdout:8/237: dread d0/de/f1f [0,4194304] 0 2023-12-05T13:24:56.738 INFO:tasks.workunit.client.1.smithi052.stdout:0/186: rename d0/db/f2a to d0/db/d1b/d42/f45 0 2023-12-05T13:24:56.740 INFO:tasks.workunit.client.1.smithi052.stdout:0/187: dread d0/db/d14/f26 [0,4194304] 0 2023-12-05T13:24:56.740 INFO:tasks.workunit.client.1.smithi052.stdout:7/187: symlink d7/d2e/l3c 0 2023-12-05T13:24:56.740 INFO:tasks.workunit.client.1.smithi052.stdout:2/180: sync 2023-12-05T13:24:56.740 INFO:tasks.workunit.client.1.smithi052.stdout:3/170: sync 2023-12-05T13:24:56.742 INFO:tasks.workunit.client.1.smithi052.stdout:8/238: mkdir d0/d28/d2b/d53/d56 0 2023-12-05T13:24:56.744 INFO:tasks.workunit.client.1.smithi052.stdout:0/188: creat d0/db/d2e/f46 x:0 0 0 2023-12-05T13:24:56.744 INFO:tasks.workunit.client.1.smithi052.stdout:0/189: readlink d0/db/d33/l38 0 2023-12-05T13:24:56.744 INFO:tasks.workunit.client.1.smithi052.stdout:0/190: fdatasync d0/f17 0 2023-12-05T13:24:56.747 INFO:tasks.workunit.client.1.smithi052.stdout:2/181: rename d2/d14/f1a to d2/d14/f39 0 2023-12-05T13:24:56.748 INFO:tasks.workunit.client.1.smithi052.stdout:3/171: creat da/d25/f37 x:0 0 0 2023-12-05T13:24:56.748 INFO:tasks.workunit.client.1.smithi052.stdout:3/172: chown da/d27/l2c 26153 1 2023-12-05T13:24:56.753 INFO:tasks.workunit.client.1.smithi052.stdout:2/182: getdents d2/d31 0 2023-12-05T13:24:56.754 INFO:tasks.workunit.client.1.smithi052.stdout:7/188: dread d7/da/f14 [0,4194304] 0 2023-12-05T13:24:56.754 INFO:tasks.workunit.client.1.smithi052.stdout:7/189: chown d7/d2e/c37 78 1 2023-12-05T13:24:56.754 INFO:tasks.workunit.client.1.smithi052.stdout:7/190: dread d7/da/d13/d16/f30 [0,4194304] 0 2023-12-05T13:24:56.756 INFO:tasks.workunit.client.1.smithi052.stdout:3/173: symlink da/d2e/l38 0 2023-12-05T13:24:56.757 INFO:tasks.workunit.client.1.smithi052.stdout:2/183: truncate d2/d13/d1e/f27 2826606 0 2023-12-05T13:24:56.758 INFO:tasks.workunit.client.1.smithi052.stdout:7/191: mknod d7/da/d13/c3d 0 2023-12-05T13:24:56.759 INFO:tasks.workunit.client.1.smithi052.stdout:3/174: creat da/d2e/f39 x:0 0 0 2023-12-05T13:24:56.760 INFO:tasks.workunit.client.1.smithi052.stdout:8/239: dwrite d0/d28/f2a [0,4194304] 0 2023-12-05T13:24:56.762 INFO:tasks.workunit.client.1.smithi052.stdout:2/184: rmdir d2/d13/d37 39 2023-12-05T13:24:56.762 INFO:tasks.workunit.client.1.smithi052.stdout:7/192: rmdir d7/da/d13 39 2023-12-05T13:24:56.766 INFO:tasks.workunit.client.1.smithi052.stdout:2/185: write d2/f2a [4085447,26496] 0 2023-12-05T13:24:56.766 INFO:tasks.workunit.client.1.smithi052.stdout:8/240: creat d0/de/d27/f57 x:0 0 0 2023-12-05T13:24:56.766 INFO:tasks.workunit.client.1.smithi052.stdout:7/193: creat d7/d31/f3e x:0 0 0 2023-12-05T13:24:56.769 INFO:tasks.workunit.client.1.smithi052.stdout:7/194: mkdir d7/da/d12/d3f 0 2023-12-05T13:24:56.769 INFO:tasks.workunit.client.1.smithi052.stdout:7/195: stat d7/f27 0 2023-12-05T13:24:56.774 INFO:tasks.workunit.client.1.smithi052.stdout:0/191: dwrite d0/db/d20/f3e [0,4194304] 0 2023-12-05T13:24:56.784 INFO:tasks.workunit.client.1.smithi052.stdout:3/175: dwrite da/dd/f17 [0,4194304] 0 2023-12-05T13:24:57.012 INFO:tasks.workunit.client.1.smithi052.stdout:2/186: dwrite d2/d13/d1e/f25 [0,4194304] 0 2023-12-05T13:24:57.012 INFO:tasks.workunit.client.1.smithi052.stdout:2/187: chown d2/d4/c29 3535 1 2023-12-05T13:24:57.015 INFO:tasks.workunit.client.1.smithi052.stdout:0/192: creat d0/db/d2e/f47 x:0 0 0 2023-12-05T13:24:57.015 INFO:tasks.workunit.client.1.smithi052.stdout:0/193: chown d0/db/d14/c32 235417 1 2023-12-05T13:24:57.018 INFO:tasks.workunit.client.1.smithi052.stdout:7/196: dwrite d7/da/f14 [0,4194304] 0 2023-12-05T13:24:57.019 INFO:tasks.workunit.client.1.smithi052.stdout:3/176: dwrite da/d27/f2d [0,4194304] 0 2023-12-05T13:24:57.027 INFO:tasks.workunit.client.1.smithi052.stdout:3/177: dread da/d25/f31 [0,4194304] 0 2023-12-05T13:24:57.028 INFO:tasks.workunit.client.1.smithi052.stdout:2/188: mkdir d2/d31/d3a 0 2023-12-05T13:24:57.029 INFO:tasks.workunit.client.1.smithi052.stdout:2/189: write d2/f2a [2081365,12533] 0 2023-12-05T13:24:57.030 INFO:tasks.workunit.client.1.smithi052.stdout:0/194: symlink d0/db/d1b/d29/l48 0 2023-12-05T13:24:57.036 INFO:tasks.workunit.client.1.smithi052.stdout:7/197: dwrite d7/da/f14 [0,4194304] 0 2023-12-05T13:24:57.038 INFO:tasks.workunit.client.1.smithi052.stdout:0/195: dread d0/f2b [4194304,4194304] 0 2023-12-05T13:24:57.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/196: truncate d0/db/d14/f26 1190532 0 2023-12-05T13:24:57.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/197: write d0/db/d2e/f46 [76607,51835] 0 2023-12-05T13:24:57.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/198: readlink d0/db/l1d 0 2023-12-05T13:24:57.039 INFO:tasks.workunit.client.1.smithi052.stdout:3/178: truncate da/d27/f2b 1996364 0 2023-12-05T13:24:57.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/199: write d0/db/d1b/f27 [5190199,16018] 0 2023-12-05T13:24:57.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/200: fsync d0/fa 0 2023-12-05T13:24:57.044 INFO:tasks.workunit.client.1.smithi052.stdout:7/198: link c5 d7/da/d13/c40 0 2023-12-05T13:24:57.046 INFO:tasks.workunit.client.1.smithi052.stdout:5/111: sync 2023-12-05T13:24:57.046 INFO:tasks.workunit.client.1.smithi052.stdout:3/179: creat da/d25/f3a x:0 0 0 2023-12-05T13:24:57.051 INFO:tasks.workunit.client.1.smithi052.stdout:0/201: mknod d0/db/d1b/d42/c49 0 2023-12-05T13:24:57.051 INFO:tasks.workunit.client.1.smithi052.stdout:5/112: symlink d5/d15/l27 0 2023-12-05T13:24:57.054 INFO:tasks.workunit.client.1.smithi052.stdout:0/202: link d0/db/d2e/c41 d0/db/d1b/d29/c4a 0 2023-12-05T13:24:57.056 INFO:tasks.workunit.client.1.smithi052.stdout:0/203: dread d0/fa [0,4194304] 0 2023-12-05T13:24:57.058 INFO:tasks.workunit.client.1.smithi052.stdout:5/113: symlink d5/df/d11/l28 0 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:1/215: sync 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:9/158: sync 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:4/173: sync 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:6/186: sync 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:6/187: chown d3/d5/d9/f2f 1529 1 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:6/188: fsync d3/f29 0 2023-12-05T13:24:57.061 INFO:tasks.workunit.client.1.smithi052.stdout:0/204: mknod d0/db/d20/c4b 0 2023-12-05T13:24:57.064 INFO:tasks.workunit.client.1.smithi052.stdout:5/114: rename d5/df/l10 to d5/d15/l29 0 2023-12-05T13:24:57.067 INFO:tasks.workunit.client.1.smithi052.stdout:1/216: unlink d5/l44 0 2023-12-05T13:24:57.067 INFO:tasks.workunit.client.1.smithi052.stdout:1/217: stat d5/d7/d35/d37/d43 0 2023-12-05T13:24:57.070 INFO:tasks.workunit.client.1.smithi052.stdout:9/159: symlink d3/d11/l32 0 2023-12-05T13:24:57.070 INFO:tasks.workunit.client.1.smithi052.stdout:9/160: stat d3/c9 0 2023-12-05T13:24:57.070 INFO:tasks.workunit.client.1.smithi052.stdout:9/161: chown d3/f24 75592 1 2023-12-05T13:24:57.074 INFO:tasks.workunit.client.1.smithi052.stdout:4/174: link de/d1e/f20 de/d1e/d24/f35 0 2023-12-05T13:24:57.077 INFO:tasks.workunit.client.1.smithi052.stdout:7/199: dwrite d7/f2a [0,4194304] 0 2023-12-05T13:24:57.077 INFO:tasks.workunit.client.1.smithi052.stdout:4/175: dread de/f17 [0,4194304] 0 2023-12-05T13:24:57.079 INFO:tasks.workunit.client.1.smithi052.stdout:6/189: unlink d3/d4/d6/d26/f32 0 2023-12-05T13:24:57.079 INFO:tasks.workunit.client.1.smithi052.stdout:6/190: dread - d3/f3d zero size 2023-12-05T13:24:57.079 INFO:tasks.workunit.client.1.smithi052.stdout:6/191: chown d3/d4/df/d27/f31 340 1 2023-12-05T13:24:57.079 INFO:tasks.workunit.client.1.smithi052.stdout:0/205: symlink d0/db/d1b/d42/l4c 0 2023-12-05T13:24:57.080 INFO:tasks.workunit.client.1.smithi052.stdout:0/206: fsync d0/f6 0 2023-12-05T13:24:57.084 INFO:tasks.workunit.client.1.smithi052.stdout:5/115: creat d5/d15/f2a x:0 0 0 2023-12-05T13:24:57.084 INFO:tasks.workunit.client.1.smithi052.stdout:3/180: dwrite da/fe [0,4194304] 0 2023-12-05T13:24:57.084 INFO:tasks.workunit.client.1.smithi052.stdout:9/162: creat d3/d11/f33 x:0 0 0 2023-12-05T13:24:57.086 INFO:tasks.workunit.client.1.smithi052.stdout:0/207: dread d0/db/f1f [0,4194304] 0 2023-12-05T13:24:57.089 INFO:tasks.workunit.client.1.smithi052.stdout:4/176: unlink l9 0 2023-12-05T13:24:57.090 INFO:tasks.workunit.client.1.smithi052.stdout:8/241: sync 2023-12-05T13:24:57.090 INFO:tasks.workunit.client.1.smithi052.stdout:3/181: dread f4 [0,4194304] 0 2023-12-05T13:24:57.090 INFO:tasks.workunit.client.1.smithi052.stdout:8/242: write d0/de/f1f [1298618,51872] 0 2023-12-05T13:24:57.090 INFO:tasks.workunit.client.1.smithi052.stdout:8/243: fdatasync d0/de/f38 0 2023-12-05T13:24:57.091 INFO:tasks.workunit.client.1.smithi052.stdout:7/200: rename d7/f2a to d7/da/f41 0 2023-12-05T13:24:57.091 INFO:tasks.workunit.client.1.smithi052.stdout:4/177: write de/f18 [128940,103439] 0 2023-12-05T13:24:57.091 INFO:tasks.workunit.client.1.smithi052.stdout:1/218: dwrite d5/f3a [0,4194304] 0 2023-12-05T13:24:57.091 INFO:tasks.workunit.client.1.smithi052.stdout:1/219: write d5/d7/de/d14/d17/f39 [239621,13996] 0 2023-12-05T13:24:57.091 INFO:tasks.workunit.client.1.smithi052.stdout:7/201: write d7/da/f36 [324256,25483] 0 2023-12-05T13:24:57.092 INFO:tasks.workunit.client.1.smithi052.stdout:6/192: rmdir d3/d4/d36/d39 0 2023-12-05T13:24:57.092 INFO:tasks.workunit.client.1.smithi052.stdout:6/193: chown d3/c12 90 1 2023-12-05T13:24:57.093 INFO:tasks.workunit.client.1.smithi052.stdout:6/194: write d3/d4/df/f2a [943264,12615] 0 2023-12-05T13:24:57.093 INFO:tasks.workunit.client.1.smithi052.stdout:6/195: write d3/d5/f34 [71219,114175] 0 2023-12-05T13:24:57.095 INFO:tasks.workunit.client.1.smithi052.stdout:5/116: creat d5/df/d11/f2b x:0 0 0 2023-12-05T13:24:57.095 INFO:tasks.workunit.client.1.smithi052.stdout:5/117: read - d5/df/f22 zero size 2023-12-05T13:24:57.095 INFO:tasks.workunit.client.1.smithi052.stdout:5/118: fsync d5/f14 0 2023-12-05T13:24:57.102 INFO:tasks.workunit.client.1.smithi052.stdout:3/182: creat da/d27/f3b x:0 0 0 2023-12-05T13:24:57.104 INFO:tasks.workunit.client.1.smithi052.stdout:5/119: dread d5/fa [0,4194304] 0 2023-12-05T13:24:57.108 INFO:tasks.workunit.client.1.smithi052.stdout:8/244: rmdir d0/d28/d39 39 2023-12-05T13:24:57.108 INFO:tasks.workunit.client.1.smithi052.stdout:9/163: rename d3/l7 to d3/d1e/l34 0 2023-12-05T13:24:57.108 INFO:tasks.workunit.client.1.smithi052.stdout:9/164: read d3/d11/d19/f29 [431398,4764] 0 2023-12-05T13:24:57.109 INFO:tasks.workunit.client.1.smithi052.stdout:9/165: read - d3/d2a/f2b zero size 2023-12-05T13:24:57.109 INFO:tasks.workunit.client.1.smithi052.stdout:1/220: creat d5/d7/f47 x:0 0 0 2023-12-05T13:24:57.109 INFO:tasks.workunit.client.1.smithi052.stdout:1/221: chown d5/d7/d35 242048312 1 2023-12-05T13:24:57.109 INFO:tasks.workunit.client.1.smithi052.stdout:1/222: write d5/d7/de/d14/d2a/f3b [1070266,72183] 0 2023-12-05T13:24:57.109 INFO:tasks.workunit.client.1.smithi052.stdout:7/202: dwrite d7/da/f2b [0,4194304] 0 2023-12-05T13:24:57.110 INFO:tasks.workunit.client.1.smithi052.stdout:1/223: write d5/d7/de/d14/f32 [2831060,38315] 0 2023-12-05T13:24:57.111 INFO:tasks.workunit.client.1.smithi052.stdout:6/196: mknod d3/d4/c42 0 2023-12-05T13:24:57.111 INFO:tasks.workunit.client.1.smithi052.stdout:6/197: read - d3/f3d zero size 2023-12-05T13:24:57.113 INFO:tasks.workunit.client.1.smithi052.stdout:3/183: unlink da/d2e/f39 0 2023-12-05T13:24:57.113 INFO:tasks.workunit.client.1.smithi052.stdout:8/245: dread d0/f5 [0,4194304] 0 2023-12-05T13:24:57.113 INFO:tasks.workunit.client.1.smithi052.stdout:4/178: dwrite de/d1e/f21 [0,4194304] 0 2023-12-05T13:24:57.114 INFO:tasks.workunit.client.1.smithi052.stdout:8/246: read - d0/de/d12/d29/f50 zero size 2023-12-05T13:24:57.117 INFO:tasks.workunit.client.1.smithi052.stdout:5/120: mkdir d5/d2c 0 2023-12-05T13:24:57.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/208: rename d0/l2c to d0/db/d2e/l4d 0 2023-12-05T13:24:57.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/209: chown d0/db/d1b/f27 167731317 1 2023-12-05T13:24:57.124 INFO:tasks.workunit.client.1.smithi052.stdout:7/203: mknod d7/d2e/c42 0 2023-12-05T13:24:57.125 INFO:tasks.workunit.client.1.smithi052.stdout:6/198: creat d3/d4/df/f43 x:0 0 0 2023-12-05T13:24:57.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/204: write d7/da/f41 [325029,16267] 0 2023-12-05T13:24:57.126 INFO:tasks.workunit.client.1.smithi052.stdout:4/179: dwrite de/f17 [0,4194304] 0 2023-12-05T13:24:57.126 INFO:tasks.workunit.client.1.smithi052.stdout:4/180: readlink l8 0 2023-12-05T13:24:57.137 INFO:tasks.workunit.client.1.smithi052.stdout:8/247: symlink d0/de/d27/d43/l58 0 2023-12-05T13:24:57.139 INFO:tasks.workunit.client.1.smithi052.stdout:5/121: symlink d5/d15/d21/l2d 0 2023-12-05T13:24:57.139 INFO:tasks.workunit.client.1.smithi052.stdout:5/122: stat d5/df/f17 0 2023-12-05T13:24:57.139 INFO:tasks.workunit.client.1.smithi052.stdout:5/123: chown l0 1793 1 2023-12-05T13:24:57.141 INFO:tasks.workunit.client.1.smithi052.stdout:9/166: rename d3/l5 to d3/d11/d19/l35 0 2023-12-05T13:24:57.141 INFO:tasks.workunit.client.1.smithi052.stdout:9/167: write d3/d11/f13 [199526,112089] 0 2023-12-05T13:24:57.147 INFO:tasks.workunit.client.1.smithi052.stdout:7/205: creat d7/da/d12/f43 x:0 0 0 2023-12-05T13:24:57.153 INFO:tasks.workunit.client.1.smithi052.stdout:4/181: symlink de/d30/l36 0 2023-12-05T13:24:57.154 INFO:tasks.workunit.client.1.smithi052.stdout:8/248: mknod d0/d28/d2b/c59 0 2023-12-05T13:24:57.154 INFO:tasks.workunit.client.1.smithi052.stdout:8/249: write d0/de/f22 [3139244,1939] 0 2023-12-05T13:24:57.155 INFO:tasks.workunit.client.1.smithi052.stdout:8/250: write d0/d28/d2b/f31 [62311,114840] 0 2023-12-05T13:24:57.156 INFO:tasks.workunit.client.1.smithi052.stdout:5/124: creat d5/d15/d21/f2e x:0 0 0 2023-12-05T13:24:57.157 INFO:tasks.workunit.client.1.smithi052.stdout:1/224: rename d5/d7/d35/d37/l40 to d5/d7/de/l48 0 2023-12-05T13:24:57.159 INFO:tasks.workunit.client.1.smithi052.stdout:9/168: link d3/d1e/f23 d3/d1e/f36 0 2023-12-05T13:24:57.160 INFO:tasks.workunit.client.1.smithi052.stdout:0/210: symlink d0/l4e 0 2023-12-05T13:24:57.168 INFO:tasks.workunit.client.1.smithi052.stdout:4/182: unlink de/f17 0 2023-12-05T13:24:57.168 INFO:tasks.workunit.client.1.smithi052.stdout:4/183: stat de/l10 0 2023-12-05T13:24:57.173 INFO:tasks.workunit.client.1.smithi052.stdout:8/251: rmdir d0/d28/d39 39 2023-12-05T13:24:57.173 INFO:tasks.workunit.client.1.smithi052.stdout:8/252: dread - d0/f3e zero size 2023-12-05T13:24:57.174 INFO:tasks.workunit.client.1.smithi052.stdout:9/169: dwrite d3/f4 [0,4194304] 0 2023-12-05T13:24:57.174 INFO:tasks.workunit.client.1.smithi052.stdout:9/170: write d3/f2c [900029,31309] 0 2023-12-05T13:24:57.174 INFO:tasks.workunit.client.1.smithi052.stdout:9/171: chown d3/d11/c18 273 1 2023-12-05T13:24:57.175 INFO:tasks.workunit.client.1.smithi052.stdout:5/125: rename d5/d15/d21/l2d to d5/d2c/l2f 0 2023-12-05T13:24:57.176 INFO:tasks.workunit.client.1.smithi052.stdout:1/225: creat d5/d7/de/d14/d2a/f49 x:0 0 0 2023-12-05T13:24:57.176 INFO:tasks.workunit.client.1.smithi052.stdout:1/226: truncate d5/d7/de/d14/d17/f39 1040965 0 2023-12-05T13:24:57.176 INFO:tasks.workunit.client.1.smithi052.stdout:8/253: dread d0/fa [0,4194304] 0 2023-12-05T13:24:57.178 INFO:tasks.workunit.client.1.smithi052.stdout:4/184: mknod de/d30/c37 0 2023-12-05T13:24:57.180 INFO:tasks.workunit.client.1.smithi052.stdout:9/172: mkdir d3/d1e/d37 0 2023-12-05T13:24:57.181 INFO:tasks.workunit.client.1.smithi052.stdout:9/173: chown d3/d11/l32 1829 1 2023-12-05T13:24:57.181 INFO:tasks.workunit.client.1.smithi052.stdout:9/174: write d3/d2a/f2b [26518,89666] 0 2023-12-05T13:24:57.186 INFO:tasks.workunit.client.1.smithi052.stdout:6/199: getdents d3/d4/df 0 2023-12-05T13:24:57.186 INFO:tasks.workunit.client.1.smithi052.stdout:5/126: mknod d5/c30 0 2023-12-05T13:24:57.187 INFO:tasks.workunit.client.1.smithi052.stdout:0/211: rename d0/db/f1f to d0/db/d14/f4f 0 2023-12-05T13:24:57.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/127: write d5/d15/d21/f23 [86723,59507] 0 2023-12-05T13:24:57.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/128: readlink d5/d15/l1e 0 2023-12-05T13:24:57.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/129: truncate d5/df/d11/f26 556333 0 2023-12-05T13:24:57.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/130: dread - d5/df/d11/f2b zero size 2023-12-05T13:24:57.189 INFO:tasks.workunit.client.1.smithi052.stdout:5/131: readlink d5/df/d11/l28 0 2023-12-05T13:24:57.189 INFO:tasks.workunit.client.1.smithi052.stdout:5/132: dread - d5/df/d11/f2b zero size 2023-12-05T13:24:57.189 INFO:tasks.workunit.client.1.smithi052.stdout:5/133: chown d5/d15/l1a 0 1 2023-12-05T13:24:57.190 INFO:tasks.workunit.client.1.smithi052.stdout:8/254: unlink d0/d28/f2a 0 2023-12-05T13:24:57.190 INFO:tasks.workunit.client.1.smithi052.stdout:8/255: chown d0/d28/d2b/l3d 1988 1 2023-12-05T13:24:57.190 INFO:tasks.workunit.client.1.smithi052.stdout:8/256: chown d0/c2c 48529733 1 2023-12-05T13:24:57.191 INFO:tasks.workunit.client.1.smithi052.stdout:1/227: dwrite d5/f3a [0,4194304] 0 2023-12-05T13:24:57.199 INFO:tasks.workunit.client.1.smithi052.stdout:2/190: sync 2023-12-05T13:24:57.199 INFO:tasks.workunit.client.1.smithi052.stdout:2/191: chown d2/d31 0 1 2023-12-05T13:24:57.199 INFO:tasks.workunit.client.1.smithi052.stdout:9/175: creat d3/d1e/d37/f38 x:0 0 0 2023-12-05T13:24:57.200 INFO:tasks.workunit.client.1.smithi052.stdout:0/212: mkdir d0/db/d20/d50 0 2023-12-05T13:24:57.202 INFO:tasks.workunit.client.1.smithi052.stdout:5/134: creat d5/d15/f31 x:0 0 0 2023-12-05T13:24:57.207 INFO:tasks.workunit.client.1.smithi052.stdout:8/257: dwrite d0/de/f22 [0,4194304] 0 2023-12-05T13:24:57.208 INFO:tasks.workunit.client.1.smithi052.stdout:1/228: rename c0 to d5/d26/d41/c4a 0 2023-12-05T13:24:57.209 INFO:tasks.workunit.client.1.smithi052.stdout:1/229: fdatasync d5/d7/f12 0 2023-12-05T13:24:57.212 INFO:tasks.workunit.client.1.smithi052.stdout:7/206: rmdir d7/da 39 2023-12-05T13:24:57.215 INFO:tasks.workunit.client.1.smithi052.stdout:2/192: mkdir d2/d14/d3b 0 2023-12-05T13:24:57.218 INFO:tasks.workunit.client.1.smithi052.stdout:8/258: dread d0/f32 [0,4194304] 0 2023-12-05T13:24:57.218 INFO:tasks.workunit.client.1.smithi052.stdout:9/176: creat d3/d2a/f39 x:0 0 0 2023-12-05T13:24:57.218 INFO:tasks.workunit.client.1.smithi052.stdout:4/185: creat de/d1e/d24/f38 x:0 0 0 2023-12-05T13:24:57.221 INFO:tasks.workunit.client.1.smithi052.stdout:9/177: dread d3/d2a/f2b [0,4194304] 0 2023-12-05T13:24:57.222 INFO:tasks.workunit.client.1.smithi052.stdout:0/213: mkdir d0/db/d1b/d51 0 2023-12-05T13:24:57.222 INFO:tasks.workunit.client.1.smithi052.stdout:0/214: chown d0/c7 53 1 2023-12-05T13:24:57.224 INFO:tasks.workunit.client.1.smithi052.stdout:2/193: chown d2/d13/f22 115633 1 2023-12-05T13:24:57.224 INFO:tasks.workunit.client.1.smithi052.stdout:5/135: dwrite d5/d15/f2a [0,4194304] 0 2023-12-05T13:24:57.227 INFO:tasks.workunit.client.1.smithi052.stdout:2/194: dread d2/f2f [0,4194304] 0 2023-12-05T13:24:57.227 INFO:tasks.workunit.client.1.smithi052.stdout:2/195: chown d2/d31/d3a 41410 1 2023-12-05T13:24:57.228 INFO:tasks.workunit.client.1.smithi052.stdout:2/196: read d2/f2f [410913,128854] 0 2023-12-05T13:24:57.228 INFO:tasks.workunit.client.1.smithi052.stdout:9/178: rename d3/f4 to d3/f3a 0 2023-12-05T13:24:57.232 INFO:tasks.workunit.client.1.smithi052.stdout:0/215: mkdir d0/db/d52 0 2023-12-05T13:24:57.238 INFO:tasks.workunit.client.1.smithi052.stdout:7/207: getdents d7/da 0 2023-12-05T13:24:57.244 INFO:tasks.workunit.client.1.smithi052.stdout:2/197: fsync d2/d13/f17 0 2023-12-05T13:24:57.246 INFO:tasks.workunit.client.1.smithi052.stdout:9/179: mknod d3/c3b 0 2023-12-05T13:24:57.247 INFO:tasks.workunit.client.1.smithi052.stdout:0/216: mkdir d0/db/d2e/d53 0 2023-12-05T13:24:57.248 INFO:tasks.workunit.client.1.smithi052.stdout:8/259: dwrite d0/de/d27/f4e [0,4194304] 0 2023-12-05T13:24:57.249 INFO:tasks.workunit.client.1.smithi052.stdout:7/208: rename d7/da/f41 to d7/da/d12/d3f/f44 0 2023-12-05T13:24:57.250 INFO:tasks.workunit.client.1.smithi052.stdout:2/198: creat d2/f3c x:0 0 0 2023-12-05T13:24:57.253 INFO:tasks.workunit.client.1.smithi052.stdout:9/180: creat d3/d2a/f3c x:0 0 0 2023-12-05T13:24:57.254 INFO:tasks.workunit.client.1.smithi052.stdout:0/217: mkdir d0/db/d14/d54 0 2023-12-05T13:24:57.254 INFO:tasks.workunit.client.1.smithi052.stdout:0/218: read d0/f6 [73611,32343] 0 2023-12-05T13:24:57.254 INFO:tasks.workunit.client.1.smithi052.stdout:4/186: dwrite de/d2b/f2d [0,4194304] 0 2023-12-05T13:24:57.254 INFO:tasks.workunit.client.1.smithi052.stdout:0/219: stat d0/f6 0 2023-12-05T13:24:57.254 INFO:tasks.workunit.client.1.smithi052.stdout:0/220: chown d0/db/d2e/f46 0 1 2023-12-05T13:24:57.256 INFO:tasks.workunit.client.1.smithi052.stdout:5/136: dwrite f3 [4194304,4194304] 0 2023-12-05T13:24:57.257 INFO:tasks.workunit.client.1.smithi052.stdout:8/260: mknod d0/de/d27/d43/d44/c5a 0 2023-12-05T13:24:57.257 INFO:tasks.workunit.client.1.smithi052.stdout:8/261: readlink d0/d28/d2b/l34 0 2023-12-05T13:24:57.257 INFO:tasks.workunit.client.1.smithi052.stdout:3/184: sync 2023-12-05T13:24:57.257 INFO:tasks.workunit.client.1.smithi052.stdout:3/185: write da/d27/f2d [4483783,100270] 0 2023-12-05T13:24:57.259 INFO:tasks.workunit.client.1.smithi052.stdout:7/209: write d7/da/d13/d16/f2d [506865,73562] 0 2023-12-05T13:24:57.260 INFO:tasks.workunit.client.1.smithi052.stdout:5/137: dread d5/f9 [0,4194304] 0 2023-12-05T13:24:57.260 INFO:tasks.workunit.client.1.smithi052.stdout:5/138: stat d5/d15/f2a 0 2023-12-05T13:24:57.261 INFO:tasks.workunit.client.1.smithi052.stdout:5/139: dread d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:24:57.261 INFO:tasks.workunit.client.1.smithi052.stdout:2/199: rename d2/d13/f17 to d2/d13/d1e/f3d 0 2023-12-05T13:24:57.261 INFO:tasks.workunit.client.1.smithi052.stdout:2/200: fdatasync d2/d14/f2c 0 2023-12-05T13:24:57.262 INFO:tasks.workunit.client.1.smithi052.stdout:2/201: dread d2/f2f [0,4194304] 0 2023-12-05T13:24:57.263 INFO:tasks.workunit.client.1.smithi052.stdout:9/181: rename d3/d1e/l34 to d3/d1e/l3d 0 2023-12-05T13:24:57.264 INFO:tasks.workunit.client.1.smithi052.stdout:9/182: write d3/d2a/f3c [249214,69662] 0 2023-12-05T13:24:57.264 INFO:tasks.workunit.client.1.smithi052.stdout:9/183: truncate d3/d1e/f23 4791947 0 2023-12-05T13:24:57.266 INFO:tasks.workunit.client.1.smithi052.stdout:4/187: truncate de/f33 1081622 0 2023-12-05T13:24:57.267 INFO:tasks.workunit.client.1.smithi052.stdout:4/188: fdatasync de/f14 0 2023-12-05T13:24:57.268 INFO:tasks.workunit.client.1.smithi052.stdout:0/221: mkdir d0/db/d1b/d51/d55 0 2023-12-05T13:24:57.268 INFO:tasks.workunit.client.1.smithi052.stdout:0/222: read d0/db/d1b/f37 [328713,89044] 0 2023-12-05T13:24:57.268 INFO:tasks.workunit.client.1.smithi052.stdout:0/223: write d0/fa [885583,31979] 0 2023-12-05T13:24:57.272 INFO:tasks.workunit.client.1.smithi052.stdout:0/224: dread d0/db/d14/f4f [0,4194304] 0 2023-12-05T13:24:57.273 INFO:tasks.workunit.client.1.smithi052.stdout:0/225: fsync d0/db/d20/f3e 0 2023-12-05T13:24:57.273 INFO:tasks.workunit.client.1.smithi052.stdout:0/226: dread - d0/db/d33/f3f zero size 2023-12-05T13:24:57.273 INFO:tasks.workunit.client.1.smithi052.stdout:0/227: write d0/db/d20/f21 [2246820,128819] 0 2023-12-05T13:24:57.273 INFO:tasks.workunit.client.1.smithi052.stdout:0/228: getdents d0/db/d2e/d53 0 2023-12-05T13:24:57.273 INFO:tasks.workunit.client.1.smithi052.stdout:4/189: dread f4 [0,4194304] 0 2023-12-05T13:24:57.290 INFO:tasks.workunit.client.1.smithi052.stdout:0/229: dwrite d0/db/d33/f35 [0,4194304] 0 2023-12-05T13:24:57.290 INFO:tasks.workunit.client.1.smithi052.stdout:0/230: write d0/db/d14/f40 [47155,6509] 0 2023-12-05T13:24:57.310 INFO:tasks.workunit.client.1.smithi052.stdout:0/231: dwrite d0/db/d2e/f46 [0,4194304] 0 2023-12-05T13:24:57.310 INFO:tasks.workunit.client.1.smithi052.stdout:0/232: dread - d0/db/d33/f3f zero size 2023-12-05T13:24:57.319 INFO:tasks.workunit.client.1.smithi052.stdout:0/233: dread d0/db/d2e/f46 [0,4194304] 0 2023-12-05T13:24:57.330 INFO:tasks.workunit.client.1.smithi052.stdout:3/186: creat da/d2e/f3c x:0 0 0 2023-12-05T13:24:57.331 INFO:tasks.workunit.client.1.smithi052.stdout:7/210: fdatasync d7/da/f2b 0 2023-12-05T13:24:57.331 INFO:tasks.workunit.client.1.smithi052.stdout:3/187: write da/fe [748411,23281] 0 2023-12-05T13:24:57.332 INFO:tasks.workunit.client.1.smithi052.stdout:3/188: chown da/dd/f26 14 1 2023-12-05T13:24:57.335 INFO:tasks.workunit.client.1.smithi052.stdout:5/140: unlink d5/d15/l29 0 2023-12-05T13:24:57.335 INFO:tasks.workunit.client.1.smithi052.stdout:5/141: chown d5/df/d11/l28 0 1 2023-12-05T13:24:57.337 INFO:tasks.workunit.client.1.smithi052.stdout:8/262: rename d0/d51/f52 to d0/d28/d39/d3a/f5b 0 2023-12-05T13:24:57.337 INFO:tasks.workunit.client.1.smithi052.stdout:8/263: readlink d0/de/l10 0 2023-12-05T13:24:57.337 INFO:tasks.workunit.client.1.smithi052.stdout:8/264: write d0/d28/d2b/f31 [1121833,91721] 0 2023-12-05T13:24:57.337 INFO:tasks.workunit.client.1.smithi052.stdout:8/265: readlink d0/de/l1e 0 2023-12-05T13:24:57.337 INFO:tasks.workunit.client.1.smithi052.stdout:8/266: write d0/f3e [250317,26196] 0 2023-12-05T13:24:57.338 INFO:tasks.workunit.client.1.smithi052.stdout:2/202: rmdir d2/d4 39 2023-12-05T13:24:57.340 INFO:tasks.workunit.client.1.smithi052.stdout:9/184: mkdir d3/d11/d3e 0 2023-12-05T13:24:57.344 INFO:tasks.workunit.client.1.smithi052.stdout:7/211: dwrite d7/da/d13/d16/f2d [0,4194304] 0 2023-12-05T13:24:57.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:57 smithi029 ceph-mon[112128]: pgmap v198: 65 pgs: 65 active+clean; 253 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 27 MiB/s wr, 671 op/s 2023-12-05T13:24:57.354 INFO:tasks.workunit.client.1.smithi052.stdout:9/185: dwrite d3/d11/d19/f29 [0,4194304] 0 2023-12-05T13:24:57.357 INFO:tasks.workunit.client.1.smithi052.stdout:0/234: mknod d0/db/d2e/c56 0 2023-12-05T13:24:57.359 INFO:tasks.workunit.client.1.smithi052.stdout:3/189: mkdir da/dd/d3d 0 2023-12-05T13:24:57.360 INFO:tasks.workunit.client.1.smithi052.stdout:3/190: readlink l3 0 2023-12-05T13:24:57.360 INFO:tasks.workunit.client.1.smithi052.stdout:3/191: dread - da/f23 zero size 2023-12-05T13:24:57.360 INFO:tasks.workunit.client.1.smithi052.stdout:3/192: write f4 [754924,73404] 0 2023-12-05T13:24:57.361 INFO:tasks.workunit.client.1.smithi052.stdout:5/142: creat d5/d15/d21/d25/f32 x:0 0 0 2023-12-05T13:24:57.361 INFO:tasks.workunit.client.1.smithi052.stdout:5/143: stat d5/fa 0 2023-12-05T13:24:57.366 INFO:tasks.workunit.client.1.smithi052.stdout:8/267: mknod d0/d28/d2b/d53/c5c 0 2023-12-05T13:24:57.366 INFO:tasks.workunit.client.1.smithi052.stdout:3/193: dread da/d27/f2b [0,4194304] 0 2023-12-05T13:24:57.366 INFO:tasks.workunit.client.1.smithi052.stdout:2/203: creat d2/d13/f3e x:0 0 0 2023-12-05T13:24:57.374 INFO:tasks.workunit.client.1.smithi052.stdout:9/186: symlink d3/l3f 0 2023-12-05T13:24:57.375 INFO:tasks.workunit.client.1.smithi052.stdout:9/187: fsync d3/d11/d19/f27 0 2023-12-05T13:24:57.380 INFO:tasks.workunit.client.1.smithi052.stdout:0/235: rename d0/f17 to d0/db/d1b/d29/f57 0 2023-12-05T13:24:57.380 INFO:tasks.workunit.client.1.smithi052.stdout:4/190: dwrite de/f33 [0,4194304] 0 2023-12-05T13:24:57.389 INFO:tasks.workunit.client.1.smithi052.stdout:8/268: symlink d0/d28/l5d 0 2023-12-05T13:24:57.390 INFO:tasks.workunit.client.1.smithi052.stdout:3/194: rmdir da/d27 39 2023-12-05T13:24:57.391 INFO:tasks.workunit.client.1.smithi052.stdout:3/195: write da/d25/f31 [1776292,103006] 0 2023-12-05T13:24:57.391 INFO:tasks.workunit.client.1.smithi052.stdout:3/196: stat l7 0 2023-12-05T13:24:57.395 INFO:tasks.workunit.client.1.smithi052.stdout:7/212: mkdir d7/da/d45 0 2023-12-05T13:24:57.401 INFO:tasks.workunit.client.1.smithi052.stdout:4/191: mknod de/d29/c39 0 2023-12-05T13:24:57.402 INFO:tasks.workunit.client.1.smithi052.stdout:0/236: dwrite d0/db/d20/f3e [0,4194304] 0 2023-12-05T13:24:57.402 INFO:tasks.workunit.client.1.smithi052.stdout:7/213: dread d7/da/d13/d16/f2d [0,4194304] 0 2023-12-05T13:24:57.406 INFO:tasks.workunit.client.1.smithi052.stdout:8/269: symlink d0/d51/l5e 0 2023-12-05T13:24:57.406 INFO:tasks.workunit.client.1.smithi052.stdout:8/270: truncate d0/de/f38 1957923 0 2023-12-05T13:24:57.406 INFO:tasks.workunit.client.1.smithi052.stdout:7/214: dread d7/da/d13/d16/f2d [0,4194304] 0 2023-12-05T13:24:57.409 INFO:tasks.workunit.client.1.smithi052.stdout:3/197: mknod da/d2e/c3e 0 2023-12-05T13:24:57.409 INFO:tasks.workunit.client.1.smithi052.stdout:3/198: read - da/f23 zero size 2023-12-05T13:24:57.410 INFO:tasks.workunit.client.1.smithi052.stdout:3/199: read da/dd/f17 [3708609,65754] 0 2023-12-05T13:24:57.410 INFO:tasks.workunit.client.1.smithi052.stdout:3/200: stat da/d2e/c3e 0 2023-12-05T13:24:57.411 INFO:tasks.workunit.client.1.smithi052.stdout:2/204: unlink d2/d13/c21 0 2023-12-05T13:24:57.411 INFO:tasks.workunit.client.1.smithi052.stdout:2/205: write d2/f2f [599808,97492] 0 2023-12-05T13:24:57.411 INFO:tasks.workunit.client.1.smithi052.stdout:2/206: chown d2/d31/d3a 928869 1 2023-12-05T13:24:57.415 INFO:tasks.workunit.client.1.smithi052.stdout:4/192: rename de/c1d to de/d1e/d24/c3a 0 2023-12-05T13:24:57.416 INFO:tasks.workunit.client.1.smithi052.stdout:3/201: dread f4 [0,4194304] 0 2023-12-05T13:24:57.417 INFO:tasks.workunit.client.1.smithi052.stdout:4/193: write de/f33 [3046748,111638] 0 2023-12-05T13:24:57.417 INFO:tasks.workunit.client.1.smithi052.stdout:7/215: write d7/da/d12/f43 [936674,80580] 0 2023-12-05T13:24:57.418 INFO:tasks.workunit.client.1.smithi052.stdout:0/237: dwrite d0/db/d1b/d29/f57 [0,4194304] 0 2023-12-05T13:24:57.419 INFO:tasks.workunit.client.1.smithi052.stdout:2/207: mkdir d2/d4/d3f 0 2023-12-05T13:24:57.421 INFO:tasks.workunit.client.1.smithi052.stdout:8/271: rename d0/c1d to d0/de/d27/d43/c5f 0 2023-12-05T13:24:57.421 INFO:tasks.workunit.client.1.smithi052.stdout:8/272: write d0/f3e [841240,66815] 0 2023-12-05T13:24:57.421 INFO:tasks.workunit.client.1.smithi052.stdout:8/273: stat d0/de/d12/f2e 0 2023-12-05T13:24:57.422 INFO:tasks.workunit.client.1.smithi052.stdout:8/274: write d0/f5 [4221228,102758] 0 2023-12-05T13:24:57.422 INFO:tasks.workunit.client.1.smithi052.stdout:3/202: creat da/d25/f3f x:0 0 0 2023-12-05T13:24:57.422 INFO:tasks.workunit.client.1.smithi052.stdout:3/203: chown da/d2e 26693 1 2023-12-05T13:24:57.425 INFO:tasks.workunit.client.1.smithi052.stdout:7/216: unlink d7/da/d13/d16/f2d 0 2023-12-05T13:24:57.425 INFO:tasks.workunit.client.1.smithi052.stdout:7/217: readlink d7/da/d12/l2c 0 2023-12-05T13:24:57.429 INFO:tasks.workunit.client.1.smithi052.stdout:4/194: dread de/d1e/f20 [0,4194304] 0 2023-12-05T13:24:57.433 INFO:tasks.workunit.client.1.smithi052.stdout:0/238: link d0/db/d14/l19 d0/db/d52/l58 0 2023-12-05T13:24:57.435 INFO:tasks.workunit.client.1.smithi052.stdout:2/208: mknod d2/d4/d3f/c40 0 2023-12-05T13:24:57.444 INFO:tasks.workunit.client.1.smithi052.stdout:8/275: mkdir d0/d28/d2b/d53/d56/d60 0 2023-12-05T13:24:57.447 INFO:tasks.workunit.client.1.smithi052.stdout:3/204: unlink da/c16 0 2023-12-05T13:24:57.448 INFO:tasks.workunit.client.1.smithi052.stdout:7/218: read d7/da/f36 [538013,108922] 0 2023-12-05T13:24:57.450 INFO:tasks.workunit.client.1.smithi052.stdout:4/195: chown de/l1c 0 1 2023-12-05T13:24:57.452 INFO:tasks.workunit.client.1.smithi052.stdout:0/239: creat d0/db/d14/f59 x:0 0 0 2023-12-05T13:24:57.455 INFO:tasks.workunit.client.1.smithi052.stdout:2/209: truncate d2/f2b 596693 0 2023-12-05T13:24:57.457 INFO:tasks.workunit.client.1.smithi052.stdout:8/276: symlink d0/d28/d39/d3a/l61 0 2023-12-05T13:24:57.461 INFO:tasks.workunit.client.1.smithi052.stdout:3/205: mkdir da/d2e/d40 0 2023-12-05T13:24:57.462 INFO:tasks.workunit.client.1.smithi052.stdout:7/219: mkdir d7/da/d12/d3f/d46 0 2023-12-05T13:24:57.464 INFO:tasks.workunit.client.1.smithi052.stdout:4/196: mknod de/d2b/c3b 0 2023-12-05T13:24:57.468 INFO:tasks.workunit.client.1.smithi052.stdout:2/210: symlink d2/d4/l41 0 2023-12-05T13:24:57.471 INFO:tasks.workunit.client.1.smithi052.stdout:7/220: creat d7/da/d12/d3f/d46/f47 x:0 0 0 2023-12-05T13:24:57.472 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:57 smithi052 ceph-mon[121072]: pgmap v198: 65 pgs: 65 active+clean; 253 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 27 MiB/s wr, 671 op/s 2023-12-05T13:24:57.476 INFO:tasks.workunit.client.1.smithi052.stdout:4/197: creat de/d30/f3c x:0 0 0 2023-12-05T13:24:57.476 INFO:tasks.workunit.client.1.smithi052.stdout:5/144: getdents d5/d15 0 2023-12-05T13:24:57.476 INFO:tasks.workunit.client.1.smithi052.stdout:5/145: dread - d5/d15/f31 zero size 2023-12-05T13:24:57.478 INFO:tasks.workunit.client.1.smithi052.stdout:2/211: rmdir d2/d13/d1e 39 2023-12-05T13:24:57.478 INFO:tasks.workunit.client.1.smithi052.stdout:2/212: readlink d2/d4/l1d 0 2023-12-05T13:24:57.478 INFO:tasks.workunit.client.1.smithi052.stdout:8/277: dwrite d0/de/d12/f2e [0,4194304] 0 2023-12-05T13:24:57.481 INFO:tasks.workunit.client.1.smithi052.stdout:7/221: unlink d7/d31/c38 0 2023-12-05T13:24:57.481 INFO:tasks.workunit.client.1.smithi052.stdout:7/222: truncate d7/da/d12/f29 677379 0 2023-12-05T13:24:57.481 INFO:tasks.workunit.client.1.smithi052.stdout:7/223: stat d7/da/d13 0 2023-12-05T13:24:57.483 INFO:tasks.workunit.client.1.smithi052.stdout:4/198: rename de/d29/f32 to de/d29/f3d 0 2023-12-05T13:24:57.485 INFO:tasks.workunit.client.1.smithi052.stdout:5/146: rename d5/d2c to d5/d15/d33 0 2023-12-05T13:24:57.488 INFO:tasks.workunit.client.1.smithi052.stdout:2/213: unlink l0 0 2023-12-05T13:24:57.489 INFO:tasks.workunit.client.1.smithi052.stdout:2/214: dread d2/f2f [0,4194304] 0 2023-12-05T13:24:57.491 INFO:tasks.workunit.client.1.smithi052.stdout:6/200: sync 2023-12-05T13:24:57.491 INFO:tasks.workunit.client.1.smithi052.stdout:6/201: chown d3/c14 309402 1 2023-12-05T13:24:57.492 INFO:tasks.workunit.client.1.smithi052.stdout:6/202: write d3/d4/d6/f7 [1701891,49426] 0 2023-12-05T13:24:57.492 INFO:tasks.workunit.client.1.smithi052.stdout:6/203: fdatasync d3/d4/df/f43 0 2023-12-05T13:24:57.493 INFO:tasks.workunit.client.1.smithi052.stdout:5/147: rmdir d5 39 2023-12-05T13:24:57.495 INFO:tasks.workunit.client.1.smithi052.stdout:7/224: rename d7/ce to d7/da/d45/c48 0 2023-12-05T13:24:57.495 INFO:tasks.workunit.client.1.smithi052.stdout:7/225: fdatasync d7/da/d13/d16/f30 0 2023-12-05T13:24:57.500 INFO:tasks.workunit.client.1.smithi052.stdout:6/204: unlink d3/d5/d9/d21/c41 0 2023-12-05T13:24:57.500 INFO:tasks.workunit.client.1.smithi052.stdout:6/205: chown d3/d5/f34 1127553 1 2023-12-05T13:24:57.501 INFO:tasks.workunit.client.1.smithi052.stdout:5/148: mknod d5/d15/d33/c34 0 2023-12-05T13:24:57.505 INFO:tasks.workunit.client.1.smithi052.stdout:7/226: mknod d7/da/d13/d16/c49 0 2023-12-05T13:24:57.508 INFO:tasks.workunit.client.1.smithi052.stdout:2/215: truncate d2/d13/f26 3956499 0 2023-12-05T13:24:57.510 INFO:tasks.workunit.client.1.smithi052.stdout:4/199: rename de/d1e/l2c to de/d2b/l3e 0 2023-12-05T13:24:57.513 INFO:tasks.workunit.client.1.smithi052.stdout:7/227: link d7/da/d13/f19 d7/da/d12/d3f/d46/f4a 0 2023-12-05T13:24:57.517 INFO:tasks.workunit.client.1.smithi052.stdout:2/216: link d2/d13/f36 d2/d14/f42 0 2023-12-05T13:24:57.517 INFO:tasks.workunit.client.1.smithi052.stdout:4/200: mknod de/d1e/d24/c3f 0 2023-12-05T13:24:57.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/217: write d2/f2f [658996,62906] 0 2023-12-05T13:24:57.518 INFO:tasks.workunit.client.1.smithi052.stdout:4/201: read de/d1e/f20 [4583388,46101] 0 2023-12-05T13:24:57.521 INFO:tasks.workunit.client.1.smithi052.stdout:4/202: symlink de/d29/l40 0 2023-12-05T13:24:57.524 INFO:tasks.workunit.client.1.smithi052.stdout:6/206: dwrite d3/d4/d6/f25 [0,4194304] 0 2023-12-05T13:24:57.525 INFO:tasks.workunit.client.1.smithi052.stdout:4/203: truncate de/f12 4602452 0 2023-12-05T13:24:57.532 INFO:tasks.workunit.client.1.smithi052.stdout:6/207: getdents d3/d4 0 2023-12-05T13:24:57.533 INFO:tasks.workunit.client.1.smithi052.stdout:7/228: dwrite d7/da/d12/f29 [0,4194304] 0 2023-12-05T13:24:57.533 INFO:tasks.workunit.client.1.smithi052.stdout:4/204: rename l8 to de/d2b/l41 0 2023-12-05T13:24:57.536 INFO:tasks.workunit.client.1.smithi052.stdout:6/208: mkdir d3/d5/d9/d44 0 2023-12-05T13:24:57.537 INFO:tasks.workunit.client.1.smithi052.stdout:6/209: write d3/d4/d6/f7 [6025969,18286] 0 2023-12-05T13:24:57.546 INFO:tasks.workunit.client.1.smithi052.stdout:6/210: symlink d3/d4/l45 0 2023-12-05T13:24:57.546 INFO:tasks.workunit.client.1.smithi052.stdout:6/211: write d3/d5/d9/d21/f23 [760219,25286] 0 2023-12-05T13:24:57.549 INFO:tasks.workunit.client.1.smithi052.stdout:6/212: creat d3/d4/d6/f46 x:0 0 0 2023-12-05T13:24:57.551 INFO:tasks.workunit.client.1.smithi052.stdout:6/213: creat d3/d4/df/d27/f47 x:0 0 0 2023-12-05T13:24:57.552 INFO:tasks.workunit.client.1.smithi052.stdout:1/230: sync 2023-12-05T13:24:57.554 INFO:tasks.workunit.client.1.smithi052.stdout:6/214: mkdir d3/d5/d9/d21/d48 0 2023-12-05T13:24:57.556 INFO:tasks.workunit.client.1.smithi052.stdout:1/231: creat d5/d7/f4b x:0 0 0 2023-12-05T13:24:57.556 INFO:tasks.workunit.client.1.smithi052.stdout:6/215: mknod d3/d5/d9/d21/d48/c49 0 2023-12-05T13:24:57.558 INFO:tasks.workunit.client.1.smithi052.stdout:6/216: mknod d3/d5/d9/d21/c4a 0 2023-12-05T13:24:57.561 INFO:tasks.workunit.client.1.smithi052.stdout:6/217: getdents d3 0 2023-12-05T13:24:57.561 INFO:tasks.workunit.client.1.smithi052.stdout:6/218: fsync d3/d4/d6/f25 0 2023-12-05T13:24:57.564 INFO:tasks.workunit.client.1.smithi052.stdout:6/219: link d3/d4/df/f43 d3/d4/d6/f4b 0 2023-12-05T13:24:57.566 INFO:tasks.workunit.client.1.smithi052.stdout:6/220: symlink d3/d5/d9/d21/l4c 0 2023-12-05T13:24:57.568 INFO:tasks.workunit.client.1.smithi052.stdout:1/232: dwrite d5/d7/de/d14/d2a/f3b [0,4194304] 0 2023-12-05T13:24:57.568 INFO:tasks.workunit.client.1.smithi052.stdout:6/221: mkdir d3/d5/d9/d21/d48/d4d 0 2023-12-05T13:24:57.568 INFO:tasks.workunit.client.1.smithi052.stdout:6/222: stat d3/d4/df/l10 0 2023-12-05T13:24:57.568 INFO:tasks.workunit.client.1.smithi052.stdout:1/233: write d5/f3a [726777,41019] 0 2023-12-05T13:24:57.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/223: dread d3/d4/d6/f1d [0,4194304] 0 2023-12-05T13:24:57.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/224: chown d3/f16 19333 1 2023-12-05T13:24:57.579 INFO:tasks.workunit.client.1.smithi052.stdout:6/225: creat d3/d5/d9/d21/d48/f4e x:0 0 0 2023-12-05T13:24:57.579 INFO:tasks.workunit.client.1.smithi052.stdout:6/226: chown d3/f3d 4623863 1 2023-12-05T13:24:57.582 INFO:tasks.workunit.client.1.smithi052.stdout:1/234: mknod d5/c4c 0 2023-12-05T13:24:57.602 INFO:tasks.workunit.client.1.smithi052.stdout:6/227: dwrite d3/d4/d6/f1d [0,4194304] 0 2023-12-05T13:24:57.602 INFO:tasks.workunit.client.1.smithi052.stdout:6/228: truncate d3/d4/df/f43 295989 0 2023-12-05T13:24:57.602 INFO:tasks.workunit.client.1.smithi052.stdout:6/229: write d3/f3d [820064,107453] 0 2023-12-05T13:24:57.607 INFO:tasks.workunit.client.1.smithi052.stdout:6/230: stat d3/c14 0 2023-12-05T13:24:57.607 INFO:tasks.workunit.client.1.smithi052.stdout:1/235: dwrite d5/d7/f13 [0,4194304] 0 2023-12-05T13:24:57.608 INFO:tasks.workunit.client.1.smithi052.stdout:1/236: write d5/d7/d35/f3d [880494,105738] 0 2023-12-05T13:24:57.610 INFO:tasks.workunit.client.1.smithi052.stdout:6/231: creat d3/d4/df/d24/f4f x:0 0 0 2023-12-05T13:24:57.612 INFO:tasks.workunit.client.1.smithi052.stdout:6/232: dread d3/d5/d9/f2e [0,4194304] 0 2023-12-05T13:24:57.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/237: dwrite d5/d7/de/d14/d17/f39 [0,4194304] 0 2023-12-05T13:24:57.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/238: fdatasync d5/d7/f4b 0 2023-12-05T13:24:57.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/239: fdatasync d5/d7/d35/f3d 0 2023-12-05T13:24:57.642 INFO:tasks.workunit.client.1.smithi052.stdout:1/240: dwrite d5/d7/de/d14/d17/f39 [0,4194304] 0 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/241: creat d5/d7/d35/d2f/f4d x:0 0 0 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/242: chown d5/d7/c10 35073122 1 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/243: dread - d5/d7/de/d14/d2a/f49 zero size 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/244: fsync d5/f3a 0 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/245: write f4 [1665937,127604] 0 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/246: write d5/d7/de/d14/f32 [4715794,72067] 0 2023-12-05T13:24:57.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/247: getdents d5/d7/d35/d37/d43 0 2023-12-05T13:24:57.674 INFO:tasks.workunit.client.1.smithi052.stdout:4/205: rename de/d1e/f20 to de/d30/f42 0 2023-12-05T13:24:57.679 INFO:tasks.workunit.client.1.smithi052.stdout:4/206: truncate de/f11 2115665 0 2023-12-05T13:24:57.684 INFO:tasks.workunit.client.1.smithi052.stdout:7/229: truncate d7/da/d12/f29 2551321 0 2023-12-05T13:24:57.684 INFO:tasks.workunit.client.1.smithi052.stdout:4/207: dread fa [0,4194304] 0 2023-12-05T13:24:57.697 INFO:tasks.workunit.client.1.smithi052.stdout:4/208: dwrite de/d30/f3c [0,4194304] 0 2023-12-05T13:24:57.702 INFO:tasks.workunit.client.1.smithi052.stdout:7/230: dwrite d7/da/d12/d3f/d46/f47 [0,4194304] 0 2023-12-05T13:24:57.704 INFO:tasks.workunit.client.1.smithi052.stdout:4/209: getdents de/d29 0 2023-12-05T13:24:57.704 INFO:tasks.workunit.client.1.smithi052.stdout:4/210: rename de to de/d29/d43 22 2023-12-05T13:24:57.709 INFO:tasks.workunit.client.1.smithi052.stdout:7/231: mkdir d7/d31/d4b 0 2023-12-05T13:24:57.713 INFO:tasks.workunit.client.1.smithi052.stdout:4/211: unlink de/d1e/d24/c3f 0 2023-12-05T13:24:57.717 INFO:tasks.workunit.client.1.smithi052.stdout:4/212: rename de/d1e/d24/f28 to de/d29/f44 0 2023-12-05T13:24:57.725 INFO:tasks.workunit.client.1.smithi052.stdout:4/213: write de/d29/f44 [804714,3835] 0 2023-12-05T13:24:57.736 INFO:tasks.workunit.client.1.smithi052.stdout:7/232: symlink d7/da/d12/l4c 0 2023-12-05T13:24:57.739 INFO:tasks.workunit.client.1.smithi052.stdout:7/233: mkdir d7/da/d12/d3f/d46/d4d 0 2023-12-05T13:24:57.745 INFO:tasks.workunit.client.1.smithi052.stdout:4/214: dread de/d1e/f2a [0,4194304] 0 2023-12-05T13:24:57.746 INFO:tasks.workunit.client.1.smithi052.stdout:4/215: readlink de/d1e/l22 0 2023-12-05T13:24:57.750 INFO:tasks.workunit.client.1.smithi052.stdout:4/216: rename de/d1e/l34 to de/d30/l45 0 2023-12-05T13:24:57.769 INFO:tasks.workunit.client.1.smithi052.stdout:4/217: dwrite de/d1e/d24/f38 [0,4194304] 0 2023-12-05T13:24:57.773 INFO:tasks.workunit.client.1.smithi052.stdout:4/218: symlink de/d30/l46 0 2023-12-05T13:24:57.773 INFO:tasks.workunit.client.1.smithi052.stdout:4/219: fdatasync de/d30/f42 0 2023-12-05T13:24:57.775 INFO:tasks.workunit.client.1.smithi052.stdout:4/220: rename de/d30/c37 to de/d2b/c47 0 2023-12-05T13:24:57.775 INFO:tasks.workunit.client.1.smithi052.stdout:4/221: chown de/d2b/f2d 35093330 1 2023-12-05T13:24:57.775 INFO:tasks.workunit.client.1.smithi052.stdout:4/222: stat de/l10 0 2023-12-05T13:24:57.776 INFO:tasks.workunit.client.1.smithi052.stdout:1/248: rmdir d5 39 2023-12-05T13:24:57.776 INFO:tasks.workunit.client.1.smithi052.stdout:1/249: read d5/d7/de/d14/f32 [3413052,8967] 0 2023-12-05T13:24:57.777 INFO:tasks.workunit.client.1.smithi052.stdout:4/223: mkdir de/d29/d48 0 2023-12-05T13:24:57.778 INFO:tasks.workunit.client.1.smithi052.stdout:1/250: write d5/f8 [4788274,77044] 0 2023-12-05T13:24:57.778 INFO:tasks.workunit.client.1.smithi052.stdout:1/251: write d5/f2c [819515,27176] 0 2023-12-05T13:24:57.781 INFO:tasks.workunit.client.1.smithi052.stdout:1/252: dread d5/f2c [0,4194304] 0 2023-12-05T13:24:57.785 INFO:tasks.workunit.client.1.smithi052.stdout:1/253: mknod d5/d7/d35/c4e 0 2023-12-05T13:24:57.788 INFO:tasks.workunit.client.1.smithi052.stdout:1/254: mkdir d5/d7/de/d18/d2e/d4f 0 2023-12-05T13:24:57.790 INFO:tasks.workunit.client.1.smithi052.stdout:1/255: dread d5/f2c [0,4194304] 0 2023-12-05T13:24:57.797 INFO:tasks.workunit.client.1.smithi052.stdout:1/256: dread d5/f3a [0,4194304] 0 2023-12-05T13:24:57.797 INFO:tasks.workunit.client.1.smithi052.stdout:1/257: fdatasync d5/d7/f4b 0 2023-12-05T13:24:57.799 INFO:tasks.workunit.client.1.smithi052.stdout:1/258: creat d5/d7/f50 x:0 0 0 2023-12-05T13:24:57.800 INFO:tasks.workunit.client.1.smithi052.stdout:1/259: mknod d5/d7/de/d18/d2e/d4f/c51 0 2023-12-05T13:24:57.801 INFO:tasks.workunit.client.1.smithi052.stdout:1/260: dread - d5/d7/f47 zero size 2023-12-05T13:24:57.804 INFO:tasks.workunit.client.1.smithi052.stdout:1/261: mkdir d5/d7/d52 0 2023-12-05T13:24:57.804 INFO:tasks.workunit.client.1.smithi052.stdout:1/262: fdatasync d5/d7/d35/d2f/f4d 0 2023-12-05T13:24:57.805 INFO:tasks.workunit.client.1.smithi052.stdout:1/263: dread - d5/d7/f50 zero size 2023-12-05T13:24:57.806 INFO:tasks.workunit.client.1.smithi052.stdout:3/206: sync 2023-12-05T13:24:57.806 INFO:tasks.workunit.client.1.smithi052.stdout:8/278: sync 2023-12-05T13:24:57.806 INFO:tasks.workunit.client.1.smithi052.stdout:5/149: sync 2023-12-05T13:24:57.807 INFO:tasks.workunit.client.1.smithi052.stdout:3/207: getdents da/dd/d3d 0 2023-12-05T13:24:57.807 INFO:tasks.workunit.client.1.smithi052.stdout:0/240: sync 2023-12-05T13:24:57.807 INFO:tasks.workunit.client.1.smithi052.stdout:9/188: sync 2023-12-05T13:24:57.807 INFO:tasks.workunit.client.1.smithi052.stdout:2/218: sync 2023-12-05T13:24:57.807 INFO:tasks.workunit.client.1.smithi052.stdout:2/219: stat d2/d4/l30 0 2023-12-05T13:24:57.807 INFO:tasks.workunit.client.1.smithi052.stdout:2/220: write d2/d13/d1e/f27 [1260342,126231] 0 2023-12-05T13:24:57.811 INFO:tasks.workunit.client.1.smithi052.stdout:5/150: mknod d5/d15/d21/c35 0 2023-12-05T13:24:57.817 INFO:tasks.workunit.client.1.smithi052.stdout:3/208: mknod da/d25/d33/c41 0 2023-12-05T13:24:57.817 INFO:tasks.workunit.client.1.smithi052.stdout:2/221: link d2/d4/l41 d2/d13/d1e/l43 0 2023-12-05T13:24:57.817 INFO:tasks.workunit.client.1.smithi052.stdout:2/222: chown d2/f2b 1484 1 2023-12-05T13:24:57.817 INFO:tasks.workunit.client.1.smithi052.stdout:8/279: mkdir d0/d62 0 2023-12-05T13:24:57.817 INFO:tasks.workunit.client.1.smithi052.stdout:3/209: write da/d27/f28 [1307941,27552] 0 2023-12-05T13:24:57.821 INFO:tasks.workunit.client.1.smithi052.stdout:5/151: unlink d5/df/f22 0 2023-12-05T13:24:57.824 INFO:tasks.workunit.client.1.smithi052.stdout:2/223: link d2/l2e d2/d31/d3a/l44 0 2023-12-05T13:24:57.824 INFO:tasks.workunit.client.1.smithi052.stdout:2/224: chown d2/d13/d1e/l2d 55153943 1 2023-12-05T13:24:57.825 INFO:tasks.workunit.client.1.smithi052.stdout:2/225: dread d2/f2b [0,4194304] 0 2023-12-05T13:24:57.826 INFO:tasks.workunit.client.1.smithi052.stdout:3/210: symlink da/dd/d3d/l42 0 2023-12-05T13:24:57.826 INFO:tasks.workunit.client.1.smithi052.stdout:0/241: dwrite d0/db/d33/f35 [0,4194304] 0 2023-12-05T13:24:57.827 INFO:tasks.workunit.client.1.smithi052.stdout:9/189: dwrite d3/d11/d19/f27 [0,4194304] 0 2023-12-05T13:24:57.830 INFO:tasks.workunit.client.1.smithi052.stdout:5/152: creat d5/df/f36 x:0 0 0 2023-12-05T13:24:57.830 INFO:tasks.workunit.client.1.smithi052.stdout:5/153: dread - d5/df/f36 zero size 2023-12-05T13:24:57.835 INFO:tasks.workunit.client.1.smithi052.stdout:2/226: dread d2/d13/f26 [0,4194304] 0 2023-12-05T13:24:57.836 INFO:tasks.workunit.client.1.smithi052.stdout:3/211: mkdir da/d25/d33/d43 0 2023-12-05T13:24:57.836 INFO:tasks.workunit.client.1.smithi052.stdout:0/242: creat d0/db/d20/f5a x:0 0 0 2023-12-05T13:24:57.839 INFO:tasks.workunit.client.1.smithi052.stdout:5/154: dread f3 [0,4194304] 0 2023-12-05T13:24:57.839 INFO:tasks.workunit.client.1.smithi052.stdout:2/227: write d2/d13/d1e/f25 [3125608,39287] 0 2023-12-05T13:24:57.840 INFO:tasks.workunit.client.1.smithi052.stdout:3/212: read da/dd/f26 [1599087,97224] 0 2023-12-05T13:24:57.840 INFO:tasks.workunit.client.1.smithi052.stdout:0/243: rename d0/c7 to d0/db/d2e/d53/c5b 0 2023-12-05T13:24:57.844 INFO:tasks.workunit.client.1.smithi052.stdout:3/213: truncate da/d27/f2b 1376576 0 2023-12-05T13:24:57.846 INFO:tasks.workunit.client.1.smithi052.stdout:0/244: symlink d0/db/d20/l5c 0 2023-12-05T13:24:57.846 INFO:tasks.workunit.client.1.smithi052.stdout:0/245: read - d0/db/d20/f5a zero size 2023-12-05T13:24:57.847 INFO:tasks.workunit.client.1.smithi052.stdout:9/190: dwrite d3/d11/d19/f29 [0,4194304] 0 2023-12-05T13:24:57.848 INFO:tasks.workunit.client.1.smithi052.stdout:3/214: creat da/dd/d3d/f44 x:0 0 0 2023-12-05T13:24:57.849 INFO:tasks.workunit.client.1.smithi052.stdout:2/228: mkdir d2/d13/d45 0 2023-12-05T13:24:57.850 INFO:tasks.workunit.client.1.smithi052.stdout:3/215: read da/d27/f2d [1618391,83659] 0 2023-12-05T13:24:57.851 INFO:tasks.workunit.client.1.smithi052.stdout:3/216: write da/dd/f19 [1767036,104845] 0 2023-12-05T13:24:57.853 INFO:tasks.workunit.client.1.smithi052.stdout:0/246: rename d0/db/d20/f3e to d0/db/d20/d50/f5d 0 2023-12-05T13:24:57.856 INFO:tasks.workunit.client.1.smithi052.stdout:9/191: symlink d3/l40 0 2023-12-05T13:24:57.856 INFO:tasks.workunit.client.1.smithi052.stdout:9/192: read - d3/d1e/d37/f38 zero size 2023-12-05T13:24:57.858 INFO:tasks.workunit.client.1.smithi052.stdout:5/155: dwrite d5/f9 [0,4194304] 0 2023-12-05T13:24:57.858 INFO:tasks.workunit.client.1.smithi052.stdout:5/156: chown d5/df/d11/l1c 0 1 2023-12-05T13:24:57.858 INFO:tasks.workunit.client.1.smithi052.stdout:5/157: stat d5/d15/f31 0 2023-12-05T13:24:57.858 INFO:tasks.workunit.client.1.smithi052.stdout:3/217: link da/d27/l36 da/d25/d33/l45 0 2023-12-05T13:24:57.860 INFO:tasks.workunit.client.1.smithi052.stdout:9/193: mkdir d3/d1e/d41 0 2023-12-05T13:24:57.862 INFO:tasks.workunit.client.1.smithi052.stdout:7/234: rename d7/da to d7/d4e 0 2023-12-05T13:24:57.862 INFO:tasks.workunit.client.1.smithi052.stdout:0/247: dread d0/db/d1b/f27 [0,4194304] 0 2023-12-05T13:24:57.867 INFO:tasks.workunit.client.1.smithi052.stdout:5/158: mknod d5/c37 0 2023-12-05T13:24:57.867 INFO:tasks.workunit.client.1.smithi052.stdout:3/218: symlink da/l46 0 2023-12-05T13:24:57.867 INFO:tasks.workunit.client.1.smithi052.stdout:7/235: chown d7/d4e/c25 87932855 1 2023-12-05T13:24:57.867 INFO:tasks.workunit.client.1.smithi052.stdout:7/236: write d7/d4e/f36 [858830,16132] 0 2023-12-05T13:24:57.867 INFO:tasks.workunit.client.1.smithi052.stdout:2/229: dwrite d2/d13/f26 [0,4194304] 0 2023-12-05T13:24:57.875 INFO:tasks.workunit.client.1.smithi052.stdout:3/219: rename da/d27/l2c to da/d2e/l47 0 2023-12-05T13:24:57.876 INFO:tasks.workunit.client.1.smithi052.stdout:7/237: fdatasync d7/d4e/f14 0 2023-12-05T13:24:57.878 INFO:tasks.workunit.client.1.smithi052.stdout:2/230: dread d2/d13/f22 [0,4194304] 0 2023-12-05T13:24:57.880 INFO:tasks.workunit.client.1.smithi052.stdout:9/194: dwrite d3/f3a [0,4194304] 0 2023-12-05T13:24:57.882 INFO:tasks.workunit.client.1.smithi052.stdout:3/220: mkdir da/d48 0 2023-12-05T13:24:57.884 INFO:tasks.workunit.client.1.smithi052.stdout:0/248: dwrite d0/fa [0,4194304] 0 2023-12-05T13:24:57.885 INFO:tasks.workunit.client.1.smithi052.stdout:0/249: read d0/db/d14/f40 [15506,45675] 0 2023-12-05T13:24:57.885 INFO:tasks.workunit.client.1.smithi052.stdout:0/250: dread - d0/db/d2e/f47 zero size 2023-12-05T13:24:57.886 INFO:tasks.workunit.client.1.smithi052.stdout:3/221: mkdir da/d25/d33/d49 0 2023-12-05T13:24:57.886 INFO:tasks.workunit.client.1.smithi052.stdout:3/222: write da/dd/f30 [383492,33992] 0 2023-12-05T13:24:57.889 INFO:tasks.workunit.client.1.smithi052.stdout:2/231: rmdir d2/d14/d3b 0 2023-12-05T13:24:57.890 INFO:tasks.workunit.client.1.smithi052.stdout:3/223: mknod da/d25/d33/d43/c4a 0 2023-12-05T13:24:57.893 INFO:tasks.workunit.client.1.smithi052.stdout:0/251: dread d0/db/d33/f35 [0,4194304] 0 2023-12-05T13:24:57.893 INFO:tasks.workunit.client.1.smithi052.stdout:0/252: truncate d0/db/d33/f3f 737554 0 2023-12-05T13:24:57.893 INFO:tasks.workunit.client.1.smithi052.stdout:0/253: chown d0/db/d1b/d42 1 1 2023-12-05T13:24:57.893 INFO:tasks.workunit.client.1.smithi052.stdout:2/232: creat d2/d13/d1e/f46 x:0 0 0 2023-12-05T13:24:57.893 INFO:tasks.workunit.client.1.smithi052.stdout:7/238: dwrite d7/d4e/f2b [4194304,4194304] 0 2023-12-05T13:24:57.894 INFO:tasks.workunit.client.1.smithi052.stdout:9/195: dwrite d3/f26 [0,4194304] 0 2023-12-05T13:24:57.895 INFO:tasks.workunit.client.1.smithi052.stdout:3/224: symlink da/d48/l4b 0 2023-12-05T13:24:57.895 INFO:tasks.workunit.client.1.smithi052.stdout:3/225: write da/d25/f3a [113441,53917] 0 2023-12-05T13:24:57.897 INFO:tasks.workunit.client.1.smithi052.stdout:0/254: mknod d0/db/d20/c5e 0 2023-12-05T13:24:57.902 INFO:tasks.workunit.client.1.smithi052.stdout:7/239: mknod d7/d31/d4b/c4f 0 2023-12-05T13:24:57.904 INFO:tasks.workunit.client.1.smithi052.stdout:0/255: dread d0/fd [0,4194304] 0 2023-12-05T13:24:57.907 INFO:tasks.workunit.client.1.smithi052.stdout:0/256: dread d0/db/d1b/d42/f45 [0,4194304] 0 2023-12-05T13:24:57.908 INFO:tasks.workunit.client.1.smithi052.stdout:3/226: symlink da/d25/l4c 0 2023-12-05T13:24:57.908 INFO:tasks.workunit.client.1.smithi052.stdout:3/227: write da/d27/f28 [1622629,47853] 0 2023-12-05T13:24:57.909 INFO:tasks.workunit.client.1.smithi052.stdout:2/233: symlink d2/d14/l47 0 2023-12-05T13:24:57.909 INFO:tasks.workunit.client.1.smithi052.stdout:2/234: readlink d2/l2e 0 2023-12-05T13:24:57.910 INFO:tasks.workunit.client.1.smithi052.stdout:2/235: write d2/f3c [522413,56458] 0 2023-12-05T13:24:57.910 INFO:tasks.workunit.client.1.smithi052.stdout:2/236: fsync d2/d13/d1e/f27 0 2023-12-05T13:24:57.911 INFO:tasks.workunit.client.1.smithi052.stdout:9/196: dwrite d3/d11/d19/f2e [0,4194304] 0 2023-12-05T13:24:57.912 INFO:tasks.workunit.client.1.smithi052.stdout:9/197: write d3/d1e/f23 [1410555,27364] 0 2023-12-05T13:24:57.912 INFO:tasks.workunit.client.1.smithi052.stdout:9/198: readlink d3/d11/l28 0 2023-12-05T13:24:57.913 INFO:tasks.workunit.client.1.smithi052.stdout:7/240: mkdir d7/d4e/d45/d50 0 2023-12-05T13:24:57.916 INFO:tasks.workunit.client.1.smithi052.stdout:3/228: symlink da/dd/d3d/l4d 0 2023-12-05T13:24:57.916 INFO:tasks.workunit.client.1.smithi052.stdout:3/229: chown da/f18 12 1 2023-12-05T13:24:57.919 INFO:tasks.workunit.client.1.smithi052.stdout:3/230: read da/d25/f3a [61211,117297] 0 2023-12-05T13:24:57.927 INFO:tasks.workunit.client.1.smithi052.stdout:3/231: dread f4 [0,4194304] 0 2023-12-05T13:24:57.927 INFO:tasks.workunit.client.1.smithi052.stdout:2/237: mkdir d2/d13/d48 0 2023-12-05T13:24:57.927 INFO:tasks.workunit.client.1.smithi052.stdout:2/238: readlink d2/d4/l1d 0 2023-12-05T13:24:57.928 INFO:tasks.workunit.client.1.smithi052.stdout:3/232: creat da/dd/f4e x:0 0 0 2023-12-05T13:24:57.929 INFO:tasks.workunit.client.1.smithi052.stdout:2/239: creat d2/d13/d37/f49 x:0 0 0 2023-12-05T13:24:57.931 INFO:tasks.workunit.client.1.smithi052.stdout:9/199: dwrite d3/d11/d19/f29 [0,4194304] 0 2023-12-05T13:24:57.931 INFO:tasks.workunit.client.1.smithi052.stdout:9/200: write d3/d2a/f30 [654087,51658] 0 2023-12-05T13:24:57.931 INFO:tasks.workunit.client.1.smithi052.stdout:0/257: dwrite d0/db/d20/d50/f5d [0,4194304] 0 2023-12-05T13:24:57.932 INFO:tasks.workunit.client.1.smithi052.stdout:3/233: rename da/dd/f17 to da/dd/d3d/f4f 0 2023-12-05T13:24:57.932 INFO:tasks.workunit.client.1.smithi052.stdout:3/234: chown da/f21 0 1 2023-12-05T13:24:57.932 INFO:tasks.workunit.client.1.smithi052.stdout:2/240: fsync d2/d14/f39 0 2023-12-05T13:24:57.933 INFO:tasks.workunit.client.1.smithi052.stdout:2/241: chown d2/d13/d1e 8239950 1 2023-12-05T13:24:57.933 INFO:tasks.workunit.client.1.smithi052.stdout:9/201: dread d3/d2a/f3c [0,4194304] 0 2023-12-05T13:24:57.939 INFO:tasks.workunit.client.1.smithi052.stdout:0/258: creat d0/db/d1b/d51/d55/f5f x:0 0 0 2023-12-05T13:24:57.943 INFO:tasks.workunit.client.1.smithi052.stdout:3/235: mkdir da/d48/d50 0 2023-12-05T13:24:57.954 INFO:tasks.workunit.client.1.smithi052.stdout:0/259: rmdir d0/db 39 2023-12-05T13:24:57.955 INFO:tasks.workunit.client.1.smithi052.stdout:3/236: dwrite da/d25/f37 [0,4194304] 0 2023-12-05T13:24:57.957 INFO:tasks.workunit.client.1.smithi052.stdout:2/242: dwrite d2/d13/f3e [0,4194304] 0 2023-12-05T13:24:57.957 INFO:tasks.workunit.client.1.smithi052.stdout:2/243: fdatasync d2/d13/d1e/f3d 0 2023-12-05T13:24:57.961 INFO:tasks.workunit.client.1.smithi052.stdout:0/260: mkdir d0/db/d14/d60 0 2023-12-05T13:24:57.966 INFO:tasks.workunit.client.1.smithi052.stdout:2/244: creat d2/d13/d45/f4a x:0 0 0 2023-12-05T13:24:57.966 INFO:tasks.workunit.client.1.smithi052.stdout:2/245: truncate d2/d13/d1e/f46 827019 0 2023-12-05T13:24:57.966 INFO:tasks.workunit.client.1.smithi052.stdout:2/246: write d2/d13/d1e/f3d [502664,99874] 0 2023-12-05T13:24:57.966 INFO:tasks.workunit.client.1.smithi052.stdout:2/247: read d2/d13/d1e/f3d [994392,25672] 0 2023-12-05T13:24:57.968 INFO:tasks.workunit.client.1.smithi052.stdout:0/261: mknod d0/db/d1b/d51/d55/c61 0 2023-12-05T13:24:57.968 INFO:tasks.workunit.client.1.smithi052.stdout:0/262: chown d0/db/d1b/d29 33 1 2023-12-05T13:24:57.972 INFO:tasks.workunit.client.1.smithi052.stdout:2/248: write d2/d13/f16 [6565159,24667] 0 2023-12-05T13:24:57.972 INFO:tasks.workunit.client.1.smithi052.stdout:0/263: creat d0/db/d14/f62 x:0 0 0 2023-12-05T13:24:57.975 INFO:tasks.workunit.client.1.smithi052.stdout:0/264: mknod d0/db/d20/c63 0 2023-12-05T13:24:57.976 INFO:tasks.workunit.client.1.smithi052.stdout:0/265: dread - d0/db/d2e/f47 zero size 2023-12-05T13:24:57.976 INFO:tasks.workunit.client.1.smithi052.stdout:0/266: write d0/f6 [1232037,100772] 0 2023-12-05T13:24:57.976 INFO:tasks.workunit.client.1.smithi052.stdout:0/267: write d0/db/d14/f62 [1036808,73654] 0 2023-12-05T13:24:57.976 INFO:tasks.workunit.client.1.smithi052.stdout:2/249: dread d2/d13/d1e/f3d [0,4194304] 0 2023-12-05T13:24:57.979 INFO:tasks.workunit.client.1.smithi052.stdout:0/268: creat d0/db/d1b/d42/f64 x:0 0 0 2023-12-05T13:24:57.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/250: fsync d2/d14/f2c 0 2023-12-05T13:24:57.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/251: chown d2/d13/d37/l38 90724 1 2023-12-05T13:24:57.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/252: write d2/d14/f2c [97851,26270] 0 2023-12-05T13:24:57.985 INFO:tasks.workunit.client.1.smithi052.stdout:0/269: mkdir d0/db/d65 0 2023-12-05T13:24:57.986 INFO:tasks.workunit.client.1.smithi052.stdout:0/270: write d0/db/d2e/f46 [2043811,64119] 0 2023-12-05T13:24:57.986 INFO:tasks.workunit.client.1.smithi052.stdout:0/271: fsync d0/db/d14/f40 0 2023-12-05T13:24:57.986 INFO:tasks.workunit.client.1.smithi052.stdout:0/272: chown d0/db/d2e/c56 47165363 1 2023-12-05T13:24:57.997 INFO:tasks.workunit.client.1.smithi052.stdout:2/253: dwrite d2/f2f [0,4194304] 0 2023-12-05T13:24:57.999 INFO:tasks.workunit.client.1.smithi052.stdout:0/273: dwrite d0/db/d20/f21 [0,4194304] 0 2023-12-05T13:24:57.999 INFO:tasks.workunit.client.1.smithi052.stdout:0/274: fsync d0/db/d14/f28 0 2023-12-05T13:24:57.999 INFO:tasks.workunit.client.1.smithi052.stdout:0/275: chown d0/db/d1b/d42/f64 12100 1 2023-12-05T13:24:57.999 INFO:tasks.workunit.client.1.smithi052.stdout:0/276: readlink d0/db/l18 0 2023-12-05T13:24:58.000 INFO:tasks.workunit.client.1.smithi052.stdout:0/277: write d0/db/d14/f26 [1382313,110394] 0 2023-12-05T13:24:58.010 INFO:tasks.workunit.client.1.smithi052.stdout:2/254: dwrite d2/f2f [0,4194304] 0 2023-12-05T13:24:58.010 INFO:tasks.workunit.client.1.smithi052.stdout:0/278: fdatasync d0/db/d14/f26 0 2023-12-05T13:24:58.011 INFO:tasks.workunit.client.1.smithi052.stdout:0/279: chown d0/db/d14/f28 270 1 2023-12-05T13:24:58.015 INFO:tasks.workunit.client.1.smithi052.stdout:2/255: unlink d2/d13/c18 0 2023-12-05T13:24:58.018 INFO:tasks.workunit.client.1.smithi052.stdout:2/256: truncate d2/f2a 775623 0 2023-12-05T13:24:58.021 INFO:tasks.workunit.client.1.smithi052.stdout:2/257: mkdir d2/d31/d3a/d4b 0 2023-12-05T13:24:58.029 INFO:tasks.workunit.client.1.smithi052.stdout:7/241: rmdir d7 39 2023-12-05T13:24:58.029 INFO:tasks.workunit.client.1.smithi052.stdout:0/280: dwrite d0/db/d1b/d29/f57 [0,4194304] 0 2023-12-05T13:24:58.031 INFO:tasks.workunit.client.1.smithi052.stdout:7/242: creat d7/d4e/d45/f51 x:0 0 0 2023-12-05T13:24:58.032 INFO:tasks.workunit.client.1.smithi052.stdout:7/243: fdatasync d7/d4e/d12/d3f/d46/f4a 0 2023-12-05T13:24:58.032 INFO:tasks.workunit.client.1.smithi052.stdout:7/244: fsync d7/d4e/d12/d3f/f44 0 2023-12-05T13:24:58.033 INFO:tasks.workunit.client.1.smithi052.stdout:0/281: mkdir d0/db/d1b/d51/d55/d66 0 2023-12-05T13:24:58.034 INFO:tasks.workunit.client.1.smithi052.stdout:7/245: symlink d7/l52 0 2023-12-05T13:24:58.035 INFO:tasks.workunit.client.1.smithi052.stdout:2/258: dwrite d2/d13/d37/f49 [0,4194304] 0 2023-12-05T13:24:58.036 INFO:tasks.workunit.client.1.smithi052.stdout:0/282: creat d0/db/d1b/d42/f67 x:0 0 0 2023-12-05T13:24:58.037 INFO:tasks.workunit.client.1.smithi052.stdout:7/246: mknod d7/d4e/d13/d16/c53 0 2023-12-05T13:24:58.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/283: dread d0/db/d14/f4f [0,4194304] 0 2023-12-05T13:24:58.041 INFO:tasks.workunit.client.1.smithi052.stdout:0/284: read d0/db/d20/d50/f5d [2772738,56645] 0 2023-12-05T13:24:58.043 INFO:tasks.workunit.client.1.smithi052.stdout:0/285: mknod d0/db/d1b/d51/c68 0 2023-12-05T13:24:58.047 INFO:tasks.workunit.client.1.smithi052.stdout:7/247: dread d7/d4e/f2b [0,4194304] 0 2023-12-05T13:24:58.049 INFO:tasks.workunit.client.1.smithi052.stdout:7/248: symlink d7/d4e/d13/d16/l54 0 2023-12-05T13:24:58.050 INFO:tasks.workunit.client.1.smithi052.stdout:2/259: dwrite d2/d14/f39 [0,4194304] 0 2023-12-05T13:24:58.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/249: creat d7/d31/f55 x:0 0 0 2023-12-05T13:24:58.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/250: chown d7/l21 76 1 2023-12-05T13:24:58.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/251: read - d7/d4e/d45/f51 zero size 2023-12-05T13:24:58.052 INFO:tasks.workunit.client.1.smithi052.stdout:6/233: sync 2023-12-05T13:24:58.058 INFO:tasks.workunit.client.1.smithi052.stdout:0/286: dwrite d0/fd [0,4194304] 0 2023-12-05T13:24:58.058 INFO:tasks.workunit.client.1.smithi052.stdout:2/260: mkdir d2/d31/d4c 0 2023-12-05T13:24:58.059 INFO:tasks.workunit.client.1.smithi052.stdout:7/252: mkdir d7/d31/d56 0 2023-12-05T13:24:58.062 INFO:tasks.workunit.client.1.smithi052.stdout:6/234: creat d3/f50 x:0 0 0 2023-12-05T13:24:58.062 INFO:tasks.workunit.client.1.smithi052.stdout:6/235: read d3/d5/f34 [91352,57455] 0 2023-12-05T13:24:58.066 INFO:tasks.workunit.client.1.smithi052.stdout:0/287: creat d0/db/d1b/d51/f69 x:0 0 0 2023-12-05T13:24:58.078 INFO:tasks.workunit.client.1.smithi052.stdout:2/261: creat d2/d13/d45/f4d x:0 0 0 2023-12-05T13:24:58.081 INFO:tasks.workunit.client.1.smithi052.stdout:6/236: mknod d3/d4/df/d24/c51 0 2023-12-05T13:24:58.083 INFO:tasks.workunit.client.1.smithi052.stdout:2/262: dread - d2/d14/f42 zero size 2023-12-05T13:24:58.089 INFO:tasks.workunit.client.1.smithi052.stdout:7/253: unlink d7/d4e/d12/l2c 0 2023-12-05T13:24:58.089 INFO:tasks.workunit.client.1.smithi052.stdout:6/237: mkdir d3/d5/d9/d52 0 2023-12-05T13:24:58.089 INFO:tasks.workunit.client.1.smithi052.stdout:0/288: mknod d0/c6a 0 2023-12-05T13:24:58.089 INFO:tasks.workunit.client.1.smithi052.stdout:0/289: chown d0/db/d2e/c3d 1773090984 1 2023-12-05T13:24:58.090 INFO:tasks.workunit.client.1.smithi052.stdout:6/238: dread d3/d4/df/f43 [0,4194304] 0 2023-12-05T13:24:58.092 INFO:tasks.workunit.client.1.smithi052.stdout:0/290: mknod d0/db/d1b/c6b 0 2023-12-05T13:24:58.094 INFO:tasks.workunit.client.1.smithi052.stdout:0/291: mknod d0/db/d1b/d29/c6c 0 2023-12-05T13:24:58.094 INFO:tasks.workunit.client.1.smithi052.stdout:0/292: fdatasync d0/db/d14/f59 0 2023-12-05T13:24:58.094 INFO:tasks.workunit.client.1.smithi052.stdout:0/293: getdents d0/db/d14/d54 0 2023-12-05T13:24:58.100 INFO:tasks.workunit.client.1.smithi052.stdout:6/239: dread d3/d4/df/d27/f40 [0,4194304] 0 2023-12-05T13:24:58.100 INFO:tasks.workunit.client.1.smithi052.stdout:7/254: write d7/d4e/d12/f29 [1483145,65220] 0 2023-12-05T13:24:58.101 INFO:tasks.workunit.client.1.smithi052.stdout:2/263: dwrite d2/d4/f23 [0,4194304] 0 2023-12-05T13:24:58.102 INFO:tasks.workunit.client.1.smithi052.stdout:6/240: mknod d3/d4/df/d27/c53 0 2023-12-05T13:24:58.103 INFO:tasks.workunit.client.1.smithi052.stdout:7/255: creat d7/d31/f57 x:0 0 0 2023-12-05T13:24:58.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/256: write d7/d4e/d13/f19 [2426430,18269] 0 2023-12-05T13:24:58.108 INFO:tasks.workunit.client.1.smithi052.stdout:0/294: dwrite d0/f4 [0,4194304] 0 2023-12-05T13:24:58.111 INFO:tasks.workunit.client.1.smithi052.stdout:6/241: rename d3/d4/f17 to d3/d5/d9/d52/f54 0 2023-12-05T13:24:58.112 INFO:tasks.workunit.client.1.smithi052.stdout:7/257: creat d7/d31/d56/f58 x:0 0 0 2023-12-05T13:24:58.112 INFO:tasks.workunit.client.1.smithi052.stdout:7/258: write d7/d4e/d13/d16/f30 [498228,89265] 0 2023-12-05T13:24:58.119 INFO:tasks.workunit.client.1.smithi052.stdout:2/264: dwrite d2/d13/d1e/f27 [0,4194304] 0 2023-12-05T13:24:58.119 INFO:tasks.workunit.client.1.smithi052.stdout:6/242: rename d3/d4/df/d27/f40 to d3/d4/f55 0 2023-12-05T13:24:58.121 INFO:tasks.workunit.client.1.smithi052.stdout:7/259: creat d7/d31/d4b/f59 x:0 0 0 2023-12-05T13:24:58.121 INFO:tasks.workunit.client.1.smithi052.stdout:2/265: dread d2/f2a [0,4194304] 0 2023-12-05T13:24:58.123 INFO:tasks.workunit.client.1.smithi052.stdout:0/295: dwrite d0/db/d20/f5a [0,4194304] 0 2023-12-05T13:24:58.123 INFO:tasks.workunit.client.1.smithi052.stdout:0/296: chown d0/db/d1b/d29/f57 328 1 2023-12-05T13:24:58.127 INFO:tasks.workunit.client.1.smithi052.stdout:2/266: symlink d2/l4e 0 2023-12-05T13:24:58.129 INFO:tasks.workunit.client.1.smithi052.stdout:6/243: dread d3/f16 [0,4194304] 0 2023-12-05T13:24:58.130 INFO:tasks.workunit.client.1.smithi052.stdout:0/297: mknod d0/db/d1b/d51/d55/d66/c6d 0 2023-12-05T13:24:58.131 INFO:tasks.workunit.client.1.smithi052.stdout:0/298: write d0/db/d14/f40 [990434,110183] 0 2023-12-05T13:24:58.132 INFO:tasks.workunit.client.1.smithi052.stdout:2/267: dread d2/d13/d1e/f3d [0,4194304] 0 2023-12-05T13:24:58.134 INFO:tasks.workunit.client.1.smithi052.stdout:6/244: link d3/d4/df/d27/f47 d3/d4/df/d27/f56 0 2023-12-05T13:24:58.134 INFO:tasks.workunit.client.1.smithi052.stdout:6/245: readlink d3/d4/l45 0 2023-12-05T13:24:58.134 INFO:tasks.workunit.client.1.smithi052.stdout:6/246: dread - d3/d5/d9/d21/d48/f4e zero size 2023-12-05T13:24:58.137 INFO:tasks.workunit.client.1.smithi052.stdout:6/247: symlink d3/d4/d6/l57 0 2023-12-05T13:24:58.138 INFO:tasks.workunit.client.1.smithi052.stdout:7/260: dwrite d7/d4e/d12/f43 [0,4194304] 0 2023-12-05T13:24:58.138 INFO:tasks.workunit.client.1.smithi052.stdout:7/261: write d7/d31/d4b/f59 [53800,121535] 0 2023-12-05T13:24:58.145 INFO:tasks.workunit.client.1.smithi052.stdout:7/262: rename d7/d4e/d13 to d7/d4e/d45/d5a 0 2023-12-05T13:24:58.145 INFO:tasks.workunit.client.1.smithi052.stdout:7/263: stat d7/d31/d56 0 2023-12-05T13:24:58.152 INFO:tasks.workunit.client.1.smithi052.stdout:0/299: dwrite d0/db/d1b/d51/d55/f5f [0,4194304] 0 2023-12-05T13:24:58.152 INFO:tasks.workunit.client.1.smithi052.stdout:0/300: fdatasync d0/db/d14/f59 0 2023-12-05T13:24:58.154 INFO:tasks.workunit.client.1.smithi052.stdout:2/268: dwrite d2/d14/f39 [0,4194304] 0 2023-12-05T13:24:58.157 INFO:tasks.workunit.client.1.smithi052.stdout:0/301: truncate d0/db/d14/f62 10853 0 2023-12-05T13:24:58.158 INFO:tasks.workunit.client.1.smithi052.stdout:7/264: dwrite d7/d4e/d12/d3f/d46/f47 [4194304,4194304] 0 2023-12-05T13:24:58.162 INFO:tasks.workunit.client.1.smithi052.stdout:7/265: creat d7/d4e/d45/f5b x:0 0 0 2023-12-05T13:24:58.164 INFO:tasks.workunit.client.1.smithi052.stdout:7/266: write d7/d4e/d45/d5a/d16/f30 [321723,84343] 0 2023-12-05T13:24:58.166 INFO:tasks.workunit.client.1.smithi052.stdout:2/269: dread d2/d13/d1e/f27 [0,4194304] 0 2023-12-05T13:24:58.169 INFO:tasks.workunit.client.1.smithi052.stdout:2/270: creat d2/d31/f4f x:0 0 0 2023-12-05T13:24:58.175 INFO:tasks.workunit.client.1.smithi052.stdout:0/302: dwrite d0/fa [0,4194304] 0 2023-12-05T13:24:58.178 INFO:tasks.workunit.client.1.smithi052.stdout:0/303: symlink d0/db/d65/l6e 0 2023-12-05T13:24:58.178 INFO:tasks.workunit.client.1.smithi052.stdout:0/304: chown d0/db/d52 1 1 2023-12-05T13:24:58.178 INFO:tasks.workunit.client.1.smithi052.stdout:0/305: readlink d0/db/d65/l6e 0 2023-12-05T13:24:58.181 INFO:tasks.workunit.client.1.smithi052.stdout:7/267: dwrite d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:24:58.185 INFO:tasks.workunit.client.1.smithi052.stdout:2/271: dwrite d2/f2f [0,4194304] 0 2023-12-05T13:24:58.187 INFO:tasks.workunit.client.1.smithi052.stdout:7/268: creat d7/d4e/f5c x:0 0 0 2023-12-05T13:24:58.187 INFO:tasks.workunit.client.1.smithi052.stdout:0/306: dread d0/db/d1b/d29/f57 [0,4194304] 0 2023-12-05T13:24:58.188 INFO:tasks.workunit.client.1.smithi052.stdout:0/307: write d0/db/d1b/d42/f67 [247920,529] 0 2023-12-05T13:24:58.188 INFO:tasks.workunit.client.1.smithi052.stdout:0/308: write d0/f4 [4512721,62122] 0 2023-12-05T13:24:58.194 INFO:tasks.workunit.client.1.smithi052.stdout:0/309: mknod d0/db/d1b/d51/c6f 0 2023-12-05T13:24:58.194 INFO:tasks.workunit.client.1.smithi052.stdout:0/310: truncate d0/db/d1b/d42/f64 464696 0 2023-12-05T13:24:58.196 INFO:tasks.workunit.client.1.smithi052.stdout:0/311: creat d0/db/d33/f70 x:0 0 0 2023-12-05T13:24:58.197 INFO:tasks.workunit.client.1.smithi052.stdout:7/269: dread d7/d4e/d12/f34 [0,4194304] 0 2023-12-05T13:24:58.198 INFO:tasks.workunit.client.1.smithi052.stdout:7/270: mknod d7/d2e/c5d 0 2023-12-05T13:24:58.198 INFO:tasks.workunit.client.1.smithi052.stdout:7/271: stat d7/d4e/f14 0 2023-12-05T13:24:58.199 INFO:tasks.workunit.client.1.smithi052.stdout:0/312: symlink d0/db/d14/d60/l71 0 2023-12-05T13:24:58.199 INFO:tasks.workunit.client.1.smithi052.stdout:2/272: dwrite d2/d13/d1e/f46 [0,4194304] 0 2023-12-05T13:24:58.200 INFO:tasks.workunit.client.1.smithi052.stdout:2/273: stat d2/d14/f2c 0 2023-12-05T13:24:58.202 INFO:tasks.workunit.client.1.smithi052.stdout:7/272: symlink d7/d4e/d12/d3f/d46/l5e 0 2023-12-05T13:24:58.202 INFO:tasks.workunit.client.1.smithi052.stdout:6/248: fsync d3/d4/d6/f7 0 2023-12-05T13:24:58.208 INFO:tasks.workunit.client.1.smithi052.stdout:2/274: symlink d2/d13/d1e/l50 0 2023-12-05T13:24:58.210 INFO:tasks.workunit.client.1.smithi052.stdout:7/273: creat d7/d4e/d12/d3f/d46/f5f x:0 0 0 2023-12-05T13:24:58.212 INFO:tasks.workunit.client.1.smithi052.stdout:6/249: mkdir d3/d5/d58 0 2023-12-05T13:24:58.214 INFO:tasks.workunit.client.1.smithi052.stdout:7/274: mkdir d7/d31/d56/d60 0 2023-12-05T13:24:58.223 INFO:tasks.workunit.client.1.smithi052.stdout:0/313: dwrite d0/db/d20/d50/f5d [4194304,4194304] 0 2023-12-05T13:24:58.225 INFO:tasks.workunit.client.1.smithi052.stdout:7/275: dread d7/d4e/f1a [0,4194304] 0 2023-12-05T13:24:58.229 INFO:tasks.workunit.client.1.smithi052.stdout:0/314: unlink d0/db/d1b/d42/f64 0 2023-12-05T13:24:58.230 INFO:tasks.workunit.client.1.smithi052.stdout:2/275: dwrite d2/d13/d1e/f27 [4194304,4194304] 0 2023-12-05T13:24:58.234 INFO:tasks.workunit.client.1.smithi052.stdout:0/315: link d0/db/d1b/f27 d0/db/d33/f72 0 2023-12-05T13:24:58.238 INFO:tasks.workunit.client.1.smithi052.stdout:2/276: unlink d2/d13/d37/l38 0 2023-12-05T13:24:58.238 INFO:tasks.workunit.client.1.smithi052.stdout:2/277: chown d2 229 1 2023-12-05T13:24:58.241 INFO:tasks.workunit.client.1.smithi052.stdout:7/276: rename d7/d31/d4b/f59 to d7/d4e/f61 0 2023-12-05T13:24:58.244 INFO:tasks.workunit.client.1.smithi052.stdout:2/278: mkdir d2/d51 0 2023-12-05T13:24:58.245 INFO:tasks.workunit.client.1.smithi052.stdout:7/277: symlink d7/d4e/d12/d3f/l62 0 2023-12-05T13:24:58.247 INFO:tasks.workunit.client.1.smithi052.stdout:7/278: mkdir d7/d4e/d45/d5a/d63 0 2023-12-05T13:24:58.247 INFO:tasks.workunit.client.1.smithi052.stdout:2/279: dread d2/d13/d1e/f27 [0,4194304] 0 2023-12-05T13:24:58.249 INFO:tasks.workunit.client.1.smithi052.stdout:2/280: mkdir d2/d51/d52 0 2023-12-05T13:24:58.252 INFO:tasks.workunit.client.1.smithi052.stdout:2/281: truncate d2/f2a 343898 0 2023-12-05T13:24:58.252 INFO:tasks.workunit.client.1.smithi052.stdout:2/282: readlink d2/l20 0 2023-12-05T13:24:58.254 INFO:tasks.workunit.client.1.smithi052.stdout:2/283: truncate d2/f3c 572205 0 2023-12-05T13:24:58.254 INFO:tasks.workunit.client.1.smithi052.stdout:2/284: chown d2 6841249 1 2023-12-05T13:24:58.255 INFO:tasks.workunit.client.1.smithi052.stdout:2/285: read d2/d13/d1e/f46 [1426384,23788] 0 2023-12-05T13:24:58.255 INFO:tasks.workunit.client.1.smithi052.stdout:2/286: write d2/d13/d1e/f3d [1449973,39661] 0 2023-12-05T13:24:58.255 INFO:tasks.workunit.client.1.smithi052.stdout:2/287: readlink d2/l4e 0 2023-12-05T13:24:58.256 INFO:tasks.workunit.client.1.smithi052.stdout:2/288: creat d2/f53 x:0 0 0 2023-12-05T13:24:58.259 INFO:tasks.workunit.client.1.smithi052.stdout:2/289: rename d2/d13/f3e to d2/d13/d1e/f54 0 2023-12-05T13:24:58.262 INFO:tasks.workunit.client.1.smithi052.stdout:7/279: dwrite d7/d4e/d12/d3f/d46/f4a [0,4194304] 0 2023-12-05T13:24:58.267 INFO:tasks.workunit.client.1.smithi052.stdout:2/290: dread d2/d13/f16 [4194304,4194304] 0 2023-12-05T13:24:58.267 INFO:tasks.workunit.client.1.smithi052.stdout:2/291: dread - d2/d31/f4f zero size 2023-12-05T13:24:58.270 INFO:tasks.workunit.client.1.smithi052.stdout:7/280: dread d7/d4e/d12/d3f/f44 [0,4194304] 0 2023-12-05T13:24:58.273 INFO:tasks.workunit.client.1.smithi052.stdout:7/281: fsync d7/d4e/f28 0 2023-12-05T13:24:58.273 INFO:tasks.workunit.client.1.smithi052.stdout:7/282: read - d7/d4e/d45/f51 zero size 2023-12-05T13:24:58.273 INFO:tasks.workunit.client.1.smithi052.stdout:7/283: getdents d7/d4e/d45/d5a/d63 0 2023-12-05T13:24:58.276 INFO:tasks.workunit.client.1.smithi052.stdout:7/284: creat d7/d4e/d12/d3f/d46/d4d/f64 x:0 0 0 2023-12-05T13:24:58.279 INFO:tasks.workunit.client.1.smithi052.stdout:7/285: rename d7/d31/d4b/c4f to d7/d4e/d45/d5a/c65 0 2023-12-05T13:24:58.282 INFO:tasks.workunit.client.1.smithi052.stdout:7/286: mkdir d7/d4e/d45/d5a/d66 0 2023-12-05T13:24:58.285 INFO:tasks.workunit.client.1.smithi052.stdout:7/287: dread d7/d4e/d12/d3f/f44 [0,4194304] 0 2023-12-05T13:24:58.286 INFO:tasks.workunit.client.1.smithi052.stdout:2/292: dwrite d2/f53 [0,4194304] 0 2023-12-05T13:24:58.290 INFO:tasks.workunit.client.1.smithi052.stdout:2/293: link d2/d13/d1e/f27 d2/d31/f55 0 2023-12-05T13:24:58.293 INFO:tasks.workunit.client.1.smithi052.stdout:7/288: dread d7/d4e/d12/f43 [0,4194304] 0 2023-12-05T13:24:58.296 INFO:tasks.workunit.client.1.smithi052.stdout:0/316: getdents d0/db/d33 0 2023-12-05T13:24:58.304 INFO:tasks.workunit.client.1.smithi052.stdout:7/289: truncate d7/d31/d56/f58 2497212 0 2023-12-05T13:24:58.304 INFO:tasks.workunit.client.1.smithi052.stdout:7/290: chown d7/l32 4901874 1 2023-12-05T13:24:58.305 INFO:tasks.workunit.client.1.smithi052.stdout:0/317: symlink d0/db/d65/l73 0 2023-12-05T13:24:58.308 INFO:tasks.workunit.client.1.smithi052.stdout:0/318: symlink d0/db/d20/l74 0 2023-12-05T13:24:58.312 INFO:tasks.workunit.client.1.smithi052.stdout:2/294: rename d2/d13/l32 to d2/d14/l56 0 2023-12-05T13:24:58.313 INFO:tasks.workunit.client.1.smithi052.stdout:2/295: readlink d2/d13/d1e/l43 0 2023-12-05T13:24:58.313 INFO:tasks.workunit.client.1.smithi052.stdout:2/296: chown d2/f2f 4 1 2023-12-05T13:24:58.313 INFO:tasks.workunit.client.1.smithi052.stdout:2/297: fdatasync d2/d13/d1e/f54 0 2023-12-05T13:24:58.317 INFO:tasks.workunit.client.1.smithi052.stdout:2/298: rename d2/d14/f2c to d2/d13/d1e/f57 0 2023-12-05T13:24:58.317 INFO:tasks.workunit.client.1.smithi052.stdout:2/299: chown d2/d13/d1e/f57 0 1 2023-12-05T13:24:58.321 INFO:tasks.workunit.client.1.smithi052.stdout:2/300: creat d2/d4/f58 x:0 0 0 2023-12-05T13:24:58.322 INFO:tasks.workunit.client.1.smithi052.stdout:2/301: dread - d2/d13/d45/f4d zero size 2023-12-05T13:24:58.322 INFO:tasks.workunit.client.1.smithi052.stdout:2/302: fsync d2/f2a 0 2023-12-05T13:24:58.323 INFO:tasks.workunit.client.1.smithi052.stdout:2/303: creat d2/f59 x:0 0 0 2023-12-05T13:24:58.353 INFO:tasks.workunit.client.1.smithi052.stdout:7/291: dwrite d7/d4e/d45/d5a/d16/f33 [0,4194304] 0 2023-12-05T13:24:58.353 INFO:tasks.workunit.client.1.smithi052.stdout:7/292: write d7/d4e/f5c [981481,90115] 0 2023-12-05T13:24:58.354 INFO:tasks.workunit.client.1.smithi052.stdout:0/319: dwrite d0/f6 [0,4194304] 0 2023-12-05T13:24:58.354 INFO:tasks.workunit.client.1.smithi052.stdout:0/320: readlink d0/db/d1b/l22 0 2023-12-05T13:24:58.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/321: link d0/db/d14/l19 d0/db/d2e/l75 0 2023-12-05T13:24:58.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/322: dread - d0/db/d14/f59 zero size 2023-12-05T13:24:58.365 INFO:tasks.workunit.client.1.smithi052.stdout:0/323: creat d0/db/d2e/f76 x:0 0 0 2023-12-05T13:24:58.365 INFO:tasks.workunit.client.1.smithi052.stdout:0/324: chown d0/db/d33/c44 69 1 2023-12-05T13:24:58.366 INFO:tasks.workunit.client.1.smithi052.stdout:7/293: rmdir d7/d31/d4b 0 2023-12-05T13:24:58.385 INFO:tasks.workunit.client.1.smithi052.stdout:2/304: getdents d2 0 2023-12-05T13:24:58.388 INFO:tasks.workunit.client.1.smithi052.stdout:0/325: dwrite d0/db/d14/f2f [0,4194304] 0 2023-12-05T13:24:58.390 INFO:tasks.workunit.client.1.smithi052.stdout:7/294: dwrite d7/d4e/f61 [0,4194304] 0 2023-12-05T13:24:58.390 INFO:tasks.workunit.client.1.smithi052.stdout:7/295: fsync d7/d4e/d45/f5b 0 2023-12-05T13:24:58.393 INFO:tasks.workunit.client.1.smithi052.stdout:2/305: dread d2/d4/f23 [0,4194304] 0 2023-12-05T13:24:58.393 INFO:tasks.workunit.client.1.smithi052.stdout:0/326: mkdir d0/db/d1b/d51/d55/d66/d77 0 2023-12-05T13:24:58.394 INFO:tasks.workunit.client.1.smithi052.stdout:2/306: write d2/f3c [493985,22343] 0 2023-12-05T13:24:58.398 INFO:tasks.workunit.client.1.smithi052.stdout:7/296: link d7/c26 d7/d2e/c67 0 2023-12-05T13:24:58.401 INFO:tasks.workunit.client.1.smithi052.stdout:7/297: truncate d7/d4e/d45/d5a/f19 1712007 0 2023-12-05T13:24:58.404 INFO:tasks.workunit.client.1.smithi052.stdout:7/298: mkdir d7/d4e/d12/d3f/d68 0 2023-12-05T13:24:58.404 INFO:tasks.workunit.client.1.smithi052.stdout:7/299: truncate d7/d31/f55 1044456 0 2023-12-05T13:24:58.411 INFO:tasks.workunit.client.1.smithi052.stdout:0/327: dwrite d0/db/d1b/d42/f45 [0,4194304] 0 2023-12-05T13:24:58.411 INFO:tasks.workunit.client.1.smithi052.stdout:0/328: stat d0/db/d14/f40 0 2023-12-05T13:24:58.411 INFO:tasks.workunit.client.1.smithi052.stdout:0/329: write d0/db/d1b/f37 [82072,18616] 0 2023-12-05T13:24:58.412 INFO:tasks.workunit.client.1.smithi052.stdout:0/330: write d0/db/d1b/f27 [2517045,60405] 0 2023-12-05T13:24:58.413 INFO:tasks.workunit.client.1.smithi052.stdout:2/307: dwrite d2/f3c [0,4194304] 0 2023-12-05T13:24:58.416 INFO:tasks.workunit.client.1.smithi052.stdout:7/300: dread d7/d4e/f61 [0,4194304] 0 2023-12-05T13:24:58.418 INFO:tasks.workunit.client.1.smithi052.stdout:0/331: rename d0/db/d1b/l22 to d0/db/d1b/d51/d55/d66/d77/l78 0 2023-12-05T13:24:58.418 INFO:tasks.workunit.client.1.smithi052.stdout:0/332: fsync d0/fd 0 2023-12-05T13:24:58.419 INFO:tasks.workunit.client.1.smithi052.stdout:7/301: dread d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:24:58.420 INFO:tasks.workunit.client.1.smithi052.stdout:7/302: fdatasync d7/d4e/d45/d5a/d16/f33 0 2023-12-05T13:24:58.424 INFO:tasks.workunit.client.1.smithi052.stdout:0/333: symlink d0/db/d14/d54/l79 0 2023-12-05T13:24:58.426 INFO:tasks.workunit.client.1.smithi052.stdout:7/303: creat d7/d31/d56/d60/f69 x:0 0 0 2023-12-05T13:24:58.426 INFO:tasks.workunit.client.1.smithi052.stdout:7/304: write d7/d31/f55 [986662,80371] 0 2023-12-05T13:24:58.429 INFO:tasks.workunit.client.1.smithi052.stdout:0/334: mkdir d0/db/d1b/d7a 0 2023-12-05T13:24:58.429 INFO:tasks.workunit.client.1.smithi052.stdout:7/305: dread d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:24:58.429 INFO:tasks.workunit.client.1.smithi052.stdout:7/306: dread - d7/d4e/d45/f5b zero size 2023-12-05T13:24:58.429 INFO:tasks.workunit.client.1.smithi052.stdout:7/307: write d7/d31/f55 [1550541,127684] 0 2023-12-05T13:24:58.433 INFO:tasks.workunit.client.1.smithi052.stdout:0/335: link d0/db/d14/f4f d0/db/d14/d60/f7b 0 2023-12-05T13:24:58.433 INFO:tasks.workunit.client.1.smithi052.stdout:0/336: fsync d0/db/d20/f21 0 2023-12-05T13:24:58.434 INFO:tasks.workunit.client.1.smithi052.stdout:4/224: sync 2023-12-05T13:24:58.434 INFO:tasks.workunit.client.1.smithi052.stdout:4/225: stat de/d29/f2e 0 2023-12-05T13:24:58.435 INFO:tasks.workunit.client.1.smithi052.stdout:7/308: rename d7/d4e/f14 to d7/d31/f6a 0 2023-12-05T13:24:58.437 INFO:tasks.workunit.client.1.smithi052.stdout:0/337: link d0/db/d1b/f37 d0/db/d1b/d51/d55/f7c 0 2023-12-05T13:24:58.440 INFO:tasks.workunit.client.1.smithi052.stdout:0/338: getdents d0/db/d52 0 2023-12-05T13:24:58.444 INFO:tasks.workunit.client.1.smithi052.stdout:4/226: symlink de/d1e/l49 0 2023-12-05T13:24:58.447 INFO:tasks.workunit.client.1.smithi052.stdout:0/339: link d0/f4 d0/db/d52/f7d 0 2023-12-05T13:24:58.447 INFO:tasks.workunit.client.1.smithi052.stdout:0/340: chown d0/c1c 946 1 2023-12-05T13:24:58.447 INFO:tasks.workunit.client.1.smithi052.stdout:0/341: write d0/db/d1b/d42/f67 [359228,78515] 0 2023-12-05T13:24:58.448 INFO:tasks.workunit.client.1.smithi052.stdout:4/227: getdents de/d2b 0 2023-12-05T13:24:58.450 INFO:tasks.workunit.client.1.smithi052.stdout:7/309: dwrite d7/d4e/d45/d5a/d16/f30 [0,4194304] 0 2023-12-05T13:24:58.451 INFO:tasks.workunit.client.1.smithi052.stdout:0/342: mkdir d0/db/d2e/d7e 0 2023-12-05T13:24:58.452 INFO:tasks.workunit.client.1.smithi052.stdout:4/228: rmdir de/d30 39 2023-12-05T13:24:58.452 INFO:tasks.workunit.client.1.smithi052.stdout:4/229: fdatasync de/f18 0 2023-12-05T13:24:58.459 INFO:tasks.workunit.client.1.smithi052.stdout:7/310: truncate d7/f27 2407648 0 2023-12-05T13:24:58.467 INFO:tasks.workunit.client.1.smithi052.stdout:4/230: rename de/d29/f44 to de/f4a 0 2023-12-05T13:24:58.467 INFO:tasks.workunit.client.1.smithi052.stdout:4/231: chown de/d1e/d24/c3a 51808 1 2023-12-05T13:24:58.469 INFO:tasks.workunit.client.1.smithi052.stdout:4/232: creat de/f4b x:0 0 0 2023-12-05T13:24:58.471 INFO:tasks.workunit.client.1.smithi052.stdout:4/233: getdents de/d1e/d24 0 2023-12-05T13:24:58.477 INFO:tasks.workunit.client.1.smithi052.stdout:4/234: unlink de/c1b 0 2023-12-05T13:24:58.477 INFO:tasks.workunit.client.1.smithi052.stdout:7/311: dwrite d7/d4e/d45/f51 [0,4194304] 0 2023-12-05T13:24:58.480 INFO:tasks.workunit.client.1.smithi052.stdout:4/235: truncate de/f12 4431794 0 2023-12-05T13:24:58.483 INFO:tasks.workunit.client.1.smithi052.stdout:0/343: getdents d0/db/d1b 0 2023-12-05T13:24:58.483 INFO:tasks.workunit.client.1.smithi052.stdout:0/344: write d0/db/d14/f4f [3894241,87428] 0 2023-12-05T13:24:58.484 INFO:tasks.workunit.client.1.smithi052.stdout:4/236: creat de/d1e/f4c x:0 0 0 2023-12-05T13:24:58.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/237: dread de/d29/f3d [0,4194304] 0 2023-12-05T13:24:58.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/238: write de/d29/f3d [1575073,79473] 0 2023-12-05T13:24:58.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/239: chown de/d29/d48 18484 1 2023-12-05T13:24:58.492 INFO:tasks.workunit.client.1.smithi052.stdout:7/312: dwrite d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:24:58.492 INFO:tasks.workunit.client.1.smithi052.stdout:7/313: fdatasync d7/d4e/d45/d5a/d16/f30 0 2023-12-05T13:24:58.497 INFO:tasks.workunit.client.1.smithi052.stdout:7/314: mknod d7/d31/d56/d60/c6b 0 2023-12-05T13:24:58.506 INFO:tasks.workunit.client.1.smithi052.stdout:0/345: dwrite d0/db/d1b/d29/f57 [4194304,4194304] 0 2023-12-05T13:24:58.511 INFO:tasks.workunit.client.1.smithi052.stdout:7/315: dwrite d7/d4e/d45/d5a/f19 [0,4194304] 0 2023-12-05T13:24:58.511 INFO:tasks.workunit.client.1.smithi052.stdout:0/346: mkdir d0/db/d52/d7f 0 2023-12-05T13:24:58.512 INFO:tasks.workunit.client.1.smithi052.stdout:0/347: fsync d0/f11 0 2023-12-05T13:24:58.517 INFO:tasks.workunit.client.1.smithi052.stdout:4/240: getdents de 0 2023-12-05T13:24:58.524 INFO:tasks.workunit.client.1.smithi052.stdout:7/316: mkdir d7/d2e/d6c 0 2023-12-05T13:24:58.524 INFO:tasks.workunit.client.1.smithi052.stdout:7/317: chown d7/d31 14 1 2023-12-05T13:24:58.527 INFO:tasks.workunit.client.1.smithi052.stdout:0/348: rename d0/db/d14/d54 to d0/db/d2e/d53/d80 0 2023-12-05T13:24:58.528 INFO:tasks.workunit.client.1.smithi052.stdout:4/241: creat de/d1e/d24/f4d x:0 0 0 2023-12-05T13:24:58.531 INFO:tasks.workunit.client.1.smithi052.stdout:7/318: creat d7/d4e/d45/d5a/d63/f6d x:0 0 0 2023-12-05T13:24:58.531 INFO:tasks.workunit.client.1.smithi052.stdout:7/319: readlink d7/l32 0 2023-12-05T13:24:58.532 INFO:tasks.workunit.client.1.smithi052.stdout:0/349: mknod d0/db/d1b/d7a/c81 0 2023-12-05T13:24:58.533 INFO:tasks.workunit.client.1.smithi052.stdout:4/242: dread de/d29/f3d [0,4194304] 0 2023-12-05T13:24:58.537 INFO:tasks.workunit.client.1.smithi052.stdout:7/320: creat d7/d4e/d12/d3f/f6e x:0 0 0 2023-12-05T13:24:58.540 INFO:tasks.workunit.client.1.smithi052.stdout:0/350: creat d0/f82 x:0 0 0 2023-12-05T13:24:58.544 INFO:tasks.workunit.client.1.smithi052.stdout:4/243: link de/d1e/f4c de/d1e/d24/f4e 0 2023-12-05T13:24:58.545 INFO:tasks.workunit.client.1.smithi052.stdout:7/321: readlink d7/d4e/l10 0 2023-12-05T13:24:58.545 INFO:tasks.workunit.client.1.smithi052.stdout:7/322: getdents d7/d2e/d6c 0 2023-12-05T13:24:58.545 INFO:tasks.workunit.client.1.smithi052.stdout:7/323: stat d7/d4e/f28 0 2023-12-05T13:24:58.548 INFO:tasks.workunit.client.1.smithi052.stdout:4/244: symlink de/l4f 0 2023-12-05T13:24:58.549 INFO:tasks.workunit.client.1.smithi052.stdout:7/324: chown d7/d4e/c1d 1 1 2023-12-05T13:24:58.553 INFO:tasks.workunit.client.1.smithi052.stdout:7/325: mknod d7/d4e/d12/d3f/c6f 0 2023-12-05T13:24:58.553 INFO:tasks.workunit.client.1.smithi052.stdout:4/245: unlink de/l4f 0 2023-12-05T13:24:58.554 INFO:tasks.workunit.client.1.smithi052.stdout:4/246: write de/d30/f42 [5379860,106341] 0 2023-12-05T13:24:58.555 INFO:tasks.workunit.client.1.smithi052.stdout:7/326: write d7/d4e/d12/d3f/d46/f47 [4744192,129052] 0 2023-12-05T13:24:58.555 INFO:tasks.workunit.client.1.smithi052.stdout:0/351: dwrite d0/f6 [0,4194304] 0 2023-12-05T13:24:58.560 INFO:tasks.workunit.client.1.smithi052.stdout:4/247: dread de/d1e/f2a [0,4194304] 0 2023-12-05T13:24:58.561 INFO:tasks.workunit.client.1.smithi052.stdout:4/248: chown de/f12 27839626 1 2023-12-05T13:24:58.561 INFO:tasks.workunit.client.1.smithi052.stdout:7/327: write d7/d4e/d45/d5a/d16/f30 [297880,27256] 0 2023-12-05T13:24:58.565 INFO:tasks.workunit.client.1.smithi052.stdout:4/249: link de/d29/f3d de/d29/d48/f50 0 2023-12-05T13:24:58.566 INFO:tasks.workunit.client.1.smithi052.stdout:7/328: symlink d7/d4e/d45/d5a/d16/l70 0 2023-12-05T13:24:58.568 INFO:tasks.workunit.client.1.smithi052.stdout:4/250: mkdir de/d29/d51 0 2023-12-05T13:24:58.570 INFO:tasks.workunit.client.1.smithi052.stdout:7/329: mknod d7/d4e/d12/d3f/d46/d4d/c71 0 2023-12-05T13:24:58.572 INFO:tasks.workunit.client.1.smithi052.stdout:4/251: mknod de/d30/c52 0 2023-12-05T13:24:58.574 INFO:tasks.workunit.client.1.smithi052.stdout:0/352: dwrite d0/fa [4194304,4194304] 0 2023-12-05T13:24:58.575 INFO:tasks.workunit.client.1.smithi052.stdout:4/252: mknod de/d30/c53 0 2023-12-05T13:24:58.584 INFO:tasks.workunit.client.1.smithi052.stdout:4/253: truncate de/d29/f3d 281005 0 2023-12-05T13:24:58.586 INFO:tasks.workunit.client.1.smithi052.stdout:0/353: link d0/db/c16 d0/c83 0 2023-12-05T13:24:58.586 INFO:tasks.workunit.client.1.smithi052.stdout:0/354: readlink d0/db/d20/l5c 0 2023-12-05T13:24:58.587 INFO:tasks.workunit.client.1.smithi052.stdout:7/330: dwrite d7/d4e/d12/d3f/f6e [0,4194304] 0 2023-12-05T13:24:58.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/254: mknod de/c54 0 2023-12-05T13:24:58.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/255: write de/d1e/d24/f4e [126203,15538] 0 2023-12-05T13:24:58.589 INFO:tasks.workunit.client.1.smithi052.stdout:0/355: symlink d0/db/d1b/d51/d55/l84 0 2023-12-05T13:24:58.589 INFO:tasks.workunit.client.1.smithi052.stdout:0/356: dread - d0/db/d2e/f76 zero size 2023-12-05T13:24:58.589 INFO:tasks.workunit.client.1.smithi052.stdout:0/357: write d0/db/d1b/d42/f67 [803131,1555] 0 2023-12-05T13:24:58.591 INFO:tasks.workunit.client.1.smithi052.stdout:0/358: dread d0/db/d33/f72 [4194304,4194304] 0 2023-12-05T13:24:58.593 INFO:tasks.workunit.client.1.smithi052.stdout:7/331: truncate d7/d4e/d45/f51 454975 0 2023-12-05T13:24:58.598 INFO:tasks.workunit.client.1.smithi052.stdout:0/359: link d0/db/d1b/d29/c6c d0/db/d1b/c85 0 2023-12-05T13:24:58.599 INFO:tasks.workunit.client.1.smithi052.stdout:4/256: dread de/d1e/d24/f38 [0,4194304] 0 2023-12-05T13:24:58.599 INFO:tasks.workunit.client.1.smithi052.stdout:7/332: mkdir d7/d31/d56/d60/d72 0 2023-12-05T13:24:58.599 INFO:tasks.workunit.client.1.smithi052.stdout:4/257: creat de/d2b/f55 x:0 0 0 2023-12-05T13:24:58.602 INFO:tasks.workunit.client.1.smithi052.stdout:7/333: rmdir d7/d4e/d12 39 2023-12-05T13:24:58.602 INFO:tasks.workunit.client.1.smithi052.stdout:1/264: sync 2023-12-05T13:24:58.603 INFO:tasks.workunit.client.1.smithi052.stdout:8/280: sync 2023-12-05T13:24:58.604 INFO:tasks.workunit.client.1.smithi052.stdout:4/258: creat de/d29/f56 x:0 0 0 2023-12-05T13:24:58.607 INFO:tasks.workunit.client.1.smithi052.stdout:8/281: mkdir d0/de/d27/d43/d63 0 2023-12-05T13:24:58.607 INFO:tasks.workunit.client.1.smithi052.stdout:8/282: read d0/fa [663313,31350] 0 2023-12-05T13:24:58.608 INFO:tasks.workunit.client.1.smithi052.stdout:1/265: write d5/d7/de/d14/d2a/f3b [1929697,108734] 0 2023-12-05T13:24:58.610 INFO:tasks.workunit.client.1.smithi052.stdout:8/283: rename d0/de/d12/c1a to d0/d28/d2b/c64 0 2023-12-05T13:24:58.614 INFO:tasks.workunit.client.1.smithi052.stdout:1/266: symlink d5/d7/d52/l53 0 2023-12-05T13:24:58.614 INFO:tasks.workunit.client.1.smithi052.stdout:1/267: write d5/d7/f4b [546921,18605] 0 2023-12-05T13:24:58.615 INFO:tasks.workunit.client.1.smithi052.stdout:7/334: dwrite d7/d4e/d12/d3f/d46/f47 [4194304,4194304] 0 2023-12-05T13:24:58.617 INFO:tasks.workunit.client.1.smithi052.stdout:4/259: dread fa [0,4194304] 0 2023-12-05T13:24:58.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/268: link d5/d7/d35/f3d d5/d7/d35/d2f/d3e/f54 0 2023-12-05T13:24:58.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/269: write f4 [1995634,68461] 0 2023-12-05T13:24:58.620 INFO:tasks.workunit.client.1.smithi052.stdout:7/335: rmdir d7/d4e/d45/d5a/d16 39 2023-12-05T13:24:58.626 INFO:tasks.workunit.client.1.smithi052.stdout:4/260: creat de/d29/d51/f57 x:0 0 0 2023-12-05T13:24:58.626 INFO:tasks.workunit.client.1.smithi052.stdout:4/261: write de/d2b/f55 [691073,81246] 0 2023-12-05T13:24:58.627 INFO:tasks.workunit.client.1.smithi052.stdout:1/270: creat d5/d7/de/d14/f55 x:0 0 0 2023-12-05T13:24:58.630 INFO:tasks.workunit.client.1.smithi052.stdout:7/336: rename d7/d31/f6a to d7/f73 0 2023-12-05T13:24:58.631 INFO:tasks.workunit.client.1.smithi052.stdout:8/284: dwrite d0/f3e [0,4194304] 0 2023-12-05T13:24:58.634 INFO:tasks.workunit.client.1.smithi052.stdout:4/262: link de/d29/f2e de/d2b/f58 0 2023-12-05T13:24:58.634 INFO:tasks.workunit.client.1.smithi052.stdout:4/263: chown de/f18 259947 1 2023-12-05T13:24:58.636 INFO:tasks.workunit.client.1.smithi052.stdout:1/271: rename d5/d7/de/d18/c36 to d5/d7/de/d14/d17/c56 0 2023-12-05T13:24:58.636 INFO:tasks.workunit.client.1.smithi052.stdout:1/272: dread - d5/d7/de/d14/d2a/f49 zero size 2023-12-05T13:24:58.636 INFO:tasks.workunit.client.1.smithi052.stdout:1/273: chown d5/d7/de/d14/d17/c56 92718 1 2023-12-05T13:24:58.636 INFO:tasks.workunit.client.1.smithi052.stdout:1/274: chown d5/d7/f50 39117778 1 2023-12-05T13:24:58.637 INFO:tasks.workunit.client.1.smithi052.stdout:7/337: mknod d7/d2e/d6c/c74 0 2023-12-05T13:24:58.638 INFO:tasks.workunit.client.1.smithi052.stdout:7/338: write d7/d4e/d45/f51 [170341,78822] 0 2023-12-05T13:24:58.642 INFO:tasks.workunit.client.1.smithi052.stdout:8/285: mknod d0/d62/c65 0 2023-12-05T13:24:58.642 INFO:tasks.workunit.client.1.smithi052.stdout:8/286: chown d0/de/l10 0 1 2023-12-05T13:24:58.642 INFO:tasks.workunit.client.1.smithi052.stdout:8/287: write d0/de/f38 [1234310,73935] 0 2023-12-05T13:24:58.643 INFO:tasks.workunit.client.1.smithi052.stdout:8/288: stat d0/de/d27/d43/d44/f49 0 2023-12-05T13:24:58.644 INFO:tasks.workunit.client.1.smithi052.stdout:4/264: mkdir de/d29/d48/d59 0 2023-12-05T13:24:58.645 INFO:tasks.workunit.client.1.smithi052.stdout:4/265: read de/f18 [404138,128586] 0 2023-12-05T13:24:58.646 INFO:tasks.workunit.client.1.smithi052.stdout:1/275: rename d5/d7/l1a to d5/d7/de/d14/d2a/l57 0 2023-12-05T13:24:58.647 INFO:tasks.workunit.client.1.smithi052.stdout:1/276: read d5/d7/de/d14/d2a/f3b [1105343,68768] 0 2023-12-05T13:24:58.647 INFO:tasks.workunit.client.1.smithi052.stdout:1/277: chown d5/d7/de/d14/f55 8054268 1 2023-12-05T13:24:58.647 INFO:tasks.workunit.client.1.smithi052.stdout:1/278: chown d5/d7/de/d14/d17/d3c 7 1 2023-12-05T13:24:58.647 INFO:tasks.workunit.client.1.smithi052.stdout:1/279: fdatasync d5/d7/de/d14/f55 0 2023-12-05T13:24:58.648 INFO:tasks.workunit.client.1.smithi052.stdout:1/280: read d5/f3a [1722098,110986] 0 2023-12-05T13:24:58.649 INFO:tasks.workunit.client.1.smithi052.stdout:7/339: mkdir d7/d4e/d12/d3f/d75 0 2023-12-05T13:24:58.652 INFO:tasks.workunit.client.1.smithi052.stdout:8/289: rmdir d0/de 39 2023-12-05T13:24:58.655 INFO:tasks.workunit.client.1.smithi052.stdout:4/266: link de/d29/f2e de/d2b/f5a 0 2023-12-05T13:24:58.658 INFO:tasks.workunit.client.1.smithi052.stdout:1/281: creat d5/d7/d35/d2f/d3e/f58 x:0 0 0 2023-12-05T13:24:58.659 INFO:tasks.workunit.client.1.smithi052.stdout:8/290: dread d0/fa [0,4194304] 0 2023-12-05T13:24:58.659 INFO:tasks.workunit.client.1.smithi052.stdout:8/291: readlink d0/de/l1e 0 2023-12-05T13:24:58.671 INFO:tasks.workunit.client.1.smithi052.stdout:4/267: dwrite de/d1e/d24/f35 [0,4194304] 0 2023-12-05T13:24:58.672 INFO:tasks.workunit.client.1.smithi052.stdout:1/282: rmdir d5/d7/de/d18/d2e/d4f 39 2023-12-05T13:24:58.675 INFO:tasks.workunit.client.1.smithi052.stdout:4/268: truncate de/d30/f3c 2925355 0 2023-12-05T13:24:58.675 INFO:tasks.workunit.client.1.smithi052.stdout:4/269: write de/d1e/d24/f4d [303565,62016] 0 2023-12-05T13:24:58.682 INFO:tasks.workunit.client.1.smithi052.stdout:1/283: dread d5/d7/de/d14/d17/f39 [0,4194304] 0 2023-12-05T13:24:58.682 INFO:tasks.workunit.client.1.smithi052.stdout:1/284: write d5/d7/f47 [539404,128061] 0 2023-12-05T13:24:58.682 INFO:tasks.workunit.client.1.smithi052.stdout:1/285: write d5/d7/de/d14/d17/f39 [5148123,11688] 0 2023-12-05T13:24:58.685 INFO:tasks.workunit.client.1.smithi052.stdout:1/286: symlink d5/d7/de/d14/d17/d3c/l59 0 2023-12-05T13:24:58.688 INFO:tasks.workunit.client.1.smithi052.stdout:1/287: mkdir d5/d7/d35/d37/d5a 0 2023-12-05T13:24:58.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/270: dwrite f4 [0,4194304] 0 2023-12-05T13:24:58.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/271: fsync de/d29/f3d 0 2023-12-05T13:24:58.704 INFO:tasks.workunit.client.1.smithi052.stdout:1/288: dwrite d5/d7/d35/d2f/d3e/f54 [4194304,4194304] 0 2023-12-05T13:24:58.722 INFO:tasks.workunit.client.1.smithi052.stdout:1/289: dwrite d5/d7/de/d14/f55 [0,4194304] 0 2023-12-05T13:24:58.722 INFO:tasks.workunit.client.1.smithi052.stdout:1/290: write d5/d7/de/d14/d2a/f49 [735005,127132] 0 2023-12-05T13:24:58.727 INFO:tasks.workunit.client.1.smithi052.stdout:1/291: getdents d5/d7/d35/d2f/d3e 0 2023-12-05T13:24:58.728 INFO:tasks.workunit.client.1.smithi052.stdout:1/292: truncate d5/d7/d35/d2f/d3e/f54 8721964 0 2023-12-05T13:24:58.728 INFO:tasks.workunit.client.1.smithi052.stdout:1/293: write d5/d7/f12 [7243439,24214] 0 2023-12-05T13:24:58.736 INFO:tasks.workunit.client.1.smithi052.stdout:1/294: dread d5/d7/de/d14/f55 [0,4194304] 0 2023-12-05T13:24:58.754 INFO:tasks.workunit.client.1.smithi052.stdout:1/295: dwrite d5/f2c [0,4194304] 0 2023-12-05T13:24:58.754 INFO:tasks.workunit.client.1.smithi052.stdout:1/296: stat d5/d7/d35/d2f/c46 0 2023-12-05T13:24:58.758 INFO:tasks.workunit.client.1.smithi052.stdout:1/297: getdents d5/d7/de/d18/d2e 0 2023-12-05T13:24:58.792 INFO:tasks.workunit.client.1.smithi052.stdout:5/159: sync 2023-12-05T13:24:58.792 INFO:tasks.workunit.client.1.smithi052.stdout:5/160: truncate d5/df/f20 153340 0 2023-12-05T13:24:58.792 INFO:tasks.workunit.client.1.smithi052.stdout:5/161: truncate d5/fc 1609809 0 2023-12-05T13:24:58.793 INFO:tasks.workunit.client.1.smithi052.stdout:5/162: dread d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:24:58.794 INFO:tasks.workunit.client.1.smithi052.stdout:5/163: creat d5/d15/d33/f38 x:0 0 0 2023-12-05T13:24:58.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 -- 172.21.15.29:0/4054646620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700fdf60 msgr2=0x7f7f700fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 --2- 172.21.15.29:0/4054646620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700fdf60 0x7f7f700fe3b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c004940 tx=0x7f7f5c009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 -- 172.21.15.29:0/4054646620 shutdown_connections 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 --2- 172.21.15.29:0/4054646620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700fdf60 0x7f7f700fe3b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 --2- 172.21.15.29:0/4054646620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700faed0 0x7f7f700fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 -- 172.21.15.29:0/4054646620 >> 172.21.15.29:0/4054646620 conn(0x7f7f700f6950 msgr2=0x7f7f700f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 -- 172.21.15.29:0/4054646620 shutdown_connections 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.796+0000 7f7f76d43700 1 -- 172.21.15.29:0/4054646620 wait complete. 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f76d43700 1 Processor -- start 2023-12-05T13:24:58.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f76d43700 1 -- start start 2023-12-05T13:24:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f76d43700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 0x7f7f7010d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f76d43700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700fdf60 0x7f7f7010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f76d43700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7010e080 con 0x7f7f700faed0 2023-12-05T13:24:58.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f76d43700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7010e920 con 0x7f7f700fdf60 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f74adf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 0x7f7f7010d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f74adf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 0x7f7f7010d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49426/0 (socket says 172.21.15.29:49426) 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.797+0000 7f7f74adf700 1 -- 172.21.15.29:0/2916331377 learned_addr learned my addr 172.21.15.29:0/2916331377 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f6ffff700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700fdf60 0x7f7f7010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f74adf700 1 -- 172.21.15.29:0/2916331377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700fdf60 msgr2=0x7f7f7010da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f74adf700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700fdf60 0x7f7f7010da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f74adf700 1 -- 172.21.15.29:0/2916331377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c005040 con 0x7f7f700faed0 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f6ffff700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700fdf60 0x7f7f7010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f74adf700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 0x7f7f7010d540 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400eb70 tx=0x7f7f6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f64007cc0 con 0x7f7f700faed0 2023-12-05T13:24:58.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7010eba0 con 0x7f7f700faed0 2023-12-05T13:24:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f6400f040 con 0x7f7f700faed0 2023-12-05T13:24:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6400c9d0 con 0x7f7f700faed0 2023-12-05T13:24:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.798+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7010f0e0 con 0x7f7f700faed0 2023-12-05T13:24:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.799+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7004bb80 con 0x7f7f700faed0 2023-12-05T13:24:58.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.800+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7f6400cc40 con 0x7f7f700faed0 2023-12-05T13:24:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.801+0000 7f7f6d7fa700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7f60068f60 0x7f7f6006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.801+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7f64086840 con 0x7f7f700faed0 2023-12-05T13:24:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.801+0000 7f7f6ffff700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7f60068f60 0x7f7f6006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:58.802 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.802+0000 7f7f6ffff700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7f60068f60 0x7f7f6006b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009fd0 tx=0x7f7f5c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:58.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:58.806+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7f6404da00 con 0x7f7f700faed0 2023-12-05T13:24:59.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.078+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f7010f530 con 0x7f7f60068f60 2023-12-05T13:24:59.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.080+0000 7f7f6d7fa700 1 -- 172.21.15.29:0/2916331377 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7f7010f530 con 0x7f7f60068f60 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7f60068f60 msgr2=0x7f7f6006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7f60068f60 0x7f7f6006b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009fd0 tx=0x7f7f5c009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 msgr2=0x7f7f7010d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 0x7f7f7010d540 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400eb70 tx=0x7f7f6400b040 comp rx=0 tx=0).stop 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 shutdown_connections 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f7f60068f60 0x7f7f6006b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f700faed0 0x7f7f7010d540 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 --2- 172.21.15.29:0/2916331377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f700fdf60 0x7f7f7010da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 >> 172.21.15.29:0/2916331377 conn(0x7f7f700f6950 msgr2=0x7f7f70101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 shutdown_connections 2023-12-05T13:24:59.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.082+0000 7f7f76d43700 1 -- 172.21.15.29:0/2916331377 wait complete. 2023-12-05T13:24:59.095 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:24:59.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 -- 172.21.15.29:0/2886073515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 msgr2=0x7f68f80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/2886073515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f80fbf00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f68e8004940 tx=0x7f68e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 -- 172.21.15.29:0/2886073515 shutdown_connections 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/2886073515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68f80fcd00 0x7f68f80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/2886073515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f80fbf00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 -- 172.21.15.29:0/2886073515 >> 172.21.15.29:0/2886073515 conn(0x7f68f80f7190 msgr2=0x7f68f80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 -- 172.21.15.29:0/2886073515 shutdown_connections 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.212+0000 7f68fcb6c700 1 -- 172.21.15.29:0/2886073515 wait complete. 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68fcb6c700 1 Processor -- start 2023-12-05T13:24:59.214 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68fcb6c700 1 -- start start 2023-12-05T13:24:59.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68fcb6c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f810d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:59.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68fcb6c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68f80fcd00 0x7f68f810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:59.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68fcb6c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f810e030 con 0x7f68f80fbaf0 2023-12-05T13:24:59.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68fcb6c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f810e8d0 con 0x7f68f80fcd00 2023-12-05T13:24:59.215 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68f659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f810d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68f659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f810d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49442/0 (socket says 172.21.15.29:49442) 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68f659c700 1 -- 172.21.15.29:0/194222525 learned_addr learned my addr 172.21.15.29:0/194222525 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.213+0000 7f68f5d9b700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68f80fcd00 0x7f68f810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68f659c700 1 -- 172.21.15.29:0/194222525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68f80fcd00 msgr2=0x7f68f810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68f659c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68f80fcd00 0x7f68f810da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68f659c700 1 -- 172.21.15.29:0/194222525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8005040 con 0x7f68f80fbaf0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68f659c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f810d4f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f68e8008f80 tx=0x7f68e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e8021070 con 0x7f68f80fbaf0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f810eb50 con 0x7f68f80fbaf0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68e801c400 con 0x7f68f80fbaf0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e800e070 con 0x7f68f80fbaf0 2023-12-05T13:24:59.216 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.214+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f810f030 con 0x7f68f80fbaf0 2023-12-05T13:24:59.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.216+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f804bb80 con 0x7f68f80fbaf0 2023-12-05T13:24:59.217 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.216+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f68e801c950 con 0x7f68f80fbaf0 2023-12-05T13:24:59.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.217+0000 7f68e6ffd700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f68e0068f70 0x7f68e006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:59.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.217+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f68e8087fc0 con 0x7f68f80fbaf0 2023-12-05T13:24:59.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.217+0000 7f68f5d9b700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f68e0068f70 0x7f68e006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:59.218 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.218+0000 7f68f5d9b700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f68e0068f70 0x7f68e006b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009b80 tx=0x7f68ec00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:59.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.222+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68e8057f20 con 0x7f68f80fbaf0 2023-12-05T13:24:59.329 INFO:tasks.workunit.client.1.smithi052.stdout:9/202: sync 2023-12-05T13:24:59.329 INFO:tasks.workunit.client.1.smithi052.stdout:9/203: truncate d3/fd 1302726 0 2023-12-05T13:24:59.329 INFO:tasks.workunit.client.1.smithi052.stdout:9/204: chown d3/d11/d19/l35 1637620873 1 2023-12-05T13:24:59.336 INFO:tasks.workunit.client.1.smithi052.stdout:9/205: dread d3/f3a [0,4194304] 0 2023-12-05T13:24:59.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:24:59 smithi029 ceph-mon[112128]: pgmap v199: 65 pgs: 65 active+clean; 304 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 32 MiB/s wr, 686 op/s 2023-12-05T13:24:59.356 INFO:tasks.workunit.client.1.smithi052.stdout:9/206: dwrite d3/d11/d19/f27 [4194304,4194304] 0 2023-12-05T13:24:59.358 INFO:tasks.workunit.client.1.smithi052.stdout:9/207: unlink d3/c10 0 2023-12-05T13:24:59.359 INFO:tasks.workunit.client.1.smithi052.stdout:9/208: creat d3/d11/f42 x:0 0 0 2023-12-05T13:24:59.362 INFO:tasks.workunit.client.1.smithi052.stdout:9/209: rename d3/la to d3/d11/d19/l43 0 2023-12-05T13:24:59.362 INFO:tasks.workunit.client.1.smithi052.stdout:9/210: truncate d3/d2a/f3c 921283 0 2023-12-05T13:24:59.365 INFO:tasks.workunit.client.1.smithi052.stdout:9/211: dread d3/d11/f13 [0,4194304] 0 2023-12-05T13:24:59.372 INFO:tasks.workunit.client.1.smithi052.stdout:9/212: dread d3/f15 [0,4194304] 0 2023-12-05T13:24:59.375 INFO:tasks.workunit.client.1.smithi052.stdout:9/213: symlink d3/d1e/d37/l44 0 2023-12-05T13:24:59.375 INFO:tasks.workunit.client.1.smithi052.stdout:9/214: stat d3/d2a/f3c 0 2023-12-05T13:24:59.375 INFO:tasks.workunit.client.1.smithi052.stdout:9/215: fsync d3/f15 0 2023-12-05T13:24:59.375 INFO:tasks.workunit.client.1.smithi052.stdout:9/216: chown d3/d11 5939 1 2023-12-05T13:24:59.377 INFO:tasks.workunit.client.1.smithi052.stdout:9/217: creat d3/d31/f45 x:0 0 0 2023-12-05T13:24:59.378 INFO:tasks.workunit.client.1.smithi052.stdout:9/218: truncate d3/d2a/f39 46400 0 2023-12-05T13:24:59.380 INFO:tasks.workunit.client.1.smithi052.stdout:9/219: creat d3/d1e/d41/f46 x:0 0 0 2023-12-05T13:24:59.397 INFO:tasks.workunit.client.1.smithi052.stdout:9/220: dwrite d3/fd [0,4194304] 0 2023-12-05T13:24:59.397 INFO:tasks.workunit.client.1.smithi052.stdout:9/221: write d3/d11/f33 [93173,75311] 0 2023-12-05T13:24:59.404 INFO:tasks.workunit.client.1.smithi052.stdout:9/222: dread d3/f2c [0,4194304] 0 2023-12-05T13:24:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:24:59 smithi052 ceph-mon[121072]: pgmap v199: 65 pgs: 65 active+clean; 304 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 32 MiB/s wr, 686 op/s 2023-12-05T13:24:59.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.547+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68f810f470 con 0x7f68e0068f70 2023-12-05T13:24:59.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.548+0000 7f68e6ffd700 1 -- 172.21.15.29:0/194222525 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f68f810f470 con 0x7f68e0068f70 2023-12-05T13:24:59.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.551+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f68e0068f70 msgr2=0x7f68e006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.551+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f68e0068f70 0x7f68e006b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009b80 tx=0x7f68ec00b040 comp rx=0 tx=0).stop 2023-12-05T13:24:59.552 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.551+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 msgr2=0x7f68f810d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.551+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f810d4f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f68e8008f80 tx=0x7f68e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 shutdown_connections 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f68e0068f70 0x7f68e006b420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68f80fbaf0 0x7f68f810d4f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 --2- 172.21.15.29:0/194222525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68f80fcd00 0x7f68f810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 >> 172.21.15.29:0/194222525 conn(0x7f68f80f7190 msgr2=0x7f68f8065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 shutdown_connections 2023-12-05T13:24:59.553 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.552+0000 7f68fcb6c700 1 -- 172.21.15.29:0/194222525 wait complete. 2023-12-05T13:24:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 -- 172.21.15.29:0/3577481403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11800fd740 msgr2=0x7f11800ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 --2- 172.21.15.29:0/3577481403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11800fd740 0x7f11800ffb20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1170004940 tx=0x7f1170009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:59.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 -- 172.21.15.29:0/3577481403 shutdown_connections 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 --2- 172.21.15.29:0/3577481403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1180100060 0x7f1180102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 --2- 172.21.15.29:0/3577481403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11800fd740 0x7f11800ffb20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 -- 172.21.15.29:0/3577481403 >> 172.21.15.29:0/3577481403 conn(0x7f11800f71c0 msgr2=0x7f11800f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 -- 172.21.15.29:0/3577481403 shutdown_connections 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.671+0000 7f118486d700 1 -- 172.21.15.29:0/3577481403 wait complete. 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f118486d700 1 Processor -- start 2023-12-05T13:24:59.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f118486d700 1 -- start start 2023-12-05T13:24:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f118486d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11800fd740 0x7f11800fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f118486d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 0x7f11800fb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:59.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f118486d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800fbc50 con 0x7f1180100060 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f118486d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800fbdc0 con 0x7f11800fd740 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f117dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 0x7f11800fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f117dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 0x7f11800fb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49456/0 (socket says 172.21.15.29:49456) 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f117dd9b700 1 -- 172.21.15.29:0/1871139560 learned_addr learned my addr 172.21.15.29:0/1871139560 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.672+0000 7f117e59c700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11800fd740 0x7f11800fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f117dd9b700 1 -- 172.21.15.29:0/1871139560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11800fd740 msgr2=0x7f11800fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f117dd9b700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11800fd740 0x7f11800fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f117dd9b700 1 -- 172.21.15.29:0/1871139560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170005040 con 0x7f1180100060 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f117e59c700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11800fd740 0x7f11800fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f117dd9b700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 0x7f11800fb650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f117400eb40 tx=0x7f117400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1174007cc0 con 0x7f1180100060 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f117400f040 con 0x7f1180100060 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11800fc040 con 0x7f1180100060 2023-12-05T13:24:59.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11801154b0 con 0x7f1180100060 2023-12-05T13:24:59.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.673+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117400c990 con 0x7f1180100060 2023-12-05T13:24:59.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.674+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11600052e0 con 0x7f1180100060 2023-12-05T13:24:59.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.676+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f117400caf0 con 0x7f1180100060 2023-12-05T13:24:59.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.676+0000 7f116effd700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1168068f70 0x7f116806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:24:59.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.676+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1174086830 con 0x7f1180100060 2023-12-05T13:24:59.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.676+0000 7f117e59c700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1168068f70 0x7f116806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:24:59.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.677+0000 7f117e59c700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1168068f70 0x7f116806b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1170013680 tx=0x7f1170009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:24:59.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.682+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f117404da00 con 0x7f1180100060 2023-12-05T13:24:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.966+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1160000bf0 con 0x7f1168068f70 2023-12-05T13:24:59.975 INFO:tasks.workunit.client.1.smithi052.stdout:3/237: sync 2023-12-05T13:24:59.975 INFO:tasks.workunit.client.1.smithi052.stdout:3/238: write da/d25/f31 [4243136,108325] 0 2023-12-05T13:24:59.975 INFO:tasks.workunit.client.1.smithi052.stdout:3/239: dread - da/d2e/f3c zero size 2023-12-05T13:24:59.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.976+0000 7f116effd700 1 -- 172.21.15.29:0/1871139560 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3344 (secure 0 0 0) 0x7f1160000bf0 con 0x7f1168068f70 2023-12-05T13:24:59.977 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:24:59.977 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (5m) 112s ago 6m 26.4M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:24:59.977 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (6m) 112s ago 6m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:24:59.977 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (5m) 115s ago 5m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (5m) 112s ago 5m 86.6M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (2m) 112s ago 2m 18.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (2m) 112s ago 2m 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (2m) 115s ago 2m 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (2m) 115s ago 2m 15.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (7m) 112s ago 7m 495M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (5m) 115s ago 5m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 0e5359a579b3 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (7m) 112s ago 7m 76.2M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (5m) 115s ago 5m 58.5M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (6m) 112s ago 6m 18.2M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 115s ago 5m 17.8M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (4m) 112s ago 4m 56.2M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:24:59.978 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (4m) 112s ago 4m 59.1M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:24:59.979 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (4m) 112s ago 4m 53.6M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:24:59.979 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (3m) 115s ago 3m 56.3M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:24:59.979 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (3m) 115s ago 3m 50.4M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:24:59.979 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (3m) 115s ago 3m 51.1M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:24:59.979 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (4m) 112s ago 5m 48.7M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:24:59.979 INFO:tasks.workunit.client.1.smithi052.stdout:3/240: mkdir da/d25/d33/d51 0 2023-12-05T13:24:59.979 INFO:tasks.workunit.client.1.smithi052.stdout:3/241: fsync da/f23 0 2023-12-05T13:24:59.979 INFO:tasks.workunit.client.1.smithi052.stdout:3/242: dread - da/dd/f4e zero size 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1168068f70 msgr2=0x7f116806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1168068f70 0x7f116806b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1170013680 tx=0x7f1170009e30 comp rx=0 tx=0).stop 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 msgr2=0x7f11800fb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 0x7f11800fb650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f117400eb40 tx=0x7f117400b040 comp rx=0 tx=0).stop 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 shutdown_connections 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f1168068f70 0x7f116806b420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11800fd740 0x7f11800fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 --2- 172.21.15.29:0/1871139560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1180100060 0x7f11800fb650 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 >> 172.21.15.29:0/1871139560 conn(0x7f11800f71c0 msgr2=0x7f11800f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:24:59.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 shutdown_connections 2023-12-05T13:24:59.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:24:59.979+0000 7f118486d700 1 -- 172.21.15.29:0/1871139560 wait complete. 2023-12-05T13:24:59.996 INFO:tasks.workunit.client.1.smithi052.stdout:3/243: dwrite da/d27/f3b [0,4194304] 0 2023-12-05T13:24:59.999 INFO:tasks.workunit.client.1.smithi052.stdout:3/244: symlink da/d25/l52 0 2023-12-05T13:25:00.001 INFO:tasks.workunit.client.1.smithi052.stdout:3/245: creat da/d48/f53 x:0 0 0 2023-12-05T13:25:00.003 INFO:tasks.workunit.client.1.smithi052.stdout:3/246: link da/dd/c15 da/d2e/c54 0 2023-12-05T13:25:00.005 INFO:tasks.workunit.client.1.smithi052.stdout:3/247: creat da/dd/f55 x:0 0 0 2023-12-05T13:25:00.008 INFO:tasks.workunit.client.1.smithi052.stdout:3/248: symlink da/d48/d50/l56 0 2023-12-05T13:25:00.013 INFO:tasks.workunit.client.1.smithi052.stdout:3/249: rename da/dd/c32 to da/d27/c57 0 2023-12-05T13:25:00.013 INFO:tasks.workunit.client.1.smithi052.stdout:3/250: truncate da/d25/f3a 605699 0 2023-12-05T13:25:00.013 INFO:tasks.workunit.client.1.smithi052.stdout:3/251: chown da/d25/d33/c41 16 1 2023-12-05T13:25:00.013 INFO:tasks.workunit.client.1.smithi052.stdout:3/252: truncate da/dd/f55 391203 0 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 -- 172.21.15.29:0/1139236196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 msgr2=0x7fbca40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 --2- 172.21.15.29:0/1139236196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca40fe250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc94004940 tx=0x7fbc94009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 -- 172.21.15.29:0/1139236196 shutdown_connections 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 --2- 172.21.15.29:0/1139236196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca40fe250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 --2- 172.21.15.29:0/1139236196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbca40fcbf0 0x7fbca40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 -- 172.21.15.29:0/1139236196 >> 172.21.15.29:0/1139236196 conn(0x7fbca40f82d0 msgr2=0x7fbca40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:00.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 -- 172.21.15.29:0/1139236196 shutdown_connections 2023-12-05T13:25:00.140 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.138+0000 7fbcab546700 1 -- 172.21.15.29:0/1139236196 wait complete. 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbcab546700 1 Processor -- start 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbcab546700 1 -- start start 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbcab546700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbca40fcbf0 0x7fbca410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbcab546700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbcab546700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca410e020 con 0x7fbca40fde00 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbcab546700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca410e8c0 con 0x7fbca40fcbf0 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.139+0000 7fbca8ae1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca8ae1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca410da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49470/0 (socket says 172.21.15.29:49470) 2023-12-05T13:25:00.141 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca8ae1700 1 -- 172.21.15.29:0/4014750298 learned_addr learned my addr 172.21.15.29:0/4014750298 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca92e2700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbca40fcbf0 0x7fbca410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca8ae1700 1 -- 172.21.15.29:0/4014750298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbca40fcbf0 msgr2=0x7fbca410d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca8ae1700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbca40fcbf0 0x7fbca410d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca8ae1700 1 -- 172.21.15.29:0/4014750298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94005040 con 0x7fbca40fde00 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbca8ae1700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca410da20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009fd0 tx=0x7fbc94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc94021070 con 0x7fbca40fde00 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca410eb40 con 0x7fbca40fde00 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc9401c400 con 0x7fbca40fde00 2023-12-05T13:25:00.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.140+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc9400e070 con 0x7fbca40fde00 2023-12-05T13:25:00.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.141+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca410f080 con 0x7fbca40fde00 2023-12-05T13:25:00.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.142+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca404bb80 con 0x7fbca40fde00 2023-12-05T13:25:00.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.143+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbc9401c570 con 0x7fbca40fde00 2023-12-05T13:25:00.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.143+0000 7fbc99ffb700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbc90068f70 0x7fbc9006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:00.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.143+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbc94088030 con 0x7fbca40fde00 2023-12-05T13:25:00.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.143+0000 7fbca92e2700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbc90068f70 0x7fbc9006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:00.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.144+0000 7fbca92e2700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbc90068f70 0x7fbc9006b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009b80 tx=0x7fbca000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:00.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.148+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbc94057f90 con 0x7fbca40fde00 2023-12-05T13:25:00.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:00 smithi029 ceph-mon[112128]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:00.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:00 smithi029 ceph-mon[112128]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:00.384 INFO:tasks.workunit.client.1.smithi052.stdout:3/253: getdents da/d25/d33 0 2023-12-05T13:25:00.414 INFO:tasks.workunit.client.1.smithi052.stdout:3/254: getdents da/d48 0 2023-12-05T13:25:00.417 INFO:tasks.workunit.client.1.smithi052.stdout:3/255: mknod da/d25/c58 0 2023-12-05T13:25:00.417 INFO:tasks.workunit.client.1.smithi052.stdout:3/256: chown da/d2e 3963083 1 2023-12-05T13:25:00.417 INFO:tasks.workunit.client.1.smithi052.stdout:3/257: write da/fe [4473579,60454] 0 2023-12-05T13:25:00.433 INFO:tasks.workunit.client.1.smithi052.stdout:3/258: dwrite da/d25/f31 [0,4194304] 0 2023-12-05T13:25:00.433 INFO:tasks.workunit.client.1.smithi052.stdout:3/259: chown da/dd/f26 16303 1 2023-12-05T13:25:00.434 INFO:tasks.workunit.client.1.smithi052.stdout:3/260: link da/d27/l36 da/d48/d50/l59 0 2023-12-05T13:25:00.448 INFO:tasks.workunit.client.1.smithi052.stdout:3/261: dwrite da/d25/f3f [0,4194304] 0 2023-12-05T13:25:00.453 INFO:tasks.workunit.client.1.smithi052.stdout:3/262: creat da/d48/d50/f5a x:0 0 0 2023-12-05T13:25:00.453 INFO:tasks.workunit.client.1.smithi052.stdout:3/263: write da/d27/f28 [1543633,85228] 0 2023-12-05T13:25:00.468 INFO:tasks.workunit.client.1.smithi052.stdout:3/264: dwrite da/dd/f55 [0,4194304] 0 2023-12-05T13:25:00.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:00 smithi052 ceph-mon[121072]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:00.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:00 smithi052 ceph-mon[121072]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:00.473 INFO:tasks.workunit.client.1.smithi052.stdout:3/265: rmdir da/d2e 39 2023-12-05T13:25:00.490 INFO:tasks.workunit.client.1.smithi052.stdout:3/266: dwrite da/d2e/f3c [0,4194304] 0 2023-12-05T13:25:00.491 INFO:tasks.workunit.client.1.smithi052.stdout:3/267: read da/dd/f19 [2102486,109803] 0 2023-12-05T13:25:00.492 INFO:tasks.workunit.client.1.smithi052.stdout:3/268: write da/dd/d3d/f4f [67085,109612] 0 2023-12-05T13:25:00.492 INFO:tasks.workunit.client.1.smithi052.stdout:3/269: write da/f11 [3688152,65787] 0 2023-12-05T13:25:00.493 INFO:tasks.workunit.client.1.smithi052.stdout:3/270: readlink da/d2e/l47 0 2023-12-05T13:25:00.500 INFO:tasks.workunit.client.1.smithi052.stdout:3/271: mkdir da/d25/d33/d43/d5b 0 2023-12-05T13:25:00.500 INFO:tasks.workunit.client.1.smithi052.stdout:3/272: chown da/d48/d50/l56 1 1 2023-12-05T13:25:00.503 INFO:tasks.workunit.client.1.smithi052.stdout:3/273: creat da/d25/d33/d43/d5b/f5c x:0 0 0 2023-12-05T13:25:00.504 INFO:tasks.workunit.client.1.smithi052.stdout:3/274: write da/d2e/f3c [2043529,22572] 0 2023-12-05T13:25:00.505 INFO:tasks.workunit.client.1.smithi052.stdout:3/275: write da/d25/f3f [412816,80068] 0 2023-12-05T13:25:00.505 INFO:tasks.workunit.client.1.smithi052.stdout:3/276: stat da/d25/f31 0 2023-12-05T13:25:00.509 INFO:tasks.workunit.client.1.smithi052.stdout:3/277: unlink f5 0 2023-12-05T13:25:00.510 INFO:tasks.workunit.client.1.smithi052.stdout:3/278: write da/d27/f3b [2699901,77881] 0 2023-12-05T13:25:00.510 INFO:tasks.workunit.client.1.smithi052.stdout:3/279: truncate da/f11 5041006 0 2023-12-05T13:25:00.513 INFO:tasks.workunit.client.1.smithi052.stdout:3/280: truncate da/dd/f30 219936 0 2023-12-05T13:25:00.526 INFO:tasks.workunit.client.1.smithi052.stdout:3/281: dwrite da/dd/f19 [0,4194304] 0 2023-12-05T13:25:00.529 INFO:tasks.workunit.client.1.smithi052.stdout:3/282: creat da/d2e/d40/f5d x:0 0 0 2023-12-05T13:25:00.529 INFO:tasks.workunit.client.1.smithi052.stdout:3/283: dread - da/d48/d50/f5a zero size 2023-12-05T13:25:00.529 INFO:tasks.workunit.client.1.smithi052.stdout:3/284: chown da/c20 1771 1 2023-12-05T13:25:00.529 INFO:tasks.workunit.client.1.smithi052.stdout:3/285: readlink da/dd/l10 0 2023-12-05T13:25:00.531 INFO:tasks.workunit.client.1.smithi052.stdout:3/286: mknod da/d25/c5e 0 2023-12-05T13:25:00.533 INFO:tasks.workunit.client.1.smithi052.stdout:3/287: fsync da/f11 0 2023-12-05T13:25:00.534 INFO:tasks.workunit.client.1.smithi052.stdout:3/288: truncate f4 4910456 0 2023-12-05T13:25:00.536 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.535+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbca41055b0 con 0x7fbca40fde00 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.536+0000 7fbc99ffb700 1 -- 172.21.15.29:0/4014750298 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fbc94057b20 con 0x7fbca40fde00 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:25:00.537 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:25:00.538 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:25:00.540 INFO:tasks.workunit.client.1.smithi052.stdout:3/289: link da/d27/f28 da/d48/f5f 0 2023-12-05T13:25:00.540 INFO:tasks.workunit.client.1.smithi052.stdout:3/290: chown da/d25/f3f 449 1 2023-12-05T13:25:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.539+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbc90068f70 msgr2=0x7fbc9006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.539+0000 7fbcab546700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbc90068f70 0x7fbc9006b420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009b80 tx=0x7fbca000b040 comp rx=0 tx=0).stop 2023-12-05T13:25:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.539+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 msgr2=0x7fbca410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:00.540 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.539+0000 7fbcab546700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca410da20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009fd0 tx=0x7fbc94009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 shutdown_connections 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7fbc90068f70 0x7fbc9006b420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbca40fcbf0 0x7fbca410d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 --2- 172.21.15.29:0/4014750298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbca40fde00 0x7fbca410da20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 >> 172.21.15.29:0/4014750298 conn(0x7fbca40f82d0 msgr2=0x7fbca4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 shutdown_connections 2023-12-05T13:25:00.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.540+0000 7fbcab546700 1 -- 172.21.15.29:0/4014750298 wait complete. 2023-12-05T13:25:00.545 INFO:tasks.workunit.client.1.smithi052.stdout:3/291: dread da/d27/f28 [0,4194304] 0 2023-12-05T13:25:00.548 INFO:tasks.workunit.client.1.smithi052.stdout:3/292: unlink da/d25/f3f 0 2023-12-05T13:25:00.550 INFO:tasks.workunit.client.1.smithi052.stdout:3/293: mknod da/d27/c60 0 2023-12-05T13:25:00.550 INFO:tasks.workunit.client.1.smithi052.stdout:3/294: write da/d25/f3a [992632,2347] 0 2023-12-05T13:25:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 -- 172.21.15.29:0/2220789117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 msgr2=0x7f5f8c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/2220789117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c0fd150 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f80004940 tx=0x7f5f80009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 -- 172.21.15.29:0/2220789117 shutdown_connections 2023-12-05T13:25:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/2220789117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c0fd150 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/2220789117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f8c0fbaf0 0x7f5f8c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 -- 172.21.15.29:0/2220789117 >> 172.21.15.29:0/2220789117 conn(0x7f5f8c0f7190 msgr2=0x7f5f8c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 -- 172.21.15.29:0/2220789117 shutdown_connections 2023-12-05T13:25:00.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.675+0000 7f5f90c3d700 1 -- 172.21.15.29:0/2220789117 wait complete. 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f90c3d700 1 Processor -- start 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f90c3d700 1 -- start start 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f90c3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f8c0fbaf0 0x7f5f8c112690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f90c3d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f90c3d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c066000 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f90c3d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c066140 con 0x7f5f8c0fbaf0 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f89d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f89d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c114be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49500/0 (socket says 172.21.15.29:49500) 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.676+0000 7f5f89d9b700 1 -- 172.21.15.29:0/1598536181 learned_addr learned my addr 172.21.15.29:0/1598536181 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f8a59c700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f8c0fbaf0 0x7f5f8c112690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:00.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f89d9b700 1 -- 172.21.15.29:0/1598536181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f8c0fbaf0 msgr2=0x7f5f8c112690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f89d9b700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f8c0fbaf0 0x7f5f8c112690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f89d9b700 1 -- 172.21.15.29:0/1598536181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80005040 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f89d9b700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c114be0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009380 tx=0x7f5f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f8000e040 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c115120 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f8000bda0 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.677+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f8001c630 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.678+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c1154c0 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.679+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c04bb80 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.679+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f5f800139d0 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.680+0000 7f5f7affd700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5f74068f60 0x7f5f7406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:00.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.680+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5f80088000 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.680+0000 7f5f8a59c700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5f74068f60 0x7f5f7406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:00.681 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.681+0000 7f5f8a59c700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5f74068f60 0x7f5f7406b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009fd0 tx=0x7f5f7c009f00 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:00.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:00.685+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5f800544d0 con 0x7f5f8c0fcd00 2023-12-05T13:25:00.907 INFO:tasks.workunit.client.1.smithi052.stdout:3/295: fsync da/d2e/d40/f5d 0 2023-12-05T13:25:00.910 INFO:tasks.workunit.client.1.smithi052.stdout:3/296: symlink da/d48/l61 0 2023-12-05T13:25:00.915 INFO:tasks.workunit.client.1.smithi052.stdout:3/297: rmdir da/d48/d50 39 2023-12-05T13:25:00.937 INFO:tasks.workunit.client.1.smithi052.stdout:3/298: getdents da/d25/d33/d43 0 2023-12-05T13:25:00.938 INFO:tasks.workunit.client.1.smithi052.stdout:3/299: mknod da/d25/d33/d51/c62 0 2023-12-05T13:25:00.940 INFO:tasks.workunit.client.1.smithi052.stdout:3/300: truncate da/dd/d3d/f4f 1184545 0 2023-12-05T13:25:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.020+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 --> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f8c101650 con 0x7f5f74068f60 2023-12-05T13:25:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.021+0000 7f5f7affd700 1 -- 172.21.15.29:0/1598536181 <== mgr.14210 v2:172.21.15.29:6800/382423942 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5f8c101650 con 0x7f5f74068f60 2023-12-05T13:25:01.022 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:25:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:25:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:25:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:25:01.022 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-12-05T13:25:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "0/2 daemons upgraded", 2023-12-05T13:25:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a image on host smithi052", 2023-12-05T13:25:01.023 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:25:01.023 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:25:01.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.023+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5f74068f60 msgr2=0x7f5f7406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:01.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.023+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5f74068f60 0x7f5f7406b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009fd0 tx=0x7f5f7c009f00 comp rx=0 tx=0).stop 2023-12-05T13:25:01.024 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.023+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 msgr2=0x7f5f8c114be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.023+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c114be0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009380 tx=0x7f5f80009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 shutdown_connections 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:6800/382423942,v1:172.21.15.29:6801/382423942] conn(0x7f5f74068f60 0x7f5f7406b410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f8c0fbaf0 0x7f5f8c112690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 --2- 172.21.15.29:0/1598536181 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f8c0fcd00 0x7f5f8c114be0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 >> 172.21.15.29:0/1598536181 conn(0x7f5f8c0f7190 msgr2=0x7f5f8c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 shutdown_connections 2023-12-05T13:25:01.025 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:01.024+0000 7f5f90c3d700 1 -- 172.21.15.29:0/1598536181 wait complete. 2023-12-05T13:25:01.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:01 smithi029 ceph-mon[112128]: pgmap v200: 65 pgs: 65 active+clean; 511 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 59 MiB/s wr, 705 op/s 2023-12-05T13:25:01.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:01 smithi029 ceph-mon[112128]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:01.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:01 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/4014750298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:25:01.376 INFO:tasks.workunit.client.1.smithi052.stdout:6/250: sync 2023-12-05T13:25:01.376 INFO:tasks.workunit.client.1.smithi052.stdout:6/251: chown d3/d5/c1a 6436 1 2023-12-05T13:25:01.376 INFO:tasks.workunit.client.1.smithi052.stdout:6/252: stat d3/d4/d6/f1d 0 2023-12-05T13:25:01.387 INFO:tasks.workunit.client.1.smithi052.stdout:2/308: sync 2023-12-05T13:25:01.387 INFO:tasks.workunit.client.1.smithi052.stdout:0/360: sync 2023-12-05T13:25:01.397 INFO:tasks.workunit.client.1.smithi052.stdout:0/361: dread d0/db/d1b/d51/d55/f5f [0,4194304] 0 2023-12-05T13:25:01.402 INFO:tasks.workunit.client.1.smithi052.stdout:0/362: rename d0/db/d1b/d29/f57 to d0/db/d1b/d51/d55/d66/f86 0 2023-12-05T13:25:01.403 INFO:tasks.workunit.client.1.smithi052.stdout:2/309: dwrite d2/f59 [0,4194304] 0 2023-12-05T13:25:01.403 INFO:tasks.workunit.client.1.smithi052.stdout:0/363: write d0/db/d33/f35 [3079371,70037] 0 2023-12-05T13:25:01.403 INFO:tasks.workunit.client.1.smithi052.stdout:0/364: chown d0/db/d2e/f76 0 1 2023-12-05T13:25:01.408 INFO:tasks.workunit.client.1.smithi052.stdout:2/310: creat d2/d14/f5a x:0 0 0 2023-12-05T13:25:01.408 INFO:tasks.workunit.client.1.smithi052.stdout:2/311: write d2/d13/d1e/f54 [4660347,16037] 0 2023-12-05T13:25:01.412 INFO:tasks.workunit.client.1.smithi052.stdout:0/365: unlink d0/db/d1b/d29/c2d 0 2023-12-05T13:25:01.412 INFO:tasks.workunit.client.1.smithi052.stdout:0/366: fdatasync d0/fa 0 2023-12-05T13:25:01.412 INFO:tasks.workunit.client.1.smithi052.stdout:0/367: stat d0/db/d1b/d29/l48 0 2023-12-05T13:25:01.416 INFO:tasks.workunit.client.1.smithi052.stdout:2/312: dread d2/f53 [0,4194304] 0 2023-12-05T13:25:01.420 INFO:tasks.workunit.client.1.smithi052.stdout:2/313: rmdir d2/d51/d52 0 2023-12-05T13:25:01.420 INFO:tasks.workunit.client.1.smithi052.stdout:2/314: write d2/d13/d1e/f25 [1432247,81643] 0 2023-12-05T13:25:01.424 INFO:tasks.workunit.client.1.smithi052.stdout:2/315: rename d2/f53 to d2/d4/d3f/f5b 0 2023-12-05T13:25:01.426 INFO:tasks.workunit.client.1.smithi052.stdout:2/316: mkdir d2/d13/d37/d5c 0 2023-12-05T13:25:01.429 INFO:tasks.workunit.client.1.smithi052.stdout:0/368: dwrite d0/db/d1b/d42/f45 [0,4194304] 0 2023-12-05T13:25:01.430 INFO:tasks.workunit.client.1.smithi052.stdout:2/317: rename d2/d14/f42 to d2/f5d 0 2023-12-05T13:25:01.430 INFO:tasks.workunit.client.1.smithi052.stdout:2/318: write d2/d4/f23 [2430638,103802] 0 2023-12-05T13:25:01.435 INFO:tasks.workunit.client.1.smithi052.stdout:0/369: rename d0/db/d1b/d51/d55/c61 to d0/db/d33/c87 0 2023-12-05T13:25:01.436 INFO:tasks.workunit.client.1.smithi052.stdout:2/319: creat d2/d13/d48/f5e x:0 0 0 2023-12-05T13:25:01.439 INFO:tasks.workunit.client.1.smithi052.stdout:0/370: mknod d0/db/d1b/d51/d55/c88 0 2023-12-05T13:25:01.439 INFO:tasks.workunit.client.1.smithi052.stdout:0/371: readlink d0/db/d1b/d51/d55/d66/d77/l78 0 2023-12-05T13:25:01.439 INFO:tasks.workunit.client.1.smithi052.stdout:0/372: write d0/f2b [9062694,23207] 0 2023-12-05T13:25:01.439 INFO:tasks.workunit.client.1.smithi052.stdout:0/373: read d0/db/d1b/d42/f67 [673799,54819] 0 2023-12-05T13:25:01.440 INFO:tasks.workunit.client.1.smithi052.stdout:2/320: creat d2/d14/f5f x:0 0 0 2023-12-05T13:25:01.440 INFO:tasks.workunit.client.1.smithi052.stdout:2/321: dread - d2/d14/f5a zero size 2023-12-05T13:25:01.443 INFO:tasks.workunit.client.1.smithi052.stdout:2/322: unlink d2/d13/d1e/c34 0 2023-12-05T13:25:01.445 INFO:tasks.workunit.client.1.smithi052.stdout:2/323: unlink d2/d4/l41 0 2023-12-05T13:25:01.454 INFO:tasks.workunit.client.1.smithi052.stdout:0/374: dwrite d0/db/d52/f7d [8388608,4194304] 0 2023-12-05T13:25:01.456 INFO:tasks.workunit.client.1.smithi052.stdout:2/324: dread d2/d13/d1e/f27 [4194304,4194304] 0 2023-12-05T13:25:01.459 INFO:tasks.workunit.client.1.smithi052.stdout:2/325: rmdir d2/d31/d4c 0 2023-12-05T13:25:01.462 INFO:tasks.workunit.client.1.smithi052.stdout:2/326: rename d2/d14/f5f to d2/d31/d3a/d4b/f60 0 2023-12-05T13:25:01.468 INFO:tasks.workunit.client.1.smithi052.stdout:2/327: mkdir d2/d13/d37/d61 0 2023-12-05T13:25:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:01 smithi052 ceph-mon[121072]: pgmap v200: 65 pgs: 65 active+clean; 511 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 59 MiB/s wr, 705 op/s 2023-12-05T13:25:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:01 smithi052 ceph-mon[121072]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:01 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/4014750298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:25:01.474 INFO:tasks.workunit.client.1.smithi052.stdout:0/375: dwrite d0/f6 [4194304,4194304] 0 2023-12-05T13:25:01.490 INFO:tasks.workunit.client.1.smithi052.stdout:2/328: dwrite d2/d31/f4f [0,4194304] 0 2023-12-05T13:25:01.493 INFO:tasks.workunit.client.1.smithi052.stdout:2/329: rmdir d2 39 2023-12-05T13:25:01.497 INFO:tasks.workunit.client.1.smithi052.stdout:0/376: dwrite d0/db/d33/f70 [0,4194304] 0 2023-12-05T13:25:01.502 INFO:tasks.workunit.client.1.smithi052.stdout:0/377: dread d0/db/d1b/f27 [0,4194304] 0 2023-12-05T13:25:01.504 INFO:tasks.workunit.client.1.smithi052.stdout:0/378: creat d0/db/d52/d7f/f89 x:0 0 0 2023-12-05T13:25:01.504 INFO:tasks.workunit.client.1.smithi052.stdout:0/379: readlink d0/db/l18 0 2023-12-05T13:25:01.505 INFO:tasks.workunit.client.1.smithi052.stdout:0/380: write d0/db/d14/d60/f7b [631162,4718] 0 2023-12-05T13:25:01.507 INFO:tasks.workunit.client.1.smithi052.stdout:2/330: dwrite d2/d14/f5a [0,4194304] 0 2023-12-05T13:25:01.513 INFO:tasks.workunit.client.1.smithi052.stdout:2/331: mkdir d2/d14/d62 0 2023-12-05T13:25:01.515 INFO:tasks.workunit.client.1.smithi052.stdout:0/381: dread d0/db/d14/f2f [0,4194304] 0 2023-12-05T13:25:01.515 INFO:tasks.workunit.client.1.smithi052.stdout:2/332: mkdir d2/d4/d63 0 2023-12-05T13:25:01.517 INFO:tasks.workunit.client.1.smithi052.stdout:0/382: mknod d0/db/d1b/d29/c8a 0 2023-12-05T13:25:01.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/333: link d2/d4/l1d d2/d14/d62/l64 0 2023-12-05T13:25:01.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/334: fdatasync d2/d13/d1e/f3d 0 2023-12-05T13:25:01.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/335: dread - d2/d13/f36 zero size 2023-12-05T13:25:01.520 INFO:tasks.workunit.client.1.smithi052.stdout:0/383: mkdir d0/db/d1b/d7a/d8b 0 2023-12-05T13:25:01.535 INFO:tasks.workunit.client.1.smithi052.stdout:2/336: dwrite d2/d13/d1e/f57 [0,4194304] 0 2023-12-05T13:25:01.540 INFO:tasks.workunit.client.1.smithi052.stdout:2/337: link d2/d14/l56 d2/d13/d48/l65 0 2023-12-05T13:25:01.807 INFO:tasks.workunit.client.1.smithi052.stdout:0/384: truncate d0/db/d14/f4f 1880848 0 2023-12-05T13:25:01.807 INFO:tasks.workunit.client.1.smithi052.stdout:0/385: chown d0/db/d52/d7f 1 1 2023-12-05T13:25:01.808 INFO:tasks.workunit.client.1.smithi052.stdout:0/386: truncate d0/db/d1b/d42/f45 1266483 0 2023-12-05T13:25:01.814 INFO:tasks.workunit.client.1.smithi052.stdout:0/387: dread d0/db/d2e/f46 [0,4194304] 0 2023-12-05T13:25:01.814 INFO:tasks.workunit.client.1.smithi052.stdout:0/388: fdatasync d0/db/d52/d7f/f89 0 2023-12-05T13:25:02.077 INFO:tasks.workunit.client.1.smithi052.stdout:0/389: write d0/db/d14/f4f [2461650,129522] 0 2023-12-05T13:25:02.077 INFO:tasks.workunit.client.1.smithi052.stdout:0/390: fdatasync d0/f6 0 2023-12-05T13:25:02.080 INFO:tasks.workunit.client.1.smithi052.stdout:0/391: link d0/db/c16 d0/db/d65/c8c 0 2023-12-05T13:25:02.083 INFO:tasks.workunit.client.1.smithi052.stdout:0/392: stat d0/db/d1b/d29/c4a 0 2023-12-05T13:25:02.086 INFO:tasks.workunit.client.1.smithi052.stdout:0/393: mknod d0/db/d1b/d51/d55/d66/c8d 0 2023-12-05T13:25:02.089 INFO:tasks.workunit.client.1.smithi052.stdout:0/394: rmdir d0/db/d20/d50 39 2023-12-05T13:25:02.089 INFO:tasks.workunit.client.1.smithi052.stdout:0/395: read d0/db/d1b/d42/f67 [608070,45677] 0 2023-12-05T13:25:02.090 INFO:tasks.workunit.client.1.smithi052.stdout:0/396: read d0/db/d1b/f27 [4677777,80251] 0 2023-12-05T13:25:02.103 INFO:tasks.workunit.client.1.smithi052.stdout:0/397: dwrite d0/db/d33/f72 [0,4194304] 0 2023-12-05T13:25:02.103 INFO:tasks.workunit.client.1.smithi052.stdout:0/398: fsync d0/f1a 0 2023-12-05T13:25:02.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:02 smithi029 ceph-mon[112128]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:02.459 INFO:tasks.workunit.client.1.smithi052.stdout:0/399: truncate d0/db/d33/f72 4935451 0 2023-12-05T13:25:02.468 INFO:tasks.workunit.client.1.smithi052.stdout:0/400: dread d0/fa [4194304,4194304] 0 2023-12-05T13:25:02.470 INFO:tasks.workunit.client.1.smithi052.stdout:0/401: write d0/fa [1394083,126629] 0 2023-12-05T13:25:02.470 INFO:tasks.workunit.client.1.smithi052.stdout:0/402: write d0/db/d33/f3f [1179087,63204] 0 2023-12-05T13:25:02.470 INFO:tasks.workunit.client.1.smithi052.stdout:0/403: chown d0/db/d14/d60/l71 131 1 2023-12-05T13:25:02.470 INFO:tasks.workunit.client.1.smithi052.stdout:0/404: dread - d0/db/d1b/d51/f69 zero size 2023-12-05T13:25:02.472 INFO:tasks.workunit.client.1.smithi052.stdout:0/405: mknod d0/db/d2e/c8e 0 2023-12-05T13:25:02.473 INFO:tasks.workunit.client.1.smithi052.stdout:0/406: write d0/db/d14/f26 [1288119,72033] 0 2023-12-05T13:25:02.473 INFO:tasks.workunit.client.1.smithi052.stdout:0/407: chown d0/db/d1b/d51/d55/c88 71187313 1 2023-12-05T13:25:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:02 smithi052 ceph-mon[121072]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:02.802 INFO:tasks.workunit.client.1.smithi052.stdout:0/408: dwrite d0/db/d1b/f27 [0,4194304] 0 2023-12-05T13:25:02.802 INFO:tasks.workunit.client.1.smithi052.stdout:0/409: read d0/db/d14/f40 [161619,119793] 0 2023-12-05T13:25:02.804 INFO:tasks.workunit.client.1.smithi052.stdout:0/410: fsync d0/f4 0 2023-12-05T13:25:02.805 INFO:tasks.workunit.client.1.smithi052.stdout:0/411: stat d0/db/d2e/d7e 0 2023-12-05T13:25:02.806 INFO:tasks.workunit.client.1.smithi052.stdout:0/412: unlink d0/db/d1b/d42/c49 0 2023-12-05T13:25:03.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/340: sync 2023-12-05T13:25:03.068 INFO:tasks.workunit.client.1.smithi052.stdout:7/341: dwrite d7/d4e/f5c [0,4194304] 0 2023-12-05T13:25:03.068 INFO:tasks.workunit.client.1.smithi052.stdout:7/342: read d7/d4e/d12/f43 [4174718,17286] 0 2023-12-05T13:25:03.069 INFO:tasks.workunit.client.1.smithi052.stdout:7/343: write d7/d31/f55 [1287248,13762] 0 2023-12-05T13:25:03.072 INFO:tasks.workunit.client.1.smithi052.stdout:7/344: truncate d7/d4e/d12/d3f/f44 257109 0 2023-12-05T13:25:03.075 INFO:tasks.workunit.client.1.smithi052.stdout:7/345: link d7/d4e/f5c d7/d31/d56/d60/f76 0 2023-12-05T13:25:03.077 INFO:tasks.workunit.client.1.smithi052.stdout:7/346: creat d7/d4e/d45/f77 x:0 0 0 2023-12-05T13:25:03.085 INFO:tasks.workunit.client.1.smithi052.stdout:7/347: dread d7/d4e/d12/d3f/f6e [0,4194304] 0 2023-12-05T13:25:03.086 INFO:tasks.workunit.client.1.smithi052.stdout:7/348: write d7/d4e/d12/f43 [3798477,27518] 0 2023-12-05T13:25:03.104 INFO:tasks.workunit.client.1.smithi052.stdout:7/349: dwrite d7/d4e/d45/d5a/d16/f30 [0,4194304] 0 2023-12-05T13:25:03.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/350: rename d7/d4e/d12/d3f/d68 to d7/d31/d56/d78 0 2023-12-05T13:25:03.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/351: readlink d7/l21 0 2023-12-05T13:25:03.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/352: dread - d7/d4e/d12/d3f/d46/f5f zero size 2023-12-05T13:25:03.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/353: fsync d7/d4e/f61 0 2023-12-05T13:25:03.108 INFO:tasks.workunit.client.1.smithi052.stdout:7/354: mkdir d7/d4e/d45/d79 0 2023-12-05T13:25:03.110 INFO:tasks.workunit.client.1.smithi052.stdout:7/355: truncate d7/f27 1075496 0 2023-12-05T13:25:03.110 INFO:tasks.workunit.client.1.smithi052.stdout:7/356: read - d7/d31/d56/d60/f69 zero size 2023-12-05T13:25:03.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/357: dwrite d7/d4e/d12/d3f/d46/d4d/f64 [0,4194304] 0 2023-12-05T13:25:03.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/358: truncate d7/d4e/f36 1778835 0 2023-12-05T13:25:03.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/359: getdents d7/d31/d56/d60/d72 0 2023-12-05T13:25:03.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/360: truncate d7/d4e/d12/d3f/d46/f5f 157585 0 2023-12-05T13:25:03.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/361: write d7/d4e/f36 [2405663,63295] 0 2023-12-05T13:25:03.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/362: fsync d7/d4e/f2b 0 2023-12-05T13:25:03.129 INFO:tasks.workunit.client.1.smithi052.stdout:7/363: creat d7/d4e/d45/d5a/d63/f7a x:0 0 0 2023-12-05T13:25:03.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:03 smithi029 ceph-mon[112128]: pgmap v201: 65 pgs: 65 active+clean; 715 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 47 MiB/s rd, 89 MiB/s wr, 566 op/s 2023-12-05T13:25:03.431 INFO:tasks.workunit.client.1.smithi052.stdout:7/364: getdents d7/d4e/d45/d5a/d63 0 2023-12-05T13:25:03.431 INFO:tasks.workunit.client.1.smithi052.stdout:7/365: chown d7/d4e/d45/d5a/d16 13672761 1 2023-12-05T13:25:03.433 INFO:tasks.workunit.client.1.smithi052.stdout:7/366: creat d7/d4e/d45/d5a/f7b x:0 0 0 2023-12-05T13:25:03.437 INFO:tasks.workunit.client.1.smithi052.stdout:7/367: creat d7/d4e/d45/d5a/d16/f7c x:0 0 0 2023-12-05T13:25:03.440 INFO:tasks.workunit.client.1.smithi052.stdout:7/368: rename d7/d31/d56/d78 to d7/d4e/d12/d7d 0 2023-12-05T13:25:03.442 INFO:tasks.workunit.client.1.smithi052.stdout:7/369: symlink d7/d4e/d45/d5a/d63/l7e 0 2023-12-05T13:25:03.451 INFO:tasks.workunit.client.1.smithi052.stdout:7/370: dread d7/d4e/f5c [0,4194304] 0 2023-12-05T13:25:03.451 INFO:tasks.workunit.client.1.smithi052.stdout:7/371: stat d7/d4e/d45/d5a/d16/c1c 0 2023-12-05T13:25:03.451 INFO:tasks.workunit.client.1.smithi052.stdout:7/372: write d7/d4e/d12/d3f/f6e [6931,92532] 0 2023-12-05T13:25:03.454 INFO:tasks.workunit.client.1.smithi052.stdout:7/373: rename d7/d31/f57 to d7/d4e/d12/d3f/f7f 0 2023-12-05T13:25:03.457 INFO:tasks.workunit.client.1.smithi052.stdout:7/374: creat d7/d4e/d12/d3f/f80 x:0 0 0 2023-12-05T13:25:03.457 INFO:tasks.workunit.client.1.smithi052.stdout:7/375: chown d7/d4e/d45/d5a/d16/c1c 1 1 2023-12-05T13:25:03.459 INFO:tasks.workunit.client.1.smithi052.stdout:7/376: mkdir d7/d2e/d81 0 2023-12-05T13:25:03.459 INFO:tasks.workunit.client.1.smithi052.stdout:7/377: dread - d7/d4e/d45/d5a/d63/f6d zero size 2023-12-05T13:25:03.459 INFO:tasks.workunit.client.1.smithi052.stdout:7/378: fdatasync d7/d4e/d45/d5a/d16/f30 0 2023-12-05T13:25:03.459 INFO:tasks.workunit.client.1.smithi052.stdout:7/379: chown d7/d4e/d45/d5a/d16/f33 15138122 1 2023-12-05T13:25:03.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:03 smithi052 ceph-mon[121072]: pgmap v201: 65 pgs: 65 active+clean; 715 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 47 MiB/s rd, 89 MiB/s wr, 566 op/s 2023-12-05T13:25:03.477 INFO:tasks.workunit.client.1.smithi052.stdout:7/380: dwrite d7/d4e/f36 [0,4194304] 0 2023-12-05T13:25:03.672 INFO:tasks.workunit.client.1.smithi052.stdout:8/292: sync 2023-12-05T13:25:03.675 INFO:tasks.workunit.client.1.smithi052.stdout:8/293: symlink d0/d28/d2b/d53/l66 0 2023-12-05T13:25:03.675 INFO:tasks.workunit.client.1.smithi052.stdout:8/294: stat d0/de/d27/f57 0 2023-12-05T13:25:03.677 INFO:tasks.workunit.client.1.smithi052.stdout:8/295: getdents d0/d4d 0 2023-12-05T13:25:03.691 INFO:tasks.workunit.client.1.smithi052.stdout:8/296: dwrite d0/de/d27/f4e [4194304,4194304] 0 2023-12-05T13:25:03.696 INFO:tasks.workunit.client.1.smithi052.stdout:8/297: rmdir d0/d28/d2b/d53/d56/d60 0 2023-12-05T13:25:03.699 INFO:tasks.workunit.client.1.smithi052.stdout:8/298: creat d0/d28/d39/d3a/f67 x:0 0 0 2023-12-05T13:25:03.721 INFO:tasks.workunit.client.1.smithi052.stdout:8/299: dwrite d0/de/d12/f2e [0,4194304] 0 2023-12-05T13:25:03.780 INFO:tasks.workunit.client.1.smithi052.stdout:7/381: getdents d7/d2e 0 2023-12-05T13:25:03.793 INFO:tasks.workunit.client.1.smithi052.stdout:7/382: dwrite d7/d4e/d12/d3f/d46/f5f [0,4194304] 0 2023-12-05T13:25:03.793 INFO:tasks.workunit.client.1.smithi052.stdout:7/383: readlink d7/d4e/d12/d3f/d46/l5e 0 2023-12-05T13:25:03.799 INFO:tasks.workunit.client.1.smithi052.stdout:7/384: truncate d7/f27 1370821 0 2023-12-05T13:25:03.800 INFO:tasks.workunit.client.1.smithi052.stdout:7/385: truncate d7/d4e/d45/f5b 828276 0 2023-12-05T13:25:03.801 INFO:tasks.workunit.client.1.smithi052.stdout:7/386: creat d7/d4e/d45/f82 x:0 0 0 2023-12-05T13:25:03.806 INFO:tasks.workunit.client.1.smithi052.stdout:7/387: mknod d7/d4e/d12/c83 0 2023-12-05T13:25:03.806 INFO:tasks.workunit.client.1.smithi052.stdout:7/388: write d7/d31/d56/d60/f76 [5076056,51459] 0 2023-12-05T13:25:03.808 INFO:tasks.workunit.client.1.smithi052.stdout:7/389: stat d7/d2e/c67 0 2023-12-05T13:25:03.808 INFO:tasks.workunit.client.1.smithi052.stdout:7/390: stat d7/d4e/d12/d3f/f80 0 2023-12-05T13:25:03.817 INFO:tasks.workunit.client.1.smithi052.stdout:7/391: dread d7/f73 [0,4194304] 0 2023-12-05T13:25:03.818 INFO:tasks.workunit.client.1.smithi052.stdout:7/392: creat d7/d4e/d45/d5a/f84 x:0 0 0 2023-12-05T13:25:03.819 INFO:tasks.workunit.client.1.smithi052.stdout:7/393: creat d7/d31/d56/f85 x:0 0 0 2023-12-05T13:25:03.821 INFO:tasks.workunit.client.1.smithi052.stdout:7/394: dread d7/d4e/d45/f51 [0,4194304] 0 2023-12-05T13:25:03.821 INFO:tasks.workunit.client.1.smithi052.stdout:7/395: stat d7/d31/d56/d60/f76 0 2023-12-05T13:25:03.840 INFO:tasks.workunit.client.1.smithi052.stdout:7/396: dwrite d7/d4e/d12/d3f/f80 [0,4194304] 0 2023-12-05T13:25:03.840 INFO:tasks.workunit.client.1.smithi052.stdout:7/397: chown d7/d4e/d45/d5a/c65 1898254 1 2023-12-05T13:25:03.863 INFO:tasks.workunit.client.1.smithi052.stdout:7/398: dwrite d7/d31/d56/d60/f76 [0,4194304] 0 2023-12-05T13:25:03.864 INFO:tasks.workunit.client.1.smithi052.stdout:7/399: chown d7/d4e/d45/d5a/d16/l70 1808 1 2023-12-05T13:25:03.864 INFO:tasks.workunit.client.1.smithi052.stdout:7/400: fdatasync d7/d4e/d12/d3f/f7f 0 2023-12-05T13:25:03.868 INFO:tasks.workunit.client.1.smithi052.stdout:7/401: dread d7/d4e/d12/f43 [0,4194304] 0 2023-12-05T13:25:03.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/402: unlink d7/c9 0 2023-12-05T13:25:03.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/403: chown d7/d4e/d45/d5a/d16/c1c 1994 1 2023-12-05T13:25:03.874 INFO:tasks.workunit.client.1.smithi052.stdout:7/404: mkdir d7/d4e/d86 0 2023-12-05T13:25:03.988 INFO:tasks.workunit.client.1.smithi052.stdout:8/300: truncate d0/de/d12/f2e 3959150 0 2023-12-05T13:25:03.990 INFO:tasks.workunit.client.1.smithi052.stdout:8/301: mknod d0/d28/d39/d3a/d4f/c68 0 2023-12-05T13:25:04.003 INFO:tasks.workunit.client.1.smithi052.stdout:8/302: dwrite d0/fa [0,4194304] 0 2023-12-05T13:25:04.006 INFO:tasks.workunit.client.1.smithi052.stdout:8/303: link d0/de/d12/c37 d0/d51/c69 0 2023-12-05T13:25:04.013 INFO:tasks.workunit.client.1.smithi052.stdout:8/304: dread d0/d28/d39/d3a/f47 [0,4194304] 0 2023-12-05T13:25:04.015 INFO:tasks.workunit.client.1.smithi052.stdout:8/305: symlink d0/de/d12/l6a 0 2023-12-05T13:25:04.017 INFO:tasks.workunit.client.1.smithi052.stdout:8/306: link d0/d51/l5e d0/de/d12/d29/l6b 0 2023-12-05T13:25:04.017 INFO:tasks.workunit.client.1.smithi052.stdout:8/307: readlink d0/de/d12/l13 0 2023-12-05T13:25:04.019 INFO:tasks.workunit.client.1.smithi052.stdout:8/308: mknod d0/d4d/c6c 0 2023-12-05T13:25:04.021 INFO:tasks.workunit.client.1.smithi052.stdout:8/309: symlink d0/de/d27/d43/d44/l6d 0 2023-12-05T13:25:04.023 INFO:tasks.workunit.client.1.smithi052.stdout:8/310: truncate d0/f3e 220331 0 2023-12-05T13:25:04.036 INFO:tasks.workunit.client.1.smithi052.stdout:8/311: dwrite d0/de/d12/d29/f50 [0,4194304] 0 2023-12-05T13:25:04.040 INFO:tasks.workunit.client.1.smithi052.stdout:8/312: rmdir d0/d28/d2b/d53 39 2023-12-05T13:25:04.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/405: dread d7/f27 [0,4194304] 0 2023-12-05T13:25:04.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/406: write d7/d4e/d12/d3f/f6e [5188248,120790] 0 2023-12-05T13:25:04.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/407: fsync d7/d4e/d12/d3f/f44 0 2023-12-05T13:25:04.053 INFO:tasks.workunit.client.1.smithi052.stdout:8/313: dwrite d0/f21 [0,4194304] 0 2023-12-05T13:25:04.054 INFO:tasks.workunit.client.1.smithi052.stdout:8/314: write d0/de/d27/d43/d44/f49 [805674,20941] 0 2023-12-05T13:25:04.055 INFO:tasks.workunit.client.1.smithi052.stdout:7/408: rename d7/d4e/d12/d3f/d46/d4d/f64 to d7/d4e/d45/d5a/f87 0 2023-12-05T13:25:04.060 INFO:tasks.workunit.client.1.smithi052.stdout:8/315: truncate d0/f11 4298366 0 2023-12-05T13:25:04.065 INFO:tasks.workunit.client.1.smithi052.stdout:8/316: mknod d0/d28/c6e 0 2023-12-05T13:25:04.077 INFO:tasks.workunit.client.1.smithi052.stdout:8/317: dwrite d0/de/f41 [4194304,4194304] 0 2023-12-05T13:25:04.077 INFO:tasks.workunit.client.1.smithi052.stdout:8/318: write d0/d28/d39/d3a/f5b [707807,61673] 0 2023-12-05T13:25:04.080 INFO:tasks.workunit.client.1.smithi052.stdout:8/319: rename d0/cf to d0/de/d27/d43/c6f 0 2023-12-05T13:25:04.095 INFO:tasks.workunit.client.1.smithi052.stdout:8/320: dwrite d0/de/f35 [0,4194304] 0 2023-12-05T13:25:04.110 INFO:tasks.workunit.client.1.smithi052.stdout:8/321: dwrite d0/d28/d39/d3a/f67 [0,4194304] 0 2023-12-05T13:25:04.111 INFO:tasks.workunit.client.1.smithi052.stdout:8/322: write d0/d28/d2b/f31 [319532,76137] 0 2023-12-05T13:25:04.115 INFO:tasks.workunit.client.1.smithi052.stdout:8/323: stat d0/d28/d39/l40 0 2023-12-05T13:25:04.115 INFO:tasks.workunit.client.1.smithi052.stdout:8/324: readlink d0/de/d27/l3f 0 2023-12-05T13:25:04.300 INFO:tasks.workunit.client.1.smithi052.stdout:8/325: truncate d0/de/f35 1314537 0 2023-12-05T13:25:04.302 INFO:tasks.workunit.client.1.smithi052.stdout:8/326: getdents d0/d28/d39/d3a/d4f 0 2023-12-05T13:25:04.304 INFO:tasks.workunit.client.1.smithi052.stdout:8/327: symlink d0/d4d/l70 0 2023-12-05T13:25:04.306 INFO:tasks.workunit.client.1.smithi052.stdout:8/328: getdents d0/d28/d39/d3a 0 2023-12-05T13:25:04.306 INFO:tasks.workunit.client.1.smithi052.stdout:8/329: chown d0/d28/d39/d3a/f67 223144191 1 2023-12-05T13:25:04.308 INFO:tasks.workunit.client.1.smithi052.stdout:8/330: fdatasync d0/d28/d39/d3a/f5b 0 2023-12-05T13:25:04.310 INFO:tasks.workunit.client.1.smithi052.stdout:8/331: symlink d0/d28/l71 0 2023-12-05T13:25:04.310 INFO:tasks.workunit.client.1.smithi052.stdout:8/332: stat d0/de/f41 0 2023-12-05T13:25:04.310 INFO:tasks.workunit.client.1.smithi052.stdout:8/333: fsync d0/de/d27/f4e 0 2023-12-05T13:25:04.313 INFO:tasks.workunit.client.1.smithi052.stdout:8/334: getdents d0 0 2023-12-05T13:25:04.315 INFO:tasks.workunit.client.1.smithi052.stdout:8/335: mkdir d0/d28/d39/d3a/d72 0 2023-12-05T13:25:04.316 INFO:tasks.workunit.client.1.smithi052.stdout:8/336: dread d0/de/f2f [0,4194304] 0 2023-12-05T13:25:04.338 INFO:tasks.workunit.client.1.smithi052.stdout:8/337: dwrite d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:25:04.338 INFO:tasks.workunit.client.1.smithi052.stdout:8/338: write d0/fa [3940757,61767] 0 2023-12-05T13:25:04.474 INFO:tasks.workunit.client.1.smithi052.stdout:8/339: dwrite d0/de/f35 [0,4194304] 0 2023-12-05T13:25:04.474 INFO:tasks.workunit.client.1.smithi052.stdout:8/340: read d0/fa [2153503,45271] 0 2023-12-05T13:25:04.475 INFO:tasks.workunit.client.1.smithi052.stdout:8/341: mknod d0/de/d12/c73 0 2023-12-05T13:25:04.478 INFO:tasks.workunit.client.1.smithi052.stdout:8/342: dread d0/d4d/f4c [0,4194304] 0 2023-12-05T13:25:04.479 INFO:tasks.workunit.client.1.smithi052.stdout:8/343: getdents d0/d28/d2b/d53 0 2023-12-05T13:25:04.479 INFO:tasks.workunit.client.1.smithi052.stdout:8/344: stat d0/l26 0 2023-12-05T13:25:04.480 INFO:tasks.workunit.client.1.smithi052.stdout:8/345: fdatasync d0/de/f41 0 2023-12-05T13:25:04.480 INFO:tasks.workunit.client.1.smithi052.stdout:8/346: stat d0/d4d 0 2023-12-05T13:25:04.480 INFO:tasks.workunit.client.1.smithi052.stdout:8/347: chown d0/c1 85 1 2023-12-05T13:25:04.480 INFO:tasks.workunit.client.1.smithi052.stdout:8/348: write d0/de/d27/f4e [2067053,2878] 0 2023-12-05T13:25:04.482 INFO:tasks.workunit.client.1.smithi052.stdout:8/349: link d0/d28/d39/d3a/l4b d0/de/l74 0 2023-12-05T13:25:04.501 INFO:tasks.workunit.client.1.smithi052.stdout:8/350: dwrite d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:25:04.502 INFO:tasks.workunit.client.1.smithi052.stdout:8/351: fdatasync d0/f32 0 2023-12-05T13:25:04.503 INFO:tasks.workunit.client.1.smithi052.stdout:8/352: mknod d0/d4d/c75 0 2023-12-05T13:25:04.506 INFO:tasks.workunit.client.1.smithi052.stdout:8/353: dread d0/f3e [0,4194304] 0 2023-12-05T13:25:04.522 INFO:tasks.workunit.client.1.smithi052.stdout:8/354: dwrite d0/de/f41 [4194304,4194304] 0 2023-12-05T13:25:04.544 INFO:tasks.workunit.client.1.smithi052.stdout:8/355: dwrite d0/de/d27/f4e [0,4194304] 0 2023-12-05T13:25:04.544 INFO:tasks.workunit.client.1.smithi052.stdout:8/356: chown d0/d28/d39/d3a/d4f/c68 6471158 1 2023-12-05T13:25:04.547 INFO:tasks.workunit.client.1.smithi052.stdout:8/357: getdents d0/d28/d2b 0 2023-12-05T13:25:04.547 INFO:tasks.workunit.client.1.smithi052.stdout:8/358: fsync d0/f21 0 2023-12-05T13:25:04.547 INFO:tasks.workunit.client.1.smithi052.stdout:8/359: chown d0/de/d27/c33 10092 1 2023-12-05T13:25:04.550 INFO:tasks.workunit.client.1.smithi052.stdout:8/360: truncate d0/d28/d2b/f31 210068 0 2023-12-05T13:25:04.552 INFO:tasks.workunit.client.1.smithi052.stdout:8/361: link d0/de/d12/d29/f50 d0/d51/f76 0 2023-12-05T13:25:04.554 INFO:tasks.workunit.client.1.smithi052.stdout:8/362: symlink d0/de/d27/l77 0 2023-12-05T13:25:04.554 INFO:tasks.workunit.client.1.smithi052.stdout:8/363: truncate d0/d28/d39/d3a/d4f/f55 430982 0 2023-12-05T13:25:04.569 INFO:tasks.workunit.client.1.smithi052.stdout:8/364: dwrite d0/d51/f76 [0,4194304] 0 2023-12-05T13:25:04.693 INFO:tasks.workunit.client.1.smithi052.stdout:8/365: truncate d0/de/f35 1380159 0 2023-12-05T13:25:04.696 INFO:tasks.workunit.client.1.smithi052.stdout:8/366: creat d0/d28/d2b/f78 x:0 0 0 2023-12-05T13:25:04.719 INFO:tasks.workunit.client.1.smithi052.stdout:8/367: dwrite d0/de/d12/f2e [0,4194304] 0 2023-12-05T13:25:04.720 INFO:tasks.workunit.client.1.smithi052.stdout:8/368: write d0/d28/d39/d3a/f5b [1075420,125389] 0 2023-12-05T13:25:04.720 INFO:tasks.workunit.client.1.smithi052.stdout:8/369: mkdir d0/d28/d2b/d53/d79 0 2023-12-05T13:25:04.721 INFO:tasks.workunit.client.1.smithi052.stdout:8/370: write d0/d28/d39/d3a/d4f/f55 [39834,73972] 0 2023-12-05T13:25:04.734 INFO:tasks.workunit.client.1.smithi052.stdout:8/371: dwrite d0/de/d12/f2e [4194304,4194304] 0 2023-12-05T13:25:04.735 INFO:tasks.workunit.client.1.smithi052.stdout:8/372: write d0/de/d12/d29/f50 [3728231,19415] 0 2023-12-05T13:25:04.735 INFO:tasks.workunit.client.1.smithi052.stdout:8/373: chown d0/d28/d2b/l34 97 1 2023-12-05T13:25:04.735 INFO:tasks.workunit.client.1.smithi052.stdout:8/374: truncate d0/de/f2f 1184708 0 2023-12-05T13:25:04.736 INFO:tasks.workunit.client.1.smithi052.stdout:8/375: chown d0/d28/d2b/f78 0 1 2023-12-05T13:25:04.739 INFO:tasks.workunit.client.1.smithi052.stdout:8/376: rename d0/d28/d39/d3a/c46 to d0/d28/d2b/d53/d56/c7a 0 2023-12-05T13:25:04.739 INFO:tasks.workunit.client.1.smithi052.stdout:8/377: write d0/d28/d2b/f78 [183144,114853] 0 2023-12-05T13:25:04.742 INFO:tasks.workunit.client.1.smithi052.stdout:8/378: rmdir d0/d62 39 2023-12-05T13:25:04.755 INFO:tasks.workunit.client.1.smithi052.stdout:8/379: dwrite d0/de/d27/f57 [0,4194304] 0 2023-12-05T13:25:04.755 INFO:tasks.workunit.client.1.smithi052.stdout:8/380: read d0/de/d27/d43/d44/f49 [1025209,67037] 0 2023-12-05T13:25:04.762 INFO:tasks.workunit.client.1.smithi052.stdout:8/381: dread d0/f5 [0,4194304] 0 2023-12-05T13:25:04.873 INFO:tasks.workunit.client.1.smithi052.stdout:8/382: dwrite d0/f3e [0,4194304] 0 2023-12-05T13:25:04.878 INFO:tasks.workunit.client.1.smithi052.stdout:8/383: rmdir d0/d28/d39 39 2023-12-05T13:25:04.878 INFO:tasks.workunit.client.1.smithi052.stdout:8/384: write d0/de/d27/f4e [8861779,93378] 0 2023-12-05T13:25:04.880 INFO:tasks.workunit.client.1.smithi052.stdout:8/385: link d0/d28/d2b/c64 d0/c7b 0 2023-12-05T13:25:04.880 INFO:tasks.workunit.client.1.smithi052.stdout:8/386: stat d0/de/d12/d29/c48 0 2023-12-05T13:25:04.964 INFO:tasks.workunit.client.1.smithi052.stdout:8/387: truncate d0/de/d12/f2e 5807417 0 2023-12-05T13:25:04.977 INFO:tasks.workunit.client.1.smithi052.stdout:8/388: dwrite d0/d28/d39/d3a/f5b [0,4194304] 0 2023-12-05T13:25:04.977 INFO:tasks.workunit.client.1.smithi052.stdout:8/389: fsync d0/de/d27/f4e 0 2023-12-05T13:25:04.979 INFO:tasks.workunit.client.1.smithi052.stdout:8/390: rmdir d0/d4d 39 2023-12-05T13:25:04.979 INFO:tasks.workunit.client.1.smithi052.stdout:8/391: chown d0/de/f38 171591 1 2023-12-05T13:25:04.979 INFO:tasks.workunit.client.1.smithi052.stdout:8/392: readlink d0/de/d27/d43/d44/l6d 0 2023-12-05T13:25:04.979 INFO:tasks.workunit.client.1.smithi052.stdout:8/393: fsync d0/de/f41 0 2023-12-05T13:25:04.981 INFO:tasks.workunit.client.1.smithi052.stdout:8/394: creat d0/d28/f7c x:0 0 0 2023-12-05T13:25:04.981 INFO:tasks.workunit.client.1.smithi052.stdout:8/395: chown d0/de/d12/f2e 59942 1 2023-12-05T13:25:04.983 INFO:tasks.workunit.client.1.smithi052.stdout:8/396: symlink d0/de/d27/d43/d44/l7d 0 2023-12-05T13:25:04.985 INFO:tasks.workunit.client.1.smithi052.stdout:8/397: creat d0/d62/f7e x:0 0 0 2023-12-05T13:25:04.987 INFO:tasks.workunit.client.1.smithi052.stdout:8/398: rmdir d0/de/d27/d43 39 2023-12-05T13:25:04.989 INFO:tasks.workunit.client.1.smithi052.stdout:8/399: creat d0/d28/d2b/f7f x:0 0 0 2023-12-05T13:25:04.990 INFO:tasks.workunit.client.1.smithi052.stdout:8/400: chown d0/de/l23 26625 1 2023-12-05T13:25:05.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:05 smithi029 ceph-mon[112128]: pgmap v202: 65 pgs: 65 active+clean; 727 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 46 MiB/s rd, 85 MiB/s wr, 219 op/s 2023-12-05T13:25:05.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:05 smithi052 ceph-mon[121072]: pgmap v202: 65 pgs: 65 active+clean; 727 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 46 MiB/s rd, 85 MiB/s wr, 219 op/s 2023-12-05T13:25:06.179 INFO:tasks.workunit.client.1.smithi052.stdout:4/272: sync 2023-12-05T13:25:06.181 INFO:tasks.workunit.client.1.smithi052.stdout:4/273: symlink de/d1e/d24/l5b 0 2023-12-05T13:25:06.183 INFO:tasks.workunit.client.1.smithi052.stdout:4/274: unlink de/d1e/d24/f38 0 2023-12-05T13:25:06.184 INFO:tasks.workunit.client.1.smithi052.stdout:4/275: readlink de/d1e/d24/l26 0 2023-12-05T13:25:06.201 INFO:tasks.workunit.client.1.smithi052.stdout:4/276: dwrite de/d30/f42 [0,4194304] 0 2023-12-05T13:25:06.713 INFO:tasks.workunit.client.1.smithi052.stdout:4/277: getdents de/d1e/d24 0 2023-12-05T13:25:06.713 INFO:tasks.workunit.client.1.smithi052.stdout:4/278: chown de/d30/c53 221333306 1 2023-12-05T13:25:06.713 INFO:tasks.workunit.client.1.smithi052.stdout:4/279: write de/d1e/d24/f4d [598639,36370] 0 2023-12-05T13:25:06.723 INFO:tasks.workunit.client.1.smithi052.stdout:4/280: dread de/d29/f2e [0,4194304] 0 2023-12-05T13:25:07.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:07 smithi029 ceph-mon[112128]: pgmap v203: 65 pgs: 65 active+clean; 768 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 93 MiB/s wr, 247 op/s 2023-12-05T13:25:07.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:07 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:07.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:07 smithi052 ceph-mon[121072]: pgmap v203: 65 pgs: 65 active+clean; 768 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 93 MiB/s wr, 247 op/s 2023-12-05T13:25:07.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:07 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:4/281: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:5/164: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:2/338: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:1/298: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:6/253: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:8/401: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:9/223: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:6/254: dread - d3/d4/d6/f46 zero size 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:0/413: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:1/299: write d5/d7/f12 [9118553,15215] 0 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:7/409: sync 2023-12-05T13:25:08.031 INFO:tasks.workunit.client.1.smithi052.stdout:3/301: sync 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:1/300: chown d5/d7/f50 15053 1 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:3/302: chown da/f21 73 1 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:3/303: readlink da/dd/d3d/l4d 0 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:7/410: read d7/d4e/d12/d3f/d46/f4a [3742472,87461] 0 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:7/411: dread - d7/d4e/d12/d3f/f7f zero size 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:4/282: mkdir de/d29/d48/d5c 0 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:0/414: write d0/db/d14/f26 [398561,97034] 0 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:4/283: stat de/d1e/d24/l5b 0 2023-12-05T13:25:08.032 INFO:tasks.workunit.client.1.smithi052.stdout:4/284: fsync de/f4b 0 2023-12-05T13:25:08.033 INFO:tasks.workunit.client.1.smithi052.stdout:5/165: symlink d5/df/d11/l39 0 2023-12-05T13:25:08.033 INFO:tasks.workunit.client.1.smithi052.stdout:5/166: chown d5/df/l13 43 1 2023-12-05T13:25:08.033 INFO:tasks.workunit.client.1.smithi052.stdout:8/402: symlink d0/de/d12/l80 0 2023-12-05T13:25:08.034 INFO:tasks.workunit.client.1.smithi052.stdout:9/224: symlink d3/d11/l47 0 2023-12-05T13:25:08.035 INFO:tasks.workunit.client.1.smithi052.stdout:9/225: read d3/d2a/f30 [222559,28857] 0 2023-12-05T13:25:08.035 INFO:tasks.workunit.client.1.smithi052.stdout:1/301: creat d5/d7/de/d18/d2e/f5b x:0 0 0 2023-12-05T13:25:08.037 INFO:tasks.workunit.client.1.smithi052.stdout:9/226: write d3/f24 [1201440,6679] 0 2023-12-05T13:25:08.037 INFO:tasks.workunit.client.1.smithi052.stdout:9/227: chown d3/d1e/c22 682296 1 2023-12-05T13:25:08.037 INFO:tasks.workunit.client.1.smithi052.stdout:3/304: creat da/dd/d3d/f63 x:0 0 0 2023-12-05T13:25:08.039 INFO:tasks.workunit.client.1.smithi052.stdout:0/415: mkdir d0/db/d52/d7f/d8f 0 2023-12-05T13:25:08.041 INFO:tasks.workunit.client.1.smithi052.stdout:5/167: truncate d5/fc 242886 0 2023-12-05T13:25:08.041 INFO:tasks.workunit.client.1.smithi052.stdout:5/168: truncate d5/d15/d33/f38 448394 0 2023-12-05T13:25:08.041 INFO:tasks.workunit.client.1.smithi052.stdout:9/228: read d3/d11/f13 [1379626,48842] 0 2023-12-05T13:25:08.042 INFO:tasks.workunit.client.1.smithi052.stdout:9/229: write d3/d2a/f2b [617450,53571] 0 2023-12-05T13:25:08.043 INFO:tasks.workunit.client.1.smithi052.stdout:8/403: mkdir d0/de/d12/d29/d81 0 2023-12-05T13:25:08.045 INFO:tasks.workunit.client.1.smithi052.stdout:1/302: creat d5/d7/d35/f5c x:0 0 0 2023-12-05T13:25:08.045 INFO:tasks.workunit.client.1.smithi052.stdout:3/305: stat da/d48/d50/l59 0 2023-12-05T13:25:08.047 INFO:tasks.workunit.client.1.smithi052.stdout:2/339: link d2/d13/d1e/f57 d2/d14/f66 0 2023-12-05T13:25:08.049 INFO:tasks.workunit.client.1.smithi052.stdout:0/416: dread d0/f2b [0,4194304] 0 2023-12-05T13:25:08.049 INFO:tasks.workunit.client.1.smithi052.stdout:0/417: fdatasync d0/db/d2e/f46 0 2023-12-05T13:25:08.054 INFO:tasks.workunit.client.1.smithi052.stdout:8/404: symlink d0/l82 0 2023-12-05T13:25:08.055 INFO:tasks.workunit.client.1.smithi052.stdout:1/303: mkdir d5/d7/de/d18/d5d 0 2023-12-05T13:25:08.055 INFO:tasks.workunit.client.1.smithi052.stdout:3/306: mknod da/d25/d33/d49/c64 0 2023-12-05T13:25:08.055 INFO:tasks.workunit.client.1.smithi052.stdout:5/169: creat d5/d15/d21/f3a x:0 0 0 2023-12-05T13:25:08.055 INFO:tasks.workunit.client.1.smithi052.stdout:8/405: write d0/de/f1f [1641809,30142] 0 2023-12-05T13:25:08.055 INFO:tasks.workunit.client.1.smithi052.stdout:9/230: dread d3/d11/d19/f27 [4194304,4194304] 0 2023-12-05T13:25:08.056 INFO:tasks.workunit.client.1.smithi052.stdout:2/340: creat d2/d13/d48/f67 x:0 0 0 2023-12-05T13:25:08.056 INFO:tasks.workunit.client.1.smithi052.stdout:2/341: getdents d2/d13/d37/d61 0 2023-12-05T13:25:08.057 INFO:tasks.workunit.client.1.smithi052.stdout:1/304: symlink d5/d7/de/d14/d2a/l5e 0 2023-12-05T13:25:08.061 INFO:tasks.workunit.client.1.smithi052.stdout:3/307: write da/d25/f31 [2083170,1817] 0 2023-12-05T13:25:08.061 INFO:tasks.workunit.client.1.smithi052.stdout:1/305: write d5/f2c [638752,118551] 0 2023-12-05T13:25:08.061 INFO:tasks.workunit.client.1.smithi052.stdout:3/308: chown da/d2e/d40/f5d 281509 1 2023-12-05T13:25:08.061 INFO:tasks.workunit.client.1.smithi052.stdout:9/231: getdents d3/d11/d19 0 2023-12-05T13:25:08.061 INFO:tasks.workunit.client.1.smithi052.stdout:3/309: dread da/ff [0,4194304] 0 2023-12-05T13:25:08.062 INFO:tasks.workunit.client.1.smithi052.stdout:4/285: dwrite de/d29/f2e [0,4194304] 0 2023-12-05T13:25:08.062 INFO:tasks.workunit.client.1.smithi052.stdout:3/310: chown da/d2e/d40/f5d 9 1 2023-12-05T13:25:08.062 INFO:tasks.workunit.client.1.smithi052.stdout:6/255: dwrite d3/f19 [0,4194304] 0 2023-12-05T13:25:08.063 INFO:tasks.workunit.client.1.smithi052.stdout:6/256: dread - d3/d4/d6/f46 zero size 2023-12-05T13:25:08.063 INFO:tasks.workunit.client.1.smithi052.stdout:6/257: readlink d3/d4/d6/l57 0 2023-12-05T13:25:08.063 INFO:tasks.workunit.client.1.smithi052.stdout:1/306: write d5/d7/f13 [3979730,114968] 0 2023-12-05T13:25:08.063 INFO:tasks.workunit.client.1.smithi052.stdout:2/342: symlink d2/d4/d3f/l68 0 2023-12-05T13:25:08.063 INFO:tasks.workunit.client.1.smithi052.stdout:2/343: write d2/d31/d3a/d4b/f60 [312465,97582] 0 2023-12-05T13:25:08.065 INFO:tasks.workunit.client.1.smithi052.stdout:8/406: dread d0/d28/d39/d3a/f5b [0,4194304] 0 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:9/232: rmdir d3/d1e/d37 39 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:7/412: dwrite d7/f73 [0,4194304] 0 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:0/418: dread d0/db/d33/f70 [0,4194304] 0 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:0/419: chown d0/db/d52 117049 1 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:0/420: dread - d0/db/d2e/f76 zero size 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:0/421: chown d0/db/d1b/d51/d55/d66/d77/l78 647976110 1 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:0/422: fsync d0/db/d1b/f37 0 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:3/311: write da/d2e/f3c [932328,71341] 0 2023-12-05T13:25:08.071 INFO:tasks.workunit.client.1.smithi052.stdout:4/286: link f4 de/d29/f5d 0 2023-12-05T13:25:08.072 INFO:tasks.workunit.client.1.smithi052.stdout:4/287: write de/d29/d48/f50 [922855,4178] 0 2023-12-05T13:25:08.072 INFO:tasks.workunit.client.1.smithi052.stdout:4/288: write f4 [5179873,22135] 0 2023-12-05T13:25:08.072 INFO:tasks.workunit.client.1.smithi052.stdout:4/289: write de/d29/f3d [617368,34724] 0 2023-12-05T13:25:08.080 INFO:tasks.workunit.client.1.smithi052.stdout:4/290: dread de/d30/f3c [0,4194304] 0 2023-12-05T13:25:08.080 INFO:tasks.workunit.client.1.smithi052.stdout:4/291: chown de/d30/l46 1362414962 1 2023-12-05T13:25:08.081 INFO:tasks.workunit.client.1.smithi052.stdout:4/292: write de/d30/f3c [1554131,74853] 0 2023-12-05T13:25:08.083 INFO:tasks.workunit.client.1.smithi052.stdout:6/258: dwrite d3/f29 [0,4194304] 0 2023-12-05T13:25:08.083 INFO:tasks.workunit.client.1.smithi052.stdout:4/293: dread de/d1e/d24/f4e [0,4194304] 0 2023-12-05T13:25:08.087 INFO:tasks.workunit.client.1.smithi052.stdout:1/307: creat d5/d26/d41/f5f x:0 0 0 2023-12-05T13:25:08.090 INFO:tasks.workunit.client.1.smithi052.stdout:0/423: dwrite d0/db/d14/f4f [0,4194304] 0 2023-12-05T13:25:08.092 INFO:tasks.workunit.client.1.smithi052.stdout:8/407: dwrite d0/de/f35 [0,4194304] 0 2023-12-05T13:25:08.092 INFO:tasks.workunit.client.1.smithi052.stdout:6/259: dread d3/f19 [0,4194304] 0 2023-12-05T13:25:08.092 INFO:tasks.workunit.client.1.smithi052.stdout:6/260: readlink d3/d4/df/l10 0 2023-12-05T13:25:08.093 INFO:tasks.workunit.client.1.smithi052.stdout:8/408: write d0/de/f35 [3684622,110488] 0 2023-12-05T13:25:08.094 INFO:tasks.workunit.client.1.smithi052.stdout:2/344: creat d2/d13/d37/f69 x:0 0 0 2023-12-05T13:25:08.102 INFO:tasks.workunit.client.1.smithi052.stdout:9/233: truncate d3/f2c 865121 0 2023-12-05T13:25:08.104 INFO:tasks.workunit.client.1.smithi052.stdout:7/413: creat d7/d4e/d45/d5a/d63/f88 x:0 0 0 2023-12-05T13:25:08.105 INFO:tasks.workunit.client.1.smithi052.stdout:4/294: dwrite de/d29/f5d [0,4194304] 0 2023-12-05T13:25:08.106 INFO:tasks.workunit.client.1.smithi052.stdout:3/312: mknod da/d25/d33/c65 0 2023-12-05T13:25:08.110 INFO:tasks.workunit.client.1.smithi052.stdout:3/313: write da/f11 [1035551,21272] 0 2023-12-05T13:25:08.112 INFO:tasks.workunit.client.1.smithi052.stdout:8/409: dwrite d0/f21 [0,4194304] 0 2023-12-05T13:25:08.113 INFO:tasks.workunit.client.1.smithi052.stdout:1/308: dwrite d5/d7/d35/d2f/d3e/f58 [0,4194304] 0 2023-12-05T13:25:08.113 INFO:tasks.workunit.client.1.smithi052.stdout:1/309: write d5/d7/d35/f5c [823888,17407] 0 2023-12-05T13:25:08.113 INFO:tasks.workunit.client.1.smithi052.stdout:8/410: dread d0/de/f2f [0,4194304] 0 2023-12-05T13:25:08.113 INFO:tasks.workunit.client.1.smithi052.stdout:8/411: fdatasync d0/de/f41 0 2023-12-05T13:25:08.114 INFO:tasks.workunit.client.1.smithi052.stdout:8/412: write d0/de/f35 [395623,52452] 0 2023-12-05T13:25:08.114 INFO:tasks.workunit.client.1.smithi052.stdout:8/413: write d0/d28/d39/d3a/d4f/f55 [1379261,3813] 0 2023-12-05T13:25:08.115 INFO:tasks.workunit.client.1.smithi052.stdout:1/310: fdatasync d5/d7/d35/f5c 0 2023-12-05T13:25:08.115 INFO:tasks.workunit.client.1.smithi052.stdout:1/311: stat d5/d7/de/d18/d2e/d4f 0 2023-12-05T13:25:08.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/424: truncate d0/db/d1b/d51/d55/d66/f86 3917804 0 2023-12-05T13:25:08.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/425: readlink d0/db/d14/l19 0 2023-12-05T13:25:08.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/426: readlink d0/db/d1b/d51/d55/l84 0 2023-12-05T13:25:08.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/427: chown d0/db/d1b/d51/d55/d66/f86 177 1 2023-12-05T13:25:08.128 INFO:tasks.workunit.client.1.smithi052.stdout:6/261: mknod d3/d5/d9/d52/c59 0 2023-12-05T13:25:08.128 INFO:tasks.workunit.client.1.smithi052.stdout:6/262: fsync d3/d5/d9/f2f 0 2023-12-05T13:25:08.128 INFO:tasks.workunit.client.1.smithi052.stdout:6/263: fdatasync d3/d4/df/d27/f56 0 2023-12-05T13:25:08.134 INFO:tasks.workunit.client.1.smithi052.stdout:9/234: unlink d3/d11/f13 0 2023-12-05T13:25:08.134 INFO:tasks.workunit.client.1.smithi052.stdout:1/312: dwrite d5/f2c [0,4194304] 0 2023-12-05T13:25:08.139 INFO:tasks.workunit.client.1.smithi052.stdout:7/414: rename d7/d4e/d45/f77 to d7/d4e/d12/d7d/f89 0 2023-12-05T13:25:08.139 INFO:tasks.workunit.client.1.smithi052.stdout:7/415: write d7/d4e/d45/d5a/d63/f88 [1026969,87096] 0 2023-12-05T13:25:08.142 INFO:tasks.workunit.client.1.smithi052.stdout:4/295: creat de/f5e x:0 0 0 2023-12-05T13:25:08.143 INFO:tasks.workunit.client.1.smithi052.stdout:9/235: dread d3/d11/f21 [0,4194304] 0 2023-12-05T13:25:08.145 INFO:tasks.workunit.client.1.smithi052.stdout:3/314: fdatasync da/d25/f37 0 2023-12-05T13:25:08.146 INFO:tasks.workunit.client.1.smithi052.stdout:6/264: dwrite d3/d4/d6/f7 [0,4194304] 0 2023-12-05T13:25:08.147 INFO:tasks.workunit.client.1.smithi052.stdout:6/265: read d3/f19 [3280102,46956] 0 2023-12-05T13:25:08.147 INFO:tasks.workunit.client.1.smithi052.stdout:6/266: dread - d3/d5/d9/d21/d48/f4e zero size 2023-12-05T13:25:08.151 INFO:tasks.workunit.client.1.smithi052.stdout:1/313: dwrite d5/f2c [4194304,4194304] 0 2023-12-05T13:25:08.151 INFO:tasks.workunit.client.1.smithi052.stdout:1/314: stat d5/d7/de/d18/d2e/f5b 0 2023-12-05T13:25:08.152 INFO:tasks.workunit.client.1.smithi052.stdout:8/414: mknod d0/de/d12/d29/c83 0 2023-12-05T13:25:08.154 INFO:tasks.workunit.client.1.smithi052.stdout:0/428: unlink d0/db/d33/l38 0 2023-12-05T13:25:08.155 INFO:tasks.workunit.client.1.smithi052.stdout:0/429: fsync d0/db/d1b/f37 0 2023-12-05T13:25:08.157 INFO:tasks.workunit.client.1.smithi052.stdout:2/345: mkdir d2/d13/d1e/d6a 0 2023-12-05T13:25:08.161 INFO:tasks.workunit.client.1.smithi052.stdout:7/416: rename d7/d4e/d45/c48 to d7/d4e/d45/d5a/c8a 0 2023-12-05T13:25:08.162 INFO:tasks.workunit.client.1.smithi052.stdout:4/296: mknod de/d29/c5f 0 2023-12-05T13:25:08.164 INFO:tasks.workunit.client.1.smithi052.stdout:9/236: creat d3/d11/f48 x:0 0 0 2023-12-05T13:25:08.164 INFO:tasks.workunit.client.1.smithi052.stdout:9/237: dread - d3/d31/f45 zero size 2023-12-05T13:25:08.165 INFO:tasks.workunit.client.1.smithi052.stdout:3/315: mknod da/d25/d33/d43/c66 0 2023-12-05T13:25:08.169 INFO:tasks.workunit.client.1.smithi052.stdout:6/267: creat d3/d5/f5a x:0 0 0 2023-12-05T13:25:08.170 INFO:tasks.workunit.client.1.smithi052.stdout:6/268: dread d3/d4/d6/f4b [0,4194304] 0 2023-12-05T13:25:08.170 INFO:tasks.workunit.client.1.smithi052.stdout:6/269: chown d3/d4/d6 0 1 2023-12-05T13:25:08.176 INFO:tasks.workunit.client.1.smithi052.stdout:1/315: mknod d5/d7/d35/d2f/c60 0 2023-12-05T13:25:08.178 INFO:tasks.workunit.client.1.smithi052.stdout:8/415: mknod d0/d51/c84 0 2023-12-05T13:25:08.179 INFO:tasks.workunit.client.1.smithi052.stdout:0/430: mknod d0/db/d52/d7f/c90 0 2023-12-05T13:25:08.179 INFO:tasks.workunit.client.1.smithi052.stdout:0/431: chown d0/db/d1b/d51/f69 373568 1 2023-12-05T13:25:08.181 INFO:tasks.workunit.client.1.smithi052.stdout:2/346: mknod d2/d13/d1e/d6a/c6b 0 2023-12-05T13:25:08.183 INFO:tasks.workunit.client.1.smithi052.stdout:7/417: creat d7/d4e/d12/f8b x:0 0 0 2023-12-05T13:25:08.185 INFO:tasks.workunit.client.1.smithi052.stdout:4/297: mkdir de/d30/d60 0 2023-12-05T13:25:08.187 INFO:tasks.workunit.client.1.smithi052.stdout:9/238: symlink d3/d11/d19/l49 0 2023-12-05T13:25:08.189 INFO:tasks.workunit.client.1.smithi052.stdout:3/316: rmdir da/d2e 39 2023-12-05T13:25:08.190 INFO:tasks.workunit.client.1.smithi052.stdout:6/270: mkdir d3/d5/d9/d21/d48/d5b 0 2023-12-05T13:25:08.193 INFO:tasks.workunit.client.1.smithi052.stdout:1/316: rename d5/cb to d5/d7/de/c61 0 2023-12-05T13:25:08.193 INFO:tasks.workunit.client.1.smithi052.stdout:1/317: chown d5/d7/d52/l53 0 1 2023-12-05T13:25:08.199 INFO:tasks.workunit.client.1.smithi052.stdout:4/298: symlink de/l61 0 2023-12-05T13:25:08.201 INFO:tasks.workunit.client.1.smithi052.stdout:7/418: dwrite d7/d4e/d45/f51 [0,4194304] 0 2023-12-05T13:25:08.202 INFO:tasks.workunit.client.1.smithi052.stdout:9/239: symlink d3/d1e/d37/l4a 0 2023-12-05T13:25:08.204 INFO:tasks.workunit.client.1.smithi052.stdout:3/317: creat da/d25/d33/d43/d5b/f67 x:0 0 0 2023-12-05T13:25:08.205 INFO:tasks.workunit.client.1.smithi052.stdout:1/318: mkdir d5/d7/d35/d2f/d3e/d62 0 2023-12-05T13:25:08.208 INFO:tasks.workunit.client.1.smithi052.stdout:2/347: unlink d2/d13/c35 0 2023-12-05T13:25:08.209 INFO:tasks.workunit.client.1.smithi052.stdout:2/348: fdatasync d2/d13/d45/f4a 0 2023-12-05T13:25:08.211 INFO:tasks.workunit.client.1.smithi052.stdout:2/349: dread d2/d31/d3a/d4b/f60 [0,4194304] 0 2023-12-05T13:25:08.212 INFO:tasks.workunit.client.1.smithi052.stdout:9/240: truncate d3/d1e/f36 68438 0 2023-12-05T13:25:08.215 INFO:tasks.workunit.client.1.smithi052.stdout:3/318: link da/d25/d33/c41 da/d25/d33/d43/d5b/c68 0 2023-12-05T13:25:08.216 INFO:tasks.workunit.client.1.smithi052.stdout:1/319: symlink d5/d7/d35/d37/l63 0 2023-12-05T13:25:08.219 INFO:tasks.workunit.client.1.smithi052.stdout:2/350: creat d2/d13/d37/d61/f6c x:0 0 0 2023-12-05T13:25:08.219 INFO:tasks.workunit.client.1.smithi052.stdout:2/351: stat d2/d4/f23 0 2023-12-05T13:25:08.222 INFO:tasks.workunit.client.1.smithi052.stdout:2/352: write d2/d14/f39 [1237148,17488] 0 2023-12-05T13:25:08.225 INFO:tasks.workunit.client.1.smithi052.stdout:9/241: mknod d3/d31/c4b 0 2023-12-05T13:25:08.225 INFO:tasks.workunit.client.1.smithi052.stdout:9/242: read d3/d11/d19/f2e [3833250,99088] 0 2023-12-05T13:25:08.226 INFO:tasks.workunit.client.1.smithi052.stdout:3/319: mknod da/d27/c69 0 2023-12-05T13:25:08.226 INFO:tasks.workunit.client.1.smithi052.stdout:3/320: truncate da/f23 990079 0 2023-12-05T13:25:08.226 INFO:tasks.workunit.client.1.smithi052.stdout:3/321: chown da/d48/d50 361246 1 2023-12-05T13:25:08.227 INFO:tasks.workunit.client.1.smithi052.stdout:9/243: write d3/f15 [3410004,40492] 0 2023-12-05T13:25:08.227 INFO:tasks.workunit.client.1.smithi052.stdout:9/244: read d3/f24 [3640221,95134] 0 2023-12-05T13:25:08.231 INFO:tasks.workunit.client.1.smithi052.stdout:2/353: mkdir d2/d4/d63/d6d 0 2023-12-05T13:25:08.232 INFO:tasks.workunit.client.1.smithi052.stdout:3/322: readlink da/d25/l4c 0 2023-12-05T13:25:08.232 INFO:tasks.workunit.client.1.smithi052.stdout:3/323: readlink l8 0 2023-12-05T13:25:08.232 INFO:tasks.workunit.client.1.smithi052.stdout:1/320: dwrite d5/d7/d35/f3d [0,4194304] 0 2023-12-05T13:25:08.235 INFO:tasks.workunit.client.1.smithi052.stdout:9/245: rmdir d3/d1e/d41 39 2023-12-05T13:25:08.235 INFO:tasks.workunit.client.1.smithi052.stdout:9/246: chown d3/d1e/d37 905995 1 2023-12-05T13:25:08.236 INFO:tasks.workunit.client.1.smithi052.stdout:9/247: chown d3/d11/f48 0 1 2023-12-05T13:25:08.239 INFO:tasks.workunit.client.1.smithi052.stdout:2/354: read d2/d13/d1e/f25 [171297,48430] 0 2023-12-05T13:25:08.239 INFO:tasks.workunit.client.1.smithi052.stdout:2/355: write d2/d13/d48/f67 [520876,15947] 0 2023-12-05T13:25:08.241 INFO:tasks.workunit.client.1.smithi052.stdout:3/324: getdents da/d25 0 2023-12-05T13:25:08.241 INFO:tasks.workunit.client.1.smithi052.stdout:1/321: creat d5/f64 x:0 0 0 2023-12-05T13:25:08.241 INFO:tasks.workunit.client.1.smithi052.stdout:3/325: fdatasync da/d2e/d40/f5d 0 2023-12-05T13:25:08.245 INFO:tasks.workunit.client.1.smithi052.stdout:3/326: write da/d27/f2d [419696,91350] 0 2023-12-05T13:25:08.252 INFO:tasks.workunit.client.1.smithi052.stdout:2/356: dwrite d2/d13/f26 [4194304,4194304] 0 2023-12-05T13:25:08.255 INFO:tasks.workunit.client.1.smithi052.stdout:3/327: symlink da/d25/l6a 0 2023-12-05T13:25:08.257 INFO:tasks.workunit.client.1.smithi052.stdout:2/357: mkdir d2/d31/d6e 0 2023-12-05T13:25:08.257 INFO:tasks.workunit.client.1.smithi052.stdout:2/358: dread - d2/d13/d45/f4a zero size 2023-12-05T13:25:08.257 INFO:tasks.workunit.client.1.smithi052.stdout:2/359: truncate d2/f2b 1188625 0 2023-12-05T13:25:08.258 INFO:tasks.workunit.client.1.smithi052.stdout:1/322: dwrite d5/d7/de/d14/f32 [0,4194304] 0 2023-12-05T13:25:08.258 INFO:tasks.workunit.client.1.smithi052.stdout:1/323: write d5/d7/de/d14/d2a/f49 [1441051,17763] 0 2023-12-05T13:25:08.260 INFO:tasks.workunit.client.1.smithi052.stdout:3/328: mknod da/dd/c6b 0 2023-12-05T13:25:08.260 INFO:tasks.workunit.client.1.smithi052.stdout:3/329: fdatasync da/d2e/d40/f5d 0 2023-12-05T13:25:08.261 INFO:tasks.workunit.client.1.smithi052.stdout:2/360: mknod d2/d4/d63/d6d/c6f 0 2023-12-05T13:25:08.261 INFO:tasks.workunit.client.1.smithi052.stdout:2/361: fsync d2/d13/d45/f4d 0 2023-12-05T13:25:08.266 INFO:tasks.workunit.client.1.smithi052.stdout:1/324: dread d5/d7/d35/f3d [0,4194304] 0 2023-12-05T13:25:08.272 INFO:tasks.workunit.client.1.smithi052.stdout:3/330: mknod da/d25/d33/d51/c6c 0 2023-12-05T13:25:08.275 INFO:tasks.workunit.client.1.smithi052.stdout:1/325: dread d5/f8 [4194304,4194304] 0 2023-12-05T13:25:08.276 INFO:tasks.workunit.client.1.smithi052.stdout:1/326: write d5/f8 [1090838,30120] 0 2023-12-05T13:25:08.276 INFO:tasks.workunit.client.1.smithi052.stdout:1/327: getdents d5/d7/d35/d37/d5a 0 2023-12-05T13:25:08.276 INFO:tasks.workunit.client.1.smithi052.stdout:2/362: write d2/d13/d1e/f46 [2378784,83841] 0 2023-12-05T13:25:08.277 INFO:tasks.workunit.client.1.smithi052.stdout:1/328: read d5/d7/de/d14/d2a/f3b [1157248,73784] 0 2023-12-05T13:25:08.280 INFO:tasks.workunit.client.1.smithi052.stdout:2/363: write d2/f3c [1583912,12901] 0 2023-12-05T13:25:08.280 INFO:tasks.workunit.client.1.smithi052.stdout:3/331: dread da/f11 [0,4194304] 0 2023-12-05T13:25:08.280 INFO:tasks.workunit.client.1.smithi052.stdout:3/332: write da/d2e/d40/f5d [12661,65700] 0 2023-12-05T13:25:08.282 INFO:tasks.workunit.client.1.smithi052.stdout:2/364: mknod d2/d31/c70 0 2023-12-05T13:25:08.284 INFO:tasks.workunit.client.1.smithi052.stdout:3/333: mkdir da/d2e/d40/d6d 0 2023-12-05T13:25:08.289 INFO:tasks.workunit.client.1.smithi052.stdout:2/365: truncate d2/d13/d1e/f27 4438135 0 2023-12-05T13:25:08.292 INFO:tasks.workunit.client.1.smithi052.stdout:2/366: creat d2/d13/d1e/f71 x:0 0 0 2023-12-05T13:25:08.427 INFO:tasks.workunit.client.1.smithi052.stdout:1/329: rmdir d5/d26/d41 39 2023-12-05T13:25:08.428 INFO:tasks.workunit.client.1.smithi052.stdout:8/416: truncate d0/de/f1f 1235743 0 2023-12-05T13:25:08.430 INFO:tasks.workunit.client.1.smithi052.stdout:1/330: mkdir d5/d7/de/d18/d2e/d65 0 2023-12-05T13:25:08.430 INFO:tasks.workunit.client.1.smithi052.stdout:1/331: write d5/d26/d41/f5f [657841,116337] 0 2023-12-05T13:25:08.431 INFO:tasks.workunit.client.1.smithi052.stdout:8/417: link d0/d28/d2b/f31 d0/de/d12/f85 0 2023-12-05T13:25:08.449 INFO:tasks.workunit.client.1.smithi052.stdout:8/418: dwrite d0/d28/d2b/f7f [0,4194304] 0 2023-12-05T13:25:08.450 INFO:tasks.workunit.client.1.smithi052.stdout:8/419: write d0/de/d27/f4e [8121411,52234] 0 2023-12-05T13:25:08.451 INFO:tasks.workunit.client.1.smithi052.stdout:8/420: write d0/d28/d39/d3a/d4f/f55 [420230,113278] 0 2023-12-05T13:25:08.457 INFO:tasks.workunit.client.1.smithi052.stdout:8/421: getdents d0/d28/d2b/d53 0 2023-12-05T13:25:08.461 INFO:tasks.workunit.client.1.smithi052.stdout:8/422: mkdir d0/de/d86 0 2023-12-05T13:25:08.463 INFO:tasks.workunit.client.1.smithi052.stdout:8/423: unlink d0/c2c 0 2023-12-05T13:25:08.467 INFO:tasks.workunit.client.1.smithi052.stdout:7/419: rename d7/d4e/d12/d7d/f89 to d7/d4e/d45/d5a/d66/f8c 0 2023-12-05T13:25:08.470 INFO:tasks.workunit.client.1.smithi052.stdout:2/367: rename d2/d4/l30 to d2/d31/d6e/l72 0 2023-12-05T13:25:08.471 INFO:tasks.workunit.client.1.smithi052.stdout:2/368: truncate d2/d13/d48/f67 814453 0 2023-12-05T13:25:08.471 INFO:tasks.workunit.client.1.smithi052.stdout:2/369: chown d2/d4 11 1 2023-12-05T13:25:08.472 INFO:tasks.workunit.client.1.smithi052.stdout:7/420: creat d7/d4e/d12/f8d x:0 0 0 2023-12-05T13:25:08.473 INFO:tasks.workunit.client.1.smithi052.stdout:7/421: read d7/d4e/f36 [1852220,118859] 0 2023-12-05T13:25:08.476 INFO:tasks.workunit.client.1.smithi052.stdout:8/424: dwrite d0/de/f2f [0,4194304] 0 2023-12-05T13:25:08.479 INFO:tasks.workunit.client.1.smithi052.stdout:1/332: rename d5/f3a to d5/d26/f66 0 2023-12-05T13:25:08.479 INFO:tasks.workunit.client.1.smithi052.stdout:2/370: mknod d2/d13/d48/c73 0 2023-12-05T13:25:08.480 INFO:tasks.workunit.client.1.smithi052.stdout:8/425: dread d0/de/d12/f2e [4194304,4194304] 0 2023-12-05T13:25:08.489 INFO:tasks.workunit.client.1.smithi052.stdout:7/422: rename d7/d4e/d45/d5a/c8a to d7/d4e/d12/d3f/d46/c8e 0 2023-12-05T13:25:08.491 INFO:tasks.workunit.client.1.smithi052.stdout:2/371: link d2/f59 d2/d13/d37/d5c/f74 0 2023-12-05T13:25:08.495 INFO:tasks.workunit.client.1.smithi052.stdout:1/333: dwrite d5/d7/d35/d2f/d3e/f54 [0,4194304] 0 2023-12-05T13:25:08.496 INFO:tasks.workunit.client.1.smithi052.stdout:8/426: creat d0/d28/f87 x:0 0 0 2023-12-05T13:25:08.496 INFO:tasks.workunit.client.1.smithi052.stdout:8/427: dread - d0/d28/f7c zero size 2023-12-05T13:25:08.496 INFO:tasks.workunit.client.1.smithi052.stdout:2/372: symlink d2/d31/d6e/l75 0 2023-12-05T13:25:08.497 INFO:tasks.workunit.client.1.smithi052.stdout:1/334: dread d5/d7/f47 [0,4194304] 0 2023-12-05T13:25:08.499 INFO:tasks.workunit.client.1.smithi052.stdout:8/428: mknod d0/de/d27/d43/c88 0 2023-12-05T13:25:08.499 INFO:tasks.workunit.client.1.smithi052.stdout:8/429: getdents d0/d28/d39/d3a/d4f 0 2023-12-05T13:25:08.501 INFO:tasks.workunit.client.1.smithi052.stdout:2/373: creat d2/d4/d63/f76 x:0 0 0 2023-12-05T13:25:08.503 INFO:tasks.workunit.client.1.smithi052.stdout:4/299: truncate de/d29/f5d 4306914 0 2023-12-05T13:25:08.504 INFO:tasks.workunit.client.1.smithi052.stdout:4/300: fdatasync de/d1e/d24/f35 0 2023-12-05T13:25:08.505 INFO:tasks.workunit.client.1.smithi052.stdout:7/423: dwrite d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:25:08.507 INFO:tasks.workunit.client.1.smithi052.stdout:1/335: mknod d5/d7/d35/d2f/c67 0 2023-12-05T13:25:08.508 INFO:tasks.workunit.client.1.smithi052.stdout:5/170: sync 2023-12-05T13:25:08.508 INFO:tasks.workunit.client.1.smithi052.stdout:4/301: truncate de/d29/d48/f50 238787 0 2023-12-05T13:25:08.509 INFO:tasks.workunit.client.1.smithi052.stdout:7/424: creat d7/d4e/d45/d50/f8f x:0 0 0 2023-12-05T13:25:08.511 INFO:tasks.workunit.client.1.smithi052.stdout:8/430: dread d0/d28/d39/d3a/f67 [0,4194304] 0 2023-12-05T13:25:08.513 INFO:tasks.workunit.client.1.smithi052.stdout:2/374: link d2/d13/d1e/l2d d2/d13/d37/l77 0 2023-12-05T13:25:08.513 INFO:tasks.workunit.client.1.smithi052.stdout:2/375: write d2/f2a [630666,72717] 0 2023-12-05T13:25:08.517 INFO:tasks.workunit.client.1.smithi052.stdout:1/336: rename d5/d7/de/d14 to d5/d7/d35/d37/d68 0 2023-12-05T13:25:08.518 INFO:tasks.workunit.client.1.smithi052.stdout:1/337: stat d5/d7/de/d18/d2e/d65 0 2023-12-05T13:25:08.519 INFO:tasks.workunit.client.1.smithi052.stdout:7/425: dread d7/d4e/d45/d5a/d16/f30 [0,4194304] 0 2023-12-05T13:25:08.519 INFO:tasks.workunit.client.1.smithi052.stdout:7/426: chown d7/d4e/d45/d5a/d16/l3b 1021892 1 2023-12-05T13:25:08.519 INFO:tasks.workunit.client.1.smithi052.stdout:7/427: stat d7/d4e/l10 0 2023-12-05T13:25:08.521 INFO:tasks.workunit.client.1.smithi052.stdout:5/171: mknod d5/c3b 0 2023-12-05T13:25:08.521 INFO:tasks.workunit.client.1.smithi052.stdout:5/172: fsync d5/d15/d21/f2e 0 2023-12-05T13:25:08.521 INFO:tasks.workunit.client.1.smithi052.stdout:4/302: symlink de/d30/d60/l62 0 2023-12-05T13:25:08.521 INFO:tasks.workunit.client.1.smithi052.stdout:4/303: chown de/d2b/l3e 461563473 1 2023-12-05T13:25:08.524 INFO:tasks.workunit.client.1.smithi052.stdout:4/304: dread de/f4a [0,4194304] 0 2023-12-05T13:25:08.529 INFO:tasks.workunit.client.1.smithi052.stdout:2/376: creat d2/d13/d37/d5c/f78 x:0 0 0 2023-12-05T13:25:08.529 INFO:tasks.workunit.client.1.smithi052.stdout:1/338: dread d5/d7/f13 [0,4194304] 0 2023-12-05T13:25:08.533 INFO:tasks.workunit.client.1.smithi052.stdout:4/305: write de/d29/f2e [3178361,125597] 0 2023-12-05T13:25:08.543 INFO:tasks.workunit.client.1.smithi052.stdout:1/339: mkdir d5/d7/d35/d37/d68/d69 0 2023-12-05T13:25:08.544 INFO:tasks.workunit.client.1.smithi052.stdout:7/428: dwrite d7/d4e/d45/d5a/d63/f7a [0,4194304] 0 2023-12-05T13:25:08.548 INFO:tasks.workunit.client.1.smithi052.stdout:5/173: dwrite d5/d15/f18 [0,4194304] 0 2023-12-05T13:25:08.550 INFO:tasks.workunit.client.1.smithi052.stdout:2/377: dwrite d2/d13/d37/d5c/f78 [0,4194304] 0 2023-12-05T13:25:08.551 INFO:tasks.workunit.client.1.smithi052.stdout:7/429: symlink d7/d4e/d86/l90 0 2023-12-05T13:25:08.559 INFO:tasks.workunit.client.1.smithi052.stdout:5/174: dwrite d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:25:08.559 INFO:tasks.workunit.client.1.smithi052.stdout:5/175: write d5/df/f20 [999218,87681] 0 2023-12-05T13:25:08.562 INFO:tasks.workunit.client.1.smithi052.stdout:7/430: rename d7/d2e/d6c to d7/d4e/d45/d79/d91 0 2023-12-05T13:25:08.566 INFO:tasks.workunit.client.1.smithi052.stdout:5/176: creat d5/d15/f3c x:0 0 0 2023-12-05T13:25:08.566 INFO:tasks.workunit.client.1.smithi052.stdout:5/177: chown d5/d15/d21/d25 9 1 2023-12-05T13:25:08.568 INFO:tasks.workunit.client.1.smithi052.stdout:2/378: link d2/d13/d37/d61/f6c d2/d31/d3a/d4b/f79 0 2023-12-05T13:25:08.568 INFO:tasks.workunit.client.1.smithi052.stdout:2/379: readlink d2/l4e 0 2023-12-05T13:25:08.570 INFO:tasks.workunit.client.1.smithi052.stdout:5/178: mknod d5/d15/c3d 0 2023-12-05T13:25:08.571 INFO:tasks.workunit.client.1.smithi052.stdout:3/334: getdents da/d25 0 2023-12-05T13:25:08.574 INFO:tasks.workunit.client.1.smithi052.stdout:2/380: unlink d2/d13/f16 0 2023-12-05T13:25:08.575 INFO:tasks.workunit.client.1.smithi052.stdout:2/381: read d2/d13/d48/f67 [265884,118884] 0 2023-12-05T13:25:08.576 INFO:tasks.workunit.client.1.smithi052.stdout:5/179: symlink d5/df/d11/l3e 0 2023-12-05T13:25:08.578 INFO:tasks.workunit.client.1.smithi052.stdout:3/335: creat da/f6e x:0 0 0 2023-12-05T13:25:08.579 INFO:tasks.workunit.client.1.smithi052.stdout:7/431: dwrite d7/d31/d56/d60/f76 [4194304,4194304] 0 2023-12-05T13:25:08.579 INFO:tasks.workunit.client.1.smithi052.stdout:3/336: chown da/d48/f53 59688 1 2023-12-05T13:25:08.580 INFO:tasks.workunit.client.1.smithi052.stdout:5/180: mkdir d5/d15/d21/d25/d3f 0 2023-12-05T13:25:08.580 INFO:tasks.workunit.client.1.smithi052.stdout:5/181: write d5/d15/d21/f23 [178882,73365] 0 2023-12-05T13:25:08.581 INFO:tasks.workunit.client.1.smithi052.stdout:3/337: getdents da/d25/d33/d43/d5b 0 2023-12-05T13:25:08.585 INFO:tasks.workunit.client.1.smithi052.stdout:5/182: mknod d5/d15/c40 0 2023-12-05T13:25:08.585 INFO:tasks.workunit.client.1.smithi052.stdout:5/183: chown d5/c3b 58 1 2023-12-05T13:25:08.586 INFO:tasks.workunit.client.1.smithi052.stdout:5/184: stat d5/df/d11/l28 0 2023-12-05T13:25:08.586 INFO:tasks.workunit.client.1.smithi052.stdout:3/338: creat da/d25/f6f x:0 0 0 2023-12-05T13:25:08.587 INFO:tasks.workunit.client.1.smithi052.stdout:3/339: chown da/dd/c15 3 1 2023-12-05T13:25:08.588 INFO:tasks.workunit.client.1.smithi052.stdout:5/185: mkdir d5/d15/d21/d41 0 2023-12-05T13:25:08.590 INFO:tasks.workunit.client.1.smithi052.stdout:5/186: creat d5/d15/f42 x:0 0 0 2023-12-05T13:25:08.591 INFO:tasks.workunit.client.1.smithi052.stdout:2/382: dwrite d2/d14/f5a [0,4194304] 0 2023-12-05T13:25:08.591 INFO:tasks.workunit.client.1.smithi052.stdout:2/383: truncate d2/d13/d37/f69 97949 0 2023-12-05T13:25:08.603 INFO:tasks.workunit.client.1.smithi052.stdout:3/340: dwrite f4 [0,4194304] 0 2023-12-05T13:25:08.603 INFO:tasks.workunit.client.1.smithi052.stdout:2/384: rmdir d2/d51 0 2023-12-05T13:25:08.603 INFO:tasks.workunit.client.1.smithi052.stdout:2/385: chown d2/f5d 476285 1 2023-12-05T13:25:08.612 INFO:tasks.workunit.client.1.smithi052.stdout:3/341: symlink da/d27/l70 0 2023-12-05T13:25:08.614 INFO:tasks.workunit.client.1.smithi052.stdout:2/386: write d2/d13/d1e/f3d [90625,16345] 0 2023-12-05T13:25:08.621 INFO:tasks.workunit.client.1.smithi052.stdout:2/387: creat d2/d31/d6e/f7a x:0 0 0 2023-12-05T13:25:08.621 INFO:tasks.workunit.client.1.smithi052.stdout:2/388: write d2/d14/f5a [3677797,9451] 0 2023-12-05T13:25:08.622 INFO:tasks.workunit.client.1.smithi052.stdout:2/389: read d2/d13/d1e/f57 [2423753,47889] 0 2023-12-05T13:25:08.622 INFO:tasks.workunit.client.1.smithi052.stdout:2/390: truncate d2/d31/d3a/d4b/f79 805894 0 2023-12-05T13:25:08.623 INFO:tasks.workunit.client.1.smithi052.stdout:2/391: chown d2/d31/d6e/l72 102218 1 2023-12-05T13:25:08.623 INFO:tasks.workunit.client.1.smithi052.stdout:2/392: chown d2/d31/d3a 3411099 1 2023-12-05T13:25:08.624 INFO:tasks.workunit.client.1.smithi052.stdout:2/393: symlink d2/d4/d63/d6d/l7b 0 2023-12-05T13:25:08.625 INFO:tasks.workunit.client.1.smithi052.stdout:2/394: read d2/d14/f5a [3675710,103230] 0 2023-12-05T13:25:08.628 INFO:tasks.workunit.client.1.smithi052.stdout:2/395: mkdir d2/d13/d7c 0 2023-12-05T13:25:08.634 INFO:tasks.workunit.client.1.smithi052.stdout:2/396: dread d2/d13/d37/d5c/f74 [0,4194304] 0 2023-12-05T13:25:08.635 INFO:tasks.workunit.client.1.smithi052.stdout:2/397: chown d2/d13/d37/d5c 1 1 2023-12-05T13:25:08.647 INFO:tasks.workunit.client.1.smithi052.stdout:2/398: dwrite d2/d13/d1e/f57 [4194304,4194304] 0 2023-12-05T13:25:08.654 INFO:tasks.workunit.client.1.smithi052.stdout:2/399: link d2/f2b d2/d13/d1e/f7d 0 2023-12-05T13:25:08.654 INFO:tasks.workunit.client.1.smithi052.stdout:2/400: dread - d2/d4/f58 zero size 2023-12-05T13:25:08.666 INFO:tasks.workunit.client.1.smithi052.stdout:2/401: dwrite d2/d13/f26 [4194304,4194304] 0 2023-12-05T13:25:08.678 INFO:tasks.workunit.client.1.smithi052.stdout:2/402: dwrite d2/d13/d45/f4a [0,4194304] 0 2023-12-05T13:25:08.690 INFO:tasks.workunit.client.1.smithi052.stdout:2/403: dwrite d2/d13/d37/d61/f6c [0,4194304] 0 2023-12-05T13:25:08.693 INFO:tasks.workunit.client.1.smithi052.stdout:2/404: creat d2/d13/d37/d61/f7e x:0 0 0 2023-12-05T13:25:08.821 INFO:tasks.workunit.client.1.smithi052.stdout:2/405: write d2/d13/d37/d5c/f78 [5122725,128096] 0 2023-12-05T13:25:08.821 INFO:tasks.workunit.client.1.smithi052.stdout:2/406: fsync d2/d13/d1e/f57 0 2023-12-05T13:25:08.832 INFO:tasks.workunit.client.1.smithi052.stdout:7/432: dwrite d7/d4e/d45/d5a/d63/f7a [4194304,4194304] 0 2023-12-05T13:25:08.832 INFO:tasks.workunit.client.1.smithi052.stdout:7/433: fdatasync d7/d4e/d45/f5b 0 2023-12-05T13:25:08.840 INFO:tasks.workunit.client.1.smithi052.stdout:7/434: rmdir d7/d4e/d45/d79 39 2023-12-05T13:25:08.841 INFO:tasks.workunit.client.1.smithi052.stdout:3/342: getdents da 0 2023-12-05T13:25:08.841 INFO:tasks.workunit.client.1.smithi052.stdout:3/343: write da/dd/f30 [286250,99006] 0 2023-12-05T13:25:08.842 INFO:tasks.workunit.client.1.smithi052.stdout:7/435: mknod d7/d4e/d12/d3f/d46/c92 0 2023-12-05T13:25:08.843 INFO:tasks.workunit.client.1.smithi052.stdout:7/436: write d7/d4e/d45/d5a/d63/f6d [764303,57480] 0 2023-12-05T13:25:08.844 INFO:tasks.workunit.client.1.smithi052.stdout:3/344: getdents da/d25/d33 0 2023-12-05T13:25:08.846 INFO:tasks.workunit.client.1.smithi052.stdout:2/407: dwrite d2/d13/d37/d5c/f78 [0,4194304] 0 2023-12-05T13:25:08.846 INFO:tasks.workunit.client.1.smithi052.stdout:7/437: mkdir d7/d4e/d45/d93 0 2023-12-05T13:25:08.846 INFO:tasks.workunit.client.1.smithi052.stdout:2/408: write d2/f2f [3666004,74909] 0 2023-12-05T13:25:08.849 INFO:tasks.workunit.client.1.smithi052.stdout:3/345: rename da/ff to da/d48/d50/f71 0 2023-12-05T13:25:08.850 INFO:tasks.workunit.client.1.smithi052.stdout:2/409: mkdir d2/d13/d1e/d6a/d7f 0 2023-12-05T13:25:08.852 INFO:tasks.workunit.client.1.smithi052.stdout:3/346: symlink da/d25/d33/d43/d5b/l72 0 2023-12-05T13:25:08.853 INFO:tasks.workunit.client.1.smithi052.stdout:3/347: write da/dd/d3d/f4f [782052,29116] 0 2023-12-05T13:25:08.856 INFO:tasks.workunit.client.1.smithi052.stdout:7/438: rename d7/d4e/d45/d5a/d63/f88 to d7/d4e/d45/f94 0 2023-12-05T13:25:08.858 INFO:tasks.workunit.client.1.smithi052.stdout:3/348: link da/d25/f37 da/d25/d33/d49/f73 0 2023-12-05T13:25:08.862 INFO:tasks.workunit.client.1.smithi052.stdout:7/439: mkdir d7/d4e/d45/d5a/d63/d95 0 2023-12-05T13:25:08.864 INFO:tasks.workunit.client.1.smithi052.stdout:3/349: mkdir da/d48/d50/d74 0 2023-12-05T13:25:08.866 INFO:tasks.workunit.client.1.smithi052.stdout:7/440: rmdir d7 39 2023-12-05T13:25:08.867 INFO:tasks.workunit.client.1.smithi052.stdout:3/350: mknod da/d25/d33/d43/d5b/c75 0 2023-12-05T13:25:08.870 INFO:tasks.workunit.client.1.smithi052.stdout:7/441: creat d7/d4e/d45/d5a/f96 x:0 0 0 2023-12-05T13:25:08.870 INFO:tasks.workunit.client.1.smithi052.stdout:7/442: chown d7/d4e/d45/d50/f8f 7772241 1 2023-12-05T13:25:08.871 INFO:tasks.workunit.client.1.smithi052.stdout:2/410: dwrite d2/d4/f23 [4194304,4194304] 0 2023-12-05T13:25:08.871 INFO:tasks.workunit.client.1.smithi052.stdout:5/187: dwrite f4 [0,4194304] 0 2023-12-05T13:25:08.872 INFO:tasks.workunit.client.1.smithi052.stdout:7/443: mknod d7/d4e/d86/c97 0 2023-12-05T13:25:08.872 INFO:tasks.workunit.client.1.smithi052.stdout:7/444: chown d7/d4e/d12/f8d 45 1 2023-12-05T13:25:08.876 INFO:tasks.workunit.client.1.smithi052.stdout:2/411: mkdir d2/d13/d37/d5c/d80 0 2023-12-05T13:25:08.880 INFO:tasks.workunit.client.1.smithi052.stdout:5/188: rmdir d5/df 39 2023-12-05T13:25:08.882 INFO:tasks.workunit.client.1.smithi052.stdout:7/445: truncate d7/d4e/d45/d5a/d16/f30 490448 0 2023-12-05T13:25:08.883 INFO:tasks.workunit.client.1.smithi052.stdout:3/351: dwrite da/d25/f6f [0,4194304] 0 2023-12-05T13:25:08.885 INFO:tasks.workunit.client.1.smithi052.stdout:2/412: unlink d2/f2b 0 2023-12-05T13:25:08.885 INFO:tasks.workunit.client.1.smithi052.stdout:2/413: chown d2/d4/d3f 1030962534 1 2023-12-05T13:25:08.885 INFO:tasks.workunit.client.1.smithi052.stdout:2/414: write d2/d14/f39 [1595035,28956] 0 2023-12-05T13:25:08.886 INFO:tasks.workunit.client.1.smithi052.stdout:5/189: mknod d5/d15/d21/d41/c43 0 2023-12-05T13:25:08.886 INFO:tasks.workunit.client.1.smithi052.stdout:5/190: chown d5/df/f36 1420 1 2023-12-05T13:25:08.892 INFO:tasks.workunit.client.1.smithi052.stdout:7/446: mkdir d7/d4e/d45/d98 0 2023-12-05T13:25:08.898 INFO:tasks.workunit.client.1.smithi052.stdout:2/415: creat d2/d13/d1e/d6a/d7f/f81 x:0 0 0 2023-12-05T13:25:08.900 INFO:tasks.workunit.client.1.smithi052.stdout:3/352: dwrite da/d25/f37 [0,4194304] 0 2023-12-05T13:25:08.904 INFO:tasks.workunit.client.1.smithi052.stdout:3/353: creat da/dd/d3d/f76 x:0 0 0 2023-12-05T13:25:08.905 INFO:tasks.workunit.client.1.smithi052.stdout:5/191: dwrite d5/d15/f31 [0,4194304] 0 2023-12-05T13:25:08.907 INFO:tasks.workunit.client.1.smithi052.stdout:3/354: rename da/d27/c34 to da/d2e/d40/c77 0 2023-12-05T13:25:08.908 INFO:tasks.workunit.client.1.smithi052.stdout:2/416: dread d2/d13/d37/d5c/f78 [0,4194304] 0 2023-12-05T13:25:08.908 INFO:tasks.workunit.client.1.smithi052.stdout:7/447: dwrite d7/d4e/d45/f82 [0,4194304] 0 2023-12-05T13:25:08.912 INFO:tasks.workunit.client.1.smithi052.stdout:3/355: mknod da/d25/d33/d43/c78 0 2023-12-05T13:25:08.918 INFO:tasks.workunit.client.1.smithi052.stdout:7/448: creat d7/d4e/d45/f99 x:0 0 0 2023-12-05T13:25:08.920 INFO:tasks.workunit.client.1.smithi052.stdout:2/417: dread d2/d13/d1e/f57 [0,4194304] 0 2023-12-05T13:25:08.921 INFO:tasks.workunit.client.1.smithi052.stdout:7/449: rename d7/d4e/d45/f82 to d7/d31/d56/f9a 0 2023-12-05T13:25:08.926 INFO:tasks.workunit.client.1.smithi052.stdout:7/450: symlink d7/d4e/d45/d5a/d66/l9b 0 2023-12-05T13:25:08.931 INFO:tasks.workunit.client.1.smithi052.stdout:2/418: rename d2/d13/d1e/f25 to d2/d14/f82 0 2023-12-05T13:25:08.931 INFO:tasks.workunit.client.1.smithi052.stdout:3/356: dwrite da/dd/d3d/f63 [0,4194304] 0 2023-12-05T13:25:08.932 INFO:tasks.workunit.client.1.smithi052.stdout:5/192: dwrite f3 [4194304,4194304] 0 2023-12-05T13:25:08.933 INFO:tasks.workunit.client.1.smithi052.stdout:7/451: truncate d7/d4e/d12/d3f/f44 223360 0 2023-12-05T13:25:08.943 INFO:tasks.workunit.client.1.smithi052.stdout:7/452: mknod d7/d4e/d45/c9c 0 2023-12-05T13:25:08.946 INFO:tasks.workunit.client.1.smithi052.stdout:9/248: truncate d3/d11/d19/f29 313980 0 2023-12-05T13:25:08.948 INFO:tasks.workunit.client.1.smithi052.stdout:5/193: dwrite d5/f9 [0,4194304] 0 2023-12-05T13:25:08.950 INFO:tasks.workunit.client.1.smithi052.stdout:9/249: dread d3/f3a [0,4194304] 0 2023-12-05T13:25:08.951 INFO:tasks.workunit.client.1.smithi052.stdout:5/194: mknod d5/d15/d21/d41/c44 0 2023-12-05T13:25:08.951 INFO:tasks.workunit.client.1.smithi052.stdout:5/195: stat d5/df/d11/f2b 0 2023-12-05T13:25:08.951 INFO:tasks.workunit.client.1.smithi052.stdout:3/357: dwrite da/dd/d3d/f4f [0,4194304] 0 2023-12-05T13:25:08.953 INFO:tasks.workunit.client.1.smithi052.stdout:9/250: creat d3/d11/d3e/f4c x:0 0 0 2023-12-05T13:25:08.953 INFO:tasks.workunit.client.1.smithi052.stdout:9/251: stat d3/d1e/d41 0 2023-12-05T13:25:08.955 INFO:tasks.workunit.client.1.smithi052.stdout:5/196: rename d5/d15/d33/c34 to d5/d15/d21/d41/c45 0 2023-12-05T13:25:08.958 INFO:tasks.workunit.client.1.smithi052.stdout:7/453: dwrite d7/d31/f55 [0,4194304] 0 2023-12-05T13:25:08.963 INFO:tasks.workunit.client.1.smithi052.stdout:9/252: creat d3/d1e/d37/f4d x:0 0 0 2023-12-05T13:25:08.966 INFO:tasks.workunit.client.1.smithi052.stdout:9/253: dread d3/d11/f21 [0,4194304] 0 2023-12-05T13:25:08.967 INFO:tasks.workunit.client.1.smithi052.stdout:3/358: dwrite da/d25/f3a [0,4194304] 0 2023-12-05T13:25:08.967 INFO:tasks.workunit.client.1.smithi052.stdout:3/359: truncate da/d48/d50/f5a 923358 0 2023-12-05T13:25:08.967 INFO:tasks.workunit.client.1.smithi052.stdout:3/360: getdents da/d25/d33 0 2023-12-05T13:25:08.968 INFO:tasks.workunit.client.1.smithi052.stdout:3/361: read da/d27/f2d [938369,102992] 0 2023-12-05T13:25:08.968 INFO:tasks.workunit.client.1.smithi052.stdout:2/419: truncate d2/d31/d3a/d4b/f79 991911 0 2023-12-05T13:25:08.971 INFO:tasks.workunit.client.1.smithi052.stdout:9/254: creat d3/d2a/f4e x:0 0 0 2023-12-05T13:25:08.971 INFO:tasks.workunit.client.1.smithi052.stdout:9/255: read d3/d2a/f3c [352989,28492] 0 2023-12-05T13:25:08.974 INFO:tasks.workunit.client.1.smithi052.stdout:3/362: mknod da/dd/d3d/c79 0 2023-12-05T13:25:08.988 INFO:tasks.workunit.client.1.smithi052.stdout:3/363: mkdir da/d7a 0 2023-12-05T13:25:08.989 INFO:tasks.workunit.client.1.smithi052.stdout:2/420: unlink d2/d13/d37/d61/f7e 0 2023-12-05T13:25:08.989 INFO:tasks.workunit.client.1.smithi052.stdout:2/421: chown d2/d13/d37/d5c 10983 1 2023-12-05T13:25:08.992 INFO:tasks.workunit.client.1.smithi052.stdout:3/364: mknod da/d25/d33/c7b 0 2023-12-05T13:25:08.995 INFO:tasks.workunit.client.1.smithi052.stdout:3/365: symlink da/d2e/l7c 0 2023-12-05T13:25:08.995 INFO:tasks.workunit.client.1.smithi052.stdout:3/366: fsync da/d27/f2b 0 2023-12-05T13:25:08.999 INFO:tasks.workunit.client.1.smithi052.stdout:3/367: mknod da/d48/c7d 0 2023-12-05T13:25:09.000 INFO:tasks.workunit.client.1.smithi052.stdout:3/368: chown da/c29 96465 1 2023-12-05T13:25:09.000 INFO:tasks.workunit.client.1.smithi052.stdout:3/369: chown da/l13 510848135 1 2023-12-05T13:25:09.003 INFO:tasks.workunit.client.1.smithi052.stdout:2/422: dwrite d2/d13/d37/d5c/f74 [4194304,4194304] 0 2023-12-05T13:25:09.147 INFO:tasks.workunit.client.1.smithi052.stdout:2/423: rmdir d2/d13/d1e 39 2023-12-05T13:25:09.164 INFO:tasks.workunit.client.1.smithi052.stdout:8/431: sync 2023-12-05T13:25:09.164 INFO:tasks.workunit.client.1.smithi052.stdout:4/306: sync 2023-12-05T13:25:09.164 INFO:tasks.workunit.client.1.smithi052.stdout:0/432: sync 2023-12-05T13:25:09.164 INFO:tasks.workunit.client.1.smithi052.stdout:6/271: sync 2023-12-05T13:25:09.164 INFO:tasks.workunit.client.1.smithi052.stdout:0/433: chown d0/db/l25 4949376 1 2023-12-05T13:25:09.164 INFO:tasks.workunit.client.1.smithi052.stdout:0/434: chown d0/db/d14 0 1 2023-12-05T13:25:09.165 INFO:tasks.workunit.client.1.smithi052.stdout:1/340: sync 2023-12-05T13:25:09.165 INFO:tasks.workunit.client.1.smithi052.stdout:8/432: mknod d0/d28/d39/d3a/c89 0 2023-12-05T13:25:09.166 INFO:tasks.workunit.client.1.smithi052.stdout:2/424: dwrite d2/d31/d3a/d4b/f60 [0,4194304] 0 2023-12-05T13:25:09.167 INFO:tasks.workunit.client.1.smithi052.stdout:6/272: symlink d3/d5/d9/d21/d48/d5b/l5c 0 2023-12-05T13:25:09.167 INFO:tasks.workunit.client.1.smithi052.stdout:6/273: readlink d3/d5/d9/l1e 0 2023-12-05T13:25:09.168 INFO:tasks.workunit.client.1.smithi052.stdout:8/433: mknod d0/d28/d39/d3a/c8a 0 2023-12-05T13:25:09.172 INFO:tasks.workunit.client.1.smithi052.stdout:5/197: rename d5/d15/d21/d41 to d5/d46 0 2023-12-05T13:25:09.177 INFO:tasks.workunit.client.1.smithi052.stdout:6/274: creat d3/d4/d6/d26/f5d x:0 0 0 2023-12-05T13:25:09.177 INFO:tasks.workunit.client.1.smithi052.stdout:8/434: getdents d0/de/d27/d43 0 2023-12-05T13:25:09.179 INFO:tasks.workunit.client.0.smithi029.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-05T13:25:09.180 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T13:25:09.180 INFO:tasks.workunit.client.0.smithi029.stderr:+ make 2023-12-05T13:25:09.183 INFO:tasks.workunit.client.1.smithi052.stdout:3/370: rename da/dd/d3d/f4f to da/d25/d33/d49/f7e 0 2023-12-05T13:25:09.184 INFO:tasks.workunit.client.1.smithi052.stdout:6/275: creat d3/d4/df/d24/f5e x:0 0 0 2023-12-05T13:25:09.184 INFO:tasks.workunit.client.1.smithi052.stdout:6/276: chown d3/d4/df/d24/f5e 2 1 2023-12-05T13:25:09.185 INFO:tasks.workunit.client.1.smithi052.stdout:4/307: dwrite de/f18 [0,4194304] 0 2023-12-05T13:25:09.185 INFO:tasks.workunit.client.1.smithi052.stdout:2/425: dwrite d2/d14/f5a [0,4194304] 0 2023-12-05T13:25:09.187 INFO:tasks.workunit.client.1.smithi052.stdout:8/435: creat d0/de/d27/d43/d63/f8b x:0 0 0 2023-12-05T13:25:09.187 INFO:tasks.workunit.client.1.smithi052.stdout:8/436: truncate d0/d62/f7e 444568 0 2023-12-05T13:25:09.187 INFO:tasks.workunit.client.1.smithi052.stdout:8/437: write d0/de/f41 [7533663,31996] 0 2023-12-05T13:25:09.190 INFO:tasks.workunit.client.1.smithi052.stdout:1/341: rename d5/d7/d35/d37/d68/d2a/f3b to d5/d7/d35/d37/d68/f6a 0 2023-12-05T13:25:09.190 INFO:tasks.workunit.client.1.smithi052.stdout:9/256: rmdir d3/d2a 39 2023-12-05T13:25:09.190 INFO:tasks.workunit.client.1.smithi052.stdout:9/257: chown d3/d1e/d37/f4d 52059357 1 2023-12-05T13:25:09.190 INFO:tasks.workunit.client.1.smithi052.stdout:9/258: write d3/d1e/d37/f4d [1004904,17927] 0 2023-12-05T13:25:09.191 INFO:tasks.workunit.client.1.smithi052.stdout:6/277: mkdir d3/d5/d9/d21/d5f 0 2023-12-05T13:25:09.194 INFO:tasks.workunit.client.1.smithi052.stdout:2/426: creat d2/d4/f83 x:0 0 0 2023-12-05T13:25:09.195 INFO:tasks.workunit.client.1.smithi052.stdout:8/438: creat d0/d28/f8c x:0 0 0 2023-12-05T13:25:09.200 INFO:tasks.workunit.client.1.smithi052.stdout:4/308: rename de/d30/c52 to de/d29/d48/c63 0 2023-12-05T13:25:09.201 INFO:tasks.workunit.client.1.smithi052.stdout:1/342: creat d5/d7/de/d18/d2e/f6b x:0 0 0 2023-12-05T13:25:09.201 INFO:tasks.workunit.client.1.smithi052.stdout:1/343: read d5/d26/d41/f5f [742096,130438] 0 2023-12-05T13:25:09.201 INFO:tasks.workunit.client.1.smithi052.stdout:9/259: mkdir d3/d1e/d37/d4f 0 2023-12-05T13:25:09.202 INFO:tasks.workunit.client.1.smithi052.stdout:9/260: chown d3/d11/d19/f27 2505 1 2023-12-05T13:25:09.203 INFO:tasks.workunit.client.1.smithi052.stdout:2/427: write d2/d13/d1e/d6a/d7f/f81 [719321,84235] 0 2023-12-05T13:25:09.204 INFO:tasks.workunit.client.1.smithi052.stdout:8/439: mkdir d0/de/d8d 0 2023-12-05T13:25:09.207 INFO:tasks.workunit.client.1.smithi052.stdout:6/278: rename d3/d4/df/d24/f5e to d3/d5/d9/d21/d48/d5b/f60 0 2023-12-05T13:25:09.207 INFO:tasks.workunit.client.1.smithi052.stdout:6/279: readlink d3/d5/d9/d21/d48/d5b/l5c 0 2023-12-05T13:25:09.209 INFO:tasks.workunit.client.1.smithi052.stdout:4/309: mkdir de/d2b/d64 0 2023-12-05T13:25:09.210 INFO:tasks.workunit.client.1.smithi052.stdout:1/344: mknod d5/d7/d35/d37/d68/d69/c6c 0 2023-12-05T13:25:09.210 INFO:tasks.workunit.client.1.smithi052.stdout:1/345: readlink d5/d7/de/d18/l34 0 2023-12-05T13:25:09.211 INFO:tasks.workunit.client.1.smithi052.stdout:1/346: write d5/d26/d41/f5f [1329203,120606] 0 2023-12-05T13:25:09.214 INFO:tasks.workunit.client.1.smithi052.stdout:9/261: link d3/l3f d3/d1e/d41/l50 0 2023-12-05T13:25:09.216 INFO:tasks.workunit.client.1.smithi052.stdout:2/428: read d2/d13/d1e/f57 [3006111,111023] 0 2023-12-05T13:25:09.216 INFO:tasks.workunit.client.1.smithi052.stdout:2/429: fdatasync d2/d4/f23 0 2023-12-05T13:25:09.218 INFO:tasks.workunit.client.1.smithi052.stdout:6/280: symlink d3/d5/d9/d21/d48/l61 0 2023-12-05T13:25:09.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:09 smithi052 ceph-mon[121072]: pgmap v204: 65 pgs: 65 active+clean; 770 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 77 MiB/s wr, 176 op/s 2023-12-05T13:25:09.223 INFO:tasks.workunit.client.1.smithi052.stdout:2/430: dread d2/d13/d37/d5c/f78 [0,4194304] 0 2023-12-05T13:25:09.223 INFO:tasks.workunit.client.1.smithi052.stdout:2/431: read - d2/d4/f83 zero size 2023-12-05T13:25:09.223 INFO:tasks.workunit.client.1.smithi052.stdout:9/262: rename d3/d2a/f2b to d3/d11/d3e/f51 0 2023-12-05T13:25:09.226 INFO:tasks.workunit.client.1.smithi052.stdout:2/432: rename d2/d31 to d2/d13/d1e/d6a/d7f/d84 0 2023-12-05T13:25:09.226 INFO:tasks.workunit.client.1.smithi052.stdout:2/433: chown d2/d13/d1e/d6a/c6b 264964 1 2023-12-05T13:25:09.226 INFO:tasks.workunit.client.1.smithi052.stdout:2/434: stat d2/d14 0 2023-12-05T13:25:09.226 INFO:tasks.workunit.client.1.smithi052.stdout:2/435: write d2/d13/d1e/d6a/d7f/d84/f4f [3256772,12480] 0 2023-12-05T13:25:09.227 INFO:tasks.workunit.client.1.smithi052.stdout:9/263: creat d3/d1e/d37/d4f/f52 x:0 0 0 2023-12-05T13:25:09.234 INFO:tasks.workunit.client.1.smithi052.stdout:1/347: dwrite d5/d7/d35/f5c [0,4194304] 0 2023-12-05T13:25:09.238 INFO:tasks.workunit.client.1.smithi052.stdout:1/348: link d5/d26/f66 d5/d7/d35/d37/d68/f6d 0 2023-12-05T13:25:09.238 INFO:tasks.workunit.client.1.smithi052.stdout:1/349: write d5/d7/d35/f3d [4568943,64476] 0 2023-12-05T13:25:09.238 INFO:tasks.workunit.client.1.smithi052.stdout:1/350: fdatasync d5/d7/f4b 0 2023-12-05T13:25:09.239 INFO:tasks.workunit.client.1.smithi052.stdout:1/351: readlink d5/d7/de/d18/l1d 0 2023-12-05T13:25:09.240 INFO:tasks.workunit.client.1.smithi052.stdout:1/352: symlink d5/d7/d35/d37/d68/l6e 0 2023-12-05T13:25:09.241 INFO:tasks.workunit.client.1.smithi052.stdout:1/353: write d5/d7/d35/d2f/d3e/f58 [1567905,42466] 0 2023-12-05T13:25:09.241 INFO:tasks.workunit.client.1.smithi052.stdout:1/354: write d5/f64 [1002360,99138] 0 2023-12-05T13:25:09.287 INFO:tasks.workunit.client.1.smithi052.stdout:5/198: write d5/d15/d33/f38 [316200,30359] 0 2023-12-05T13:25:09.294 INFO:tasks.workunit.client.1.smithi052.stdout:7/454: sync 2023-12-05T13:25:09.294 INFO:tasks.workunit.client.1.smithi052.stdout:7/455: chown d7/d4e/d45/f99 25 1 2023-12-05T13:25:09.294 INFO:tasks.workunit.client.1.smithi052.stdout:2/436: truncate d2/f59 5510804 0 2023-12-05T13:25:09.296 INFO:tasks.workunit.client.1.smithi052.stdout:7/456: symlink d7/d4e/d12/d3f/d46/l9d 0 2023-12-05T13:25:09.298 INFO:tasks.workunit.client.1.smithi052.stdout:4/310: rmdir de 39 2023-12-05T13:25:09.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/311: chown de/l1c 67 1 2023-12-05T13:25:09.299 INFO:tasks.workunit.client.1.smithi052.stdout:5/199: dread f4 [0,4194304] 0 2023-12-05T13:25:09.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/312: write de/d29/f2e [3034771,105397] 0 2023-12-05T13:25:09.300 INFO:tasks.workunit.client.1.smithi052.stdout:4/313: write de/d29/d48/f50 [308498,60002] 0 2023-12-05T13:25:09.300 INFO:tasks.workunit.client.1.smithi052.stdout:5/200: mkdir d5/d15/d47 0 2023-12-05T13:25:09.301 INFO:tasks.workunit.client.1.smithi052.stdout:7/457: dread d7/d4e/d12/f34 [0,4194304] 0 2023-12-05T13:25:09.305 INFO:tasks.workunit.client.1.smithi052.stdout:5/201: rename d5/d15/f2a to d5/df/d11/f48 0 2023-12-05T13:25:09.305 INFO:tasks.workunit.client.1.smithi052.stdout:4/314: dread de/f11 [0,4194304] 0 2023-12-05T13:25:09.305 INFO:tasks.workunit.client.1.smithi052.stdout:4/315: getdents de/d2b/d64 0 2023-12-05T13:25:09.305 INFO:tasks.workunit.client.1.smithi052.stdout:2/437: dread d2/d13/d45/f4a [0,4194304] 0 2023-12-05T13:25:09.305 INFO:tasks.workunit.client.1.smithi052.stdout:7/458: symlink d7/d4e/d12/d3f/d46/l9e 0 2023-12-05T13:25:09.306 INFO:tasks.workunit.client.1.smithi052.stdout:2/438: write d2/d14/f5a [3045107,101128] 0 2023-12-05T13:25:09.306 INFO:tasks.workunit.client.1.smithi052.stdout:4/316: symlink de/d29/l65 0 2023-12-05T13:25:09.306 INFO:tasks.workunit.client.1.smithi052.stdout:4/317: getdents de/d1e/d24 0 2023-12-05T13:25:09.308 INFO:tasks.workunit.client.1.smithi052.stdout:7/459: mknod d7/d4e/d45/d79/c9f 0 2023-12-05T13:25:09.308 INFO:tasks.workunit.client.1.smithi052.stdout:7/460: write d7/d31/d56/d60/f69 [890006,50362] 0 2023-12-05T13:25:09.311 INFO:tasks.workunit.client.1.smithi052.stdout:5/202: dread d5/fa [0,4194304] 0 2023-12-05T13:25:09.311 INFO:tasks.workunit.client.1.smithi052.stdout:4/318: unlink de/l61 0 2023-12-05T13:25:09.313 INFO:tasks.workunit.client.1.smithi052.stdout:7/461: getdents d7/d4e/d45/d50 0 2023-12-05T13:25:09.313 INFO:tasks.workunit.client.1.smithi052.stdout:7/462: fsync d7/d4e/f1a 0 2023-12-05T13:25:09.314 INFO:tasks.workunit.client.1.smithi052.stdout:7/463: write d7/d4e/d45/d5a/f87 [3668736,1875] 0 2023-12-05T13:25:09.314 INFO:tasks.workunit.client.1.smithi052.stdout:7/464: chown d7/d4e/d12/d3f/c6f 1547 1 2023-12-05T13:25:09.315 INFO:tasks.workunit.client.1.smithi052.stdout:7/465: fsync d7/d4e/d12/f34 0 2023-12-05T13:25:09.315 INFO:tasks.workunit.client.1.smithi052.stdout:7/466: fsync d7/d4e/d12/f8d 0 2023-12-05T13:25:09.317 INFO:tasks.workunit.client.1.smithi052.stdout:5/203: unlink d5/df/d11/l39 0 2023-12-05T13:25:09.317 INFO:tasks.workunit.client.1.smithi052.stdout:5/204: write d5/d15/f18 [4547801,110958] 0 2023-12-05T13:25:09.318 INFO:tasks.workunit.client.1.smithi052.stdout:4/319: creat de/d2b/d64/f66 x:0 0 0 2023-12-05T13:25:09.319 INFO:tasks.workunit.client.1.smithi052.stdout:7/467: truncate d7/d4e/d12/d3f/d46/f5f 3906120 0 2023-12-05T13:25:09.323 INFO:tasks.workunit.client.0.smithi029.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-05T13:25:09.326 INFO:tasks.workunit.client.1.smithi052.stdout:4/320: rename de/d1e/f4c to de/d1e/f67 0 2023-12-05T13:25:09.332 INFO:tasks.workunit.client.1.smithi052.stdout:4/321: rename de/d29/d48 to de/d30/d68 0 2023-12-05T13:25:09.333 INFO:tasks.workunit.client.1.smithi052.stdout:4/322: rmdir de/d29 39 2023-12-05T13:25:09.333 INFO:tasks.workunit.client.1.smithi052.stdout:4/323: chown de/d29/f2e 218 1 2023-12-05T13:25:09.338 INFO:tasks.workunit.client.1.smithi052.stdout:5/205: dwrite d5/f14 [0,4194304] 0 2023-12-05T13:25:09.338 INFO:tasks.workunit.client.1.smithi052.stdout:5/206: write d5/d15/d21/f3a [857814,70374] 0 2023-12-05T13:25:09.342 INFO:tasks.workunit.client.1.smithi052.stdout:5/207: link d5/df/d11/f2b d5/d15/d33/f49 0 2023-12-05T13:25:09.344 INFO:tasks.workunit.client.1.smithi052.stdout:4/324: dread de/f18 [0,4194304] 0 2023-12-05T13:25:09.344 INFO:tasks.workunit.client.1.smithi052.stdout:4/325: chown de/d1e/l49 305891510 1 2023-12-05T13:25:09.344 INFO:tasks.workunit.client.1.smithi052.stdout:4/326: fsync de/f33 0 2023-12-05T13:25:09.344 INFO:tasks.workunit.client.1.smithi052.stdout:7/468: dwrite d7/d4e/d45/d5a/d16/f30 [0,4194304] 0 2023-12-05T13:25:09.345 INFO:tasks.workunit.client.1.smithi052.stdout:7/469: readlink d7/d4e/d45/d5a/d63/l7e 0 2023-12-05T13:25:09.345 INFO:tasks.workunit.client.1.smithi052.stdout:5/208: unlink d5/df/f20 0 2023-12-05T13:25:09.347 INFO:tasks.workunit.client.1.smithi052.stdout:4/327: rename de/d30/d60 to de/d2b/d64/d69 0 2023-12-05T13:25:09.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:09 smithi029 ceph-mon[112128]: pgmap v204: 65 pgs: 65 active+clean; 770 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 77 MiB/s wr, 176 op/s 2023-12-05T13:25:09.357 INFO:tasks.workunit.client.1.smithi052.stdout:5/209: dread f4 [0,4194304] 0 2023-12-05T13:25:09.357 INFO:tasks.workunit.client.1.smithi052.stdout:5/210: chown d5/d15/d21/d25/d3f 6 1 2023-12-05T13:25:09.359 INFO:tasks.workunit.client.1.smithi052.stdout:5/211: mkdir d5/d15/d21/d4a 0 2023-12-05T13:25:09.359 INFO:tasks.workunit.client.1.smithi052.stdout:5/212: write d5/df/d11/f2b [720716,102980] 0 2023-12-05T13:25:09.360 INFO:tasks.workunit.client.1.smithi052.stdout:5/213: fdatasync d5/fa 0 2023-12-05T13:25:09.361 INFO:tasks.workunit.client.1.smithi052.stdout:4/328: dread fa [0,4194304] 0 2023-12-05T13:25:09.361 INFO:tasks.workunit.client.1.smithi052.stdout:5/214: mkdir d5/df/d4b 0 2023-12-05T13:25:09.362 INFO:tasks.workunit.client.1.smithi052.stdout:7/470: dwrite d7/d4e/f61 [4194304,4194304] 0 2023-12-05T13:25:09.363 INFO:tasks.workunit.client.1.smithi052.stdout:4/329: truncate de/d30/f3c 811451 0 2023-12-05T13:25:09.364 INFO:tasks.workunit.client.1.smithi052.stdout:5/215: rename d5/d15/d21/d25/f32 to d5/df/f4c 0 2023-12-05T13:25:09.366 INFO:tasks.workunit.client.1.smithi052.stdout:7/471: mknod d7/d4e/d45/d93/ca0 0 2023-12-05T13:25:09.368 INFO:tasks.workunit.client.1.smithi052.stdout:4/330: getdents de/d2b 0 2023-12-05T13:25:09.374 INFO:tasks.workunit.client.1.smithi052.stdout:4/331: rename de/f5e to de/d2b/d64/f6a 0 2023-12-05T13:25:09.378 INFO:tasks.workunit.client.1.smithi052.stdout:5/216: rmdir d5/d15 39 2023-12-05T13:25:09.378 INFO:tasks.workunit.client.1.smithi052.stdout:5/217: write d5/d15/f42 [299908,107436] 0 2023-12-05T13:25:09.385 INFO:tasks.workunit.client.1.smithi052.stdout:4/332: dread de/d2b/f5a [0,4194304] 0 2023-12-05T13:25:09.385 INFO:tasks.workunit.client.1.smithi052.stdout:4/333: readlink de/d30/l31 0 2023-12-05T13:25:09.387 INFO:tasks.workunit.client.1.smithi052.stdout:7/472: dwrite d7/d4e/d45/d5a/d63/f7a [0,4194304] 0 2023-12-05T13:25:09.387 INFO:tasks.workunit.client.1.smithi052.stdout:7/473: chown d7/f73 7083941 1 2023-12-05T13:25:09.387 INFO:tasks.workunit.client.1.smithi052.stdout:4/334: creat de/d29/d51/f6b x:0 0 0 2023-12-05T13:25:09.388 INFO:tasks.workunit.client.1.smithi052.stdout:4/335: write de/d29/f3d [1121859,32718] 0 2023-12-05T13:25:09.388 INFO:tasks.workunit.client.1.smithi052.stdout:4/336: dread - de/d2b/d64/f66 zero size 2023-12-05T13:25:09.388 INFO:tasks.workunit.client.1.smithi052.stdout:5/218: dread d5/f9 [4194304,4194304] 0 2023-12-05T13:25:09.388 INFO:tasks.workunit.client.1.smithi052.stdout:5/219: chown d5/d15/l1a 39261 1 2023-12-05T13:25:09.388 INFO:tasks.workunit.client.1.smithi052.stdout:4/337: mknod de/d2b/d64/d69/c6c 0 2023-12-05T13:25:09.388 INFO:tasks.workunit.client.1.smithi052.stdout:4/338: fdatasync de/f33 0 2023-12-05T13:25:09.389 INFO:tasks.workunit.client.1.smithi052.stdout:5/220: creat d5/df/d4b/f4d x:0 0 0 2023-12-05T13:25:09.390 INFO:tasks.workunit.client.1.smithi052.stdout:4/339: truncate de/d29/f2e 2718559 0 2023-12-05T13:25:09.391 INFO:tasks.workunit.client.1.smithi052.stdout:4/340: write de/f4b [431033,76240] 0 2023-12-05T13:25:09.392 INFO:tasks.workunit.client.1.smithi052.stdout:4/341: truncate de/f18 2044089 0 2023-12-05T13:25:09.397 INFO:tasks.workunit.client.1.smithi052.stdout:5/221: dread d5/fc [0,4194304] 0 2023-12-05T13:25:09.397 INFO:tasks.workunit.client.1.smithi052.stdout:5/222: chown d5/df/d4b 0 1 2023-12-05T13:25:09.398 INFO:tasks.workunit.client.1.smithi052.stdout:5/223: chown d5/c3b 87 1 2023-12-05T13:25:09.510 INFO:tasks.workunit.client.1.smithi052.stdout:7/474: dwrite d7/d4e/d45/d5a/d63/f7a [0,4194304] 0 2023-12-05T13:25:09.510 INFO:tasks.workunit.client.1.smithi052.stdout:7/475: chown d7/d4e/d45/d5a/d63/l7e 1154349 1 2023-12-05T13:25:09.522 INFO:tasks.workunit.client.1.smithi052.stdout:7/476: mknod d7/d4e/d12/d3f/d75/ca1 0 2023-12-05T13:25:09.522 INFO:tasks.workunit.client.1.smithi052.stdout:7/477: write d7/d4e/d12/d3f/f6e [5841082,84595] 0 2023-12-05T13:25:09.530 INFO:tasks.workunit.client.1.smithi052.stdout:7/478: mkdir d7/d4e/d86/da2 0 2023-12-05T13:25:09.537 INFO:tasks.workunit.client.1.smithi052.stdout:7/479: rename d7/d4e/d45/f94 to d7/d4e/d12/d7d/fa3 0 2023-12-05T13:25:09.537 INFO:tasks.workunit.client.1.smithi052.stdout:7/480: read - d7/d4e/d12/f8b zero size 2023-12-05T13:25:09.544 INFO:tasks.workunit.client.1.smithi052.stdout:7/481: rename d7/d4e/c25 to d7/d4e/d12/d3f/d75/ca4 0 2023-12-05T13:25:09.550 INFO:tasks.workunit.client.1.smithi052.stdout:7/482: link d7/c26 d7/d4e/d45/d5a/d63/d95/ca5 0 2023-12-05T13:25:09.565 INFO:tasks.workunit.client.1.smithi052.stdout:7/483: symlink d7/d4e/d45/d98/la6 0 2023-12-05T13:25:09.565 INFO:tasks.workunit.client.1.smithi052.stdout:7/484: write d7/d4e/d45/d5a/d16/f7c [288122,68957] 0 2023-12-05T13:25:09.572 INFO:tasks.workunit.client.1.smithi052.stdout:7/485: rmdir d7/d4e/d45/d79 39 2023-12-05T13:25:09.586 INFO:tasks.workunit.client.1.smithi052.stdout:7/486: mknod d7/d31/d56/d60/d72/ca7 0 2023-12-05T13:25:09.590 INFO:tasks.workunit.client.1.smithi052.stdout:7/487: symlink d7/d4e/d45/d5a/d63/la8 0 2023-12-05T13:25:09.590 INFO:tasks.workunit.client.1.smithi052.stdout:7/488: dread - d7/d4e/d45/f99 zero size 2023-12-05T13:25:09.601 INFO:tasks.workunit.client.1.smithi052.stdout:7/489: creat d7/d2e/fa9 x:0 0 0 2023-12-05T13:25:09.743 INFO:tasks.workunit.client.1.smithi052.stdout:7/490: dwrite d7/d4e/f36 [0,4194304] 0 2023-12-05T13:25:09.744 INFO:tasks.workunit.client.1.smithi052.stdout:7/491: dread - d7/d4e/d45/d5a/f96 zero size 2023-12-05T13:25:09.744 INFO:tasks.workunit.client.1.smithi052.stdout:7/492: fdatasync d7/d4e/d45/d50/f8f 0 2023-12-05T13:25:09.747 INFO:tasks.workunit.client.1.smithi052.stdout:5/224: dwrite d5/df/f17 [0,4194304] 0 2023-12-05T13:25:09.747 INFO:tasks.workunit.client.1.smithi052.stdout:5/225: write d5/df/f36 [88596,112234] 0 2023-12-05T13:25:09.760 INFO:tasks.workunit.client.1.smithi052.stdout:5/226: mkdir d5/df/d4e 0 2023-12-05T13:25:10.384 INFO:tasks.workunit.client.1.smithi052.stdout:5/227: dread f3 [4194304,4194304] 0 2023-12-05T13:25:10.384 INFO:tasks.workunit.client.1.smithi052.stdout:5/228: chown f3 178733 1 2023-12-05T13:25:10.484 INFO:tasks.workunit.client.1.smithi052.stdout:4/342: dread de/d2b/f5a [0,4194304] 0 2023-12-05T13:25:10.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/343: truncate de/d1e/f2a 1926608 0 2023-12-05T13:25:10.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/344: fdatasync de/d29/f2e 0 2023-12-05T13:25:10.547 INFO:tasks.workunit.client.1.smithi052.stdout:4/345: write de/f18 [1424841,18315] 0 2023-12-05T13:25:10.565 INFO:tasks.workunit.client.1.smithi052.stdout:4/346: mkdir de/d30/d68/d59/d6d 0 2023-12-05T13:25:10.565 INFO:tasks.workunit.client.1.smithi052.stdout:4/347: read - de/d29/f56 zero size 2023-12-05T13:25:10.573 INFO:tasks.workunit.client.1.smithi052.stdout:4/348: creat de/d1e/d24/f6e x:0 0 0 2023-12-05T13:25:10.583 INFO:tasks.workunit.client.1.smithi052.stdout:4/349: creat de/d2b/d64/d69/f6f x:0 0 0 2023-12-05T13:25:10.583 INFO:tasks.workunit.client.1.smithi052.stdout:4/350: chown de/d1e/d24/f6e 86102290 1 2023-12-05T13:25:10.595 INFO:tasks.workunit.client.1.smithi052.stdout:4/351: rmdir de/d29/d51 39 2023-12-05T13:25:10.595 INFO:tasks.workunit.client.1.smithi052.stdout:4/352: fdatasync f4 0 2023-12-05T13:25:10.602 INFO:tasks.workunit.client.1.smithi052.stdout:4/353: mknod de/d2b/c70 0 2023-12-05T13:25:10.603 INFO:tasks.workunit.client.1.smithi052.stdout:4/354: fdatasync de/d1e/d24/f35 0 2023-12-05T13:25:10.609 INFO:tasks.workunit.client.1.smithi052.stdout:4/355: rename de/d2b/d64/d69/c6c to de/d2b/d64/c71 0 2023-12-05T13:25:10.619 INFO:tasks.workunit.client.1.smithi052.stdout:4/356: mknod de/d30/d68/d59/d6d/c72 0 2023-12-05T13:25:10.641 INFO:tasks.workunit.client.1.smithi052.stdout:4/357: getdents de/d30/d68 0 2023-12-05T13:25:10.641 INFO:tasks.workunit.client.1.smithi052.stdout:4/358: write de/d2b/d64/f66 [337623,6026] 0 2023-12-05T13:25:10.641 INFO:tasks.workunit.client.1.smithi052.stdout:4/359: fdatasync de/f4b 0 2023-12-05T13:25:10.641 INFO:tasks.workunit.client.1.smithi052.stdout:4/360: write de/d1e/d24/f4d [765129,30199] 0 2023-12-05T13:25:10.641 INFO:tasks.workunit.client.1.smithi052.stdout:4/361: stat de/d1e/d24/f6e 0 2023-12-05T13:25:10.690 INFO:tasks.workunit.client.1.smithi052.stdout:8/440: sync 2023-12-05T13:25:10.690 INFO:tasks.workunit.client.1.smithi052.stdout:0/435: sync 2023-12-05T13:25:10.690 INFO:tasks.workunit.client.1.smithi052.stdout:6/281: sync 2023-12-05T13:25:10.690 INFO:tasks.workunit.client.1.smithi052.stdout:6/282: write d3/d5/d9/d52/f54 [5791990,127426] 0 2023-12-05T13:25:10.690 INFO:tasks.workunit.client.1.smithi052.stdout:6/283: write d3/d4/df/d27/f47 [239003,90163] 0 2023-12-05T13:25:10.690 INFO:tasks.workunit.client.1.smithi052.stdout:3/371: sync 2023-12-05T13:25:10.696 INFO:tasks.workunit.client.1.smithi052.stdout:0/436: unlink d0/db/d14/f28 0 2023-12-05T13:25:10.706 INFO:tasks.workunit.client.1.smithi052.stdout:0/437: creat d0/db/d1b/d29/f91 x:0 0 0 2023-12-05T13:25:10.718 INFO:tasks.workunit.client.1.smithi052.stdout:3/372: write da/d27/f2b [503088,31325] 0 2023-12-05T13:25:10.718 INFO:tasks.workunit.client.1.smithi052.stdout:3/373: write da/d25/d33/d43/d5b/f5c [928579,70583] 0 2023-12-05T13:25:10.723 INFO:tasks.workunit.client.1.smithi052.stdout:0/438: creat d0/db/d20/d50/f92 x:0 0 0 2023-12-05T13:25:10.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: Upgrade: Updating mgr.smithi052.ocazcp 2023-12-05T13:25:10.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:10.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:25:10.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:25:10.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:25:10.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: Deploying daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:25:10.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:10 smithi052 ceph-mon[121072]: pgmap v205: 65 pgs: 65 active+clean; 827 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 80 MiB/s wr, 179 op/s 2023-12-05T13:25:10.730 INFO:tasks.workunit.client.1.smithi052.stdout:5/229: dread d5/fa [0,4194304] 0 2023-12-05T13:25:10.730 INFO:tasks.workunit.client.1.smithi052.stdout:5/230: fdatasync d5/d15/d21/f3a 0 2023-12-05T13:25:10.733 INFO:tasks.workunit.client.1.smithi052.stdout:3/374: rename da/d48/d50/f5a to da/d2e/f7f 0 2023-12-05T13:25:10.733 INFO:tasks.workunit.client.1.smithi052.stdout:0/439: getdents d0/db 0 2023-12-05T13:25:10.737 INFO:tasks.workunit.client.1.smithi052.stdout:3/375: truncate da/d25/f3a 3552825 0 2023-12-05T13:25:10.803 INFO:tasks.workunit.client.1.smithi052.stdout:4/362: dwrite de/d2b/d64/d69/f6f [0,4194304] 0 2023-12-05T13:25:10.853 INFO:tasks.workunit.client.1.smithi052.stdout:5/231: write d5/df/d11/f26 [3792484,16185] 0 2023-12-05T13:25:10.867 INFO:tasks.workunit.client.1.smithi052.stdout:5/232: rename d5/df/f4c to d5/d15/d33/f4f 0 2023-12-05T13:25:10.876 INFO:tasks.workunit.client.1.smithi052.stdout:7/493: dwrite d7/d4e/d12/f43 [0,4194304] 0 2023-12-05T13:25:10.882 INFO:tasks.workunit.client.1.smithi052.stdout:0/440: dwrite d0/f2b [4194304,4194304] 0 2023-12-05T13:25:10.890 INFO:tasks.workunit.client.1.smithi052.stdout:7/494: mknod d7/d4e/d45/d5a/caa 0 2023-12-05T13:25:10.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/441: truncate d0/db/d33/f72 1260811 0 2023-12-05T13:25:10.986 INFO:tasks.workunit.client.1.smithi052.stdout:7/495: dread d7/d4e/d45/d5a/d16/f7c [0,4194304] 0 2023-12-05T13:25:10.988 INFO:tasks.workunit.client.1.smithi052.stdout:5/233: dwrite d5/df/d11/f48 [0,4194304] 0 2023-12-05T13:25:10.998 INFO:tasks.workunit.client.1.smithi052.stdout:5/234: creat d5/d15/d21/d25/d3f/f50 x:0 0 0 2023-12-05T13:25:11.007 INFO:tasks.workunit.client.1.smithi052.stdout:5/235: rename d5/d15/d47 to d5/df/d11/d51 0 2023-12-05T13:25:11.015 INFO:tasks.workunit.client.1.smithi052.stdout:7/496: dread d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:25:11.016 INFO:tasks.workunit.client.1.smithi052.stdout:5/236: creat d5/df/d11/f52 x:0 0 0 2023-12-05T13:25:11.021 INFO:tasks.workunit.client.1.smithi052.stdout:7/497: rmdir d7/d4e/d86/da2 0 2023-12-05T13:25:11.022 INFO:tasks.workunit.client.1.smithi052.stdout:7/498: chown d7/f73 1676 1 2023-12-05T13:25:11.022 INFO:tasks.workunit.client.1.smithi052.stdout:7/499: chown d7/d4e/d45/d5a/d16/l70 44 1 2023-12-05T13:25:11.027 INFO:tasks.workunit.client.1.smithi052.stdout:5/237: creat d5/d15/d33/f53 x:0 0 0 2023-12-05T13:25:11.031 INFO:tasks.workunit.client.1.smithi052.stdout:7/500: mkdir d7/d4e/d12/d3f/d46/dab 0 2023-12-05T13:25:11.085 INFO:tasks.workunit.client.1.smithi052.stdout:6/284: dwrite d3/f3d [0,4194304] 0 2023-12-05T13:25:11.095 INFO:tasks.workunit.client.1.smithi052.stdout:6/285: mknod d3/d4/df/d24/c62 0 2023-12-05T13:25:11.095 INFO:tasks.workunit.client.1.smithi052.stdout:6/286: truncate d3/d5/d9/f3a 865838 0 2023-12-05T13:25:11.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: Upgrade: Updating mgr.smithi052.ocazcp 2023-12-05T13:25:11.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:11.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:25:11.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:25:11.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:25:11.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: Deploying daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:25:11.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:10 smithi029 ceph-mon[112128]: pgmap v205: 65 pgs: 65 active+clean; 827 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 80 MiB/s wr, 179 op/s 2023-12-05T13:25:11.176 INFO:tasks.workunit.client.1.smithi052.stdout:7/501: dread d7/d31/d56/f9a [0,4194304] 0 2023-12-05T13:25:11.184 INFO:tasks.workunit.client.1.smithi052.stdout:7/502: rename d7/l52 to d7/d31/d56/lac 0 2023-12-05T13:25:11.184 INFO:tasks.workunit.client.1.smithi052.stdout:7/503: fdatasync d7/d4e/d45/d5a/f96 0 2023-12-05T13:25:11.200 INFO:tasks.workunit.client.1.smithi052.stdout:5/238: dwrite d5/df/d4b/f4d [0,4194304] 0 2023-12-05T13:25:11.200 INFO:tasks.workunit.client.1.smithi052.stdout:5/239: fsync d5/d15/d21/f3a 0 2023-12-05T13:25:11.200 INFO:tasks.workunit.client.1.smithi052.stdout:5/240: dread - d5/d15/d33/f4f zero size 2023-12-05T13:25:11.210 INFO:tasks.workunit.client.1.smithi052.stdout:6/287: dread d3/d5/d9/f3a [0,4194304] 0 2023-12-05T13:25:11.217 INFO:tasks.workunit.client.1.smithi052.stdout:5/241: mknod d5/df/c54 0 2023-12-05T13:25:11.224 INFO:tasks.workunit.client.1.smithi052.stdout:6/288: mkdir d3/d4/df/d63 0 2023-12-05T13:25:11.238 INFO:tasks.workunit.client.1.smithi052.stdout:6/289: creat d3/d5/d9/f64 x:0 0 0 2023-12-05T13:25:11.244 INFO:tasks.workunit.client.1.smithi052.stdout:6/290: mknod d3/d5/c65 0 2023-12-05T13:25:11.344 INFO:tasks.workunit.client.1.smithi052.stdout:8/441: write d0/de/f41 [4843763,78068] 0 2023-12-05T13:25:11.344 INFO:tasks.workunit.client.1.smithi052.stdout:0/442: dwrite d0/db/d1b/d29/f91 [0,4194304] 0 2023-12-05T13:25:11.360 INFO:tasks.workunit.client.1.smithi052.stdout:8/442: dread d0/de/d12/f85 [0,4194304] 0 2023-12-05T13:25:11.362 INFO:tasks.workunit.client.1.smithi052.stdout:8/443: dread d0/de/d12/f2e [4194304,4194304] 0 2023-12-05T13:25:11.363 INFO:tasks.workunit.client.1.smithi052.stdout:0/443: creat d0/db/d1b/d7a/f93 x:0 0 0 2023-12-05T13:25:11.363 INFO:tasks.workunit.client.1.smithi052.stdout:0/444: write d0/db/d1b/d51/f69 [252580,86616] 0 2023-12-05T13:25:11.366 INFO:tasks.workunit.client.1.smithi052.stdout:8/444: read d0/de/d12/f85 [91072,103957] 0 2023-12-05T13:25:11.369 INFO:tasks.workunit.client.1.smithi052.stdout:0/445: mknod d0/db/d1b/d42/c94 0 2023-12-05T13:25:11.382 INFO:tasks.workunit.client.1.smithi052.stdout:0/446: creat d0/db/d1b/d51/d55/d66/d77/f95 x:0 0 0 2023-12-05T13:25:11.387 INFO:tasks.workunit.client.1.smithi052.stdout:8/445: read d0/d28/d39/d3a/f67 [1290977,72018] 0 2023-12-05T13:25:11.424 INFO:tasks.workunit.client.1.smithi052.stdout:6/291: dwrite d3/d4/df/d27/f47 [0,4194304] 0 2023-12-05T13:25:11.460 INFO:tasks.workunit.client.1.smithi052.stdout:6/292: dread d3/d5/d9/f2e [0,4194304] 0 2023-12-05T13:25:11.461 INFO:tasks.workunit.client.1.smithi052.stdout:6/293: chown d3/d4/d6/f7 1016 1 2023-12-05T13:25:11.461 INFO:tasks.workunit.client.1.smithi052.stdout:8/446: dwrite d0/de/d27/d43/d63/f8b [0,4194304] 0 2023-12-05T13:25:11.468 INFO:tasks.workunit.client.1.smithi052.stdout:8/447: truncate d0/d28/d39/d3a/f47 2552676 0 2023-12-05T13:25:11.475 INFO:tasks.workunit.client.1.smithi052.stdout:8/448: symlink d0/de/d27/d43/d63/l8e 0 2023-12-05T13:25:11.485 INFO:tasks.workunit.client.1.smithi052.stdout:8/449: rmdir d0/de/d8d 0 2023-12-05T13:25:11.485 INFO:tasks.workunit.client.1.smithi052.stdout:8/450: chown d0/d28/d2b/c59 176758383 1 2023-12-05T13:25:11.520 INFO:tasks.workunit.client.1.smithi052.stdout:8/451: write d0/d28/d39/d3a/d4f/f55 [661315,109969] 0 2023-12-05T13:25:11.520 INFO:tasks.workunit.client.1.smithi052.stdout:8/452: dread - d0/d28/f8c zero size 2023-12-05T13:25:11.534 INFO:tasks.workunit.client.1.smithi052.stdout:8/453: rename d0/d28/d39/d3a/d72 to d0/d28/d39/d3a/d8f 0 2023-12-05T13:25:11.534 INFO:tasks.workunit.client.1.smithi052.stdout:8/454: write d0/de/d12/f85 [289746,48251] 0 2023-12-05T13:25:11.550 INFO:tasks.workunit.client.1.smithi052.stdout:8/455: dread d0/de/f41 [0,4194304] 0 2023-12-05T13:25:11.551 INFO:tasks.workunit.client.1.smithi052.stdout:8/456: readlink d0/d28/d2b/l34 0 2023-12-05T13:25:11.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/457: mknod d0/d28/d2b/c90 0 2023-12-05T13:25:11.556 INFO:tasks.workunit.client.1.smithi052.stdout:8/458: readlink d0/d28/d39/l40 0 2023-12-05T13:25:11.596 INFO:tasks.workunit.client.1.smithi052.stdout:4/363: dwrite de/d2b/f58 [0,4194304] 0 2023-12-05T13:25:11.596 INFO:tasks.workunit.client.1.smithi052.stdout:4/364: write de/d30/d68/f50 [1906927,24100] 0 2023-12-05T13:25:11.611 INFO:tasks.workunit.client.1.smithi052.stdout:4/365: mkdir de/d30/d73 0 2023-12-05T13:25:11.615 INFO:tasks.workunit.client.1.smithi052.stdout:4/366: rmdir de/d30/d68 39 2023-12-05T13:25:11.624 INFO:tasks.workunit.client.1.smithi052.stdout:4/367: write de/d29/f3d [791844,68090] 0 2023-12-05T13:25:11.630 INFO:tasks.workunit.client.1.smithi052.stdout:4/368: symlink de/d1e/d24/l74 0 2023-12-05T13:25:11.635 INFO:tasks.workunit.client.1.smithi052.stdout:8/459: dread d0/de/d12/d29/f50 [0,4194304] 0 2023-12-05T13:25:11.638 INFO:tasks.workunit.client.1.smithi052.stdout:4/369: link de/d30/d68/c63 de/d30/d73/c75 0 2023-12-05T13:25:11.643 INFO:tasks.workunit.client.1.smithi052.stdout:8/460: creat d0/d28/d2b/f91 x:0 0 0 2023-12-05T13:25:11.648 INFO:tasks.workunit.client.1.smithi052.stdout:4/370: mkdir de/d29/d51/d76 0 2023-12-05T13:25:11.651 INFO:tasks.workunit.client.1.smithi052.stdout:8/461: creat d0/de/d27/f92 x:0 0 0 2023-12-05T13:25:11.651 INFO:tasks.workunit.client.1.smithi052.stdout:8/462: chown d0/de/d12/f2e 117 1 2023-12-05T13:25:11.656 INFO:tasks.workunit.client.1.smithi052.stdout:4/371: symlink de/d29/l77 0 2023-12-05T13:25:11.658 INFO:tasks.workunit.client.1.smithi052.stdout:8/463: mknod d0/de/d12/d29/d81/c93 0 2023-12-05T13:25:11.658 INFO:tasks.workunit.client.1.smithi052.stdout:8/464: fsync d0/de/f38 0 2023-12-05T13:25:11.658 INFO:tasks.workunit.client.1.smithi052.stdout:8/465: chown d0/de/d12/d29/c48 2 1 2023-12-05T13:25:11.661 INFO:tasks.workunit.client.1.smithi052.stdout:8/466: write d0/f21 [263802,35928] 0 2023-12-05T13:25:11.668 INFO:tasks.workunit.client.1.smithi052.stdout:8/467: symlink d0/de/d27/l94 0 2023-12-05T13:25:11.684 INFO:tasks.workunit.client.1.smithi052.stdout:8/468: dwrite d0/f32 [8388608,4194304] 0 2023-12-05T13:25:11.684 INFO:tasks.workunit.client.1.smithi052.stdout:0/447: dwrite d0/db/d14/f26 [0,4194304] 0 2023-12-05T13:25:11.684 INFO:tasks.workunit.client.1.smithi052.stdout:0/448: readlink d0/db/d1b/d29/l48 0 2023-12-05T13:25:11.691 INFO:tasks.workunit.client.1.smithi052.stdout:8/469: rmdir d0/d28/d2b/d53/d79 0 2023-12-05T13:25:11.699 INFO:tasks.workunit.client.1.smithi052.stdout:0/449: link d0/fd d0/db/f96 0 2023-12-05T13:25:11.702 INFO:tasks.workunit.client.1.smithi052.stdout:8/470: creat d0/f95 x:0 0 0 2023-12-05T13:25:11.710 INFO:tasks.workunit.client.1.smithi052.stdout:0/450: dread d0/db/d20/f5a [0,4194304] 0 2023-12-05T13:25:11.713 INFO:tasks.workunit.client.1.smithi052.stdout:0/451: symlink d0/db/d20/d50/l97 0 2023-12-05T13:25:11.718 INFO:tasks.workunit.client.1.smithi052.stdout:8/471: dwrite d0/de/f1f [0,4194304] 0 2023-12-05T13:25:11.731 INFO:tasks.workunit.client.1.smithi052.stdout:0/452: dwrite d0/db/d14/f2f [0,4194304] 0 2023-12-05T13:25:11.731 INFO:tasks.workunit.client.1.smithi052.stdout:8/472: dread d0/de/d12/f2e [0,4194304] 0 2023-12-05T13:25:11.731 INFO:tasks.workunit.client.1.smithi052.stdout:8/473: write d0/d4d/f4c [696633,60541] 0 2023-12-05T13:25:11.737 INFO:tasks.workunit.client.1.smithi052.stdout:0/453: creat d0/db/d52/d7f/f98 x:0 0 0 2023-12-05T13:25:11.741 INFO:tasks.workunit.client.1.smithi052.stdout:8/474: creat d0/d28/d2b/f96 x:0 0 0 2023-12-05T13:25:11.750 INFO:tasks.workunit.client.1.smithi052.stdout:8/475: dread d0/de/f2f [0,4194304] 0 2023-12-05T13:25:11.752 INFO:tasks.workunit.client.1.smithi052.stdout:8/476: creat d0/de/f97 x:0 0 0 2023-12-05T13:25:11.754 INFO:tasks.workunit.client.1.smithi052.stdout:4/372: dread fa [4194304,4194304] 0 2023-12-05T13:25:11.754 INFO:tasks.workunit.client.1.smithi052.stdout:4/373: readlink de/d1e/d24/l26 0 2023-12-05T13:25:11.758 INFO:tasks.workunit.client.1.smithi052.stdout:0/454: dwrite d0/db/d1b/d51/d55/d66/d77/f95 [0,4194304] 0 2023-12-05T13:25:11.758 INFO:tasks.workunit.client.1.smithi052.stdout:0/455: dread - d0/db/d2e/f47 zero size 2023-12-05T13:25:11.758 INFO:tasks.workunit.client.1.smithi052.stdout:0/456: fsync d0/f6 0 2023-12-05T13:25:11.758 INFO:tasks.workunit.client.1.smithi052.stdout:0/457: read d0/f2b [1676687,847] 0 2023-12-05T13:25:11.770 INFO:tasks.workunit.client.1.smithi052.stdout:0/458: dwrite d0/db/d1b/f37 [0,4194304] 0 2023-12-05T13:25:11.773 INFO:tasks.workunit.client.1.smithi052.stdout:0/459: dread d0/db/d14/f40 [0,4194304] 0 2023-12-05T13:25:11.777 INFO:tasks.workunit.client.1.smithi052.stdout:0/460: creat d0/db/d52/d7f/d8f/f99 x:0 0 0 2023-12-05T13:25:11.780 INFO:tasks.workunit.client.1.smithi052.stdout:0/461: getdents d0/db/d1b 0 2023-12-05T13:25:11.783 INFO:tasks.workunit.client.1.smithi052.stdout:0/462: mknod d0/db/d2e/d53/d80/c9a 0 2023-12-05T13:25:11.783 INFO:tasks.workunit.client.1.smithi052.stdout:0/463: write d0/db/d33/f3f [756900,23252] 0 2023-12-05T13:25:11.818 INFO:tasks.workunit.client.1.smithi052.stdout:3/376: write da/f23 [1034276,107812] 0 2023-12-05T13:25:11.833 INFO:tasks.workunit.client.1.smithi052.stdout:3/377: dwrite da/d48/d50/f71 [0,4194304] 0 2023-12-05T13:25:11.839 INFO:tasks.workunit.client.1.smithi052.stdout:3/378: creat da/d25/d33/d43/f80 x:0 0 0 2023-12-05T13:25:11.839 INFO:tasks.workunit.client.1.smithi052.stdout:3/379: write da/d48/f5f [580014,13852] 0 2023-12-05T13:25:11.845 INFO:tasks.workunit.client.1.smithi052.stdout:3/380: mknod da/d25/d33/d43/d5b/c81 0 2023-12-05T13:25:11.845 INFO:tasks.workunit.client.1.smithi052.stdout:3/381: fdatasync da/d48/d50/f71 0 2023-12-05T13:25:11.861 INFO:tasks.workunit.client.1.smithi052.stdout:3/382: dwrite da/d25/d33/d43/f80 [0,4194304] 0 2023-12-05T13:25:11.868 INFO:tasks.workunit.client.1.smithi052.stdout:3/383: dread da/d27/f2d [0,4194304] 0 2023-12-05T13:25:11.870 INFO:tasks.workunit.client.1.smithi052.stdout:3/384: link l7 da/d7a/l82 0 2023-12-05T13:25:11.873 INFO:tasks.workunit.client.1.smithi052.stdout:3/385: symlink da/d48/d50/d74/l83 0 2023-12-05T13:25:11.875 INFO:tasks.workunit.client.1.smithi052.stdout:3/386: mknod da/d25/d33/d43/c84 0 2023-12-05T13:25:11.875 INFO:tasks.workunit.client.1.smithi052.stdout:3/387: truncate da/dd/d3d/f44 64882 0 2023-12-05T13:25:11.878 INFO:tasks.workunit.client.1.smithi052.stdout:3/388: rename da/dd/d3d/f44 to da/d2e/f85 0 2023-12-05T13:25:11.881 INFO:tasks.workunit.client.1.smithi052.stdout:3/389: mknod da/d2e/d40/c86 0 2023-12-05T13:25:11.885 INFO:tasks.workunit.client.1.smithi052.stdout:3/390: dread da/d27/f28 [0,4194304] 0 2023-12-05T13:25:11.886 INFO:tasks.workunit.client.1.smithi052.stdout:3/391: chown da/d2e 22861925 1 2023-12-05T13:25:11.886 INFO:tasks.workunit.client.1.smithi052.stdout:3/392: write da/f23 [478318,48261] 0 2023-12-05T13:25:11.889 INFO:tasks.workunit.client.1.smithi052.stdout:3/393: rename da/d27/f28 to da/dd/d3d/f87 0 2023-12-05T13:25:11.890 INFO:tasks.workunit.client.1.smithi052.stdout:3/394: fsync da/d25/f6f 0 2023-12-05T13:25:11.893 INFO:tasks.workunit.client.1.smithi052.stdout:3/395: creat da/d25/d33/d51/f88 x:0 0 0 2023-12-05T13:25:11.902 INFO:tasks.workunit.client.1.smithi052.stdout:3/396: dread da/fe [0,4194304] 0 2023-12-05T13:25:11.982 INFO:tasks.workunit.client.1.smithi052.stdout:9/264: sync 2023-12-05T13:25:11.982 INFO:tasks.workunit.client.1.smithi052.stdout:1/355: sync 2023-12-05T13:25:11.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/439: sync 2023-12-05T13:25:11.982 INFO:tasks.workunit.client.1.smithi052.stdout:9/265: fsync d3/d1e/d37/f38 0 2023-12-05T13:25:11.982 INFO:tasks.workunit.client.1.smithi052.stdout:9/266: read - d3/d1e/d37/f38 zero size 2023-12-05T13:25:11.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/440: write d2/d13/d45/f4a [4177234,79745] 0 2023-12-05T13:25:11.985 INFO:tasks.workunit.client.1.smithi052.stdout:9/267: creat d3/d11/d19/f53 x:0 0 0 2023-12-05T13:25:11.986 INFO:tasks.workunit.client.1.smithi052.stdout:1/356: dread d5/d26/f66 [0,4194304] 0 2023-12-05T13:25:11.989 INFO:tasks.workunit.client.1.smithi052.stdout:2/441: creat d2/d4/d63/d6d/f85 x:0 0 0 2023-12-05T13:25:11.992 INFO:tasks.workunit.client.1.smithi052.stdout:9/268: getdents d3/d11/d3e 0 2023-12-05T13:25:11.996 INFO:tasks.workunit.client.1.smithi052.stdout:1/357: mknod d5/d7/de/d18/c6f 0 2023-12-05T13:25:11.997 INFO:tasks.workunit.client.1.smithi052.stdout:1/358: read d5/f8 [5893178,66973] 0 2023-12-05T13:25:11.999 INFO:tasks.workunit.client.1.smithi052.stdout:2/442: mknod d2/d13/d37/d5c/d80/c86 0 2023-12-05T13:25:12.001 INFO:tasks.workunit.client.1.smithi052.stdout:1/359: mknod d5/d7/d35/c70 0 2023-12-05T13:25:12.004 INFO:tasks.workunit.client.1.smithi052.stdout:2/443: truncate d2/d13/d1e/d6a/d7f/d84/d3a/d4b/f79 858083 0 2023-12-05T13:25:12.004 INFO:tasks.workunit.client.1.smithi052.stdout:2/444: dread - d2/d4/f58 zero size 2023-12-05T13:25:12.006 INFO:tasks.workunit.client.1.smithi052.stdout:1/360: creat d5/d7/d35/f71 x:0 0 0 2023-12-05T13:25:12.006 INFO:tasks.workunit.client.1.smithi052.stdout:1/361: truncate d5/f64 1563171 0 2023-12-05T13:25:12.008 INFO:tasks.workunit.client.1.smithi052.stdout:2/445: link d2/l2e d2/d13/d37/d61/l87 0 2023-12-05T13:25:12.011 INFO:tasks.workunit.client.1.smithi052.stdout:1/362: creat d5/d7/d35/d37/d68/f72 x:0 0 0 2023-12-05T13:25:12.011 INFO:tasks.workunit.client.1.smithi052.stdout:1/363: dread - d5/d7/de/d18/d2e/f5b zero size 2023-12-05T13:25:12.011 INFO:tasks.workunit.client.1.smithi052.stdout:1/364: chown d5/d7/d35/c70 5 1 2023-12-05T13:25:12.011 INFO:tasks.workunit.client.1.smithi052.stdout:9/269: dwrite d3/d11/d19/f53 [0,4194304] 0 2023-12-05T13:25:12.011 INFO:tasks.workunit.client.1.smithi052.stdout:9/270: dread - d3/d1e/d37/d4f/f52 zero size 2023-12-05T13:25:12.012 INFO:tasks.workunit.client.1.smithi052.stdout:9/271: write d3/d1e/d37/d4f/f52 [595968,2003] 0 2023-12-05T13:25:12.013 INFO:tasks.workunit.client.1.smithi052.stdout:2/446: write d2/d13/d1e/f3d [477753,96824] 0 2023-12-05T13:25:12.013 INFO:tasks.workunit.client.1.smithi052.stdout:2/447: truncate d2/d4/f83 213047 0 2023-12-05T13:25:12.014 INFO:tasks.workunit.client.1.smithi052.stdout:1/365: mkdir d5/d7/d35/d37/d5a/d73 0 2023-12-05T13:25:12.015 INFO:tasks.workunit.client.1.smithi052.stdout:1/366: chown d5/d7/d35/d37/d68/d2a/l5e 211346224 1 2023-12-05T13:25:12.019 INFO:tasks.workunit.client.1.smithi052.stdout:1/367: write d5/d7/f47 [200141,32247] 0 2023-12-05T13:25:12.020 INFO:tasks.workunit.client.1.smithi052.stdout:1/368: write d5/d7/f12 [2034492,99463] 0 2023-12-05T13:25:12.021 INFO:tasks.workunit.client.1.smithi052.stdout:2/448: read d2/d13/d1e/f54 [3446414,42625] 0 2023-12-05T13:25:12.025 INFO:tasks.workunit.client.1.smithi052.stdout:1/369: dread d5/d7/d35/d37/d68/f6d [0,4194304] 0 2023-12-05T13:25:12.025 INFO:tasks.workunit.client.1.smithi052.stdout:1/370: stat d5/d7/d35/d37/d43 0 2023-12-05T13:25:12.025 INFO:tasks.workunit.client.1.smithi052.stdout:1/371: truncate d5/d7/de/d18/d2e/f5b 238153 0 2023-12-05T13:25:12.029 INFO:tasks.workunit.client.1.smithi052.stdout:9/272: dwrite d3/fd [0,4194304] 0 2023-12-05T13:25:12.029 INFO:tasks.workunit.client.1.smithi052.stdout:1/372: mkdir d5/d7/de/d74 0 2023-12-05T13:25:12.039 INFO:tasks.workunit.client.1.smithi052.stdout:9/273: truncate d3/f26 419879 0 2023-12-05T13:25:12.041 INFO:tasks.workunit.client.1.smithi052.stdout:2/449: dwrite d2/d13/d1e/d6a/d7f/f81 [0,4194304] 0 2023-12-05T13:25:12.041 INFO:tasks.workunit.client.1.smithi052.stdout:2/450: chown d2/d4/f58 852 1 2023-12-05T13:25:12.044 INFO:tasks.workunit.client.1.smithi052.stdout:9/274: unlink d3/d1e/d37/f38 0 2023-12-05T13:25:12.049 INFO:tasks.workunit.client.1.smithi052.stdout:1/373: dwrite d5/d7/d35/d37/d68/f55 [0,4194304] 0 2023-12-05T13:25:12.059 INFO:tasks.workunit.client.1.smithi052.stdout:9/275: dwrite d3/d11/d3e/f51 [0,4194304] 0 2023-12-05T13:25:12.062 INFO:tasks.workunit.client.1.smithi052.stdout:1/374: dwrite d5/d7/de/d18/d2e/f5b [0,4194304] 0 2023-12-05T13:25:12.065 INFO:tasks.workunit.client.1.smithi052.stdout:9/276: rmdir d3/d11/d3e 39 2023-12-05T13:25:12.065 INFO:tasks.workunit.client.1.smithi052.stdout:9/277: fdatasync d3/fd 0 2023-12-05T13:25:12.065 INFO:tasks.workunit.client.1.smithi052.stdout:9/278: stat d3/d11/f42 0 2023-12-05T13:25:12.069 INFO:tasks.workunit.client.1.smithi052.stdout:1/375: mkdir d5/d26/d75 0 2023-12-05T13:25:12.072 INFO:tasks.workunit.client.1.smithi052.stdout:9/279: rmdir d3/d2a 39 2023-12-05T13:25:12.072 INFO:tasks.workunit.client.1.smithi052.stdout:9/280: write d3/d11/f48 [106652,76753] 0 2023-12-05T13:25:12.073 INFO:tasks.workunit.client.1.smithi052.stdout:9/281: getdents d3/d11/d3e 0 2023-12-05T13:25:12.092 INFO:tasks.workunit.client.1.smithi052.stdout:1/376: dwrite d5/d7/d35/d2f/d3e/f58 [0,4194304] 0 2023-12-05T13:25:12.367 INFO:tasks.workunit.client.1.smithi052.stdout:8/477: fsync d0/d28/d2b/f91 0 2023-12-05T13:25:13.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:12 smithi052 ceph-mon[121072]: pgmap v206: 65 pgs: 65 active+clean; 929 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 33 MiB/s rd, 66 MiB/s wr, 472 op/s 2023-12-05T13:25:13.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:12 smithi029 ceph-mon[112128]: pgmap v206: 65 pgs: 65 active+clean; 929 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 33 MiB/s rd, 66 MiB/s wr, 472 op/s 2023-12-05T13:25:13.665 INFO:tasks.workunit.client.1.smithi052.stdout:8/478: mkdir d0/de/d98 0 2023-12-05T13:25:13.665 INFO:tasks.workunit.client.1.smithi052.stdout:8/479: chown d0/de/d12/d29/l6b 4166477 1 2023-12-05T13:25:13.667 INFO:tasks.workunit.client.1.smithi052.stdout:8/480: mkdir d0/d62/d99 0 2023-12-05T13:25:13.669 INFO:tasks.workunit.client.1.smithi052.stdout:8/481: creat d0/d62/d99/f9a x:0 0 0 2023-12-05T13:25:14.227 INFO:tasks.workunit.client.1.smithi052.stdout:8/482: unlink d0/c2d 0 2023-12-05T13:25:14.278 INFO:tasks.workunit.client.1.smithi052.stdout:8/483: dwrite d0/d28/d2b/f7f [0,4194304] 0 2023-12-05T13:25:14.279 INFO:tasks.workunit.client.1.smithi052.stdout:8/484: getdents d0/de/d98 0 2023-12-05T13:25:14.286 INFO:tasks.workunit.client.1.smithi052.stdout:8/485: mknod d0/d51/c9b 0 2023-12-05T13:25:14.287 INFO:tasks.workunit.client.1.smithi052.stdout:8/486: write d0/d28/d2b/f7f [2155664,89038] 0 2023-12-05T13:25:14.287 INFO:tasks.workunit.client.1.smithi052.stdout:8/487: truncate d0/d28/f87 877724 0 2023-12-05T13:25:14.289 INFO:tasks.workunit.client.1.smithi052.stdout:8/488: mkdir d0/de/d98/d9c 0 2023-12-05T13:25:14.293 INFO:tasks.workunit.client.1.smithi052.stdout:8/489: creat d0/de/d27/d43/d63/f9d x:0 0 0 2023-12-05T13:25:14.295 INFO:tasks.workunit.client.1.smithi052.stdout:8/490: mknod d0/d62/d99/c9e 0 2023-12-05T13:25:14.312 INFO:tasks.workunit.client.1.smithi052.stdout:8/491: dwrite d0/de/f41 [8388608,4194304] 0 2023-12-05T13:25:14.312 INFO:tasks.workunit.client.1.smithi052.stdout:8/492: write d0/d28/f7c [855721,3450] 0 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:3/397: sync 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:6/294: sync 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:7/504: sync 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:5/242: sync 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:1/377: sync 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:9/282: sync 2023-12-05T13:25:14.504 INFO:tasks.workunit.client.1.smithi052.stdout:2/451: sync 2023-12-05T13:25:14.505 INFO:tasks.workunit.client.1.smithi052.stdout:3/398: fsync f4 0 2023-12-05T13:25:14.505 INFO:tasks.workunit.client.1.smithi052.stdout:9/283: chown d3/d11/d3e/f4c 11 1 2023-12-05T13:25:14.505 INFO:tasks.workunit.client.1.smithi052.stdout:6/295: truncate d3/d4/df/f43 853614 0 2023-12-05T13:25:14.505 INFO:tasks.workunit.client.1.smithi052.stdout:0/464: sync 2023-12-05T13:25:14.505 INFO:tasks.workunit.client.1.smithi052.stdout:4/374: sync 2023-12-05T13:25:14.505 INFO:tasks.workunit.client.1.smithi052.stdout:7/505: write d7/d31/d56/f9a [1521766,106938] 0 2023-12-05T13:25:14.509 INFO:tasks.workunit.client.1.smithi052.stdout:5/243: rename d5/c7 to d5/c55 0 2023-12-05T13:25:14.513 INFO:tasks.workunit.client.1.smithi052.stdout:1/378: mkdir d5/d7/d35/d37/d5a/d73/d76 0 2023-12-05T13:25:14.516 INFO:tasks.workunit.client.1.smithi052.stdout:2/452: symlink d2/d13/d37/d61/l88 0 2023-12-05T13:25:14.518 INFO:tasks.workunit.client.1.smithi052.stdout:9/284: creat d3/d1e/d37/d4f/f54 x:0 0 0 2023-12-05T13:25:14.522 INFO:tasks.workunit.client.1.smithi052.stdout:0/465: getdents d0/db/d1b/d42 0 2023-12-05T13:25:14.524 INFO:tasks.workunit.client.1.smithi052.stdout:3/399: dwrite da/d27/f2d [4194304,4194304] 0 2023-12-05T13:25:14.524 INFO:tasks.workunit.client.1.smithi052.stdout:4/375: mknod de/d30/d73/c78 0 2023-12-05T13:25:14.524 INFO:tasks.workunit.client.1.smithi052.stdout:6/296: dwrite d3/d5/d9/f64 [0,4194304] 0 2023-12-05T13:25:14.529 INFO:tasks.workunit.client.1.smithi052.stdout:2/453: dread d2/f3c [0,4194304] 0 2023-12-05T13:25:14.529 INFO:tasks.workunit.client.1.smithi052.stdout:7/506: mknod d7/d4e/d12/d3f/cad 0 2023-12-05T13:25:14.530 INFO:tasks.workunit.client.1.smithi052.stdout:7/507: chown d7/d4e/d45/d50 374903 1 2023-12-05T13:25:14.532 INFO:tasks.workunit.client.1.smithi052.stdout:5/244: truncate d5/d15/d21/f3a 804439 0 2023-12-05T13:25:14.537 INFO:tasks.workunit.client.1.smithi052.stdout:1/379: creat d5/d7/de/d74/f77 x:0 0 0 2023-12-05T13:25:14.538 INFO:tasks.workunit.client.1.smithi052.stdout:5/245: dread d5/fc [0,4194304] 0 2023-12-05T13:25:14.540 INFO:tasks.workunit.client.1.smithi052.stdout:9/285: symlink d3/d31/l55 0 2023-12-05T13:25:14.542 INFO:tasks.workunit.client.1.smithi052.stdout:6/297: dwrite d3/d5/d9/d21/d48/f4e [0,4194304] 0 2023-12-05T13:25:14.543 INFO:tasks.workunit.client.1.smithi052.stdout:0/466: mkdir d0/db/d14/d9b 0 2023-12-05T13:25:14.545 INFO:tasks.workunit.client.1.smithi052.stdout:5/246: dread d5/f9 [4194304,4194304] 0 2023-12-05T13:25:14.545 INFO:tasks.workunit.client.1.smithi052.stdout:5/247: chown d5/fc 0 1 2023-12-05T13:25:14.550 INFO:tasks.workunit.client.1.smithi052.stdout:3/400: getdents da 0 2023-12-05T13:25:14.552 INFO:tasks.workunit.client.1.smithi052.stdout:4/376: link de/d30/c53 de/d30/d68/d59/c79 0 2023-12-05T13:25:14.561 INFO:tasks.workunit.client.1.smithi052.stdout:2/454: link d2/d4/d63/d6d/f85 d2/d4/f89 0 2023-12-05T13:25:14.561 INFO:tasks.workunit.client.1.smithi052.stdout:2/455: chown d2/d13/d45/f4a 8133 1 2023-12-05T13:25:14.562 INFO:tasks.workunit.client.1.smithi052.stdout:7/508: mkdir d7/d4e/d45/d5a/d16/dae 0 2023-12-05T13:25:14.562 INFO:tasks.workunit.client.1.smithi052.stdout:2/456: readlink d2/d14/d62/l64 0 2023-12-05T13:25:14.565 INFO:tasks.workunit.client.1.smithi052.stdout:9/286: symlink d3/d1e/d37/d4f/l56 0 2023-12-05T13:25:14.570 INFO:tasks.workunit.client.1.smithi052.stdout:6/298: mkdir d3/d5/d9/d21/d48/d4d/d66 0 2023-12-05T13:25:14.573 INFO:tasks.workunit.client.1.smithi052.stdout:5/248: rmdir d5/df/d11/d51 0 2023-12-05T13:25:14.574 INFO:tasks.workunit.client.1.smithi052.stdout:3/401: mkdir da/d25/d33/d89 0 2023-12-05T13:25:14.583 INFO:tasks.workunit.client.1.smithi052.stdout:9/287: mkdir d3/d1e/d41/d57 0 2023-12-05T13:25:14.588 INFO:tasks.workunit.client.1.smithi052.stdout:2/457: dread d2/d13/d1e/d6a/d7f/d84/d3a/d4b/f60 [0,4194304] 0 2023-12-05T13:25:14.589 INFO:tasks.workunit.client.1.smithi052.stdout:1/380: dwrite f4 [0,4194304] 0 2023-12-05T13:25:14.590 INFO:tasks.workunit.client.1.smithi052.stdout:4/377: dread f4 [0,4194304] 0 2023-12-05T13:25:14.590 INFO:tasks.workunit.client.1.smithi052.stdout:6/299: creat d3/d5/d9/d21/d5f/f67 x:0 0 0 2023-12-05T13:25:14.590 INFO:tasks.workunit.client.1.smithi052.stdout:7/509: mknod d7/d4e/d12/caf 0 2023-12-05T13:25:14.591 INFO:tasks.workunit.client.1.smithi052.stdout:3/402: creat da/d25/d33/d49/f8a x:0 0 0 2023-12-05T13:25:14.591 INFO:tasks.workunit.client.1.smithi052.stdout:3/403: read da/d25/f37 [877719,116520] 0 2023-12-05T13:25:14.591 INFO:tasks.workunit.client.1.smithi052.stdout:3/404: read - da/d25/d33/d51/f88 zero size 2023-12-05T13:25:14.591 INFO:tasks.workunit.client.1.smithi052.stdout:7/510: write d7/d4e/d45/d5a/d63/f6d [129898,12728] 0 2023-12-05T13:25:14.592 INFO:tasks.workunit.client.1.smithi052.stdout:9/288: mknod d3/d1e/d37/d4f/c58 0 2023-12-05T13:25:14.592 INFO:tasks.workunit.client.1.smithi052.stdout:9/289: dread - d3/d2a/f4e zero size 2023-12-05T13:25:14.593 INFO:tasks.workunit.client.1.smithi052.stdout:2/458: readlink d2/d14/l15 0 2023-12-05T13:25:14.593 INFO:tasks.workunit.client.1.smithi052.stdout:2/459: fdatasync d2/d13/d1e/f3d 0 2023-12-05T13:25:14.595 INFO:tasks.workunit.client.1.smithi052.stdout:1/381: creat d5/d7/d35/d37/d43/f78 x:0 0 0 2023-12-05T13:25:14.599 INFO:tasks.workunit.client.1.smithi052.stdout:6/300: mknod d3/d5/d9/d21/d48/d4d/c68 0 2023-12-05T13:25:14.602 INFO:tasks.workunit.client.1.smithi052.stdout:7/511: unlink d7/d4e/d45/f99 0 2023-12-05T13:25:14.607 INFO:tasks.workunit.client.1.smithi052.stdout:9/290: creat d3/d2a/f59 x:0 0 0 2023-12-05T13:25:14.614 INFO:tasks.workunit.client.1.smithi052.stdout:6/301: mkdir d3/d4/d6/d26/d69 0 2023-12-05T13:25:14.617 INFO:tasks.workunit.client.1.smithi052.stdout:7/512: creat d7/d4e/d45/d93/fb0 x:0 0 0 2023-12-05T13:25:14.618 INFO:tasks.workunit.client.1.smithi052.stdout:7/513: fsync d7/d4e/f1a 0 2023-12-05T13:25:14.618 INFO:tasks.workunit.client.1.smithi052.stdout:7/514: chown d7/d4e/d45/d79/d91/c74 15904581 1 2023-12-05T13:25:14.618 INFO:tasks.workunit.client.1.smithi052.stdout:3/405: dwrite f4 [0,4194304] 0 2023-12-05T13:25:14.619 INFO:tasks.workunit.client.1.smithi052.stdout:9/291: symlink d3/d1e/l5a 0 2023-12-05T13:25:14.622 INFO:tasks.workunit.client.1.smithi052.stdout:6/302: unlink d3/d4/d6/f46 0 2023-12-05T13:25:14.624 INFO:tasks.workunit.client.1.smithi052.stdout:2/460: dwrite d2/f2a [0,4194304] 0 2023-12-05T13:25:14.624 INFO:tasks.workunit.client.1.smithi052.stdout:1/382: dwrite d5/d7/f50 [0,4194304] 0 2023-12-05T13:25:14.624 INFO:tasks.workunit.client.1.smithi052.stdout:1/383: readlink d5/d7/d35/d37/d68/d2a/l2b 0 2023-12-05T13:25:14.624 INFO:tasks.workunit.client.1.smithi052.stdout:3/406: creat da/d48/f8b x:0 0 0 2023-12-05T13:25:14.628 INFO:tasks.workunit.client.1.smithi052.stdout:6/303: link d3/d5/d9/d21/d48/d5b/l5c d3/d5/d9/d44/l6a 0 2023-12-05T13:25:14.629 INFO:tasks.workunit.client.1.smithi052.stdout:7/515: dread d7/d4e/d45/d5a/f87 [0,4194304] 0 2023-12-05T13:25:14.631 INFO:tasks.workunit.client.1.smithi052.stdout:9/292: dwrite d3/d1e/d37/d4f/f54 [0,4194304] 0 2023-12-05T13:25:14.632 INFO:tasks.workunit.client.1.smithi052.stdout:2/461: symlink d2/d13/d37/d61/l8a 0 2023-12-05T13:25:14.638 INFO:tasks.workunit.client.1.smithi052.stdout:1/384: mkdir d5/d7/d35/d37/d68/d79 0 2023-12-05T13:25:14.638 INFO:tasks.workunit.client.1.smithi052.stdout:1/385: chown d5/d7/d52/l53 224490123 1 2023-12-05T13:25:14.639 INFO:tasks.workunit.client.1.smithi052.stdout:1/386: write f4 [165913,3571] 0 2023-12-05T13:25:14.640 INFO:tasks.workunit.client.1.smithi052.stdout:1/387: write d5/d7/d35/d2f/f4d [998847,59537] 0 2023-12-05T13:25:14.642 INFO:tasks.workunit.client.1.smithi052.stdout:3/407: unlink da/dd/f4e 0 2023-12-05T13:25:14.645 INFO:tasks.workunit.client.1.smithi052.stdout:6/304: symlink d3/d5/d9/d52/l6b 0 2023-12-05T13:25:14.648 INFO:tasks.workunit.client.1.smithi052.stdout:7/516: getdents d7 0 2023-12-05T13:25:14.648 INFO:tasks.workunit.client.1.smithi052.stdout:7/517: truncate d7/d4e/d12/f8b 557469 0 2023-12-05T13:25:14.648 INFO:tasks.workunit.client.1.smithi052.stdout:7/518: fsync d7/f73 0 2023-12-05T13:25:14.658 INFO:tasks.workunit.client.1.smithi052.stdout:9/293: creat d3/d11/d19/f5b x:0 0 0 2023-12-05T13:25:14.658 INFO:tasks.workunit.client.1.smithi052.stdout:9/294: fsync d3/d11/f21 0 2023-12-05T13:25:14.659 INFO:tasks.workunit.client.1.smithi052.stdout:2/462: rmdir d2/d13/d37/d5c/d80 39 2023-12-05T13:25:14.661 INFO:tasks.workunit.client.1.smithi052.stdout:1/388: mkdir d5/d26/d75/d7a 0 2023-12-05T13:25:14.662 INFO:tasks.workunit.client.1.smithi052.stdout:3/408: dwrite da/f18 [0,4194304] 0 2023-12-05T13:25:14.662 INFO:tasks.workunit.client.1.smithi052.stdout:3/409: fdatasync da/dd/f55 0 2023-12-05T13:25:14.663 INFO:tasks.workunit.client.1.smithi052.stdout:6/305: dwrite d3/d5/f34 [0,4194304] 0 2023-12-05T13:25:14.663 INFO:tasks.workunit.client.1.smithi052.stdout:6/306: chown d3/d4/df/d24/c62 0 1 2023-12-05T13:25:14.663 INFO:tasks.workunit.client.1.smithi052.stdout:6/307: readlink d3/d5/d9/d21/d48/l61 0 2023-12-05T13:25:14.664 INFO:tasks.workunit.client.1.smithi052.stdout:9/295: mkdir d3/d2a/d5c 0 2023-12-05T13:25:14.664 INFO:tasks.workunit.client.1.smithi052.stdout:9/296: fsync d3/d1e/d41/f46 0 2023-12-05T13:25:14.666 INFO:tasks.workunit.client.1.smithi052.stdout:2/463: mkdir d2/d13/d37/d8b 0 2023-12-05T13:25:14.666 INFO:tasks.workunit.client.1.smithi052.stdout:2/464: stat d2/d13/d48/f67 0 2023-12-05T13:25:14.666 INFO:tasks.workunit.client.1.smithi052.stdout:6/308: dread d3/d5/d9/d52/f54 [4194304,4194304] 0 2023-12-05T13:25:14.666 INFO:tasks.workunit.client.1.smithi052.stdout:7/519: dwrite d7/d4e/d45/d5a/f19 [0,4194304] 0 2023-12-05T13:25:14.668 INFO:tasks.workunit.client.1.smithi052.stdout:1/389: symlink d5/d7/d35/d37/d68/l7b 0 2023-12-05T13:25:14.670 INFO:tasks.workunit.client.1.smithi052.stdout:2/465: dread d2/d4/d3f/f5b [0,4194304] 0 2023-12-05T13:25:14.670 INFO:tasks.workunit.client.1.smithi052.stdout:2/466: truncate d2/d13/d37/f69 1088946 0 2023-12-05T13:25:14.670 INFO:tasks.workunit.client.1.smithi052.stdout:2/467: stat d2/d13/d37/d61/l87 0 2023-12-05T13:25:14.672 INFO:tasks.workunit.client.1.smithi052.stdout:3/410: mknod da/d7a/c8c 0 2023-12-05T13:25:14.673 INFO:tasks.workunit.client.1.smithi052.stdout:3/411: write da/d2e/f85 [883852,113760] 0 2023-12-05T13:25:14.674 INFO:tasks.workunit.client.1.smithi052.stdout:2/468: dread d2/f3c [0,4194304] 0 2023-12-05T13:25:14.677 INFO:tasks.workunit.client.1.smithi052.stdout:9/297: unlink d3/c14 0 2023-12-05T13:25:14.679 INFO:tasks.workunit.client.1.smithi052.stdout:6/309: mkdir d3/d5/d9/d21/d48/d4d/d66/d6c 0 2023-12-05T13:25:14.681 INFO:tasks.workunit.client.1.smithi052.stdout:7/520: symlink d7/d4e/d45/d5a/d16/dae/lb1 0 2023-12-05T13:25:14.686 INFO:tasks.workunit.client.1.smithi052.stdout:1/390: creat d5/d7/de/d18/d2e/d65/f7c x:0 0 0 2023-12-05T13:25:14.686 INFO:tasks.workunit.client.1.smithi052.stdout:1/391: stat d5/d7/d35/d2f/c60 0 2023-12-05T13:25:14.686 INFO:tasks.workunit.client.1.smithi052.stdout:1/392: readlink d5/d7/l1b 0 2023-12-05T13:25:14.691 INFO:tasks.workunit.client.1.smithi052.stdout:3/412: symlink da/d48/d50/d74/l8d 0 2023-12-05T13:25:14.691 INFO:tasks.workunit.client.1.smithi052.stdout:3/413: readlink da/l13 0 2023-12-05T13:25:14.691 INFO:tasks.workunit.client.1.smithi052.stdout:3/414: chown da/d48/d50/l59 324872723 1 2023-12-05T13:25:14.695 INFO:tasks.workunit.client.1.smithi052.stdout:7/521: dwrite d7/d4e/d12/d3f/d46/f4a [0,4194304] 0 2023-12-05T13:25:14.695 INFO:tasks.workunit.client.1.smithi052.stdout:9/298: dwrite d3/fd [0,4194304] 0 2023-12-05T13:25:14.704 INFO:tasks.workunit.client.1.smithi052.stdout:9/299: creat d3/d1e/d41/f5d x:0 0 0 2023-12-05T13:25:14.706 INFO:tasks.workunit.client.1.smithi052.stdout:2/469: dwrite d2/d13/d1e/f71 [0,4194304] 0 2023-12-05T13:25:14.711 INFO:tasks.workunit.client.1.smithi052.stdout:9/300: mkdir d3/d5e 0 2023-12-05T13:25:14.711 INFO:tasks.workunit.client.1.smithi052.stdout:9/301: fdatasync d3/d11/d19/f27 0 2023-12-05T13:25:14.711 INFO:tasks.workunit.client.1.smithi052.stdout:9/302: chown d3/d11/d19/f27 371594617 1 2023-12-05T13:25:14.715 INFO:tasks.workunit.client.1.smithi052.stdout:2/470: creat d2/d13/d37/d5c/f8c x:0 0 0 2023-12-05T13:25:14.715 INFO:tasks.workunit.client.1.smithi052.stdout:2/471: chown d2/d14/f82 19455 1 2023-12-05T13:25:14.716 INFO:tasks.workunit.client.1.smithi052.stdout:9/303: mkdir d3/d1e/d41/d5f 0 2023-12-05T13:25:14.718 INFO:tasks.workunit.client.1.smithi052.stdout:2/472: rmdir d2/d13/d1e/d6a/d7f/d84 39 2023-12-05T13:25:14.719 INFO:tasks.workunit.client.1.smithi052.stdout:9/304: creat d3/d1e/f60 x:0 0 0 2023-12-05T13:25:14.720 INFO:tasks.workunit.client.1.smithi052.stdout:9/305: read d3/fd [1705706,118648] 0 2023-12-05T13:25:14.720 INFO:tasks.workunit.client.1.smithi052.stdout:9/306: chown d3/le 32644 1 2023-12-05T13:25:14.725 INFO:tasks.workunit.client.1.smithi052.stdout:2/473: dread d2/d13/d1e/f27 [0,4194304] 0 2023-12-05T13:25:14.737 INFO:tasks.workunit.client.1.smithi052.stdout:2/474: dwrite d2/f2f [4194304,4194304] 0 2023-12-05T13:25:14.739 INFO:tasks.workunit.client.1.smithi052.stdout:2/475: dread d2/d13/d1e/f3d [0,4194304] 0 2023-12-05T13:25:14.742 INFO:tasks.workunit.client.1.smithi052.stdout:2/476: symlink d2/d4/d63/d6d/l8d 0 2023-12-05T13:25:14.742 INFO:tasks.workunit.client.1.smithi052.stdout:2/477: chown d2/d13/d1e/d6a/d7f/f81 252 1 2023-12-05T13:25:14.748 INFO:tasks.workunit.client.1.smithi052.stdout:2/478: dread d2/d14/f5a [0,4194304] 0 2023-12-05T13:25:14.752 INFO:tasks.workunit.client.1.smithi052.stdout:2/479: creat d2/d13/d1e/d6a/d7f/d84/d3a/d4b/f8e x:0 0 0 2023-12-05T13:25:14.758 INFO:tasks.workunit.client.1.smithi052.stdout:2/480: rename d2/d14/f82 to d2/d14/f8f 0 2023-12-05T13:25:15.063 INFO:tasks.workunit.client.1.smithi052.stdout:8/493: rename d0/d62/d99 to d0/d28/d39/d3a/d9f 0 2023-12-05T13:25:15.067 INFO:tasks.workunit.client.1.smithi052.stdout:4/378: rename de/f4a to de/d2b/d64/d69/f7a 0 2023-12-05T13:25:15.071 INFO:tasks.workunit.client.1.smithi052.stdout:3/415: rename da/d48/l61 to da/d25/d33/d43/l8e 0 2023-12-05T13:25:15.071 INFO:tasks.workunit.client.1.smithi052.stdout:4/379: rename de/d30 to de/d30/d73/d7b 22 2023-12-05T13:25:15.076 INFO:tasks.workunit.client.1.smithi052.stdout:3/416: mknod da/d7a/c8f 0 2023-12-05T13:25:15.076 INFO:tasks.workunit.client.1.smithi052.stdout:3/417: fdatasync da/d25/d33/d43/d5b/f5c 0 2023-12-05T13:25:15.076 INFO:tasks.workunit.client.1.smithi052.stdout:3/418: fsync da/dd/f26 0 2023-12-05T13:25:15.076 INFO:tasks.workunit.client.1.smithi052.stdout:8/494: dwrite d0/de/d27/d43/d63/f9d [0,4194304] 0 2023-12-05T13:25:15.077 INFO:tasks.workunit.client.1.smithi052.stdout:4/380: creat de/d30/d68/f7c x:0 0 0 2023-12-05T13:25:15.082 INFO:tasks.workunit.client.1.smithi052.stdout:8/495: dread d0/d28/d39/d3a/f5b [0,4194304] 0 2023-12-05T13:25:15.082 INFO:tasks.workunit.client.1.smithi052.stdout:8/496: chown d0/d4d/c24 324631 1 2023-12-05T13:25:15.085 INFO:tasks.workunit.client.1.smithi052.stdout:8/497: write d0/de/d27/d43/d63/f8b [965106,14590] 0 2023-12-05T13:25:15.091 INFO:tasks.workunit.client.1.smithi052.stdout:8/498: rmdir d0/de 39 2023-12-05T13:25:15.091 INFO:tasks.workunit.client.1.smithi052.stdout:8/499: write d0/de/f97 [881415,125008] 0 2023-12-05T13:25:15.094 INFO:tasks.workunit.client.1.smithi052.stdout:3/419: dwrite da/d25/d33/d43/d5b/f67 [0,4194304] 0 2023-12-05T13:25:15.095 INFO:tasks.workunit.client.1.smithi052.stdout:8/500: rename d0/de/d12/c36 to d0/ca0 0 2023-12-05T13:25:15.098 INFO:tasks.workunit.client.1.smithi052.stdout:4/381: dwrite de/d1e/d24/f6e [0,4194304] 0 2023-12-05T13:25:15.101 INFO:tasks.workunit.client.1.smithi052.stdout:3/420: creat da/dd/f90 x:0 0 0 2023-12-05T13:25:15.103 INFO:tasks.workunit.client.1.smithi052.stdout:8/501: creat d0/de/fa1 x:0 0 0 2023-12-05T13:25:15.108 INFO:tasks.workunit.client.1.smithi052.stdout:3/421: creat da/d25/d33/d89/f91 x:0 0 0 2023-12-05T13:25:15.110 INFO:tasks.workunit.client.1.smithi052.stdout:8/502: getdents d0/d28/d2b/d53 0 2023-12-05T13:25:15.117 INFO:tasks.workunit.client.1.smithi052.stdout:4/382: dwrite de/f11 [0,4194304] 0 2023-12-05T13:25:15.122 INFO:tasks.workunit.client.1.smithi052.stdout:3/422: dread da/d2e/f3c [0,4194304] 0 2023-12-05T13:25:15.122 INFO:tasks.workunit.client.1.smithi052.stdout:3/423: dread - da/dd/f90 zero size 2023-12-05T13:25:15.122 INFO:tasks.workunit.client.1.smithi052.stdout:8/503: unlink d0/d28/d2b/d53/d56/c7a 0 2023-12-05T13:25:15.140 INFO:tasks.workunit.client.1.smithi052.stdout:4/383: dwrite de/f33 [0,4194304] 0 2023-12-05T13:25:15.141 INFO:tasks.workunit.client.1.smithi052.stdout:3/424: dwrite da/f6e [0,4194304] 0 2023-12-05T13:25:15.142 INFO:tasks.workunit.client.1.smithi052.stdout:8/504: dwrite d0/de/d27/d43/d63/f9d [0,4194304] 0 2023-12-05T13:25:15.147 INFO:tasks.workunit.client.1.smithi052.stdout:8/505: write d0/de/d27/d43/d63/f8b [85582,13554] 0 2023-12-05T13:25:15.147 INFO:tasks.workunit.client.1.smithi052.stdout:8/506: readlink d0/de/l74 0 2023-12-05T13:25:15.148 INFO:tasks.workunit.client.1.smithi052.stdout:3/425: creat da/d27/f92 x:0 0 0 2023-12-05T13:25:15.153 INFO:tasks.workunit.client.1.smithi052.stdout:3/426: mknod da/d48/d50/c93 0 2023-12-05T13:25:15.157 INFO:tasks.workunit.client.1.smithi052.stdout:4/384: dwrite de/f33 [0,4194304] 0 2023-12-05T13:25:15.157 INFO:tasks.workunit.client.1.smithi052.stdout:4/385: readlink de/l13 0 2023-12-05T13:25:15.163 INFO:tasks.workunit.client.1.smithi052.stdout:4/386: mknod de/d30/d68/d59/c7d 0 2023-12-05T13:25:15.163 INFO:tasks.workunit.client.1.smithi052.stdout:8/507: dwrite d0/f21 [0,4194304] 0 2023-12-05T13:25:15.163 INFO:tasks.workunit.client.1.smithi052.stdout:3/427: dread da/dd/d3d/f63 [0,4194304] 0 2023-12-05T13:25:15.167 INFO:tasks.workunit.client.1.smithi052.stdout:4/387: read de/d1e/f2a [100565,96240] 0 2023-12-05T13:25:15.169 INFO:tasks.workunit.client.1.smithi052.stdout:8/508: rmdir d0/d4d 39 2023-12-05T13:25:15.171 INFO:tasks.workunit.client.1.smithi052.stdout:3/428: mkdir da/d25/d33/d43/d5b/d94 0 2023-12-05T13:25:15.171 INFO:tasks.workunit.client.1.smithi052.stdout:3/429: fsync da/f18 0 2023-12-05T13:25:15.172 INFO:tasks.workunit.client.1.smithi052.stdout:8/509: dread d0/d28/d39/d3a/d4f/f55 [0,4194304] 0 2023-12-05T13:25:15.174 INFO:tasks.workunit.client.1.smithi052.stdout:3/430: mknod da/d25/d33/d49/c95 0 2023-12-05T13:25:15.175 INFO:tasks.workunit.client.1.smithi052.stdout:3/431: chown da/dd/d3d/f63 625 1 2023-12-05T13:25:15.177 INFO:tasks.workunit.client.1.smithi052.stdout:3/432: mkdir da/d25/d33/d43/d5b/d96 0 2023-12-05T13:25:15.181 INFO:tasks.workunit.client.1.smithi052.stdout:3/433: creat da/d25/d33/f97 x:0 0 0 2023-12-05T13:25:15.189 INFO:tasks.workunit.client.1.smithi052.stdout:8/510: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:25:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:14 smithi052 ceph-mon[121072]: pgmap v207: 65 pgs: 65 active+clean; 939 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 37 MiB/s wr, 502 op/s 2023-12-05T13:25:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:14 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:15.288 INFO:tasks.workunit.client.1.smithi052.stdout:1/393: getdents d5/d7/d35/d37/d5a/d73 0 2023-12-05T13:25:15.291 INFO:tasks.workunit.client.1.smithi052.stdout:1/394: creat d5/d7/d35/d2f/d3e/f7d x:0 0 0 2023-12-05T13:25:15.293 INFO:tasks.workunit.client.1.smithi052.stdout:1/395: truncate d5/d7/d35/d37/d68/f55 1444568 0 2023-12-05T13:25:15.295 INFO:tasks.workunit.client.1.smithi052.stdout:4/388: getdents de/d30/d73 0 2023-12-05T13:25:15.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/389: unlink de/d30/f3c 0 2023-12-05T13:25:15.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/390: write de/d29/f3d [2481062,19747] 0 2023-12-05T13:25:15.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/391: stat de/d29/f56 0 2023-12-05T13:25:15.302 INFO:tasks.workunit.client.1.smithi052.stdout:5/249: write d5/d15/d21/f3a [1102849,19625] 0 2023-12-05T13:25:15.303 INFO:tasks.workunit.client.1.smithi052.stdout:4/392: symlink de/d1e/l7e 0 2023-12-05T13:25:15.305 INFO:tasks.workunit.client.1.smithi052.stdout:5/250: rmdir d5 39 2023-12-05T13:25:15.305 INFO:tasks.workunit.client.1.smithi052.stdout:5/251: fsync d5/d15/d33/f49 0 2023-12-05T13:25:15.305 INFO:tasks.workunit.client.1.smithi052.stdout:5/252: fsync d5/df/f17 0 2023-12-05T13:25:15.306 INFO:tasks.workunit.client.1.smithi052.stdout:5/253: write d5/fc [1854972,62903] 0 2023-12-05T13:25:15.310 INFO:tasks.workunit.client.1.smithi052.stdout:5/254: getdents d5/df/d4b 0 2023-12-05T13:25:15.326 INFO:tasks.workunit.client.1.smithi052.stdout:5/255: dwrite d5/df/f17 [0,4194304] 0 2023-12-05T13:25:15.326 INFO:tasks.workunit.client.1.smithi052.stdout:5/256: chown d5/df/d11 137188 1 2023-12-05T13:25:15.329 INFO:tasks.workunit.client.1.smithi052.stdout:5/257: symlink d5/d15/d21/l56 0 2023-12-05T13:25:15.329 INFO:tasks.workunit.client.1.smithi052.stdout:5/258: chown d5/d15/d21/d25/d3f 3337741 1 2023-12-05T13:25:15.331 INFO:tasks.workunit.client.1.smithi052.stdout:5/259: dread d5/d15/d33/f38 [0,4194304] 0 2023-12-05T13:25:15.333 INFO:tasks.workunit.client.1.smithi052.stdout:5/260: truncate d5/df/d4b/f4d 2558379 0 2023-12-05T13:25:15.333 INFO:tasks.workunit.client.1.smithi052.stdout:5/261: chown d5/d15/c1b 6055 1 2023-12-05T13:25:15.333 INFO:tasks.workunit.client.1.smithi052.stdout:5/262: getdents d5/d15/d21/d4a 0 2023-12-05T13:25:15.333 INFO:tasks.workunit.client.1.smithi052.stdout:5/263: read - d5/d15/f3c zero size 2023-12-05T13:25:15.334 INFO:tasks.workunit.client.1.smithi052.stdout:5/264: dread - d5/d15/d33/f4f zero size 2023-12-05T13:25:15.335 INFO:tasks.workunit.client.1.smithi052.stdout:5/265: dread d5/d15/d21/f23 [0,4194304] 0 2023-12-05T13:25:15.336 INFO:tasks.workunit.client.1.smithi052.stdout:5/266: dread d5/df/f36 [0,4194304] 0 2023-12-05T13:25:15.339 INFO:tasks.workunit.client.1.smithi052.stdout:6/310: truncate d3/d4/d6/f4b 742124 0 2023-12-05T13:25:15.343 INFO:tasks.workunit.client.1.smithi052.stdout:5/267: mknod d5/d15/c57 0 2023-12-05T13:25:15.346 INFO:tasks.workunit.client.1.smithi052.stdout:5/268: symlink d5/d15/l58 0 2023-12-05T13:25:15.346 INFO:tasks.workunit.client.1.smithi052.stdout:5/269: write d5/d15/d33/f49 [1632761,63568] 0 2023-12-05T13:25:15.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:14 smithi029 ceph-mon[112128]: pgmap v207: 65 pgs: 65 active+clean; 939 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 17 MiB/s rd, 37 MiB/s wr, 502 op/s 2023-12-05T13:25:15.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:15.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:15.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:14 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:15.409 INFO:tasks.workunit.client.1.smithi052.stdout:1/396: rename d5/d7/de/d18/d2e to d5/d7/d35/d37/d5a/d73/d7e 0 2023-12-05T13:25:15.412 INFO:tasks.workunit.client.1.smithi052.stdout:4/393: rename de/d30/d68/d59/c79 to de/d2b/c7f 0 2023-12-05T13:25:15.412 INFO:tasks.workunit.client.1.smithi052.stdout:4/394: chown de/d30/d68/f7c 1786940 1 2023-12-05T13:25:15.414 INFO:tasks.workunit.client.1.smithi052.stdout:1/397: truncate d5/d7/d35/d37/d68/d2a/f49 750074 0 2023-12-05T13:25:15.414 INFO:tasks.workunit.client.1.smithi052.stdout:1/398: dread - d5/d7/d35/f71 zero size 2023-12-05T13:25:15.414 INFO:tasks.workunit.client.1.smithi052.stdout:1/399: dread - d5/d7/d35/f71 zero size 2023-12-05T13:25:15.414 INFO:tasks.workunit.client.1.smithi052.stdout:1/400: chown d5/d26/f66 1 1 2023-12-05T13:25:15.415 INFO:tasks.workunit.client.1.smithi052.stdout:4/395: mkdir de/d2b/d80 0 2023-12-05T13:25:15.419 INFO:tasks.workunit.client.1.smithi052.stdout:4/396: creat de/d2b/d80/f81 x:0 0 0 2023-12-05T13:25:15.419 INFO:tasks.workunit.client.1.smithi052.stdout:4/397: chown de/f33 89375145 1 2023-12-05T13:25:15.480 INFO:tasks.workunit.client.1.smithi052.stdout:4/398: dwrite de/d1e/f21 [0,4194304] 0 2023-12-05T13:25:15.480 INFO:tasks.workunit.client.1.smithi052.stdout:1/401: dwrite f4 [0,4194304] 0 2023-12-05T13:25:15.484 INFO:tasks.workunit.client.1.smithi052.stdout:4/399: dread de/d1e/f2a [0,4194304] 0 2023-12-05T13:25:15.484 INFO:tasks.workunit.client.1.smithi052.stdout:9/307: dwrite d3/d1e/f36 [0,4194304] 0 2023-12-05T13:25:15.484 INFO:tasks.workunit.client.1.smithi052.stdout:1/402: creat d5/d7/d35/d2f/f7f x:0 0 0 2023-12-05T13:25:15.485 INFO:tasks.workunit.client.1.smithi052.stdout:1/403: write d5/d7/f47 [1367512,2166] 0 2023-12-05T13:25:15.485 INFO:tasks.workunit.client.1.smithi052.stdout:1/404: chown d5/d7/d35/d37/d68/d2a/f49 2 1 2023-12-05T13:25:15.485 INFO:tasks.workunit.client.1.smithi052.stdout:9/308: write d3/d11/d3e/f51 [1513294,92090] 0 2023-12-05T13:25:15.486 INFO:tasks.workunit.client.1.smithi052.stdout:9/309: write d3/d11/d19/f27 [3250238,71502] 0 2023-12-05T13:25:15.486 INFO:tasks.workunit.client.1.smithi052.stdout:4/400: rename de/d2b/d80/f81 to de/d30/d68/d59/f82 0 2023-12-05T13:25:15.494 INFO:tasks.workunit.client.1.smithi052.stdout:9/310: mknod d3/d2a/c61 0 2023-12-05T13:25:15.501 INFO:tasks.workunit.client.1.smithi052.stdout:9/311: mkdir d3/d1e/d62 0 2023-12-05T13:25:15.786 INFO:tasks.workunit.client.1.smithi052.stdout:8/511: rmdir d0/d28/d39/d3a/d9f 39 2023-12-05T13:25:16.001 INFO:tasks.workunit.client.1.smithi052.stdout:4/401: getdents de/d1e 0 2023-12-05T13:25:16.003 INFO:tasks.workunit.client.1.smithi052.stdout:4/402: truncate de/d2b/f58 2628083 0 2023-12-05T13:25:16.003 INFO:tasks.workunit.client.1.smithi052.stdout:4/403: truncate de/d1e/d24/f4d 892046 0 2023-12-05T13:25:16.006 INFO:tasks.workunit.client.1.smithi052.stdout:4/404: link de/d30/c53 de/d2b/c83 0 2023-12-05T13:25:16.015 INFO:tasks.workunit.client.1.smithi052.stdout:4/405: dread de/d1e/d24/f35 [0,4194304] 0 2023-12-05T13:25:16.015 INFO:tasks.workunit.client.1.smithi052.stdout:4/406: fsync de/f4b 0 2023-12-05T13:25:16.018 INFO:tasks.workunit.client.1.smithi052.stdout:4/407: link de/d1e/c27 de/d30/d68/d59/c84 0 2023-12-05T13:25:16.018 INFO:tasks.workunit.client.1.smithi052.stdout:4/408: stat de/f14 0 2023-12-05T13:25:16.018 INFO:tasks.workunit.client.1.smithi052.stdout:4/409: fsync de/d2b/f55 0 2023-12-05T13:25:16.020 INFO:tasks.workunit.client.1.smithi052.stdout:4/410: mkdir de/d30/d73/d85 0 2023-12-05T13:25:16.023 INFO:tasks.workunit.client.1.smithi052.stdout:4/411: rename de/d2b/c70 to de/d30/d68/d59/d6d/c86 0 2023-12-05T13:25:16.023 INFO:tasks.workunit.client.1.smithi052.stdout:4/412: readlink de/d29/l65 0 2023-12-05T13:25:16.023 INFO:tasks.workunit.client.1.smithi052.stdout:4/413: chown de/d30/d73/c78 31537669 1 2023-12-05T13:25:16.026 INFO:tasks.workunit.client.1.smithi052.stdout:4/414: creat de/f87 x:0 0 0 2023-12-05T13:25:16.037 INFO:tasks.workunit.client.1.smithi052.stdout:4/415: dread de/f14 [0,4194304] 0 2023-12-05T13:25:16.037 INFO:tasks.workunit.client.1.smithi052.stdout:4/416: truncate de/f4b 610633 0 2023-12-05T13:25:16.051 INFO:tasks.workunit.client.1.smithi052.stdout:0/467: sync 2023-12-05T13:25:16.052 INFO:tasks.workunit.client.1.smithi052.stdout:7/522: sync 2023-12-05T13:25:16.052 INFO:tasks.workunit.client.1.smithi052.stdout:2/481: sync 2023-12-05T13:25:16.053 INFO:tasks.workunit.client.1.smithi052.stdout:7/523: write d7/d4e/d12/f29 [1020942,52064] 0 2023-12-05T13:25:16.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/482: write d2/d13/d1e/d6a/d7f/d84/d3a/d4b/f79 [805788,36622] 0 2023-12-05T13:25:16.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/483: write d2/d13/d1e/f54 [4765237,87441] 0 2023-12-05T13:25:16.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/484: write d2/f2f [9027391,41015] 0 2023-12-05T13:25:16.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/485: write d2/d13/f26 [1097968,81548] 0 2023-12-05T13:25:16.053 INFO:tasks.workunit.client.1.smithi052.stdout:4/417: dwrite de/f18 [0,4194304] 0 2023-12-05T13:25:16.054 INFO:tasks.workunit.client.1.smithi052.stdout:0/468: mkdir d0/db/d20/d9c 0 2023-12-05T13:25:16.054 INFO:tasks.workunit.client.1.smithi052.stdout:0/469: write d0/db/d14/d60/f7b [3878703,110890] 0 2023-12-05T13:25:16.057 INFO:tasks.workunit.client.1.smithi052.stdout:7/524: creat d7/d4e/d45/d79/d91/fb2 x:0 0 0 2023-12-05T13:25:16.057 INFO:tasks.workunit.client.1.smithi052.stdout:7/525: dread - d7/d31/f3e zero size 2023-12-05T13:25:16.057 INFO:tasks.workunit.client.1.smithi052.stdout:7/526: write d7/d31/d56/f85 [645565,117762] 0 2023-12-05T13:25:16.068 INFO:tasks.workunit.client.1.smithi052.stdout:4/418: rmdir de/d30/d73 39 2023-12-05T13:25:16.070 INFO:tasks.workunit.client.1.smithi052.stdout:4/419: dread de/f4b [0,4194304] 0 2023-12-05T13:25:16.070 INFO:tasks.workunit.client.1.smithi052.stdout:0/470: dwrite d0/f4 [4194304,4194304] 0 2023-12-05T13:25:16.071 INFO:tasks.workunit.client.1.smithi052.stdout:0/471: write d0/db/d1b/f37 [2085271,32049] 0 2023-12-05T13:25:16.073 INFO:tasks.workunit.client.1.smithi052.stdout:7/527: mknod d7/d4e/d12/d3f/d46/cb3 0 2023-12-05T13:25:16.078 INFO:tasks.workunit.client.1.smithi052.stdout:4/420: truncate de/d2b/f2d 3869420 0 2023-12-05T13:25:16.078 INFO:tasks.workunit.client.1.smithi052.stdout:4/421: chown de/f18 1265 1 2023-12-05T13:25:16.085 INFO:tasks.workunit.client.1.smithi052.stdout:7/528: unlink d7/d4e/d12/c83 0 2023-12-05T13:25:16.092 INFO:tasks.workunit.client.1.smithi052.stdout:0/472: mknod d0/c9d 0 2023-12-05T13:25:16.098 INFO:tasks.workunit.client.1.smithi052.stdout:0/473: unlink d0/db/d20/c4b 0 2023-12-05T13:25:16.100 INFO:tasks.workunit.client.1.smithi052.stdout:7/529: mkdir d7/d4e/db4 0 2023-12-05T13:25:16.104 INFO:tasks.workunit.client.1.smithi052.stdout:0/474: unlink d0/db/d14/l19 0 2023-12-05T13:25:16.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/530: rmdir d7/d4e 39 2023-12-05T13:25:16.109 INFO:tasks.workunit.client.1.smithi052.stdout:0/475: symlink d0/db/d1b/d51/l9e 0 2023-12-05T13:25:16.109 INFO:tasks.workunit.client.1.smithi052.stdout:0/476: write d0/db/d14/f26 [4868798,107787] 0 2023-12-05T13:25:16.109 INFO:tasks.workunit.client.1.smithi052.stdout:0/477: chown d0/db/d1b/d51/d55/d66/d77 245350 1 2023-12-05T13:25:16.115 INFO:tasks.workunit.client.1.smithi052.stdout:0/478: rename d0/db/d2e/f76 to d0/db/d52/d7f/f9f 0 2023-12-05T13:25:16.115 INFO:tasks.workunit.client.1.smithi052.stdout:0/479: chown d0/db/d2e 18107 1 2023-12-05T13:25:16.118 INFO:tasks.workunit.client.1.smithi052.stdout:0/480: creat d0/db/d1b/d51/d55/d66/d77/fa0 x:0 0 0 2023-12-05T13:25:16.120 INFO:tasks.workunit.client.1.smithi052.stdout:7/531: dwrite d7/d31/f55 [0,4194304] 0 2023-12-05T13:25:16.120 INFO:tasks.workunit.client.1.smithi052.stdout:0/481: mknod d0/db/d1b/d51/d55/d66/ca1 0 2023-12-05T13:25:16.123 INFO:tasks.workunit.client.1.smithi052.stdout:7/532: mkdir d7/d2e/d81/db5 0 2023-12-05T13:25:16.125 INFO:tasks.workunit.client.1.smithi052.stdout:0/482: mknod d0/db/d2e/d7e/ca2 0 2023-12-05T13:25:16.125 INFO:tasks.workunit.client.1.smithi052.stdout:0/483: chown d0/db/d1b/d42/l4c 58340844 1 2023-12-05T13:25:16.128 INFO:tasks.workunit.client.1.smithi052.stdout:7/533: creat d7/d4e/d45/fb6 x:0 0 0 2023-12-05T13:25:16.131 INFO:tasks.workunit.client.1.smithi052.stdout:0/484: truncate d0/db/d1b/d51/d55/d66/d77/f95 2753080 0 2023-12-05T13:25:16.131 INFO:tasks.workunit.client.1.smithi052.stdout:0/485: fsync d0/db/d52/d7f/f98 0 2023-12-05T13:25:16.132 INFO:tasks.workunit.client.1.smithi052.stdout:3/434: sync 2023-12-05T13:25:16.132 INFO:tasks.workunit.client.1.smithi052.stdout:0/486: write d0/db/d1b/d51/d55/f5f [1956114,116560] 0 2023-12-05T13:25:16.133 INFO:tasks.workunit.client.1.smithi052.stdout:3/435: write da/d25/f37 [3987321,110433] 0 2023-12-05T13:25:16.133 INFO:tasks.workunit.client.1.smithi052.stdout:3/436: dread - da/d25/d33/f97 zero size 2023-12-05T13:25:16.133 INFO:tasks.workunit.client.1.smithi052.stdout:3/437: truncate da/dd/f30 1222084 0 2023-12-05T13:25:16.143 INFO:tasks.workunit.client.1.smithi052.stdout:3/438: truncate da/fe 1604166 0 2023-12-05T13:25:16.144 INFO:tasks.workunit.client.1.smithi052.stdout:3/439: write da/d25/d33/d43/d5b/f67 [948520,19961] 0 2023-12-05T13:25:16.145 INFO:tasks.workunit.client.1.smithi052.stdout:3/440: write da/d25/d33/d43/d5b/f67 [3598003,115274] 0 2023-12-05T13:25:16.149 INFO:tasks.workunit.client.1.smithi052.stdout:3/441: creat da/d25/d33/d43/d5b/f98 x:0 0 0 2023-12-05T13:25:16.149 INFO:tasks.workunit.client.1.smithi052.stdout:3/442: fdatasync da/d27/f3b 0 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:6/311: sync 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:1/405: sync 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:8/512: sync 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:5/270: sync 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:5/271: rename d5/d15 to d5/d15/d21/d25/d3f/d59 22 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:6/312: write d3/f50 [306313,101513] 0 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:6/313: chown d3/d5/d9/d21/d48/d4d/d66 134357619 1 2023-12-05T13:25:16.208 INFO:tasks.workunit.client.1.smithi052.stdout:6/314: write d3/d5/d9/f2e [1322879,95012] 0 2023-12-05T13:25:16.211 INFO:tasks.workunit.client.1.smithi052.stdout:8/513: mkdir d0/de/d27/d43/da2 0 2023-12-05T13:25:16.214 INFO:tasks.workunit.client.1.smithi052.stdout:1/406: creat d5/d7/d35/d37/d68/d17/d3c/f80 x:0 0 0 2023-12-05T13:25:16.215 INFO:tasks.workunit.client.1.smithi052.stdout:1/407: write d5/d7/d35/d37/d68/f6d [166739,116276] 0 2023-12-05T13:25:16.215 INFO:tasks.workunit.client.1.smithi052.stdout:1/408: fsync d5/d7/f12 0 2023-12-05T13:25:16.216 INFO:tasks.workunit.client.1.smithi052.stdout:1/409: chown d5/d7/c10 4 1 2023-12-05T13:25:16.216 INFO:tasks.workunit.client.1.smithi052.stdout:1/410: dread - d5/d7/d35/d37/d5a/d73/d7e/d65/f7c zero size 2023-12-05T13:25:16.217 INFO:tasks.workunit.client.1.smithi052.stdout:6/315: unlink d3/d5/d9/d21/d48/f4e 0 2023-12-05T13:25:16.222 INFO:tasks.workunit.client.1.smithi052.stdout:8/514: creat d0/d28/d2b/fa3 x:0 0 0 2023-12-05T13:25:16.223 INFO:tasks.workunit.client.1.smithi052.stdout:8/515: dread d0/d62/f7e [0,4194304] 0 2023-12-05T13:25:16.225 INFO:tasks.workunit.client.1.smithi052.stdout:9/312: dwrite d3/f26 [0,4194304] 0 2023-12-05T13:25:16.226 INFO:tasks.workunit.client.1.smithi052.stdout:1/411: creat d5/d7/d35/d37/d68/d79/f81 x:0 0 0 2023-12-05T13:25:16.228 INFO:tasks.workunit.client.1.smithi052.stdout:6/316: getdents d3/d4 0 2023-12-05T13:25:16.230 INFO:tasks.workunit.client.1.smithi052.stdout:8/516: link d0/d4d/c24 d0/d62/ca4 0 2023-12-05T13:25:16.236 INFO:tasks.workunit.client.1.smithi052.stdout:8/517: dread d0/de/f41 [0,4194304] 0 2023-12-05T13:25:16.237 INFO:tasks.workunit.client.1.smithi052.stdout:1/412: creat d5/d7/d35/d37/d68/d69/f82 x:0 0 0 2023-12-05T13:25:16.238 INFO:tasks.workunit.client.1.smithi052.stdout:9/313: dwrite d3/d1e/d41/f5d [0,4194304] 0 2023-12-05T13:25:16.238 INFO:tasks.workunit.client.1.smithi052.stdout:9/314: write d3/d11/d19/f5b [190747,114661] 0 2023-12-05T13:25:16.239 INFO:tasks.workunit.client.1.smithi052.stdout:6/317: truncate d3/d4/df/d27/f31 3598430 0 2023-12-05T13:25:16.241 INFO:tasks.workunit.client.1.smithi052.stdout:8/518: creat d0/d28/d2b/d53/fa5 x:0 0 0 2023-12-05T13:25:16.241 INFO:tasks.workunit.client.1.smithi052.stdout:8/519: truncate d0/de/d12/f85 374673 0 2023-12-05T13:25:16.242 INFO:tasks.workunit.client.1.smithi052.stdout:1/413: mknod d5/d7/c83 0 2023-12-05T13:25:16.250 INFO:tasks.workunit.client.1.smithi052.stdout:6/318: mkdir d3/d4/d6/d26/d6d 0 2023-12-05T13:25:16.250 INFO:tasks.workunit.client.1.smithi052.stdout:6/319: chown d3/d4 164236198 1 2023-12-05T13:25:16.254 INFO:tasks.workunit.client.1.smithi052.stdout:9/315: dwrite d3/d11/f48 [0,4194304] 0 2023-12-05T13:25:16.254 INFO:tasks.workunit.client.1.smithi052.stdout:1/414: creat d5/d7/d35/d37/d5a/d73/f84 x:0 0 0 2023-12-05T13:25:16.255 INFO:tasks.workunit.client.1.smithi052.stdout:8/520: dread d0/f11 [0,4194304] 0 2023-12-05T13:25:16.262 INFO:tasks.workunit.client.1.smithi052.stdout:6/320: creat d3/d4/df/d63/f6e x:0 0 0 2023-12-05T13:25:16.262 INFO:tasks.workunit.client.1.smithi052.stdout:6/321: fdatasync d3/d4/df/d27/f47 0 2023-12-05T13:25:16.267 INFO:tasks.workunit.client.1.smithi052.stdout:9/316: mknod d3/d2a/d5c/c63 0 2023-12-05T13:25:16.267 INFO:tasks.workunit.client.1.smithi052.stdout:9/317: fsync d3/d2a/f3c 0 2023-12-05T13:25:16.269 INFO:tasks.workunit.client.1.smithi052.stdout:1/415: mkdir d5/d7/d35/d2f/d3e/d62/d85 0 2023-12-05T13:25:16.272 INFO:tasks.workunit.client.1.smithi052.stdout:8/521: symlink d0/de/d27/d43/da2/la6 0 2023-12-05T13:25:16.272 INFO:tasks.workunit.client.1.smithi052.stdout:8/522: chown d0/d4d/l70 239044921 1 2023-12-05T13:25:16.273 INFO:tasks.workunit.client.1.smithi052.stdout:6/322: stat d3/d5/d9/d44/l6a 0 2023-12-05T13:25:16.273 INFO:tasks.workunit.client.1.smithi052.stdout:6/323: fdatasync d3/d4/d6/d26/f5d 0 2023-12-05T13:25:16.274 INFO:tasks.workunit.client.1.smithi052.stdout:6/324: read d3/d4/df/d27/f56 [3046263,54922] 0 2023-12-05T13:25:16.279 INFO:tasks.workunit.client.1.smithi052.stdout:1/416: mknod d5/d7/d35/d37/d5a/d73/c86 0 2023-12-05T13:25:16.283 INFO:tasks.workunit.client.1.smithi052.stdout:9/318: dwrite d3/d11/d3e/f51 [0,4194304] 0 2023-12-05T13:25:16.284 INFO:tasks.workunit.client.1.smithi052.stdout:1/417: symlink d5/d26/d75/l87 0 2023-12-05T13:25:16.285 INFO:tasks.workunit.client.1.smithi052.stdout:6/325: mkdir d3/d4/d36/d6f 0 2023-12-05T13:25:16.287 INFO:tasks.workunit.client.1.smithi052.stdout:6/326: write d3/f16 [1622689,25518] 0 2023-12-05T13:25:16.287 INFO:tasks.workunit.client.1.smithi052.stdout:8/523: dwrite d0/fa [0,4194304] 0 2023-12-05T13:25:16.287 INFO:tasks.workunit.client.1.smithi052.stdout:8/524: write d0/d4d/f4c [60198,155] 0 2023-12-05T13:25:16.289 INFO:tasks.workunit.client.1.smithi052.stdout:9/319: rmdir d3/d1e/d41/d5f 0 2023-12-05T13:25:16.289 INFO:tasks.workunit.client.1.smithi052.stdout:9/320: chown d3/d1e/d37/d4f/f52 1071 1 2023-12-05T13:25:16.292 INFO:tasks.workunit.client.1.smithi052.stdout:1/418: creat d5/d7/d35/d37/d68/d17/f88 x:0 0 0 2023-12-05T13:25:16.295 INFO:tasks.workunit.client.1.smithi052.stdout:6/327: link d3/d4/df/d27/f47 d3/d4/df/d63/f70 0 2023-12-05T13:25:16.297 INFO:tasks.workunit.client.1.smithi052.stdout:8/525: symlink d0/d28/d2b/d53/la7 0 2023-12-05T13:25:16.300 INFO:tasks.workunit.client.1.smithi052.stdout:6/328: creat d3/d4/df/d63/f71 x:0 0 0 2023-12-05T13:25:16.301 INFO:tasks.workunit.client.1.smithi052.stdout:6/329: read d3/d4/df/d27/f56 [1686592,65774] 0 2023-12-05T13:25:16.302 INFO:tasks.workunit.client.1.smithi052.stdout:8/526: rename d0/l26 to d0/d4d/la8 0 2023-12-05T13:25:16.304 INFO:tasks.workunit.client.1.smithi052.stdout:6/330: symlink d3/d5/d58/l72 0 2023-12-05T13:25:16.304 INFO:tasks.workunit.client.1.smithi052.stdout:6/331: truncate d3/d4/d6/f11 1585980 0 2023-12-05T13:25:16.307 INFO:tasks.workunit.client.1.smithi052.stdout:8/527: link d0/de/f35 d0/d62/fa9 0 2023-12-05T13:25:16.313 INFO:tasks.workunit.client.1.smithi052.stdout:8/528: getdents d0/d28/d2b/d53/d56 0 2023-12-05T13:25:16.314 INFO:tasks.workunit.client.1.smithi052.stdout:8/529: write d0/fa [2161176,68049] 0 2023-12-05T13:25:16.317 INFO:tasks.workunit.client.1.smithi052.stdout:6/332: dwrite d3/d5/d9/f3a [0,4194304] 0 2023-12-05T13:25:16.319 INFO:tasks.workunit.client.1.smithi052.stdout:8/530: unlink d0/d28/d2b/f78 0 2023-12-05T13:25:16.319 INFO:tasks.workunit.client.1.smithi052.stdout:8/531: readlink d0/d28/d39/l40 0 2023-12-05T13:25:16.319 INFO:tasks.workunit.client.1.smithi052.stdout:8/532: chown d0/d28/d39/d3a/c8a 162383613 1 2023-12-05T13:25:16.319 INFO:tasks.workunit.client.1.smithi052.stdout:8/533: write d0/de/f2f [3792163,108361] 0 2023-12-05T13:25:16.324 INFO:tasks.workunit.client.1.smithi052.stdout:8/534: mknod d0/de/d27/d43/da2/caa 0 2023-12-05T13:25:16.327 INFO:tasks.workunit.client.1.smithi052.stdout:8/535: mknod d0/d28/d39/d3a/d8f/cab 0 2023-12-05T13:25:16.345 INFO:tasks.workunit.client.1.smithi052.stdout:8/536: dwrite d0/de/f1f [0,4194304] 0 2023-12-05T13:25:16.349 INFO:tasks.workunit.client.1.smithi052.stdout:8/537: rmdir d0/de/d27 39 2023-12-05T13:25:16.349 INFO:tasks.workunit.client.1.smithi052.stdout:8/538: truncate d0/de/f38 2632511 0 2023-12-05T13:25:16.349 INFO:tasks.workunit.client.1.smithi052.stdout:8/539: chown d0/d28/c6e 3986052 1 2023-12-05T13:25:16.351 INFO:tasks.workunit.client.1.smithi052.stdout:8/540: unlink d0/d51/c9b 0 2023-12-05T13:25:16.351 INFO:tasks.workunit.client.1.smithi052.stdout:8/541: stat d0/f3e 0 2023-12-05T13:25:16.353 INFO:tasks.workunit.client.1.smithi052.stdout:8/542: mknod d0/d28/d39/d3a/cac 0 2023-12-05T13:25:16.354 INFO:tasks.workunit.client.1.smithi052.stdout:8/543: stat d0/d4d 0 2023-12-05T13:25:16.354 INFO:tasks.workunit.client.1.smithi052.stdout:8/544: chown d0/de/l1e 217832832 1 2023-12-05T13:25:16.354 INFO:tasks.workunit.client.1.smithi052.stdout:8/545: chown d0/de/d12/f85 84 1 2023-12-05T13:25:16.356 INFO:tasks.workunit.client.1.smithi052.stdout:8/546: creat d0/d62/fad x:0 0 0 2023-12-05T13:25:16.356 INFO:tasks.workunit.client.1.smithi052.stdout:8/547: chown d0/de/d27/d43/d44/c4a 10966012 1 2023-12-05T13:25:16.358 INFO:tasks.workunit.client.1.smithi052.stdout:8/548: mkdir d0/dae 0 2023-12-05T13:25:16.358 INFO:tasks.workunit.client.1.smithi052.stdout:8/549: fdatasync d0/d28/d2b/f7f 0 2023-12-05T13:25:16.371 INFO:tasks.workunit.client.1.smithi052.stdout:8/550: dwrite d0/de/d12/d29/f50 [0,4194304] 0 2023-12-05T13:25:16.792 INFO:tasks.workunit.client.1.smithi052.stdout:2/486: write d2/d13/d1e/d6a/d7f/d84/f55 [4372349,110621] 0 2023-12-05T13:25:16.793 INFO:tasks.workunit.client.1.smithi052.stdout:2/487: write d2/d13/f26 [5628726,24932] 0 2023-12-05T13:25:16.793 INFO:tasks.workunit.client.1.smithi052.stdout:2/488: getdents d2/d13/d37/d8b 0 2023-12-05T13:25:16.794 INFO:tasks.workunit.client.1.smithi052.stdout:4/422: rmdir de 39 2023-12-05T13:25:16.797 INFO:tasks.workunit.client.1.smithi052.stdout:2/489: symlink d2/d13/d37/l90 0 2023-12-05T13:25:16.802 INFO:tasks.workunit.client.1.smithi052.stdout:4/423: mkdir de/d2b/d88 0 2023-12-05T13:25:16.805 INFO:tasks.workunit.client.1.smithi052.stdout:4/424: mknod de/d30/d68/c89 0 2023-12-05T13:25:16.806 INFO:tasks.workunit.client.1.smithi052.stdout:0/487: getdents d0 0 2023-12-05T13:25:16.816 INFO:tasks.workunit.client.1.smithi052.stdout:4/425: rename de/d2b/d64/f66 to de/d30/f8a 0 2023-12-05T13:25:16.816 INFO:tasks.workunit.client.1.smithi052.stdout:2/490: dwrite d2/d14/f39 [0,4194304] 0 2023-12-05T13:25:16.819 INFO:tasks.workunit.client.1.smithi052.stdout:4/426: mknod de/d30/d68/c8b 0 2023-12-05T13:25:16.819 INFO:tasks.workunit.client.1.smithi052.stdout:4/427: getdents de/d30/d73/d85 0 2023-12-05T13:25:16.822 INFO:tasks.workunit.client.1.smithi052.stdout:0/488: dwrite d0/db/d20/f21 [0,4194304] 0 2023-12-05T13:25:16.827 INFO:tasks.workunit.client.1.smithi052.stdout:2/491: getdents d2/d13/d1e/d6a/d7f/d84/d3a 0 2023-12-05T13:25:16.834 INFO:tasks.workunit.client.1.smithi052.stdout:0/489: getdents d0/db/d20/d50 0 2023-12-05T13:25:16.838 INFO:tasks.workunit.client.1.smithi052.stdout:2/492: creat d2/d13/d48/f91 x:0 0 0 2023-12-05T13:25:16.838 INFO:tasks.workunit.client.1.smithi052.stdout:2/493: chown d2/d13/d37/f49 4126809 1 2023-12-05T13:25:16.839 INFO:tasks.workunit.client.1.smithi052.stdout:2/494: write d2/d4/f23 [4537860,52177] 0 2023-12-05T13:25:16.840 INFO:tasks.workunit.client.1.smithi052.stdout:0/490: readlink d0/db/d2e/l34 0 2023-12-05T13:25:16.840 INFO:tasks.workunit.client.1.smithi052.stdout:0/491: fsync d0/db/d1b/d51/d55/d66/d77/fa0 0 2023-12-05T13:25:16.842 INFO:tasks.workunit.client.1.smithi052.stdout:0/492: symlink d0/db/d20/d9c/la3 0 2023-12-05T13:25:16.848 INFO:tasks.workunit.client.1.smithi052.stdout:0/493: symlink d0/db/d14/d9b/la4 0 2023-12-05T13:25:16.849 INFO:tasks.workunit.client.1.smithi052.stdout:0/494: stat d0/c1c 0 2023-12-05T13:25:16.849 INFO:tasks.workunit.client.1.smithi052.stdout:2/495: dread d2/d13/d1e/f71 [0,4194304] 0 2023-12-05T13:25:16.855 INFO:tasks.workunit.client.1.smithi052.stdout:2/496: creat d2/d4/d3f/f92 x:0 0 0 2023-12-05T13:25:16.859 INFO:tasks.workunit.client.1.smithi052.stdout:2/497: readlink d2/d13/d1e/l2d 0 2023-12-05T13:25:16.859 INFO:tasks.workunit.client.1.smithi052.stdout:2/498: readlink d2/d14/l47 0 2023-12-05T13:25:16.862 INFO:tasks.workunit.client.1.smithi052.stdout:7/534: dwrite d7/d4e/d12/f8b [0,4194304] 0 2023-12-05T13:25:16.870 INFO:tasks.workunit.client.1.smithi052.stdout:7/535: mkdir d7/d4e/d45/d50/db7 0 2023-12-05T13:25:16.873 INFO:tasks.workunit.client.1.smithi052.stdout:7/536: creat d7/d4e/d45/d5a/d66/fb8 x:0 0 0 2023-12-05T13:25:16.875 INFO:tasks.workunit.client.1.smithi052.stdout:2/499: dwrite d2/d14/f39 [0,4194304] 0 2023-12-05T13:25:16.878 INFO:tasks.workunit.client.1.smithi052.stdout:7/537: link c5 d7/d4e/d12/cb9 0 2023-12-05T13:25:16.878 INFO:tasks.workunit.client.1.smithi052.stdout:7/538: fsync d7/d4e/d12/d3f/d46/f4a 0 2023-12-05T13:25:16.885 INFO:tasks.workunit.client.1.smithi052.stdout:2/500: rename d2/d4/d63/d6d/l7b to d2/d13/d45/l93 0 2023-12-05T13:25:16.898 INFO:tasks.workunit.client.1.smithi052.stdout:7/539: dwrite d7/d4e/d12/f29 [0,4194304] 0 2023-12-05T13:25:16.900 INFO:tasks.workunit.client.1.smithi052.stdout:7/540: dread d7/d31/d56/f85 [0,4194304] 0 2023-12-05T13:25:16.902 INFO:tasks.workunit.client.1.smithi052.stdout:7/541: mkdir d7/d4e/d45/d5a/d63/d95/dba 0 2023-12-05T13:25:16.922 INFO:tasks.workunit.client.1.smithi052.stdout:7/542: dwrite d7/d4e/d12/f29 [0,4194304] 0 2023-12-05T13:25:16.922 INFO:tasks.workunit.client.1.smithi052.stdout:7/543: chown d7/d4e/d45/f5b 2 1 2023-12-05T13:25:16.923 INFO:tasks.workunit.client.1.smithi052.stdout:7/544: write d7/d4e/f5c [6050545,11644] 0 2023-12-05T13:25:16.926 INFO:tasks.workunit.client.1.smithi052.stdout:7/545: creat d7/d4e/d45/fbb x:0 0 0 2023-12-05T13:25:16.926 INFO:tasks.workunit.client.1.smithi052.stdout:7/546: chown d7/d4e/d12/d3f/d46/l9d 0 1 2023-12-05T13:25:16.929 INFO:tasks.workunit.client.1.smithi052.stdout:7/547: rename d7/d4e/d45/c9c to d7/d4e/d45/d5a/d16/dae/cbc 0 2023-12-05T13:25:16.946 INFO:tasks.workunit.client.1.smithi052.stdout:7/548: dwrite d7/d4e/d12/d3f/f7f [0,4194304] 0 2023-12-05T13:25:17.033 INFO:tasks.workunit.client.1.smithi052.stdout:8/551: getdents d0/de/d27/d43/da2 0 2023-12-05T13:25:17.035 INFO:tasks.workunit.client.1.smithi052.stdout:8/552: getdents d0/d28/d2b/d53 0 2023-12-05T13:25:17.047 INFO:tasks.workunit.client.1.smithi052.stdout:3/443: sync 2023-12-05T13:25:17.047 INFO:tasks.workunit.client.1.smithi052.stdout:3/444: truncate da/d2e/d40/f5d 384090 0 2023-12-05T13:25:17.049 INFO:tasks.workunit.client.1.smithi052.stdout:3/445: mknod da/d48/c99 0 2023-12-05T13:25:17.052 INFO:tasks.workunit.client.1.smithi052.stdout:3/446: creat da/d27/f9a x:0 0 0 2023-12-05T13:25:17.057 INFO:tasks.workunit.client.1.smithi052.stdout:8/553: dread d0/d28/d2b/f7f [0,4194304] 0 2023-12-05T13:25:17.057 INFO:tasks.workunit.client.1.smithi052.stdout:8/554: write d0/d28/d39/d3a/d9f/f9a [911805,1357] 0 2023-12-05T13:25:17.061 INFO:tasks.workunit.client.1.smithi052.stdout:3/447: mkdir da/d2e/d40/d9b 0 2023-12-05T13:25:17.062 INFO:tasks.workunit.client.1.smithi052.stdout:3/448: write da/f21 [358020,38049] 0 2023-12-05T13:25:17.064 INFO:tasks.workunit.client.1.smithi052.stdout:8/555: symlink d0/de/d86/laf 0 2023-12-05T13:25:17.064 INFO:tasks.workunit.client.1.smithi052.stdout:8/556: fdatasync d0/de/fa1 0 2023-12-05T13:25:17.068 INFO:tasks.workunit.client.1.smithi052.stdout:8/557: mkdir d0/d28/db0 0 2023-12-05T13:25:17.068 INFO:tasks.workunit.client.1.smithi052.stdout:8/558: fsync d0/d28/d2b/f96 0 2023-12-05T13:25:17.071 INFO:tasks.workunit.client.1.smithi052.stdout:8/559: getdents d0/d62 0 2023-12-05T13:25:17.072 INFO:tasks.workunit.client.1.smithi052.stdout:8/560: read d0/de/d27/d43/d63/f8b [2856437,116422] 0 2023-12-05T13:25:17.073 INFO:tasks.workunit.client.1.smithi052.stdout:8/561: write d0/d28/d2b/f7f [1312393,58042] 0 2023-12-05T13:25:17.075 INFO:tasks.workunit.client.1.smithi052.stdout:3/449: dwrite da/d27/f2d [4194304,4194304] 0 2023-12-05T13:25:17.075 INFO:tasks.workunit.client.1.smithi052.stdout:8/562: creat d0/dae/fb1 x:0 0 0 2023-12-05T13:25:17.080 INFO:tasks.workunit.client.1.smithi052.stdout:3/450: unlink da/d25/d33/d49/c95 0 2023-12-05T13:25:17.080 INFO:tasks.workunit.client.1.smithi052.stdout:3/451: chown da/d25/d33/d89/f91 56360038 1 2023-12-05T13:25:17.080 INFO:tasks.workunit.client.1.smithi052.stdout:3/452: chown da/d25/d33/d43/c84 3182 1 2023-12-05T13:25:17.083 INFO:tasks.workunit.client.1.smithi052.stdout:8/563: creat d0/d28/d39/d3a/d8f/fb2 x:0 0 0 2023-12-05T13:25:17.086 INFO:tasks.workunit.client.1.smithi052.stdout:3/453: creat da/dd/d3d/f9c x:0 0 0 2023-12-05T13:25:17.086 INFO:tasks.workunit.client.1.smithi052.stdout:3/454: write da/dd/f26 [121052,80474] 0 2023-12-05T13:25:17.087 INFO:tasks.workunit.client.1.smithi052.stdout:8/564: rmdir d0/de/d27/d43/da2 39 2023-12-05T13:25:17.091 INFO:tasks.workunit.client.1.smithi052.stdout:3/455: rename da/d2e/f3c to da/f9d 0 2023-12-05T13:25:17.091 INFO:tasks.workunit.client.1.smithi052.stdout:3/456: read da/fe [965390,42588] 0 2023-12-05T13:25:17.093 INFO:tasks.workunit.client.1.smithi052.stdout:8/565: mkdir d0/de/d12/d29/db3 0 2023-12-05T13:25:17.098 INFO:tasks.workunit.client.1.smithi052.stdout:3/457: symlink da/dd/l9e 0 2023-12-05T13:25:17.100 INFO:tasks.workunit.client.1.smithi052.stdout:8/566: dread d0/de/d27/f57 [0,4194304] 0 2023-12-05T13:25:17.101 INFO:tasks.workunit.client.1.smithi052.stdout:3/458: link da/d25/l6a da/d2e/d40/d6d/l9f 0 2023-12-05T13:25:17.104 INFO:tasks.workunit.client.1.smithi052.stdout:8/567: rename d0/d28/d2b/l3d to d0/d28/d39/d3a/d8f/lb4 0 2023-12-05T13:25:17.110 INFO:tasks.workunit.client.1.smithi052.stdout:8/568: mkdir d0/d28/d39/d3a/d4f/db5 0 2023-12-05T13:25:17.112 INFO:tasks.workunit.client.1.smithi052.stdout:3/459: dwrite da/d27/f2d [8388608,4194304] 0 2023-12-05T13:25:17.113 INFO:tasks.workunit.client.1.smithi052.stdout:8/569: mknod d0/de/d27/d43/cb6 0 2023-12-05T13:25:17.113 INFO:tasks.workunit.client.1.smithi052.stdout:8/570: readlink d0/d4d/l70 0 2023-12-05T13:25:17.115 INFO:tasks.workunit.client.1.smithi052.stdout:3/460: creat da/d25/d33/d43/d5b/d94/fa0 x:0 0 0 2023-12-05T13:25:17.116 INFO:tasks.workunit.client.1.smithi052.stdout:3/461: chown da/d25/d33/d51/c6c 8789620 1 2023-12-05T13:25:17.118 INFO:tasks.workunit.client.1.smithi052.stdout:8/571: link d0/d4d/c6c d0/de/d27/d43/d63/cb7 0 2023-12-05T13:25:17.122 INFO:tasks.workunit.client.1.smithi052.stdout:3/462: unlink da/d25/d33/d43/d5b/f98 0 2023-12-05T13:25:17.125 INFO:tasks.workunit.client.1.smithi052.stdout:3/463: mknod da/d27/ca1 0 2023-12-05T13:25:17.126 INFO:tasks.workunit.client.1.smithi052.stdout:3/464: write da/d48/f5f [669748,122126] 0 2023-12-05T13:25:17.137 INFO:tasks.workunit.client.1.smithi052.stdout:8/572: dwrite d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:25:17.139 INFO:tasks.workunit.client.1.smithi052.stdout:8/573: mknod d0/d4d/cb8 0 2023-12-05T13:25:17.142 INFO:tasks.workunit.client.1.smithi052.stdout:8/574: mkdir d0/de/d27/d43/d44/db9 0 2023-12-05T13:25:17.142 INFO:tasks.workunit.client.1.smithi052.stdout:8/575: dread - d0/d28/d2b/f91 zero size 2023-12-05T13:25:17.143 INFO:tasks.workunit.client.1.smithi052.stdout:8/576: creat d0/de/d98/fba x:0 0 0 2023-12-05T13:25:17.143 INFO:tasks.workunit.client.1.smithi052.stdout:8/577: chown d0/ca0 2469352 1 2023-12-05T13:25:17.157 INFO:tasks.workunit.client.1.smithi052.stdout:1/419: sync 2023-12-05T13:25:17.157 INFO:tasks.workunit.client.1.smithi052.stdout:6/333: sync 2023-12-05T13:25:17.158 INFO:tasks.workunit.client.1.smithi052.stdout:9/321: sync 2023-12-05T13:25:17.158 INFO:tasks.workunit.client.1.smithi052.stdout:5/272: sync 2023-12-05T13:25:17.158 INFO:tasks.workunit.client.1.smithi052.stdout:9/322: write d3/d1e/f36 [750841,115015] 0 2023-12-05T13:25:17.167 INFO:tasks.workunit.client.1.smithi052.stdout:5/273: unlink d5/d15/l1a 0 2023-12-05T13:25:17.168 INFO:tasks.workunit.client.1.smithi052.stdout:1/420: mknod d5/d7/d35/d2f/d3e/d62/d85/c89 0 2023-12-05T13:25:17.168 INFO:tasks.workunit.client.1.smithi052.stdout:1/421: chown d5/d7/de/d18 1 1 2023-12-05T13:25:17.168 INFO:tasks.workunit.client.1.smithi052.stdout:1/422: chown d5/l25 299080149 1 2023-12-05T13:25:17.168 INFO:tasks.workunit.client.1.smithi052.stdout:1/423: dread - d5/d7/d35/d2f/f7f zero size 2023-12-05T13:25:17.168 INFO:tasks.workunit.client.1.smithi052.stdout:5/274: write d5/d15/d33/f49 [1360938,58311] 0 2023-12-05T13:25:17.170 INFO:tasks.workunit.client.1.smithi052.stdout:9/323: dread d3/d1e/f36 [0,4194304] 0 2023-12-05T13:25:17.170 INFO:tasks.workunit.client.1.smithi052.stdout:9/324: fdatasync d3/d2a/f4e 0 2023-12-05T13:25:17.176 INFO:tasks.workunit.client.1.smithi052.stdout:6/334: dwrite d3/d4/df/d27/f56 [0,4194304] 0 2023-12-05T13:25:17.178 INFO:tasks.workunit.client.1.smithi052.stdout:1/424: getdents d5/d7/d35/d37/d43 0 2023-12-05T13:25:17.180 INFO:tasks.workunit.client.1.smithi052.stdout:9/325: rename d3/d1e/d41/f5d to d3/d5e/f64 0 2023-12-05T13:25:17.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/335: symlink d3/d5/d58/l73 0 2023-12-05T13:25:17.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/336: readlink d3/d5/d9/l1e 0 2023-12-05T13:25:17.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/337: fdatasync d3/d4/d6/f4b 0 2023-12-05T13:25:17.186 INFO:tasks.workunit.client.1.smithi052.stdout:1/425: symlink d5/d26/d41/l8a 0 2023-12-05T13:25:17.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/326: creat d3/d1e/d37/d4f/f65 x:0 0 0 2023-12-05T13:25:17.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/327: fdatasync d3/d1e/d37/d4f/f52 0 2023-12-05T13:25:17.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/328: write d3/d1e/d37/d4f/f65 [91045,21179] 0 2023-12-05T13:25:17.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/329: readlink d3/d1e/d37/l4a 0 2023-12-05T13:25:17.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/330: stat d3/d2a/f59 0 2023-12-05T13:25:17.194 INFO:tasks.workunit.client.1.smithi052.stdout:1/426: mknod d5/d7/d35/d2f/d3e/d62/d85/c8b 0 2023-12-05T13:25:17.194 INFO:tasks.workunit.client.1.smithi052.stdout:1/427: write d5/d7/f4b [1401733,13932] 0 2023-12-05T13:25:17.194 INFO:tasks.workunit.client.1.smithi052.stdout:1/428: dread - d5/d7/d35/d37/d68/d17/f88 zero size 2023-12-05T13:25:17.196 INFO:tasks.workunit.client.1.smithi052.stdout:9/331: symlink d3/d5e/l66 0 2023-12-05T13:25:17.199 INFO:tasks.workunit.client.1.smithi052.stdout:9/332: rename d3/d11/d19/f5b to d3/d1e/d37/d4f/f67 0 2023-12-05T13:25:17.211 INFO:tasks.workunit.client.1.smithi052.stdout:1/429: dwrite d5/d7/f12 [0,4194304] 0 2023-12-05T13:25:17.212 INFO:tasks.workunit.client.1.smithi052.stdout:1/430: write d5/d7/d35/d37/d68/f32 [3741960,12889] 0 2023-12-05T13:25:17.216 INFO:tasks.workunit.client.1.smithi052.stdout:1/431: mknod d5/d7/d35/d37/d68/d17/c8c 0 2023-12-05T13:25:17.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:16 smithi052 ceph-mon[121072]: pgmap v208: 65 pgs: 65 active+clean; 1.0 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 22 MiB/s rd, 49 MiB/s wr, 899 op/s 2023-12-05T13:25:17.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:16 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:17.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:16 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:17.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:16 smithi029 ceph-mon[112128]: pgmap v208: 65 pgs: 65 active+clean; 1.0 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 22 MiB/s rd, 49 MiB/s wr, 899 op/s 2023-12-05T13:25:17.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:16 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:17.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:16 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:17.585 INFO:tasks.workunit.client.1.smithi052.stdout:2/501: getdents d2/d13/d48 0 2023-12-05T13:25:17.585 INFO:tasks.workunit.client.1.smithi052.stdout:2/502: readlink d2/d14/d62/l64 0 2023-12-05T13:25:17.586 INFO:tasks.workunit.client.1.smithi052.stdout:2/503: truncate d2/f3c 1714359 0 2023-12-05T13:25:17.678 INFO:tasks.workunit.client.1.smithi052.stdout:4/428: sync 2023-12-05T13:25:17.678 INFO:tasks.workunit.client.1.smithi052.stdout:0/495: sync 2023-12-05T13:25:17.678 INFO:tasks.workunit.client.1.smithi052.stdout:7/549: sync 2023-12-05T13:25:17.678 INFO:tasks.workunit.client.1.smithi052.stdout:7/550: write d7/d4e/d45/d50/f8f [76310,6482] 0 2023-12-05T13:25:17.681 INFO:tasks.workunit.client.1.smithi052.stdout:4/429: truncate de/d2b/f55 15967 0 2023-12-05T13:25:17.682 INFO:tasks.workunit.client.1.smithi052.stdout:0/496: read d0/db/d1b/f27 [511410,3668] 0 2023-12-05T13:25:17.683 INFO:tasks.workunit.client.1.smithi052.stdout:0/497: fdatasync d0/db/d33/f3f 0 2023-12-05T13:25:17.684 INFO:tasks.workunit.client.1.smithi052.stdout:7/551: creat d7/d4e/d45/d5a/d63/d95/fbd x:0 0 0 2023-12-05T13:25:17.685 INFO:tasks.workunit.client.1.smithi052.stdout:0/498: read d0/db/d1b/d51/d55/d66/d77/f95 [2149267,39090] 0 2023-12-05T13:25:17.686 INFO:tasks.workunit.client.1.smithi052.stdout:4/430: creat de/d1e/d24/f8c x:0 0 0 2023-12-05T13:25:17.687 INFO:tasks.workunit.client.1.smithi052.stdout:7/552: creat d7/d4e/d45/d93/fbe x:0 0 0 2023-12-05T13:25:17.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/431: creat de/d30/d68/f8d x:0 0 0 2023-12-05T13:25:17.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/432: stat de/d30 0 2023-12-05T13:25:17.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/433: chown de/d30/d68/c8b 2614 1 2023-12-05T13:25:17.694 INFO:tasks.workunit.client.1.smithi052.stdout:7/553: mknod d7/d4e/d45/d98/cbf 0 2023-12-05T13:25:17.696 INFO:tasks.workunit.client.1.smithi052.stdout:4/434: creat de/d30/d68/d59/d6d/f8e x:0 0 0 2023-12-05T13:25:17.698 INFO:tasks.workunit.client.1.smithi052.stdout:0/499: dread d0/db/d1b/d51/d55/d66/f86 [0,4194304] 0 2023-12-05T13:25:17.698 INFO:tasks.workunit.client.1.smithi052.stdout:7/554: symlink d7/d4e/d12/d3f/d46/dab/lc0 0 2023-12-05T13:25:17.698 INFO:tasks.workunit.client.1.smithi052.stdout:7/555: chown d7 1874 1 2023-12-05T13:25:17.705 INFO:tasks.workunit.client.1.smithi052.stdout:0/500: unlink d0/db/d14/f26 0 2023-12-05T13:25:17.709 INFO:tasks.workunit.client.1.smithi052.stdout:0/501: creat d0/db/d20/fa5 x:0 0 0 2023-12-05T13:25:17.709 INFO:tasks.workunit.client.1.smithi052.stdout:0/502: fsync d0/db/d1b/d51/d55/d66/f86 0 2023-12-05T13:25:17.709 INFO:tasks.workunit.client.1.smithi052.stdout:4/435: dread de/d2b/f2d [0,4194304] 0 2023-12-05T13:25:17.713 INFO:tasks.workunit.client.1.smithi052.stdout:4/436: mkdir de/d29/d51/d76/d8f 0 2023-12-05T13:25:17.715 INFO:tasks.workunit.client.1.smithi052.stdout:0/503: mkdir d0/db/d2e/d7e/da6 0 2023-12-05T13:25:17.715 INFO:tasks.workunit.client.1.smithi052.stdout:0/504: fdatasync d0/db/d14/f4f 0 2023-12-05T13:25:17.718 INFO:tasks.workunit.client.1.smithi052.stdout:0/505: readlink d0/db/d2e/d53/d80/l79 0 2023-12-05T13:25:17.722 INFO:tasks.workunit.client.1.smithi052.stdout:0/506: dread d0/f2b [0,4194304] 0 2023-12-05T13:25:17.784 INFO:tasks.workunit.client.1.smithi052.stdout:3/465: getdents da/dd 0 2023-12-05T13:25:17.865 INFO:tasks.workunit.client.1.smithi052.stdout:6/338: dread d3/d4/df/f43 [0,4194304] 0 2023-12-05T13:25:17.865 INFO:tasks.workunit.client.1.smithi052.stdout:6/339: chown d3/d4/df/d63/f70 667508168 1 2023-12-05T13:25:17.908 INFO:tasks.workunit.client.1.smithi052.stdout:1/432: sync 2023-12-05T13:25:17.909 INFO:tasks.workunit.client.1.smithi052.stdout:5/275: sync 2023-12-05T13:25:17.909 INFO:tasks.workunit.client.1.smithi052.stdout:9/333: sync 2023-12-05T13:25:17.909 INFO:tasks.workunit.client.1.smithi052.stdout:9/334: dread - d3/d31/f45 zero size 2023-12-05T13:25:17.909 INFO:tasks.workunit.client.1.smithi052.stdout:8/578: sync 2023-12-05T13:25:17.910 INFO:tasks.workunit.client.1.smithi052.stdout:1/433: mknod d5/d7/d35/d37/d5a/d73/d7e/c8d 0 2023-12-05T13:25:17.911 INFO:tasks.workunit.client.1.smithi052.stdout:1/434: read d5/f2c [1316156,56757] 0 2023-12-05T13:25:17.914 INFO:tasks.workunit.client.1.smithi052.stdout:1/435: mknod d5/d7/d35/d37/d5a/d73/d7e/c8e 0 2023-12-05T13:25:17.914 INFO:tasks.workunit.client.1.smithi052.stdout:1/436: read - d5/d7/d35/d37/d68/d69/f82 zero size 2023-12-05T13:25:17.914 INFO:tasks.workunit.client.1.smithi052.stdout:1/437: fsync d5/d7/d35/f3d 0 2023-12-05T13:25:17.929 INFO:tasks.workunit.client.1.smithi052.stdout:8/579: dwrite d0/de/d27/d43/d63/f8b [4194304,4194304] 0 2023-12-05T13:25:17.930 INFO:tasks.workunit.client.1.smithi052.stdout:5/276: dwrite d5/f9 [0,4194304] 0 2023-12-05T13:25:17.934 INFO:tasks.workunit.client.1.smithi052.stdout:8/580: rename d0/d28/d39/d3a/d4f/f55 to d0/d28/d2b/d53/fbb 0 2023-12-05T13:25:17.937 INFO:tasks.workunit.client.1.smithi052.stdout:5/277: rename d5/d15/d33/f38 to d5/d15/d21/d25/d3f/f5a 0 2023-12-05T13:25:17.937 INFO:tasks.workunit.client.1.smithi052.stdout:5/278: write d5/df/d11/f26 [5048971,32831] 0 2023-12-05T13:25:17.937 INFO:tasks.workunit.client.1.smithi052.stdout:5/279: readlink d5/d15/l1e 0 2023-12-05T13:25:17.943 INFO:tasks.workunit.client.1.smithi052.stdout:5/280: mkdir d5/df/d4e/d5b 0 2023-12-05T13:25:18.028 INFO:tasks.workunit.client.1.smithi052.stdout:0/507: creat d0/db/d52/d7f/fa7 x:0 0 0 2023-12-05T13:25:18.029 INFO:tasks.workunit.client.1.smithi052.stdout:0/508: stat d0/db/d52/d7f/f89 0 2023-12-05T13:25:18.045 INFO:tasks.workunit.client.1.smithi052.stdout:0/509: dwrite d0/db/d1b/d29/f91 [4194304,4194304] 0 2023-12-05T13:25:18.045 INFO:tasks.workunit.client.1.smithi052.stdout:0/510: chown d0/db/f96 1856948739 1 2023-12-05T13:25:18.049 INFO:tasks.workunit.client.1.smithi052.stdout:0/511: symlink d0/db/d2e/d7e/da6/la8 0 2023-12-05T13:25:18.051 INFO:tasks.workunit.client.1.smithi052.stdout:0/512: mknod d0/db/d14/d9b/ca9 0 2023-12-05T13:25:18.442 INFO:tasks.workunit.client.1.smithi052.stdout:0/513: getdents d0/db/d20 0 2023-12-05T13:25:18.446 INFO:tasks.workunit.client.1.smithi052.stdout:0/514: mknod d0/db/d2e/d53/d80/caa 0 2023-12-05T13:25:18.446 INFO:tasks.workunit.client.1.smithi052.stdout:0/515: getdents d0/db/d1b/d42 0 2023-12-05T13:25:18.454 INFO:tasks.workunit.client.1.smithi052.stdout:0/516: dread d0/db/d52/f7d [0,4194304] 0 2023-12-05T13:25:18.475 INFO:tasks.workunit.client.1.smithi052.stdout:0/517: dwrite d0/db/d1b/d51/d55/d66/d77/f95 [0,4194304] 0 2023-12-05T13:25:18.626 INFO:tasks.workunit.client.1.smithi052.stdout:3/466: dwrite da/d2e/f7f [0,4194304] 0 2023-12-05T13:25:18.626 INFO:tasks.workunit.client.1.smithi052.stdout:3/467: write da/dd/f90 [317309,54557] 0 2023-12-05T13:25:18.626 INFO:tasks.workunit.client.1.smithi052.stdout:3/468: stat da/dd 0 2023-12-05T13:25:18.626 INFO:tasks.workunit.client.1.smithi052.stdout:3/469: fsync da/f9d 0 2023-12-05T13:25:18.626 INFO:tasks.workunit.client.1.smithi052.stdout:3/470: truncate da/d25/d33/f97 684868 0 2023-12-05T13:25:18.641 INFO:tasks.workunit.client.1.smithi052.stdout:3/471: dwrite da/d25/f3a [0,4194304] 0 2023-12-05T13:25:18.645 INFO:tasks.workunit.client.1.smithi052.stdout:3/472: link da/d2e/d40/c77 da/d25/d33/d43/d5b/d96/ca2 0 2023-12-05T13:25:18.660 INFO:tasks.workunit.client.1.smithi052.stdout:3/473: dwrite da/d25/f6f [4194304,4194304] 0 2023-12-05T13:25:18.661 INFO:tasks.workunit.client.1.smithi052.stdout:3/474: fdatasync f4 0 2023-12-05T13:25:18.661 INFO:tasks.workunit.client.1.smithi052.stdout:3/475: fdatasync da/d27/f3b 0 2023-12-05T13:25:18.661 INFO:tasks.workunit.client.1.smithi052.stdout:3/476: fsync da/d25/d33/d49/f8a 0 2023-12-05T13:25:18.668 INFO:tasks.workunit.client.1.smithi052.stdout:3/477: creat da/d7a/fa3 x:0 0 0 2023-12-05T13:25:18.671 INFO:tasks.workunit.client.1.smithi052.stdout:6/340: write d3/d4/df/d27/f31 [1590185,71265] 0 2023-12-05T13:25:18.671 INFO:tasks.workunit.client.1.smithi052.stdout:3/478: truncate da/f21 444730 0 2023-12-05T13:25:18.671 INFO:tasks.workunit.client.1.smithi052.stdout:3/479: truncate da/d25/d33/d49/f8a 661705 0 2023-12-05T13:25:18.671 INFO:tasks.workunit.client.1.smithi052.stdout:3/480: readlink da/dd/l9e 0 2023-12-05T13:25:18.674 INFO:tasks.workunit.client.1.smithi052.stdout:6/341: rmdir d3/d4/d6/d26/d69 0 2023-12-05T13:25:18.674 INFO:tasks.workunit.client.1.smithi052.stdout:6/342: stat d3/d4/d6/l57 0 2023-12-05T13:25:18.677 INFO:tasks.workunit.client.1.smithi052.stdout:6/343: mkdir d3/d5/d9/d21/d48/d4d/d66/d74 0 2023-12-05T13:25:18.679 INFO:tasks.workunit.client.1.smithi052.stdout:6/344: creat d3/d4/df/d24/f75 x:0 0 0 2023-12-05T13:25:18.684 INFO:tasks.workunit.client.1.smithi052.stdout:6/345: link d3/d5/d9/f3a d3/d4/d36/f76 0 2023-12-05T13:25:18.686 INFO:tasks.workunit.client.1.smithi052.stdout:6/346: symlink d3/d4/df/d63/l77 0 2023-12-05T13:25:18.686 INFO:tasks.workunit.client.1.smithi052.stdout:6/347: fdatasync d3/d4/df/d27/f56 0 2023-12-05T13:25:18.689 INFO:tasks.workunit.client.1.smithi052.stdout:6/348: creat d3/d5/d9/d21/d48/d4d/f78 x:0 0 0 2023-12-05T13:25:18.691 INFO:tasks.workunit.client.1.smithi052.stdout:6/349: mknod d3/d5/d9/d21/d48/c79 0 2023-12-05T13:25:18.691 INFO:tasks.workunit.client.1.smithi052.stdout:6/350: dread - d3/d5/d9/d21/d48/d5b/f60 zero size 2023-12-05T13:25:18.691 INFO:tasks.workunit.client.1.smithi052.stdout:6/351: stat d3/d5/d58/l72 0 2023-12-05T13:25:18.836 INFO:tasks.workunit.client.1.smithi052.stdout:6/352: symlink d3/d5/d9/l7a 0 2023-12-05T13:25:18.838 INFO:tasks.workunit.client.1.smithi052.stdout:6/353: creat d3/d5/d9/d21/d48/d5b/f7b x:0 0 0 2023-12-05T13:25:18.968 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:18.969 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:18 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:18.969 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:18 smithi052 ceph-mon[121072]: pgmap v209: 65 pgs: 65 active+clean; 1.0 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 21 MiB/s rd, 46 MiB/s wr, 891 op/s 2023-12-05T13:25:19.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:19.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:18 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:19.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:18 smithi029 ceph-mon[112128]: pgmap v209: 65 pgs: 65 active+clean; 1.0 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 21 MiB/s rd, 46 MiB/s wr, 891 op/s 2023-12-05T13:25:19.146 INFO:tasks.workunit.client.1.smithi052.stdout:4/437: symlink de/d30/l90 0 2023-12-05T13:25:19.164 INFO:tasks.workunit.client.1.smithi052.stdout:4/438: dwrite de/d1e/d24/f35 [0,4194304] 0 2023-12-05T13:25:19.507 INFO:tasks.workunit.client.1.smithi052.stdout:4/439: mkdir de/d91 0 2023-12-05T13:25:19.526 INFO:tasks.workunit.client.1.smithi052.stdout:4/440: dwrite de/d30/f8a [0,4194304] 0 2023-12-05T13:25:19.526 INFO:tasks.workunit.client.1.smithi052.stdout:4/441: chown de/d29/c39 73079 1 2023-12-05T13:25:19.529 INFO:tasks.workunit.client.1.smithi052.stdout:5/281: rename d5/d15/d33 to d5/d15/d21/d25/d3f/d5c 0 2023-12-05T13:25:19.533 INFO:tasks.workunit.client.1.smithi052.stdout:4/442: mknod de/d1e/c92 0 2023-12-05T13:25:19.538 INFO:tasks.workunit.client.1.smithi052.stdout:5/282: link d5/c55 d5/df/d11/c5d 0 2023-12-05T13:25:19.538 INFO:tasks.workunit.client.1.smithi052.stdout:5/283: write d5/df/d11/f2b [1703399,1934] 0 2023-12-05T13:25:19.545 INFO:tasks.workunit.client.1.smithi052.stdout:3/481: getdents da/d25/d33/d43/d5b/d96 0 2023-12-05T13:25:19.546 INFO:tasks.workunit.client.1.smithi052.stdout:5/284: dread d5/f9 [4194304,4194304] 0 2023-12-05T13:25:19.547 INFO:tasks.workunit.client.1.smithi052.stdout:5/285: fdatasync d5/f9 0 2023-12-05T13:25:19.550 INFO:tasks.workunit.client.1.smithi052.stdout:5/286: creat d5/d15/d21/f5e x:0 0 0 2023-12-05T13:25:19.559 INFO:tasks.workunit.client.1.smithi052.stdout:4/443: dwrite de/d2b/d64/d69/f7a [0,4194304] 0 2023-12-05T13:25:19.559 INFO:tasks.workunit.client.1.smithi052.stdout:4/444: write de/f33 [4780738,63689] 0 2023-12-05T13:25:19.561 INFO:tasks.workunit.client.1.smithi052.stdout:6/354: rename d3/d5/d9/d21/d48/d5b/f60 to d3/d5/f7c 0 2023-12-05T13:25:19.566 INFO:tasks.workunit.client.1.smithi052.stdout:3/482: dwrite da/f18 [0,4194304] 0 2023-12-05T13:25:19.568 INFO:tasks.workunit.client.1.smithi052.stdout:4/445: mknod de/d2b/c93 0 2023-12-05T13:25:19.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/446: write fa [2275412,18948] 0 2023-12-05T13:25:19.570 INFO:tasks.workunit.client.1.smithi052.stdout:5/287: dwrite d5/d15/f3c [0,4194304] 0 2023-12-05T13:25:19.570 INFO:tasks.workunit.client.1.smithi052.stdout:9/335: rmdir d3/d1e/d41 39 2023-12-05T13:25:19.571 INFO:tasks.workunit.client.1.smithi052.stdout:9/336: write d3/d11/d3e/f51 [2581808,72499] 0 2023-12-05T13:25:19.571 INFO:tasks.workunit.client.1.smithi052.stdout:9/337: getdents d3/d11/d3e 0 2023-12-05T13:25:19.572 INFO:tasks.workunit.client.1.smithi052.stdout:6/355: symlink d3/d5/d9/d44/l7d 0 2023-12-05T13:25:19.577 INFO:tasks.workunit.client.1.smithi052.stdout:4/447: rename de/d2b/d88 to de/d30/d94 0 2023-12-05T13:25:19.578 INFO:tasks.workunit.client.1.smithi052.stdout:4/448: stat de/f87 0 2023-12-05T13:25:19.578 INFO:tasks.workunit.client.1.smithi052.stdout:4/449: fsync de/d29/f3d 0 2023-12-05T13:25:19.579 INFO:tasks.workunit.client.1.smithi052.stdout:6/356: dread d3/d4/f55 [0,4194304] 0 2023-12-05T13:25:19.580 INFO:tasks.workunit.client.1.smithi052.stdout:6/357: fsync d3/d4/d6/f4b 0 2023-12-05T13:25:19.583 INFO:tasks.workunit.client.1.smithi052.stdout:5/288: creat d5/d15/d21/d4a/f5f x:0 0 0 2023-12-05T13:25:19.585 INFO:tasks.workunit.client.1.smithi052.stdout:3/483: write da/f21 [143527,62574] 0 2023-12-05T13:25:19.586 INFO:tasks.workunit.client.1.smithi052.stdout:3/484: chown da/d48/d50/d74/l8d 2525397 1 2023-12-05T13:25:19.586 INFO:tasks.workunit.client.1.smithi052.stdout:3/485: read da/d25/d33/f97 [423356,52163] 0 2023-12-05T13:25:19.590 INFO:tasks.workunit.client.1.smithi052.stdout:9/338: getdents d3/d1e/d37 0 2023-12-05T13:25:19.590 INFO:tasks.workunit.client.1.smithi052.stdout:9/339: truncate d3/d2a/f59 553229 0 2023-12-05T13:25:19.597 INFO:tasks.workunit.client.1.smithi052.stdout:6/358: creat d3/d4/d6/d26/d6d/f7e x:0 0 0 2023-12-05T13:25:19.599 INFO:tasks.workunit.client.1.smithi052.stdout:6/359: read d3/d5/d9/f3a [932449,80085] 0 2023-12-05T13:25:19.599 INFO:tasks.workunit.client.1.smithi052.stdout:6/360: chown d3/d5/d9/d52/l6b 11712 1 2023-12-05T13:25:19.599 INFO:tasks.workunit.client.1.smithi052.stdout:6/361: readlink d3/d5/d9/d44/l6a 0 2023-12-05T13:25:19.601 INFO:tasks.workunit.client.1.smithi052.stdout:3/486: dwrite da/dd/f26 [0,4194304] 0 2023-12-05T13:25:19.601 INFO:tasks.workunit.client.1.smithi052.stdout:5/289: creat d5/d15/d21/f60 x:0 0 0 2023-12-05T13:25:19.601 INFO:tasks.workunit.client.1.smithi052.stdout:3/487: write da/dd/f26 [3099485,44590] 0 2023-12-05T13:25:19.612 INFO:tasks.workunit.client.1.smithi052.stdout:9/340: rename d3/d1e/d41/l50 to d3/d1e/d62/l68 0 2023-12-05T13:25:19.613 INFO:tasks.workunit.client.1.smithi052.stdout:6/362: mknod d3/d5/d9/d52/c7f 0 2023-12-05T13:25:19.613 INFO:tasks.workunit.client.1.smithi052.stdout:9/341: stat d3/d1e/d37/d4f 0 2023-12-05T13:25:19.613 INFO:tasks.workunit.client.1.smithi052.stdout:6/363: read - d3/d4/df/d24/f75 zero size 2023-12-05T13:25:19.613 INFO:tasks.workunit.client.1.smithi052.stdout:6/364: chown d3/d4/df/d27 31 1 2023-12-05T13:25:19.614 INFO:tasks.workunit.client.1.smithi052.stdout:9/342: write d3/d11/d3e/f51 [4087844,60370] 0 2023-12-05T13:25:19.619 INFO:tasks.workunit.client.1.smithi052.stdout:9/343: creat d3/d11/f69 x:0 0 0 2023-12-05T13:25:19.619 INFO:tasks.workunit.client.1.smithi052.stdout:5/290: creat d5/df/f61 x:0 0 0 2023-12-05T13:25:19.619 INFO:tasks.workunit.client.1.smithi052.stdout:5/291: truncate d5/d15/d21/d25/d3f/d5c/f53 88567 0 2023-12-05T13:25:19.621 INFO:tasks.workunit.client.1.smithi052.stdout:3/488: dwrite da/d27/f92 [0,4194304] 0 2023-12-05T13:25:19.621 INFO:tasks.workunit.client.1.smithi052.stdout:3/489: fsync da/d25/f31 0 2023-12-05T13:25:19.621 INFO:tasks.workunit.client.1.smithi052.stdout:3/490: fdatasync da/f23 0 2023-12-05T13:25:19.621 INFO:tasks.workunit.client.1.smithi052.stdout:9/344: write d3/d1e/d37/d4f/f54 [627160,89441] 0 2023-12-05T13:25:19.623 INFO:tasks.workunit.client.1.smithi052.stdout:5/292: truncate d5/df/f17 3098300 0 2023-12-05T13:25:19.625 INFO:tasks.workunit.client.1.smithi052.stdout:6/365: symlink d3/d4/d36/l80 0 2023-12-05T13:25:19.625 INFO:tasks.workunit.client.1.smithi052.stdout:6/366: stat d3/d5/c65 0 2023-12-05T13:25:19.625 INFO:tasks.workunit.client.1.smithi052.stdout:6/367: readlink d3/d5/d9/l1e 0 2023-12-05T13:25:19.625 INFO:tasks.workunit.client.1.smithi052.stdout:6/368: read d3/d4/df/f43 [139806,114653] 0 2023-12-05T13:25:19.626 INFO:tasks.workunit.client.1.smithi052.stdout:9/345: dread d3/d1e/d37/d4f/f52 [0,4194304] 0 2023-12-05T13:25:19.626 INFO:tasks.workunit.client.1.smithi052.stdout:9/346: fsync d3/d31/f45 0 2023-12-05T13:25:19.632 INFO:tasks.workunit.client.1.smithi052.stdout:6/369: mkdir d3/d5/d9/d21/d48/d4d/d81 0 2023-12-05T13:25:19.636 INFO:tasks.workunit.client.1.smithi052.stdout:9/347: creat d3/f6a x:0 0 0 2023-12-05T13:25:19.641 INFO:tasks.workunit.client.1.smithi052.stdout:9/348: rename d3/d11/l32 to d3/d1e/d62/l6b 0 2023-12-05T13:25:19.644 INFO:tasks.workunit.client.1.smithi052.stdout:3/491: dwrite da/dd/f55 [0,4194304] 0 2023-12-05T13:25:19.644 INFO:tasks.workunit.client.1.smithi052.stdout:9/349: mkdir d3/d31/d6c 0 2023-12-05T13:25:19.644 INFO:tasks.workunit.client.1.smithi052.stdout:5/293: dwrite d5/d15/d21/d4a/f5f [0,4194304] 0 2023-12-05T13:25:19.645 INFO:tasks.workunit.client.1.smithi052.stdout:5/294: stat d5/d15/f18 0 2023-12-05T13:25:19.646 INFO:tasks.workunit.client.1.smithi052.stdout:6/370: dread d3/d4/d6/f1d [0,4194304] 0 2023-12-05T13:25:19.649 INFO:tasks.workunit.client.1.smithi052.stdout:5/295: dread d5/df/d11/f2b [0,4194304] 0 2023-12-05T13:25:19.650 INFO:tasks.workunit.client.1.smithi052.stdout:9/350: rename d3/d1e/d37/l4a to d3/d2a/l6d 0 2023-12-05T13:25:19.656 INFO:tasks.workunit.client.1.smithi052.stdout:6/371: mkdir d3/d5/d9/d21/d48/d4d/d81/d82 0 2023-12-05T13:25:19.656 INFO:tasks.workunit.client.1.smithi052.stdout:5/296: mknod d5/df/d4b/c62 0 2023-12-05T13:25:19.657 INFO:tasks.workunit.client.1.smithi052.stdout:3/492: dread da/dd/f26 [0,4194304] 0 2023-12-05T13:25:19.659 INFO:tasks.workunit.client.1.smithi052.stdout:6/372: link d3/d5/d9/d21/f23 d3/d4/d6/f83 0 2023-12-05T13:25:19.661 INFO:tasks.workunit.client.1.smithi052.stdout:3/493: creat da/d7a/fa4 x:0 0 0 2023-12-05T13:25:19.661 INFO:tasks.workunit.client.1.smithi052.stdout:3/494: truncate da/d25/d33/d51/f88 228828 0 2023-12-05T13:25:19.664 INFO:tasks.workunit.client.1.smithi052.stdout:6/373: creat d3/d5/d58/f84 x:0 0 0 2023-12-05T13:25:19.665 INFO:tasks.workunit.client.1.smithi052.stdout:9/351: dwrite d3/d11/f21 [0,4194304] 0 2023-12-05T13:25:19.665 INFO:tasks.workunit.client.1.smithi052.stdout:9/352: truncate d3/d1e/f60 468194 0 2023-12-05T13:25:19.665 INFO:tasks.workunit.client.1.smithi052.stdout:9/353: chown d3/f6a 60351194 1 2023-12-05T13:25:19.665 INFO:tasks.workunit.client.1.smithi052.stdout:9/354: fsync d3/d1e/d37/d4f/f67 0 2023-12-05T13:25:19.666 INFO:tasks.workunit.client.1.smithi052.stdout:3/495: symlink da/d25/d33/d89/la5 0 2023-12-05T13:25:19.666 INFO:tasks.workunit.client.1.smithi052.stdout:3/496: readlink da/dd/d3d/l4d 0 2023-12-05T13:25:19.666 INFO:tasks.workunit.client.1.smithi052.stdout:3/497: readlink da/d48/d50/d74/l8d 0 2023-12-05T13:25:19.666 INFO:tasks.workunit.client.1.smithi052.stdout:3/498: fdatasync da/d25/d33/d51/f88 0 2023-12-05T13:25:19.670 INFO:tasks.workunit.client.1.smithi052.stdout:9/355: rename d3/f15 to d3/d11/d3e/f6e 0 2023-12-05T13:25:19.670 INFO:tasks.workunit.client.1.smithi052.stdout:9/356: fdatasync d3/d11/d19/f2e 0 2023-12-05T13:25:19.671 INFO:tasks.workunit.client.1.smithi052.stdout:6/374: dread d3/f3d [0,4194304] 0 2023-12-05T13:25:19.671 INFO:tasks.workunit.client.1.smithi052.stdout:6/375: dread - d3/d4/df/d24/f4f zero size 2023-12-05T13:25:19.673 INFO:tasks.workunit.client.1.smithi052.stdout:3/499: getdents da/d25/d33/d43/d5b 0 2023-12-05T13:25:19.677 INFO:tasks.workunit.client.1.smithi052.stdout:9/357: mknod d3/d1e/d62/c6f 0 2023-12-05T13:25:19.678 INFO:tasks.workunit.client.1.smithi052.stdout:9/358: fsync d3/d1e/d41/f46 0 2023-12-05T13:25:19.680 INFO:tasks.workunit.client.1.smithi052.stdout:9/359: write d3/fd [1590453,62957] 0 2023-12-05T13:25:19.690 INFO:tasks.workunit.client.1.smithi052.stdout:9/360: symlink d3/d5e/l70 0 2023-12-05T13:25:19.693 INFO:tasks.workunit.client.1.smithi052.stdout:9/361: read d3/f24 [1115712,15926] 0 2023-12-05T13:25:19.694 INFO:tasks.workunit.client.1.smithi052.stdout:3/500: dwrite da/d25/d33/d49/f7e [4194304,4194304] 0 2023-12-05T13:25:19.694 INFO:tasks.workunit.client.1.smithi052.stdout:3/501: fsync da/dd/f90 0 2023-12-05T13:25:19.716 INFO:tasks.workunit.client.1.smithi052.stdout:3/502: dwrite da/f23 [0,4194304] 0 2023-12-05T13:25:19.716 INFO:tasks.workunit.client.1.smithi052.stdout:3/503: readlink da/dd/l9e 0 2023-12-05T13:25:19.718 INFO:tasks.workunit.client.1.smithi052.stdout:2/504: mknod d2/d13/d1e/d6a/c94 0 2023-12-05T13:25:19.721 INFO:tasks.workunit.client.1.smithi052.stdout:2/505: dread d2/d13/d1e/f3d [0,4194304] 0 2023-12-05T13:25:19.722 INFO:tasks.workunit.client.1.smithi052.stdout:2/506: write d2/d14/f8f [2340229,61404] 0 2023-12-05T13:25:19.724 INFO:tasks.workunit.client.1.smithi052.stdout:3/504: mkdir da/d25/d33/d43/d5b/da6 0 2023-12-05T13:25:19.729 INFO:tasks.workunit.client.1.smithi052.stdout:2/507: dread d2/d14/f5a [0,4194304] 0 2023-12-05T13:25:19.733 INFO:tasks.workunit.client.1.smithi052.stdout:2/508: getdents d2/d4/d3f 0 2023-12-05T13:25:19.733 INFO:tasks.workunit.client.1.smithi052.stdout:2/509: chown d2/d14 787 1 2023-12-05T13:25:19.737 INFO:tasks.workunit.client.1.smithi052.stdout:2/510: mknod d2/d13/d1e/d6a/d7f/d84/d6e/c95 0 2023-12-05T13:25:19.741 INFO:tasks.workunit.client.1.smithi052.stdout:2/511: rename d2/c12 to d2/d13/d45/c96 0 2023-12-05T13:25:19.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/512: creat d2/d4/d3f/f97 x:0 0 0 2023-12-05T13:25:19.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/513: write d2/d4/f89 [787882,104009] 0 2023-12-05T13:25:20.443 INFO:tasks.workunit.client.1.smithi052.stdout:4/450: dwrite de/d1e/d24/f4d [0,4194304] 0 2023-12-05T13:25:20.452 INFO:tasks.workunit.client.1.smithi052.stdout:4/451: creat de/d29/d51/d76/f95 x:0 0 0 2023-12-05T13:25:20.460 INFO:tasks.workunit.client.1.smithi052.stdout:5/297: dwrite d5/df/f17 [0,4194304] 0 2023-12-05T13:25:20.470 INFO:tasks.workunit.client.1.smithi052.stdout:4/452: dwrite de/d29/d51/f6b [0,4194304] 0 2023-12-05T13:25:20.470 INFO:tasks.workunit.client.1.smithi052.stdout:5/298: dread f4 [0,4194304] 0 2023-12-05T13:25:20.479 INFO:tasks.workunit.client.1.smithi052.stdout:4/453: link de/d2b/c7f de/d30/d68/c96 0 2023-12-05T13:25:20.482 INFO:tasks.workunit.client.1.smithi052.stdout:4/454: rename de/d1e/l49 to de/d29/d51/d76/d8f/l97 0 2023-12-05T13:25:20.484 INFO:tasks.workunit.client.1.smithi052.stdout:4/455: creat de/f98 x:0 0 0 2023-12-05T13:25:20.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/456: symlink de/d2b/d80/l99 0 2023-12-05T13:25:20.487 INFO:tasks.workunit.client.1.smithi052.stdout:4/457: dread - de/d2b/d64/f6a zero size 2023-12-05T13:25:20.491 INFO:tasks.workunit.client.1.smithi052.stdout:4/458: link de/d30/f8a de/d30/d73/f9a 0 2023-12-05T13:25:20.491 INFO:tasks.workunit.client.1.smithi052.stdout:4/459: fdatasync de/f14 0 2023-12-05T13:25:20.491 INFO:tasks.workunit.client.1.smithi052.stdout:4/460: chown de/d1e/d24/l2f 8 1 2023-12-05T13:25:20.493 INFO:tasks.workunit.client.1.smithi052.stdout:4/461: rename de/d2b/d64/d69/f7a to de/d30/d68/d59/f9b 0 2023-12-05T13:25:20.496 INFO:tasks.workunit.client.1.smithi052.stdout:4/462: mknod de/d30/d68/d59/d6d/c9c 0 2023-12-05T13:25:20.496 INFO:tasks.workunit.client.1.smithi052.stdout:4/463: readlink de/d30/l36 0 2023-12-05T13:25:20.516 INFO:tasks.workunit.client.1.smithi052.stdout:4/464: truncate de/d1e/d24/f35 4095023 0 2023-12-05T13:25:20.519 INFO:tasks.workunit.client.1.smithi052.stdout:4/465: mknod de/d30/d68/d59/c9d 0 2023-12-05T13:25:20.519 INFO:tasks.workunit.client.1.smithi052.stdout:4/466: read de/d29/f3d [1851350,21557] 0 2023-12-05T13:25:20.519 INFO:tasks.workunit.client.1.smithi052.stdout:4/467: fsync de/f11 0 2023-12-05T13:25:20.522 INFO:tasks.workunit.client.1.smithi052.stdout:4/468: creat de/d2b/d64/d69/f9e x:0 0 0 2023-12-05T13:25:20.525 INFO:tasks.workunit.client.1.smithi052.stdout:4/469: mknod de/d2b/d64/c9f 0 2023-12-05T13:25:20.525 INFO:tasks.workunit.client.1.smithi052.stdout:4/470: chown f4 245140967 1 2023-12-05T13:25:20.525 INFO:tasks.workunit.client.1.smithi052.stdout:4/471: fdatasync de/d1e/d24/f35 0 2023-12-05T13:25:20.529 INFO:tasks.workunit.client.1.smithi052.stdout:4/472: rename de/d1e/l22 to de/d30/d68/d59/la0 0 2023-12-05T13:25:20.529 INFO:tasks.workunit.client.1.smithi052.stdout:4/473: chown de/d30/d68/c89 208 1 2023-12-05T13:25:20.529 INFO:tasks.workunit.client.1.smithi052.stdout:4/474: fsync de/d29/f2e 0 2023-12-05T13:25:20.534 INFO:tasks.workunit.client.1.smithi052.stdout:4/475: creat de/d30/d73/fa1 x:0 0 0 2023-12-05T13:25:20.534 INFO:tasks.workunit.client.1.smithi052.stdout:4/476: stat de/d30/d68/d59/c9d 0 2023-12-05T13:25:20.535 INFO:tasks.workunit.client.1.smithi052.stdout:4/477: write de/d30/d73/f9a [83430,45220] 0 2023-12-05T13:25:20.540 INFO:tasks.workunit.client.1.smithi052.stdout:4/478: symlink de/d1e/d24/la2 0 2023-12-05T13:25:20.541 INFO:tasks.workunit.client.1.smithi052.stdout:4/479: write de/f33 [69238,36336] 0 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:0/518: sync 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:1/438: sync 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:0/519: chown d0/db/d1b/c1e 5 1 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:1/439: chown d5/d7/d35/d37/d5a/d73/d7e/d4f/c51 241666 1 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:7/556: sync 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:8/581: sync 2023-12-05T13:25:20.550 INFO:tasks.workunit.client.1.smithi052.stdout:0/520: fsync d0/db/d33/f35 0 2023-12-05T13:25:20.552 INFO:tasks.workunit.client.1.smithi052.stdout:0/521: rmdir d0/db/d1b/d42 39 2023-12-05T13:25:20.554 INFO:tasks.workunit.client.1.smithi052.stdout:0/522: stat d0/db/d1b/d29/c6c 0 2023-12-05T13:25:20.557 INFO:tasks.workunit.client.1.smithi052.stdout:1/440: dread d5/d7/d35/d37/d68/f55 [0,4194304] 0 2023-12-05T13:25:20.558 INFO:tasks.workunit.client.1.smithi052.stdout:0/523: mknod d0/db/d2e/d53/cab 0 2023-12-05T13:25:20.558 INFO:tasks.workunit.client.1.smithi052.stdout:0/524: truncate d0/f82 5672 0 2023-12-05T13:25:20.558 INFO:tasks.workunit.client.1.smithi052.stdout:8/582: dread d0/d28/d39/d3a/f47 [0,4194304] 0 2023-12-05T13:25:20.562 INFO:tasks.workunit.client.1.smithi052.stdout:1/441: rename d5/c4c to d5/d7/d35/d37/d68/d69/c8f 0 2023-12-05T13:25:20.564 INFO:tasks.workunit.client.1.smithi052.stdout:1/442: write d5/f2c [7375074,29980] 0 2023-12-05T13:25:20.570 INFO:tasks.workunit.client.1.smithi052.stdout:8/583: unlink d0/de/d12/d29/c48 0 2023-12-05T13:25:20.573 INFO:tasks.workunit.client.1.smithi052.stdout:1/443: creat d5/d7/d35/d37/d43/f90 x:0 0 0 2023-12-05T13:25:20.573 INFO:tasks.workunit.client.1.smithi052.stdout:1/444: readlink d5/d7/d35/d37/d68/d2a/l57 0 2023-12-05T13:25:20.573 INFO:tasks.workunit.client.1.smithi052.stdout:1/445: chown d5/d7/f4b 976 1 2023-12-05T13:25:20.576 INFO:tasks.workunit.client.1.smithi052.stdout:0/525: dwrite d0/db/d14/f40 [0,4194304] 0 2023-12-05T13:25:20.577 INFO:tasks.workunit.client.1.smithi052.stdout:7/557: dwrite d7/d4e/d45/d5a/f19 [0,4194304] 0 2023-12-05T13:25:20.577 INFO:tasks.workunit.client.1.smithi052.stdout:7/558: stat d7/d4e/d45/d79 0 2023-12-05T13:25:20.593 INFO:tasks.workunit.client.1.smithi052.stdout:0/526: link d0/db/d2e/c8e d0/db/d2e/d7e/cac 0 2023-12-05T13:25:20.594 INFO:tasks.workunit.client.1.smithi052.stdout:8/584: dwrite d0/d62/fad [0,4194304] 0 2023-12-05T13:25:20.594 INFO:tasks.workunit.client.1.smithi052.stdout:8/585: chown d0/de/d27/d43/c6f 336555 1 2023-12-05T13:25:20.601 INFO:tasks.workunit.client.1.smithi052.stdout:1/446: dwrite d5/d7/f13 [0,4194304] 0 2023-12-05T13:25:20.601 INFO:tasks.workunit.client.1.smithi052.stdout:1/447: fdatasync d5/d7/d35/d37/d43/f78 0 2023-12-05T13:25:20.601 INFO:tasks.workunit.client.1.smithi052.stdout:1/448: fsync d5/d7/d35/d37/d68/d79/f81 0 2023-12-05T13:25:20.602 INFO:tasks.workunit.client.1.smithi052.stdout:0/527: link d0/db/d2e/d7e/ca2 d0/db/d2e/cad 0 2023-12-05T13:25:20.607 INFO:tasks.workunit.client.1.smithi052.stdout:0/528: mkdir d0/db/d20/d50/dae 0 2023-12-05T13:25:20.609 INFO:tasks.workunit.client.1.smithi052.stdout:0/529: truncate d0/db/d1b/d42/f45 498909 0 2023-12-05T13:25:20.612 INFO:tasks.workunit.client.1.smithi052.stdout:0/530: rmdir d0/db/d1b/d51/d55 39 2023-12-05T13:25:20.615 INFO:tasks.workunit.client.1.smithi052.stdout:1/449: dwrite d5/d7/d35/d37/d68/f6a [0,4194304] 0 2023-12-05T13:25:20.615 INFO:tasks.workunit.client.1.smithi052.stdout:1/450: write d5/d7/d35/d37/d43/f78 [513615,54723] 0 2023-12-05T13:25:20.619 INFO:tasks.workunit.client.1.smithi052.stdout:1/451: mknod d5/d7/c91 0 2023-12-05T13:25:20.619 INFO:tasks.workunit.client.1.smithi052.stdout:1/452: chown d5/d7/d35/d37/d68/l7b 495735516 1 2023-12-05T13:25:20.623 INFO:tasks.workunit.client.1.smithi052.stdout:1/453: truncate d5/d26/f66 3817474 0 2023-12-05T13:25:20.625 INFO:tasks.workunit.client.1.smithi052.stdout:9/362: sync 2023-12-05T13:25:20.625 INFO:tasks.workunit.client.1.smithi052.stdout:2/514: sync 2023-12-05T13:25:20.625 INFO:tasks.workunit.client.1.smithi052.stdout:3/505: sync 2023-12-05T13:25:20.625 INFO:tasks.workunit.client.1.smithi052.stdout:6/376: sync 2023-12-05T13:25:20.625 INFO:tasks.workunit.client.1.smithi052.stdout:0/531: dwrite d0/db/d52/d7f/f89 [0,4194304] 0 2023-12-05T13:25:20.625 INFO:tasks.workunit.client.1.smithi052.stdout:6/377: write d3/d5/f5a [2080,64107] 0 2023-12-05T13:25:20.626 INFO:tasks.workunit.client.1.smithi052.stdout:6/378: fdatasync d3/d5/d9/d21/f23 0 2023-12-05T13:25:20.626 INFO:tasks.workunit.client.1.smithi052.stdout:6/379: readlink d3/d5/d9/d21/d48/l61 0 2023-12-05T13:25:20.626 INFO:tasks.workunit.client.1.smithi052.stdout:6/380: fsync d3/f3d 0 2023-12-05T13:25:20.626 INFO:tasks.workunit.client.1.smithi052.stdout:6/381: read - d3/d5/d9/d21/d5f/f67 zero size 2023-12-05T13:25:20.632 INFO:tasks.workunit.client.1.smithi052.stdout:9/363: creat d3/d2a/d5c/f71 x:0 0 0 2023-12-05T13:25:20.634 INFO:tasks.workunit.client.1.smithi052.stdout:2/515: symlink d2/d13/d1e/d6a/d7f/d84/l98 0 2023-12-05T13:25:20.638 INFO:tasks.workunit.client.1.smithi052.stdout:9/364: rename d3/d11/c1b to d3/d11/c72 0 2023-12-05T13:25:20.640 INFO:tasks.workunit.client.1.smithi052.stdout:2/516: getdents d2/d13/d45 0 2023-12-05T13:25:20.644 INFO:tasks.workunit.client.1.smithi052.stdout:6/382: unlink d3/d4/d6/f83 0 2023-12-05T13:25:20.644 INFO:tasks.workunit.client.1.smithi052.stdout:3/506: dwrite da/d25/d33/d43/d5b/f5c [0,4194304] 0 2023-12-05T13:25:20.644 INFO:tasks.workunit.client.1.smithi052.stdout:3/507: readlink da/d25/l52 0 2023-12-05T13:25:20.646 INFO:tasks.workunit.client.1.smithi052.stdout:9/365: symlink d3/d2a/l73 0 2023-12-05T13:25:20.649 INFO:tasks.workunit.client.1.smithi052.stdout:9/366: dread d3/d2a/f30 [0,4194304] 0 2023-12-05T13:25:20.649 INFO:tasks.workunit.client.1.smithi052.stdout:9/367: chown d3/d5e/f64 7 1 2023-12-05T13:25:20.655 INFO:tasks.workunit.client.1.smithi052.stdout:3/508: creat da/d25/d33/d49/fa7 x:0 0 0 2023-12-05T13:25:20.655 INFO:tasks.workunit.client.1.smithi052.stdout:3/509: truncate da/d25/d33/d43/d5b/d94/fa0 263114 0 2023-12-05T13:25:20.655 INFO:tasks.workunit.client.1.smithi052.stdout:3/510: fsync da/d25/f31 0 2023-12-05T13:25:20.657 INFO:tasks.workunit.client.1.smithi052.stdout:3/511: getdents da/d48/d50/d74 0 2023-12-05T13:25:20.657 INFO:tasks.workunit.client.1.smithi052.stdout:9/368: dread d3/d1e/d37/d4f/f54 [0,4194304] 0 2023-12-05T13:25:20.660 INFO:tasks.workunit.client.1.smithi052.stdout:3/512: creat da/d2e/d40/d9b/fa8 x:0 0 0 2023-12-05T13:25:20.661 INFO:tasks.workunit.client.1.smithi052.stdout:2/517: dwrite d2/d13/d37/d5c/f74 [4194304,4194304] 0 2023-12-05T13:25:20.663 INFO:tasks.workunit.client.1.smithi052.stdout:9/369: symlink d3/d1e/d37/d4f/l74 0 2023-12-05T13:25:20.663 INFO:tasks.workunit.client.1.smithi052.stdout:6/383: dwrite d3/d4/df/d63/f70 [0,4194304] 0 2023-12-05T13:25:20.664 INFO:tasks.workunit.client.1.smithi052.stdout:9/370: dread d3/d1e/f60 [0,4194304] 0 2023-12-05T13:25:20.668 INFO:tasks.workunit.client.1.smithi052.stdout:3/513: symlink da/d48/la9 0 2023-12-05T13:25:20.673 INFO:tasks.workunit.client.1.smithi052.stdout:9/371: rmdir d3/d31/d6c 0 2023-12-05T13:25:20.680 INFO:tasks.workunit.client.1.smithi052.stdout:3/514: symlink da/d25/d33/d43/laa 0 2023-12-05T13:25:20.680 INFO:tasks.workunit.client.1.smithi052.stdout:3/515: fdatasync da/d48/f53 0 2023-12-05T13:25:20.687 INFO:tasks.workunit.client.1.smithi052.stdout:2/518: dwrite d2/d13/f36 [0,4194304] 0 2023-12-05T13:25:20.687 INFO:tasks.workunit.client.1.smithi052.stdout:9/372: dwrite d3/d1e/f60 [0,4194304] 0 2023-12-05T13:25:20.699 INFO:tasks.workunit.client.1.smithi052.stdout:2/519: symlink d2/d4/l99 0 2023-12-05T13:25:20.706 INFO:tasks.workunit.client.1.smithi052.stdout:9/373: mknod d3/d1e/d41/d57/c75 0 2023-12-05T13:25:20.706 INFO:tasks.workunit.client.1.smithi052.stdout:9/374: chown d3/l3f 852445809 1 2023-12-05T13:25:20.710 INFO:tasks.workunit.client.1.smithi052.stdout:9/375: creat d3/d5e/f76 x:0 0 0 2023-12-05T13:25:20.713 INFO:tasks.workunit.client.1.smithi052.stdout:2/520: dwrite d2/f2f [0,4194304] 0 2023-12-05T13:25:20.713 INFO:tasks.workunit.client.1.smithi052.stdout:9/376: creat d3/d1e/d37/d4f/f77 x:0 0 0 2023-12-05T13:25:20.713 INFO:tasks.workunit.client.1.smithi052.stdout:9/377: fdatasync d3/d5e/f64 0 2023-12-05T13:25:20.715 INFO:tasks.workunit.client.1.smithi052.stdout:2/521: creat d2/d13/d48/f9a x:0 0 0 2023-12-05T13:25:20.716 INFO:tasks.workunit.client.1.smithi052.stdout:9/378: creat d3/d31/f78 x:0 0 0 2023-12-05T13:25:20.718 INFO:tasks.workunit.client.1.smithi052.stdout:2/522: rmdir d2/d13/d37 39 2023-12-05T13:25:20.720 INFO:tasks.workunit.client.1.smithi052.stdout:9/379: creat d3/d11/d3e/f79 x:0 0 0 2023-12-05T13:25:20.724 INFO:tasks.workunit.client.1.smithi052.stdout:9/380: truncate d3/d1e/d37/d4f/f54 624400 0 2023-12-05T13:25:20.739 INFO:tasks.workunit.client.1.smithi052.stdout:2/523: dwrite d2/d13/d45/f4a [0,4194304] 0 2023-12-05T13:25:20.739 INFO:tasks.workunit.client.1.smithi052.stdout:2/524: creat d2/d13/d1e/d6a/d7f/d84/f9b x:0 0 0 2023-12-05T13:25:20.739 INFO:tasks.workunit.client.1.smithi052.stdout:9/381: dwrite d3/d1e/d37/f4d [0,4194304] 0 2023-12-05T13:25:20.739 INFO:tasks.workunit.client.1.smithi052.stdout:2/525: write d2/d13/d37/f49 [3347263,62847] 0 2023-12-05T13:25:20.743 INFO:tasks.workunit.client.1.smithi052.stdout:9/382: symlink d3/l7a 0 2023-12-05T13:25:20.746 INFO:tasks.workunit.client.1.smithi052.stdout:2/526: creat d2/d13/d37/d5c/f9c x:0 0 0 2023-12-05T13:25:20.747 INFO:tasks.workunit.client.1.smithi052.stdout:9/383: symlink d3/d1e/d41/d57/l7b 0 2023-12-05T13:25:20.750 INFO:tasks.workunit.client.1.smithi052.stdout:2/527: mkdir d2/d4/d3f/d9d 0 2023-12-05T13:25:20.750 INFO:tasks.workunit.client.1.smithi052.stdout:2/528: write d2/d13/d1e/d6a/d7f/d84/d3a/d4b/f8e [430351,65081] 0 2023-12-05T13:25:20.750 INFO:tasks.workunit.client.1.smithi052.stdout:2/529: chown d2/d4/d63/f76 47 1 2023-12-05T13:25:20.750 INFO:tasks.workunit.client.1.smithi052.stdout:2/530: chown d2/d4/d3f 211109234 1 2023-12-05T13:25:20.752 INFO:tasks.workunit.client.1.smithi052.stdout:2/531: symlink d2/d13/d45/l9e 0 2023-12-05T13:25:20.757 INFO:tasks.workunit.client.1.smithi052.stdout:2/532: getdents d2/d13/d37/d61 0 2023-12-05T13:25:20.757 INFO:tasks.workunit.client.1.smithi052.stdout:2/533: fdatasync d2/d13/d1e/f54 0 2023-12-05T13:25:20.760 INFO:tasks.workunit.client.1.smithi052.stdout:2/534: creat d2/f9f x:0 0 0 2023-12-05T13:25:20.763 INFO:tasks.workunit.client.1.smithi052.stdout:9/384: dwrite d3/d31/f45 [0,4194304] 0 2023-12-05T13:25:20.763 INFO:tasks.workunit.client.1.smithi052.stdout:2/535: mknod d2/d4/d3f/ca0 0 2023-12-05T13:25:20.769 INFO:tasks.workunit.client.1.smithi052.stdout:2/536: creat d2/d13/fa1 x:0 0 0 2023-12-05T13:25:20.772 INFO:tasks.workunit.client.1.smithi052.stdout:9/385: dread d3/d31/f45 [0,4194304] 0 2023-12-05T13:25:20.772 INFO:tasks.workunit.client.1.smithi052.stdout:2/537: creat d2/d4/d3f/d9d/fa2 x:0 0 0 2023-12-05T13:25:20.772 INFO:tasks.workunit.client.1.smithi052.stdout:2/538: fdatasync d2/d13/d1e/f3d 0 2023-12-05T13:25:20.772 INFO:tasks.workunit.client.1.smithi052.stdout:2/539: write d2/d4/d63/d6d/f85 [1159590,14007] 0 2023-12-05T13:25:20.772 INFO:tasks.workunit.client.1.smithi052.stdout:2/540: readlink d2/d13/d1e/d6a/d7f/d84/d3a/l44 0 2023-12-05T13:25:20.774 INFO:tasks.workunit.client.1.smithi052.stdout:9/386: creat d3/d11/d3e/f7c x:0 0 0 2023-12-05T13:25:20.774 INFO:tasks.workunit.client.1.smithi052.stdout:9/387: stat d3 0 2023-12-05T13:25:20.792 INFO:tasks.workunit.client.1.smithi052.stdout:2/541: dwrite d2/d13/d1e/d6a/d7f/f81 [4194304,4194304] 0 2023-12-05T13:25:20.792 INFO:tasks.workunit.client.1.smithi052.stdout:9/388: dwrite d3/d1e/d41/f46 [0,4194304] 0 2023-12-05T13:25:20.792 INFO:tasks.workunit.client.1.smithi052.stdout:2/542: chown d2/d13/d1e/d6a/d7f/f81 44953279 1 2023-12-05T13:25:20.793 INFO:tasks.workunit.client.1.smithi052.stdout:2/543: write d2/d4/f83 [151770,40703] 0 2023-12-05T13:25:20.793 INFO:tasks.workunit.client.1.smithi052.stdout:2/544: fsync d2/d13/d45/f4d 0 2023-12-05T13:25:20.799 INFO:tasks.workunit.client.1.smithi052.stdout:9/389: link d3/d11/f69 d3/d1e/d37/d4f/f7d 0 2023-12-05T13:25:20.801 INFO:tasks.workunit.client.1.smithi052.stdout:2/545: creat d2/d13/fa3 x:0 0 0 2023-12-05T13:25:20.801 INFO:tasks.workunit.client.1.smithi052.stdout:2/546: chown d2/d4/d63/d6d/f85 10 1 2023-12-05T13:25:20.801 INFO:tasks.workunit.client.1.smithi052.stdout:2/547: fdatasync d2/d13/d1e/d6a/d7f/f81 0 2023-12-05T13:25:20.805 INFO:tasks.workunit.client.1.smithi052.stdout:9/390: dread d3/d11/d19/f29 [0,4194304] 0 2023-12-05T13:25:20.812 INFO:tasks.workunit.client.1.smithi052.stdout:9/391: dread d3/d11/f21 [0,4194304] 0 2023-12-05T13:25:20.823 INFO:tasks.workunit.client.1.smithi052.stdout:9/392: dwrite d3/d2a/f4e [0,4194304] 0 2023-12-05T13:25:20.823 INFO:tasks.workunit.client.1.smithi052.stdout:9/393: write d3/d11/f33 [153542,44082] 0 2023-12-05T13:25:21.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:20 smithi052 ceph-mon[121072]: pgmap v210: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 23 MiB/s rd, 52 MiB/s wr, 896 op/s 2023-12-05T13:25:21.309 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:20 smithi029 ceph-mon[112128]: pgmap v210: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 23 MiB/s rd, 52 MiB/s wr, 896 op/s 2023-12-05T13:25:21.419 INFO:tasks.workunit.client.1.smithi052.stdout:4/480: read de/d2b/f58 [1641305,102528] 0 2023-12-05T13:25:21.425 INFO:tasks.workunit.client.1.smithi052.stdout:4/481: dread de/d2b/f5a [0,4194304] 0 2023-12-05T13:25:21.498 INFO:tasks.workunit.client.1.smithi052.stdout:7/559: write d7/d4e/d12/d3f/d46/f5f [718541,53577] 0 2023-12-05T13:25:21.498 INFO:tasks.workunit.client.1.smithi052.stdout:7/560: getdents d7/d4e/db4 0 2023-12-05T13:25:21.499 INFO:tasks.workunit.client.1.smithi052.stdout:7/561: dread d7/d4e/d45/f5b [0,4194304] 0 2023-12-05T13:25:21.499 INFO:tasks.workunit.client.1.smithi052.stdout:7/562: truncate d7/d31/f3e 926515 0 2023-12-05T13:25:21.499 INFO:tasks.workunit.client.1.smithi052.stdout:7/563: readlink d7/d4e/d45/d5a/d63/l7e 0 2023-12-05T13:25:21.514 INFO:tasks.workunit.client.1.smithi052.stdout:8/586: write d0/d28/f87 [554669,13453] 0 2023-12-05T13:25:21.516 INFO:tasks.workunit.client.1.smithi052.stdout:7/564: dwrite d7/d4e/d12/d3f/f7f [0,4194304] 0 2023-12-05T13:25:21.520 INFO:tasks.workunit.client.1.smithi052.stdout:7/565: getdents d7/d4e/d45/d50 0 2023-12-05T13:25:21.538 INFO:tasks.workunit.client.1.smithi052.stdout:7/566: dwrite d7/d4e/d45/d5a/d66/fb8 [0,4194304] 0 2023-12-05T13:25:21.539 INFO:tasks.workunit.client.1.smithi052.stdout:7/567: write d7/d4e/d12/d3f/f44 [429332,115281] 0 2023-12-05T13:25:21.540 INFO:tasks.workunit.client.1.smithi052.stdout:1/454: rename d5/d7/d35/d37/d68/f6d to d5/d7/d35/d37/d68/d2a/f92 0 2023-12-05T13:25:21.541 INFO:tasks.workunit.client.1.smithi052.stdout:1/455: chown d5/d7/d35/d2f/d3e/f54 274 1 2023-12-05T13:25:21.546 INFO:tasks.workunit.client.1.smithi052.stdout:0/532: rename d0/db/d52/d7f/c90 to d0/db/d1b/caf 0 2023-12-05T13:25:21.549 INFO:tasks.workunit.client.1.smithi052.stdout:1/456: mknod d5/d7/d35/d2f/d3e/d62/d85/c93 0 2023-12-05T13:25:21.549 INFO:tasks.workunit.client.1.smithi052.stdout:1/457: chown d5/d7/c83 7 1 2023-12-05T13:25:21.549 INFO:tasks.workunit.client.1.smithi052.stdout:1/458: dread - d5/d7/d35/f71 zero size 2023-12-05T13:25:21.549 INFO:tasks.workunit.client.1.smithi052.stdout:0/533: dread d0/db/d1b/f27 [0,4194304] 0 2023-12-05T13:25:21.552 INFO:tasks.workunit.client.1.smithi052.stdout:3/516: rename da/c24 to da/d25/d33/d89/cab 0 2023-12-05T13:25:21.552 INFO:tasks.workunit.client.1.smithi052.stdout:3/517: write da/d2e/f7f [4716798,52115] 0 2023-12-05T13:25:21.552 INFO:tasks.workunit.client.1.smithi052.stdout:3/518: fsync da/dd/d3d/f76 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:1/459: truncate d5/d7/d35/d37/d5a/d73/d7e/f5b 1330887 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:1/460: fsync d5/d7/d35/d37/d68/d17/f88 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:1/461: write d5/d7/d35/d37/d5a/d73/d7e/d65/f7c [935169,129877] 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:1/462: fsync d5/d7/d35/d37/d68/f72 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:9/394: rename d3/d1e/d41/d57/c75 to d3/d2a/d5c/c7e 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:9/395: write d3/d1e/d37/d4f/f7d [157189,83088] 0 2023-12-05T13:25:21.558 INFO:tasks.workunit.client.1.smithi052.stdout:9/396: read - d3/d5e/f76 zero size 2023-12-05T13:25:21.559 INFO:tasks.workunit.client.1.smithi052.stdout:3/519: unlink da/d27/f9a 0 2023-12-05T13:25:21.564 INFO:tasks.workunit.client.1.smithi052.stdout:1/463: symlink d5/d7/d35/d37/d5a/d73/d7e/d4f/l94 0 2023-12-05T13:25:21.568 INFO:tasks.workunit.client.1.smithi052.stdout:4/482: rename de/d30/d68/d59 to de/d29/d51/da3 0 2023-12-05T13:25:21.572 INFO:tasks.workunit.client.1.smithi052.stdout:9/397: getdents d3/d1e/d41 0 2023-12-05T13:25:21.574 INFO:tasks.workunit.client.1.smithi052.stdout:9/398: dread d3/d1e/d37/d4f/f67 [0,4194304] 0 2023-12-05T13:25:21.574 INFO:tasks.workunit.client.1.smithi052.stdout:9/399: dread - d3/d11/f42 zero size 2023-12-05T13:25:21.575 INFO:tasks.workunit.client.1.smithi052.stdout:3/520: truncate da/dd/f26 507635 0 2023-12-05T13:25:21.577 INFO:tasks.workunit.client.1.smithi052.stdout:1/464: getdents d5/d7/d35 0 2023-12-05T13:25:21.581 INFO:tasks.workunit.client.1.smithi052.stdout:9/400: dread d3/d1e/d37/d4f/f7d [0,4194304] 0 2023-12-05T13:25:21.581 INFO:tasks.workunit.client.1.smithi052.stdout:9/401: fdatasync d3/d1e/d37/d4f/f67 0 2023-12-05T13:25:21.581 INFO:tasks.workunit.client.1.smithi052.stdout:8/587: rename d0/l82 to d0/d28/db0/lbc 0 2023-12-05T13:25:21.585 INFO:tasks.workunit.client.1.smithi052.stdout:3/521: unlink da/d2e/d40/c86 0 2023-12-05T13:25:21.585 INFO:tasks.workunit.client.1.smithi052.stdout:1/465: dread d5/d7/d35/d37/d68/f32 [0,4194304] 0 2023-12-05T13:25:21.585 INFO:tasks.workunit.client.1.smithi052.stdout:1/466: readlink d5/d7/d35/d37/d68/l7b 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/483: dwrite de/d30/d68/f7c [0,4194304] 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/484: truncate de/d30/d68/f8d 738504 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:9/402: dread d3/d11/d19/f53 [0,4194304] 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:9/403: write d3/d1e/d37/d4f/f52 [1396528,28132] 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:9/404: chown d3/d2a/l73 111218 1 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:4/485: read de/d2b/f58 [606954,51006] 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:7/568: rename d7/d4e/d12/d3f/cad to d7/d4e/d45/d50/cc1 0 2023-12-05T13:25:21.588 INFO:tasks.workunit.client.1.smithi052.stdout:3/522: write da/f22 [6792044,71298] 0 2023-12-05T13:25:21.589 INFO:tasks.workunit.client.1.smithi052.stdout:3/523: write da/f21 [1487203,26574] 0 2023-12-05T13:25:21.589 INFO:tasks.workunit.client.1.smithi052.stdout:7/569: read d7/d31/f55 [170202,83515] 0 2023-12-05T13:25:21.589 INFO:tasks.workunit.client.1.smithi052.stdout:7/570: chown d7/d4e/d45/d5a/d63 119 1 2023-12-05T13:25:21.590 INFO:tasks.workunit.client.1.smithi052.stdout:8/588: creat d0/de/d27/d43/d44/db9/fbd x:0 0 0 2023-12-05T13:25:21.592 INFO:tasks.workunit.client.1.smithi052.stdout:1/467: symlink d5/d7/d35/d37/d68/d79/l95 0 2023-12-05T13:25:21.602 INFO:tasks.workunit.client.1.smithi052.stdout:0/534: rename d0/db/d1b/d51/d55/d66/d77 to d0/db/d1b/d29/db0 0 2023-12-05T13:25:21.604 INFO:tasks.workunit.client.1.smithi052.stdout:7/571: symlink d7/d4e/d45/d5a/d63/d95/dba/lc2 0 2023-12-05T13:25:21.605 INFO:tasks.workunit.client.1.smithi052.stdout:3/524: dread da/dd/f55 [0,4194304] 0 2023-12-05T13:25:21.607 INFO:tasks.workunit.client.1.smithi052.stdout:8/589: creat d0/d28/db0/fbe x:0 0 0 2023-12-05T13:25:21.611 INFO:tasks.workunit.client.1.smithi052.stdout:1/468: creat d5/d7/de/f96 x:0 0 0 2023-12-05T13:25:21.611 INFO:tasks.workunit.client.1.smithi052.stdout:1/469: truncate d5/d7/de/f96 125034 0 2023-12-05T13:25:21.613 INFO:tasks.workunit.client.1.smithi052.stdout:4/486: rename de/d1e/d24/l74 to de/d30/d73/la4 0 2023-12-05T13:25:21.617 INFO:tasks.workunit.client.1.smithi052.stdout:0/535: unlink d0/db/d20/d9c/la3 0 2023-12-05T13:25:21.620 INFO:tasks.workunit.client.1.smithi052.stdout:9/405: dwrite d3/d11/d19/f27 [4194304,4194304] 0 2023-12-05T13:25:21.628 INFO:tasks.workunit.client.1.smithi052.stdout:1/470: creat d5/d7/d35/d2f/d3e/d62/f97 x:0 0 0 2023-12-05T13:25:21.628 INFO:tasks.workunit.client.1.smithi052.stdout:1/471: truncate d5/d7/d35/d37/d68/d79/f81 312407 0 2023-12-05T13:25:21.630 INFO:tasks.workunit.client.1.smithi052.stdout:4/487: rename de/d29/d51/da3/la0 to de/d29/d51/da3/d6d/la5 0 2023-12-05T13:25:21.630 INFO:tasks.workunit.client.1.smithi052.stdout:9/406: rename d3/d1e/d41 to d3/d1e/d41/d57/d7f 22 2023-12-05T13:25:21.630 INFO:tasks.workunit.client.1.smithi052.stdout:9/407: readlink d3/d2a/l6d 0 2023-12-05T13:25:21.631 INFO:tasks.workunit.client.1.smithi052.stdout:9/408: write d3/d1e/f23 [104007,113738] 0 2023-12-05T13:25:21.631 INFO:tasks.workunit.client.1.smithi052.stdout:9/409: fdatasync d3/d1e/d37/d4f/f54 0 2023-12-05T13:25:21.632 INFO:tasks.workunit.client.1.smithi052.stdout:3/525: dwrite da/d25/d33/d43/d5b/f67 [0,4194304] 0 2023-12-05T13:25:21.632 INFO:tasks.workunit.client.1.smithi052.stdout:3/526: truncate da/d2e/f7f 5067196 0 2023-12-05T13:25:21.633 INFO:tasks.workunit.client.1.smithi052.stdout:7/572: dwrite d7/d2e/fa9 [0,4194304] 0 2023-12-05T13:25:21.633 INFO:tasks.workunit.client.1.smithi052.stdout:0/536: creat d0/db/d52/fb1 x:0 0 0 2023-12-05T13:25:21.633 INFO:tasks.workunit.client.1.smithi052.stdout:0/537: chown d0/f6 75 1 2023-12-05T13:25:21.633 INFO:tasks.workunit.client.1.smithi052.stdout:8/590: dwrite d0/d28/d2b/f7f [0,4194304] 0 2023-12-05T13:25:21.633 INFO:tasks.workunit.client.1.smithi052.stdout:8/591: chown d0/de/f22 774 1 2023-12-05T13:25:21.638 INFO:tasks.workunit.client.1.smithi052.stdout:1/472: rmdir d5/d7/de/d18 39 2023-12-05T13:25:21.639 INFO:tasks.workunit.client.1.smithi052.stdout:1/473: stat d5/d7/d35/f5c 0 2023-12-05T13:25:21.640 INFO:tasks.workunit.client.1.smithi052.stdout:4/488: creat de/d91/fa6 x:0 0 0 2023-12-05T13:25:21.641 INFO:tasks.workunit.client.1.smithi052.stdout:8/592: write d0/d28/d39/d3a/f5b [3188105,17345] 0 2023-12-05T13:25:21.648 INFO:tasks.workunit.client.1.smithi052.stdout:9/410: mknod d3/d1e/d62/c80 0 2023-12-05T13:25:21.648 INFO:tasks.workunit.client.1.smithi052.stdout:9/411: chown d3/d2a/d5c/c63 521663119 1 2023-12-05T13:25:21.651 INFO:tasks.workunit.client.1.smithi052.stdout:1/474: dread d5/d7/d35/d37/d68/f6a [0,4194304] 0 2023-12-05T13:25:21.651 INFO:tasks.workunit.client.1.smithi052.stdout:1/475: chown d5/d7/d35/d37/d5a/d73/d7e/d4f 192 1 2023-12-05T13:25:21.651 INFO:tasks.workunit.client.1.smithi052.stdout:1/476: chown d5/d7/d35/d37/d68/d2a/l57 269 1 2023-12-05T13:25:21.652 INFO:tasks.workunit.client.1.smithi052.stdout:0/538: symlink d0/db/d1b/d29/db0/lb2 0 2023-12-05T13:25:21.659 INFO:tasks.workunit.client.1.smithi052.stdout:4/489: dwrite de/d1e/d24/f8c [0,4194304] 0 2023-12-05T13:25:21.659 INFO:tasks.workunit.client.1.smithi052.stdout:3/527: dwrite da/d2e/f85 [0,4194304] 0 2023-12-05T13:25:21.660 INFO:tasks.workunit.client.1.smithi052.stdout:8/593: mknod d0/de/d98/cbf 0 2023-12-05T13:25:21.669 INFO:tasks.workunit.client.1.smithi052.stdout:1/477: rename d5/d7/de/d18/d5d to d5/d7/de/d74/d98 0 2023-12-05T13:25:21.670 INFO:tasks.workunit.client.1.smithi052.stdout:0/539: rmdir d0/db/d2e/d7e 39 2023-12-05T13:25:21.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/490: getdents de/d2b/d80 0 2023-12-05T13:25:21.692 INFO:tasks.workunit.client.1.smithi052.stdout:4/491: fdatasync de/d2b/f2d 0 2023-12-05T13:25:21.698 INFO:tasks.workunit.client.1.smithi052.stdout:3/528: link da/d25/c58 da/d25/cac 0 2023-12-05T13:25:21.701 INFO:tasks.workunit.client.1.smithi052.stdout:1/478: mkdir d5/d7/de/d74/d99 0 2023-12-05T13:25:21.707 INFO:tasks.workunit.client.1.smithi052.stdout:4/492: unlink de/d2b/c83 0 2023-12-05T13:25:21.708 INFO:tasks.workunit.client.1.smithi052.stdout:2/548: rmdir d2/d4/d3f 39 2023-12-05T13:25:21.709 INFO:tasks.workunit.client.1.smithi052.stdout:3/529: mkdir da/dd/d3d/dad 0 2023-12-05T13:25:21.710 INFO:tasks.workunit.client.1.smithi052.stdout:3/530: read da/d27/f3b [1462511,42086] 0 2023-12-05T13:25:21.711 INFO:tasks.workunit.client.1.smithi052.stdout:3/531: write da/f9d [1885140,45251] 0 2023-12-05T13:25:21.712 INFO:tasks.workunit.client.1.smithi052.stdout:1/479: getdents d5/d7/d35/d2f/d3e 0 2023-12-05T13:25:21.719 INFO:tasks.workunit.client.1.smithi052.stdout:0/540: mknod d0/db/d2e/cb3 0 2023-12-05T13:25:21.720 INFO:tasks.workunit.client.1.smithi052.stdout:3/532: dread da/dd/f19 [0,4194304] 0 2023-12-05T13:25:21.720 INFO:tasks.workunit.client.1.smithi052.stdout:3/533: chown da/d25/d33/d49/f73 67673 1 2023-12-05T13:25:21.723 INFO:tasks.workunit.client.1.smithi052.stdout:4/493: dwrite de/d1e/d24/f35 [0,4194304] 0 2023-12-05T13:25:21.723 INFO:tasks.workunit.client.1.smithi052.stdout:2/549: rename d2/d13/d1e/d6a/d7f/d84/d3a/d4b to d2/da4 0 2023-12-05T13:25:21.725 INFO:tasks.workunit.client.1.smithi052.stdout:4/494: write de/d30/f42 [1584201,40388] 0 2023-12-05T13:25:21.725 INFO:tasks.workunit.client.1.smithi052.stdout:4/495: write de/d1e/f21 [5125295,46956] 0 2023-12-05T13:25:21.725 INFO:tasks.workunit.client.1.smithi052.stdout:4/496: fdatasync fa 0 2023-12-05T13:25:21.726 INFO:tasks.workunit.client.1.smithi052.stdout:4/497: write de/d29/f2e [2961724,53639] 0 2023-12-05T13:25:21.726 INFO:tasks.workunit.client.1.smithi052.stdout:4/498: fdatasync de/f33 0 2023-12-05T13:25:21.733 INFO:tasks.workunit.client.1.smithi052.stdout:4/499: rename de/d1e/l7e to de/d29/d51/d76/la7 0 2023-12-05T13:25:21.733 INFO:tasks.workunit.client.1.smithi052.stdout:4/500: chown de/d1e/d24 2048308 1 2023-12-05T13:25:21.735 INFO:tasks.workunit.client.1.smithi052.stdout:2/550: dread d2/d13/d1e/f57 [0,4194304] 0 2023-12-05T13:25:21.736 INFO:tasks.workunit.client.1.smithi052.stdout:4/501: write de/f18 [2643435,12546] 0 2023-12-05T13:25:21.736 INFO:tasks.workunit.client.1.smithi052.stdout:4/502: truncate de/d1e/d24/f35 5229124 0 2023-12-05T13:25:21.736 INFO:tasks.workunit.client.1.smithi052.stdout:4/503: chown de/d29/d51/d76/d8f/l97 10 1 2023-12-05T13:25:21.739 INFO:tasks.workunit.client.1.smithi052.stdout:2/551: mknod d2/d13/d1e/d6a/d7f/d84/d3a/ca5 0 2023-12-05T13:25:21.741 INFO:tasks.workunit.client.1.smithi052.stdout:3/534: dwrite da/f22 [4194304,4194304] 0 2023-12-05T13:25:21.742 INFO:tasks.workunit.client.1.smithi052.stdout:4/504: mknod de/d30/d73/ca8 0 2023-12-05T13:25:21.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/552: creat d2/d13/d1e/d6a/fa6 x:0 0 0 2023-12-05T13:25:21.748 INFO:tasks.workunit.client.1.smithi052.stdout:3/535: mkdir da/d25/d33/d89/dae 0 2023-12-05T13:25:21.748 INFO:tasks.workunit.client.1.smithi052.stdout:3/536: fsync da/d27/f2d 0 2023-12-05T13:25:21.749 INFO:tasks.workunit.client.1.smithi052.stdout:0/541: dwrite d0/db/d1b/d29/db0/f95 [0,4194304] 0 2023-12-05T13:25:21.751 INFO:tasks.workunit.client.1.smithi052.stdout:4/505: creat de/d29/d51/fa9 x:0 0 0 2023-12-05T13:25:21.752 INFO:tasks.workunit.client.1.smithi052.stdout:4/506: write de/d30/f42 [6121684,12537] 0 2023-12-05T13:25:21.752 INFO:tasks.workunit.client.1.smithi052.stdout:4/507: readlink de/d2b/d80/l99 0 2023-12-05T13:25:21.752 INFO:tasks.workunit.client.1.smithi052.stdout:2/553: dread d2/d4/f89 [0,4194304] 0 2023-12-05T13:25:21.756 INFO:tasks.workunit.client.1.smithi052.stdout:9/412: rmdir d3/d1e/d37/d4f 39 2023-12-05T13:25:21.758 INFO:tasks.workunit.client.1.smithi052.stdout:3/537: dread da/d25/f3a [0,4194304] 0 2023-12-05T13:25:21.758 INFO:tasks.workunit.client.1.smithi052.stdout:0/542: mknod d0/db/d20/d50/cb4 0 2023-12-05T13:25:21.761 INFO:tasks.workunit.client.1.smithi052.stdout:3/538: write da/fe [30560,115158] 0 2023-12-05T13:25:21.761 INFO:tasks.workunit.client.1.smithi052.stdout:4/508: symlink de/d29/d51/da3/d6d/laa 0 2023-12-05T13:25:21.765 INFO:tasks.workunit.client.1.smithi052.stdout:2/554: truncate d2/f2a 3814758 0 2023-12-05T13:25:21.765 INFO:tasks.workunit.client.1.smithi052.stdout:2/555: chown d2/d4/d3f/d9d 6763 1 2023-12-05T13:25:21.768 INFO:tasks.workunit.client.1.smithi052.stdout:9/413: mknod d3/d11/c81 0 2023-12-05T13:25:21.768 INFO:tasks.workunit.client.1.smithi052.stdout:9/414: fdatasync d3/d2a/f30 0 2023-12-05T13:25:21.778 INFO:tasks.workunit.client.1.smithi052.stdout:0/543: rename d0/db/d1b/d51/d55/d66/c6d to d0/db/d52/d7f/d8f/cb5 0 2023-12-05T13:25:21.780 INFO:tasks.workunit.client.1.smithi052.stdout:4/509: mknod de/d1e/d24/cab 0 2023-12-05T13:25:21.780 INFO:tasks.workunit.client.1.smithi052.stdout:4/510: dread - de/d29/d51/fa9 zero size 2023-12-05T13:25:21.783 INFO:tasks.workunit.client.1.smithi052.stdout:2/556: mkdir d2/d14/d62/da7 0 2023-12-05T13:25:21.783 INFO:tasks.workunit.client.1.smithi052.stdout:2/557: fdatasync d2/d13/d45/f4a 0 2023-12-05T13:25:21.785 INFO:tasks.workunit.client.1.smithi052.stdout:9/415: creat d3/d1e/d41/d57/f82 x:0 0 0 2023-12-05T13:25:21.789 INFO:tasks.workunit.client.1.smithi052.stdout:3/539: rename da/d48/f53 to da/d25/d33/d89/dae/faf 0 2023-12-05T13:25:21.789 INFO:tasks.workunit.client.1.smithi052.stdout:3/540: readlink da/d2e/l2f 0 2023-12-05T13:25:21.791 INFO:tasks.workunit.client.1.smithi052.stdout:0/544: truncate d0/db/d2e/f46 4521423 0 2023-12-05T13:25:21.791 INFO:tasks.workunit.client.1.smithi052.stdout:0/545: dread - d0/db/d20/d50/f92 zero size 2023-12-05T13:25:21.791 INFO:tasks.workunit.client.1.smithi052.stdout:0/546: chown d0/l39 2776 1 2023-12-05T13:25:21.791 INFO:tasks.workunit.client.1.smithi052.stdout:0/547: truncate d0/db/d20/d50/f92 693103 0 2023-12-05T13:25:21.793 INFO:tasks.workunit.client.1.smithi052.stdout:4/511: mkdir de/d30/dac 0 2023-12-05T13:25:21.798 INFO:tasks.workunit.client.1.smithi052.stdout:3/541: dread da/f18 [0,4194304] 0 2023-12-05T13:25:21.799 INFO:tasks.workunit.client.1.smithi052.stdout:9/416: mkdir d3/d11/d19/d83 0 2023-12-05T13:25:21.801 INFO:tasks.workunit.client.1.smithi052.stdout:9/417: write d3/d5e/f64 [553778,108356] 0 2023-12-05T13:25:21.801 INFO:tasks.workunit.client.1.smithi052.stdout:0/548: symlink d0/db/d52/d7f/d8f/lb6 0 2023-12-05T13:25:21.804 INFO:tasks.workunit.client.1.smithi052.stdout:2/558: dread d2/d13/d1e/f46 [0,4194304] 0 2023-12-05T13:25:21.807 INFO:tasks.workunit.client.1.smithi052.stdout:4/512: symlink de/d29/d51/da3/lad 0 2023-12-05T13:25:21.809 INFO:tasks.workunit.client.1.smithi052.stdout:3/542: creat da/d25/d33/d49/fb0 x:0 0 0 2023-12-05T13:25:21.809 INFO:tasks.workunit.client.1.smithi052.stdout:3/543: chown da/d2e/c54 3809607 1 2023-12-05T13:25:21.815 INFO:tasks.workunit.client.1.smithi052.stdout:9/418: mknod d3/d1e/c84 0 2023-12-05T13:25:21.818 INFO:tasks.workunit.client.1.smithi052.stdout:0/549: dread - d0/db/d2e/f47 zero size 2023-12-05T13:25:21.820 INFO:tasks.workunit.client.1.smithi052.stdout:4/513: dwrite de/f4b [0,4194304] 0 2023-12-05T13:25:21.821 INFO:tasks.workunit.client.1.smithi052.stdout:2/559: creat d2/d13/d1e/fa8 x:0 0 0 2023-12-05T13:25:21.822 INFO:tasks.workunit.client.1.smithi052.stdout:0/550: dread d0/db/d33/f3f [0,4194304] 0 2023-12-05T13:25:21.824 INFO:tasks.workunit.client.1.smithi052.stdout:3/544: creat da/d25/d33/d89/fb1 x:0 0 0 2023-12-05T13:25:21.828 INFO:tasks.workunit.client.1.smithi052.stdout:3/545: read da/f18 [3926055,36846] 0 2023-12-05T13:25:21.828 INFO:tasks.workunit.client.1.smithi052.stdout:9/419: dwrite d3/d11/f42 [0,4194304] 0 2023-12-05T13:25:21.830 INFO:tasks.workunit.client.1.smithi052.stdout:2/560: rmdir d2/d4/d3f 39 2023-12-05T13:25:21.833 INFO:tasks.workunit.client.1.smithi052.stdout:4/514: dwrite de/f12 [4194304,4194304] 0 2023-12-05T13:25:21.835 INFO:tasks.workunit.client.1.smithi052.stdout:3/546: rmdir da/d7a 39 2023-12-05T13:25:21.847 INFO:tasks.workunit.client.1.smithi052.stdout:9/420: rename d3/d5e/l66 to d3/d2a/d5c/l85 0 2023-12-05T13:25:21.847 INFO:tasks.workunit.client.1.smithi052.stdout:9/421: write d3/d1e/d37/d4f/f77 [87349,109043] 0 2023-12-05T13:25:21.850 INFO:tasks.workunit.client.1.smithi052.stdout:0/551: link d0/db/d14/d9b/la4 d0/db/d2e/lb7 0 2023-12-05T13:25:21.851 INFO:tasks.workunit.client.1.smithi052.stdout:2/561: dwrite d2/f59 [8388608,4194304] 0 2023-12-05T13:25:21.853 INFO:tasks.workunit.client.1.smithi052.stdout:4/515: rmdir de/d2b/d80 39 2023-12-05T13:25:21.853 INFO:tasks.workunit.client.1.smithi052.stdout:3/547: dwrite da/dd/f55 [0,4194304] 0 2023-12-05T13:25:21.855 INFO:tasks.workunit.client.1.smithi052.stdout:0/552: dread d0/db/d1b/d51/d55/d66/f86 [0,4194304] 0 2023-12-05T13:25:21.857 INFO:tasks.workunit.client.1.smithi052.stdout:9/422: unlink d3/d1e/f60 0 2023-12-05T13:25:21.857 INFO:tasks.workunit.client.1.smithi052.stdout:9/423: fdatasync d3/d31/f78 0 2023-12-05T13:25:21.860 INFO:tasks.workunit.client.1.smithi052.stdout:2/562: mkdir d2/d13/d37/d5c/da9 0 2023-12-05T13:25:21.860 INFO:tasks.workunit.client.1.smithi052.stdout:2/563: truncate d2/d4/d63/f76 788140 0 2023-12-05T13:25:21.861 INFO:tasks.workunit.client.1.smithi052.stdout:2/564: chown d2/d14/f8f 0 1 2023-12-05T13:25:21.861 INFO:tasks.workunit.client.1.smithi052.stdout:2/565: readlink d2/d13/d37/d61/l87 0 2023-12-05T13:25:21.863 INFO:tasks.workunit.client.1.smithi052.stdout:3/548: mknod da/d2e/d40/d6d/cb2 0 2023-12-05T13:25:21.863 INFO:tasks.workunit.client.1.smithi052.stdout:3/549: fdatasync f4 0 2023-12-05T13:25:21.863 INFO:tasks.workunit.client.1.smithi052.stdout:4/516: dread de/d30/d73/f9a [0,4194304] 0 2023-12-05T13:25:21.865 INFO:tasks.workunit.client.1.smithi052.stdout:0/553: mknod d0/db/d14/d9b/cb8 0 2023-12-05T13:25:21.868 INFO:tasks.workunit.client.1.smithi052.stdout:0/554: dread d0/db/d1b/d42/f67 [0,4194304] 0 2023-12-05T13:25:21.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/424: mkdir d3/d1e/d41/d86 0 2023-12-05T13:25:21.869 INFO:tasks.workunit.client.1.smithi052.stdout:9/425: chown d3/d5e 1035737 1 2023-12-05T13:25:21.870 INFO:tasks.workunit.client.1.smithi052.stdout:4/517: dread de/d1e/d24/f8c [0,4194304] 0 2023-12-05T13:25:21.871 INFO:tasks.workunit.client.1.smithi052.stdout:4/518: write de/d1e/d24/f35 [382428,107336] 0 2023-12-05T13:25:21.871 INFO:tasks.workunit.client.1.smithi052.stdout:4/519: truncate de/d2b/f58 3275766 0 2023-12-05T13:25:21.871 INFO:tasks.workunit.client.1.smithi052.stdout:2/566: symlink d2/d13/d37/d5c/d80/laa 0 2023-12-05T13:25:21.871 INFO:tasks.workunit.client.1.smithi052.stdout:2/567: truncate d2/d13/d48/f5e 909016 0 2023-12-05T13:25:21.872 INFO:tasks.workunit.client.1.smithi052.stdout:4/520: write de/f18 [1308230,62635] 0 2023-12-05T13:25:21.874 INFO:tasks.workunit.client.1.smithi052.stdout:3/550: creat da/d25/d33/d43/d5b/fb3 x:0 0 0 2023-12-05T13:25:21.876 INFO:tasks.workunit.client.1.smithi052.stdout:0/555: readlink d0/db/d2e/l75 0 2023-12-05T13:25:21.876 INFO:tasks.workunit.client.1.smithi052.stdout:0/556: truncate d0/db/d52/d7f/d8f/f99 273964 0 2023-12-05T13:25:21.876 INFO:tasks.workunit.client.1.smithi052.stdout:0/557: fdatasync d0/db/d1b/d29/db0/fa0 0 2023-12-05T13:25:21.878 INFO:tasks.workunit.client.1.smithi052.stdout:9/426: unlink d3/d2a/l73 0 2023-12-05T13:25:21.878 INFO:tasks.workunit.client.1.smithi052.stdout:9/427: chown d3/d2a/f4e 1343 1 2023-12-05T13:25:21.878 INFO:tasks.workunit.client.1.smithi052.stdout:9/428: chown d3/d31 25 1 2023-12-05T13:25:21.880 INFO:tasks.workunit.client.1.smithi052.stdout:2/568: getdents d2/d13/d48 0 2023-12-05T13:25:21.883 INFO:tasks.workunit.client.1.smithi052.stdout:2/569: dread d2/f3c [0,4194304] 0 2023-12-05T13:25:21.885 INFO:tasks.workunit.client.1.smithi052.stdout:4/521: mknod de/d30/dac/cae 0 2023-12-05T13:25:21.887 INFO:tasks.workunit.client.1.smithi052.stdout:0/558: rename d0/c83 to d0/db/d1b/d7a/cb9 0 2023-12-05T13:25:21.889 INFO:tasks.workunit.client.1.smithi052.stdout:0/559: write d0/db/d52/d7f/f89 [3422627,50003] 0 2023-12-05T13:25:21.892 INFO:tasks.workunit.client.1.smithi052.stdout:9/429: rename d3/fd to d3/d31/f87 0 2023-12-05T13:25:21.892 INFO:tasks.workunit.client.1.smithi052.stdout:9/430: chown d3/d1e/d62/c80 1389939 1 2023-12-05T13:25:21.892 INFO:tasks.workunit.client.1.smithi052.stdout:9/431: chown d3/d31 11 1 2023-12-05T13:25:21.892 INFO:tasks.workunit.client.1.smithi052.stdout:9/432: readlink d3/d1e/l5a 0 2023-12-05T13:25:21.897 INFO:tasks.workunit.client.1.smithi052.stdout:0/560: mkdir d0/db/d1b/d29/dba 0 2023-12-05T13:25:21.905 INFO:tasks.workunit.client.1.smithi052.stdout:9/433: dread d3/d11/d19/f27 [4194304,4194304] 0 2023-12-05T13:25:21.905 INFO:tasks.workunit.client.1.smithi052.stdout:4/522: dwrite de/d30/d68/f7c [0,4194304] 0 2023-12-05T13:25:21.906 INFO:tasks.workunit.client.1.smithi052.stdout:4/523: chown de/d1e/d24/f8c 3770481 1 2023-12-05T13:25:21.906 INFO:tasks.workunit.client.1.smithi052.stdout:2/570: dwrite d2/d4/f89 [0,4194304] 0 2023-12-05T13:25:21.906 INFO:tasks.workunit.client.1.smithi052.stdout:2/571: dread - d2/f9f zero size 2023-12-05T13:25:21.906 INFO:tasks.workunit.client.1.smithi052.stdout:4/524: read f4 [3473943,677] 0 2023-12-05T13:25:21.908 INFO:tasks.workunit.client.1.smithi052.stdout:9/434: rename d3/d1e/c84 to d3/d11/d19/c88 0 2023-12-05T13:25:21.908 INFO:tasks.workunit.client.1.smithi052.stdout:9/435: dread - d3/d2a/d5c/f71 zero size 2023-12-05T13:25:21.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/572: creat d2/d13/d1e/fab x:0 0 0 2023-12-05T13:25:21.933 INFO:tasks.workunit.client.1.smithi052.stdout:4/525: creat de/d30/d68/d5c/faf x:0 0 0 2023-12-05T13:25:21.936 INFO:tasks.workunit.client.1.smithi052.stdout:9/436: mknod d3/c89 0 2023-12-05T13:25:21.936 INFO:tasks.workunit.client.1.smithi052.stdout:9/437: chown d3/d11/f48 3008 1 2023-12-05T13:25:21.939 INFO:tasks.workunit.client.1.smithi052.stdout:2/573: mknod d2/d13/d45/cac 0 2023-12-05T13:25:21.943 INFO:tasks.workunit.client.1.smithi052.stdout:4/526: creat de/fb0 x:0 0 0 2023-12-05T13:25:21.945 INFO:tasks.workunit.client.1.smithi052.stdout:9/438: symlink d3/d11/d3e/l8a 0 2023-12-05T13:25:21.947 INFO:tasks.workunit.client.1.smithi052.stdout:9/439: dread d3/d11/d19/f29 [0,4194304] 0 2023-12-05T13:25:21.948 INFO:tasks.workunit.client.1.smithi052.stdout:2/574: link d2/d14/f8f d2/d14/d62/da7/fad 0 2023-12-05T13:25:21.951 INFO:tasks.workunit.client.1.smithi052.stdout:4/527: mknod de/d2b/d64/cb1 0 2023-12-05T13:25:21.953 INFO:tasks.workunit.client.1.smithi052.stdout:9/440: symlink d3/d1e/d62/l8b 0 2023-12-05T13:25:21.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/528: dread de/d1e/d24/f8c [0,4194304] 0 2023-12-05T13:25:21.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/529: chown de/d30/d68/f50 12618 1 2023-12-05T13:25:21.960 INFO:tasks.workunit.client.1.smithi052.stdout:4/530: rename de/d30/d68/c89 to de/d29/d51/da3/d6d/cb2 0 2023-12-05T13:25:21.964 INFO:tasks.workunit.client.1.smithi052.stdout:4/531: unlink de/d2b/d80/l99 0 2023-12-05T13:25:21.964 INFO:tasks.workunit.client.1.smithi052.stdout:4/532: chown de/d1e/d24/cab 44795760 1 2023-12-05T13:25:21.967 INFO:tasks.workunit.client.1.smithi052.stdout:4/533: symlink de/d29/lb3 0 2023-12-05T13:25:21.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/534: write de/d29/d51/da3/f9b [2207025,56607] 0 2023-12-05T13:25:21.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/535: stat de/d29/d51/da3/d6d/f8e 0 2023-12-05T13:25:21.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/536: stat de/d30/d68/f50 0 2023-12-05T13:25:21.972 INFO:tasks.workunit.client.1.smithi052.stdout:4/537: symlink de/d2b/d64/lb4 0 2023-12-05T13:25:22.186 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:22.186 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:22.186 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:25:22.186 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:25:22.186 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:22.187 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:22.187 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr fail", "who": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:25:22.187 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: osdmap e44: 6 total, 6 up, 6 in 2023-12-05T13:25:22.187 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "mgr fail", "who": "smithi029.eekhlu"}]': finished 2023-12-05T13:25:22.187 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:21 smithi052 ceph-mon[121072]: mgrmap e20: smithi052.ocazcp(active, starting, since 0.00726563s) 2023-12-05T13:25:22.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:22.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr fail", "who": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: osdmap e44: 6 total, 6 up, 6 in 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: from='mgr.14210 172.21.15.29:0/2915542243' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "mgr fail", "who": "smithi029.eekhlu"}]': finished 2023-12-05T13:25:22.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:21 smithi029 ceph-mon[112128]: mgrmap e20: smithi052.ocazcp(active, starting, since 0.00726563s) 2023-12-05T13:25:22.522 INFO:tasks.workunit.client.1.smithi052.stdout:5/299: sync 2023-12-05T13:25:22.523 INFO:tasks.workunit.client.1.smithi052.stdout:6/384: sync 2023-12-05T13:25:22.524 INFO:tasks.workunit.client.1.smithi052.stdout:6/385: rmdir d3/d5/d9/d21/d48 39 2023-12-05T13:25:22.526 INFO:tasks.workunit.client.1.smithi052.stdout:5/300: dread d5/d15/d21/d25/d3f/d5c/f49 [0,4194304] 0 2023-12-05T13:25:22.534 INFO:tasks.workunit.client.1.smithi052.stdout:5/301: link d5/c37 d5/d15/d21/d4a/c63 0 2023-12-05T13:25:22.537 INFO:tasks.workunit.client.1.smithi052.stdout:5/302: rmdir d5 39 2023-12-05T13:25:22.538 INFO:tasks.workunit.client.1.smithi052.stdout:5/303: chown d5/d15/d21/d25/d3f/d5c/f49 3951 1 2023-12-05T13:25:22.538 INFO:tasks.workunit.client.1.smithi052.stdout:5/304: fsync d5/d15/f42 0 2023-12-05T13:25:22.545 INFO:tasks.workunit.client.1.smithi052.stdout:5/305: link d5/d15/d21/c35 d5/df/c64 0 2023-12-05T13:25:22.548 INFO:tasks.workunit.client.1.smithi052.stdout:1/480: rmdir d5/d7/d35/d37/d5a/d73 39 2023-12-05T13:25:22.548 INFO:tasks.workunit.client.1.smithi052.stdout:1/481: fdatasync d5/d7/d35/d37/d68/d2a/f49 0 2023-12-05T13:25:22.548 INFO:tasks.workunit.client.1.smithi052.stdout:1/482: fdatasync d5/d7/d35/f71 0 2023-12-05T13:25:22.548 INFO:tasks.workunit.client.1.smithi052.stdout:1/483: read - d5/d7/d35/d37/d68/d17/d3c/f80 zero size 2023-12-05T13:25:22.548 INFO:tasks.workunit.client.1.smithi052.stdout:1/484: chown d5/d7/d35/d37/d68/d17/c8c 1 1 2023-12-05T13:25:22.551 INFO:tasks.workunit.client.1.smithi052.stdout:5/306: mkdir d5/df/d4e/d65 0 2023-12-05T13:25:22.552 INFO:tasks.workunit.client.1.smithi052.stdout:6/386: dwrite d3/d5/d9/d21/d48/d5b/f7b [0,4194304] 0 2023-12-05T13:25:22.559 INFO:tasks.workunit.client.1.smithi052.stdout:1/485: unlink d5/d7/d35/d37/d68/d79/f81 0 2023-12-05T13:25:22.559 INFO:tasks.workunit.client.1.smithi052.stdout:1/486: fdatasync d5/d7/d35/d37/d68/f32 0 2023-12-05T13:25:22.560 INFO:tasks.workunit.client.1.smithi052.stdout:3/551: write da/dd/f26 [215025,27674] 0 2023-12-05T13:25:22.561 INFO:tasks.workunit.client.1.smithi052.stdout:6/387: dread d3/d4/df/d27/f47 [0,4194304] 0 2023-12-05T13:25:22.562 INFO:tasks.workunit.client.1.smithi052.stdout:5/307: unlink d5/df/d11/f48 0 2023-12-05T13:25:22.562 INFO:tasks.workunit.client.1.smithi052.stdout:5/308: fsync d5/df/d11/f26 0 2023-12-05T13:25:22.570 INFO:tasks.workunit.client.1.smithi052.stdout:3/552: mknod da/d25/cb4 0 2023-12-05T13:25:22.575 INFO:tasks.workunit.client.1.smithi052.stdout:3/553: rmdir da/d2e 39 2023-12-05T13:25:22.578 INFO:tasks.workunit.client.1.smithi052.stdout:3/554: creat da/d25/fb5 x:0 0 0 2023-12-05T13:25:22.578 INFO:tasks.workunit.client.1.smithi052.stdout:3/555: truncate da/d27/f92 5127840 0 2023-12-05T13:25:22.581 INFO:tasks.workunit.client.1.smithi052.stdout:5/309: dwrite f3 [8388608,4194304] 0 2023-12-05T13:25:22.582 INFO:tasks.workunit.client.1.smithi052.stdout:3/556: symlink da/d25/d33/d43/d5b/d96/lb6 0 2023-12-05T13:25:22.583 INFO:tasks.workunit.client.1.smithi052.stdout:6/388: dwrite d3/f16 [0,4194304] 0 2023-12-05T13:25:22.587 INFO:tasks.workunit.client.1.smithi052.stdout:5/310: mkdir d5/df/d11/d66 0 2023-12-05T13:25:22.589 INFO:tasks.workunit.client.1.smithi052.stdout:3/557: link da/d7a/c8f da/d2e/cb7 0 2023-12-05T13:25:22.594 INFO:tasks.workunit.client.1.smithi052.stdout:6/389: creat d3/d4/d36/d6f/f85 x:0 0 0 2023-12-05T13:25:22.594 INFO:tasks.workunit.client.1.smithi052.stdout:6/390: stat d3/f29 0 2023-12-05T13:25:22.596 INFO:tasks.workunit.client.1.smithi052.stdout:5/311: mknod d5/d15/c67 0 2023-12-05T13:25:22.600 INFO:tasks.workunit.client.1.smithi052.stdout:5/312: symlink d5/d15/d21/d25/l68 0 2023-12-05T13:25:22.603 INFO:tasks.workunit.client.1.smithi052.stdout:5/313: truncate f4 509413 0 2023-12-05T13:25:22.610 INFO:tasks.workunit.client.1.smithi052.stdout:6/391: dwrite d3/f3d [0,4194304] 0 2023-12-05T13:25:22.613 INFO:tasks.workunit.client.1.smithi052.stdout:6/392: mknod d3/d4/df/c86 0 2023-12-05T13:25:22.622 INFO:tasks.workunit.client.1.smithi052.stdout:6/393: dread d3/d4/df/d27/f31 [0,4194304] 0 2023-12-05T13:25:22.622 INFO:tasks.workunit.client.1.smithi052.stdout:6/394: readlink d3/d5/d9/d21/d48/d5b/l5c 0 2023-12-05T13:25:22.622 INFO:tasks.workunit.client.1.smithi052.stdout:6/395: fsync d3/d4/d6/f11 0 2023-12-05T13:25:22.622 INFO:tasks.workunit.client.1.smithi052.stdout:6/396: dread - d3/d4/d36/d6f/f85 zero size 2023-12-05T13:25:22.622 INFO:tasks.workunit.client.1.smithi052.stdout:6/397: chown d3/d4/d6/ce 32736268 1 2023-12-05T13:25:22.627 INFO:tasks.workunit.client.1.smithi052.stdout:6/398: creat d3/d5/d9/d21/d48/d4d/d66/d74/f87 x:0 0 0 2023-12-05T13:25:22.627 INFO:tasks.workunit.client.1.smithi052.stdout:6/399: truncate d3/d5/d9/d21/d48/d4d/f78 128381 0 2023-12-05T13:25:22.706 INFO:tasks.workunit.client.1.smithi052.stdout:2/575: dread d2/f2a [0,4194304] 0 2023-12-05T13:25:22.706 INFO:tasks.workunit.client.1.smithi052.stdout:2/576: stat d2/d4/d3f/f97 0 2023-12-05T13:25:22.706 INFO:tasks.workunit.client.1.smithi052.stdout:2/577: readlink d2/d13/d37/d61/l8a 0 2023-12-05T13:25:22.722 INFO:tasks.workunit.client.1.smithi052.stdout:2/578: dwrite d2/d13/d1e/fa8 [0,4194304] 0 2023-12-05T13:25:22.722 INFO:tasks.workunit.client.1.smithi052.stdout:7/573: sync 2023-12-05T13:25:22.728 INFO:tasks.workunit.client.1.smithi052.stdout:2/579: rmdir d2/da4 39 2023-12-05T13:25:22.728 INFO:tasks.workunit.client.1.smithi052.stdout:2/580: write d2/d4/d3f/d9d/fa2 [244669,9764] 0 2023-12-05T13:25:22.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/574: dread d7/d4e/d45/d5a/d16/f33 [0,4194304] 0 2023-12-05T13:25:22.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/575: chown d7/d4e/d45/d93 23079 1 2023-12-05T13:25:22.736 INFO:tasks.workunit.client.1.smithi052.stdout:7/576: dread d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:25:22.738 INFO:tasks.workunit.client.1.smithi052.stdout:8/594: sync 2023-12-05T13:25:22.750 INFO:tasks.workunit.client.1.smithi052.stdout:7/577: dwrite d7/d4e/d45/fbb [0,4194304] 0 2023-12-05T13:25:22.757 INFO:tasks.workunit.client.1.smithi052.stdout:7/578: creat d7/d4e/d45/d5a/d63/d95/dba/fc3 x:0 0 0 2023-12-05T13:25:22.757 INFO:tasks.workunit.client.1.smithi052.stdout:7/579: write d7/d4e/d45/fb6 [1036514,44690] 0 2023-12-05T13:25:22.857 INFO:tasks.workunit.client.1.smithi052.stdout:9/441: dwrite d3/d2a/f59 [0,4194304] 0 2023-12-05T13:25:22.857 INFO:tasks.workunit.client.1.smithi052.stdout:9/442: readlink d3/d1e/d37/l44 0 2023-12-05T13:25:22.857 INFO:tasks.workunit.client.1.smithi052.stdout:4/538: getdents de/d2b/d64 0 2023-12-05T13:25:22.862 INFO:tasks.workunit.client.1.smithi052.stdout:9/443: creat d3/d2a/d5c/f8c x:0 0 0 2023-12-05T13:25:22.862 INFO:tasks.workunit.client.1.smithi052.stdout:0/561: sync 2023-12-05T13:25:22.863 INFO:tasks.workunit.client.1.smithi052.stdout:4/539: creat de/d29/d51/da3/d6d/fb5 x:0 0 0 2023-12-05T13:25:22.865 INFO:tasks.workunit.client.1.smithi052.stdout:9/444: rmdir d3/d1e/d37 39 2023-12-05T13:25:22.867 INFO:tasks.workunit.client.1.smithi052.stdout:4/540: truncate de/d1e/d24/f4e 55908 0 2023-12-05T13:25:22.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/445: rename d3/d31/l55 to d3/d31/l8d 0 2023-12-05T13:25:22.872 INFO:tasks.workunit.client.1.smithi052.stdout:4/541: rename de/d1e/d24/f4d to de/d29/d51/fb6 0 2023-12-05T13:25:22.872 INFO:tasks.workunit.client.1.smithi052.stdout:4/542: write de/d30/d68/f8d [1327023,17150] 0 2023-12-05T13:25:22.872 INFO:tasks.workunit.client.1.smithi052.stdout:4/543: chown de 466604219 1 2023-12-05T13:25:22.880 INFO:tasks.workunit.client.1.smithi052.stdout:9/446: dread d3/d11/f48 [0,4194304] 0 2023-12-05T13:25:22.883 INFO:tasks.workunit.client.1.smithi052.stdout:9/447: symlink d3/d5e/l8e 0 2023-12-05T13:25:22.889 INFO:tasks.workunit.client.1.smithi052.stdout:4/544: dwrite f4 [0,4194304] 0 2023-12-05T13:25:22.889 INFO:tasks.workunit.client.1.smithi052.stdout:4/545: write de/f14 [2441019,96890] 0 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: Active manager daemon smithi052.ocazcp restarted 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: Activating manager daemon smithi052.ocazcp 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: osdmap e45: 6 total, 6 up, 6 in 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: mgrmap e21: smithi052.ocazcp(active, starting, since 0.0058478s) 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:25:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:25:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: Manager daemon smithi052.ocazcp is now available 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/trash_purge_schedule"}]: dispatch 2023-12-05T13:25:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:22 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/trash_purge_schedule"}]: dispatch 2023-12-05T13:25:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: Active manager daemon smithi052.ocazcp restarted 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: Activating manager daemon smithi052.ocazcp 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: osdmap e45: 6 total, 6 up, 6 in 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: mgrmap e21: smithi052.ocazcp(active, starting, since 0.0058478s) 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:25:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: Manager daemon smithi052.ocazcp is now available 2023-12-05T13:25:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/trash_purge_schedule"}]: dispatch 2023-12-05T13:25:23.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:22 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.ocazcp/trash_purge_schedule"}]: dispatch 2023-12-05T13:25:23.793 INFO:tasks.workunit.client.1.smithi052.stdout:6/400: fsync d3/d4/d36/d6f/f85 0 2023-12-05T13:25:23.810 INFO:tasks.workunit.client.1.smithi052.stdout:6/401: dwrite d3/d4/df/d63/f70 [0,4194304] 0 2023-12-05T13:25:23.810 INFO:tasks.workunit.client.1.smithi052.stdout:6/402: chown d3/d4/d6/d26/d6d/f7e 4931851 1 2023-12-05T13:25:23.814 INFO:tasks.workunit.client.1.smithi052.stdout:6/403: mknod d3/d4/d6/d26/d6d/c88 0 2023-12-05T13:25:23.816 INFO:tasks.workunit.client.1.smithi052.stdout:6/404: mknod d3/d5/d9/d21/d48/d4d/d66/d74/c89 0 2023-12-05T13:25:23.817 INFO:tasks.workunit.client.1.smithi052.stdout:6/405: write d3/d5/d9/d52/f54 [1007340,18655] 0 2023-12-05T13:25:23.818 INFO:tasks.workunit.client.1.smithi052.stdout:6/406: chown d3/d4/d6/d26/f5d 8102 1 2023-12-05T13:25:23.822 INFO:tasks.workunit.client.1.smithi052.stdout:6/407: creat d3/d4/df/d24/f8a x:0 0 0 2023-12-05T13:25:23.840 INFO:tasks.workunit.client.1.smithi052.stdout:6/408: dwrite d3/d4/df/d24/f75 [0,4194304] 0 2023-12-05T13:25:23.849 INFO:tasks.workunit.client.1.smithi052.stdout:6/409: dread d3/d5/d9/f2e [0,4194304] 0 2023-12-05T13:25:23.853 INFO:tasks.workunit.client.1.smithi052.stdout:1/487: sync 2023-12-05T13:25:23.853 INFO:tasks.workunit.client.1.smithi052.stdout:1/488: fsync d5/d7/f47 0 2023-12-05T13:25:23.854 INFO:tasks.workunit.client.1.smithi052.stdout:6/410: link d3/f16 d3/d4/d36/f8b 0 2023-12-05T13:25:23.854 INFO:tasks.workunit.client.1.smithi052.stdout:6/411: write d3/d5/d9/d52/f54 [6558826,28319] 0 2023-12-05T13:25:23.855 INFO:tasks.workunit.client.1.smithi052.stdout:1/489: getdents d5/d7/d35/d37/d5a/d73/d7e/d4f 0 2023-12-05T13:25:23.855 INFO:tasks.workunit.client.1.smithi052.stdout:1/490: dread - d5/d7/d35/d37/d68/f72 zero size 2023-12-05T13:25:23.858 INFO:tasks.workunit.client.1.smithi052.stdout:6/412: link d3/d4/l45 d3/d5/d9/d21/d48/d4d/d66/d74/l8c 0 2023-12-05T13:25:23.860 INFO:tasks.workunit.client.1.smithi052.stdout:1/491: mkdir d5/d7/d35/d37/d68/d17/d9a 0 2023-12-05T13:25:23.860 INFO:tasks.workunit.client.1.smithi052.stdout:1/492: fsync d5/d7/d35/d37/d68/d2a/f49 0 2023-12-05T13:25:23.884 INFO:tasks.workunit.client.1.smithi052.stdout:1/493: dwrite d5/d7/f13 [4194304,4194304] 0 2023-12-05T13:25:23.898 INFO:tasks.workunit.client.1.smithi052.stdout:1/494: dwrite d5/d7/d35/d37/d68/f6a [0,4194304] 0 2023-12-05T13:25:23.898 INFO:tasks.workunit.client.1.smithi052.stdout:1/495: chown d5/d7/d35/d37/d68/d69/c6c 108016767 1 2023-12-05T13:25:23.899 INFO:tasks.workunit.client.1.smithi052.stdout:1/496: mkdir d5/d7/d35/d2f/d9b 0 2023-12-05T13:25:23.899 INFO:tasks.workunit.client.1.smithi052.stdout:1/497: getdents d5/d7/d35/d2f/d3e/d62/d85 0 2023-12-05T13:25:23.900 INFO:tasks.workunit.client.1.smithi052.stdout:1/498: write d5/d7/d35/d37/d68/d69/f82 [276604,122680] 0 2023-12-05T13:25:23.900 INFO:tasks.workunit.client.1.smithi052.stdout:1/499: fsync d5/d7/d35/d2f/d3e/f54 0 2023-12-05T13:25:23.901 INFO:tasks.workunit.client.1.smithi052.stdout:1/500: creat d5/d7/d35/d2f/d9b/f9c x:0 0 0 2023-12-05T13:25:23.901 INFO:tasks.workunit.client.1.smithi052.stdout:3/558: sync 2023-12-05T13:25:23.901 INFO:tasks.workunit.client.1.smithi052.stdout:5/314: sync 2023-12-05T13:25:23.902 INFO:tasks.workunit.client.1.smithi052.stdout:5/315: truncate d5/fa 2076269 0 2023-12-05T13:25:23.904 INFO:tasks.workunit.client.1.smithi052.stdout:3/559: symlink da/d7a/lb8 0 2023-12-05T13:25:23.906 INFO:tasks.workunit.client.1.smithi052.stdout:5/316: truncate d5/d15/d21/f3a 883140 0 2023-12-05T13:25:23.910 INFO:tasks.workunit.client.1.smithi052.stdout:5/317: mkdir d5/df/d4e/d69 0 2023-12-05T13:25:23.913 INFO:tasks.workunit.client.1.smithi052.stdout:5/318: creat d5/df/d11/d66/f6a x:0 0 0 2023-12-05T13:25:23.914 INFO:tasks.workunit.client.1.smithi052.stdout:5/319: symlink d5/d15/d21/d25/d3f/l6b 0 2023-12-05T13:25:23.914 INFO:tasks.workunit.client.1.smithi052.stdout:5/320: write d5/df/d11/d66/f6a [947184,63926] 0 2023-12-05T13:25:23.920 INFO:tasks.workunit.client.1.smithi052.stdout:3/560: dwrite da/d7a/fa3 [0,4194304] 0 2023-12-05T13:25:23.920 INFO:tasks.workunit.client.1.smithi052.stdout:3/561: fdatasync f4 0 2023-12-05T13:25:23.922 INFO:tasks.workunit.client.1.smithi052.stdout:1/501: dwrite d5/d7/d35/f71 [0,4194304] 0 2023-12-05T13:25:23.926 INFO:tasks.workunit.client.1.smithi052.stdout:3/562: symlink da/dd/d3d/dad/lb9 0 2023-12-05T13:25:23.935 INFO:tasks.workunit.client.1.smithi052.stdout:5/321: dwrite d5/d15/d21/f5e [0,4194304] 0 2023-12-05T13:25:23.935 INFO:tasks.workunit.client.1.smithi052.stdout:5/322: truncate d5/df/f61 923027 0 2023-12-05T13:25:23.943 INFO:tasks.workunit.client.1.smithi052.stdout:5/323: dread d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:25:23.943 INFO:tasks.workunit.client.1.smithi052.stdout:3/563: dwrite da/dd/d3d/f63 [0,4194304] 0 2023-12-05T13:25:23.945 INFO:tasks.workunit.client.1.smithi052.stdout:3/564: mkdir da/d2e/d40/d6d/dba 0 2023-12-05T13:25:23.946 INFO:tasks.workunit.client.1.smithi052.stdout:3/565: rmdir da/d2e/d40 39 2023-12-05T13:25:23.947 INFO:tasks.workunit.client.1.smithi052.stdout:5/324: dread d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:25:23.947 INFO:tasks.workunit.client.1.smithi052.stdout:5/325: fsync d5/df/f17 0 2023-12-05T13:25:23.947 INFO:tasks.workunit.client.1.smithi052.stdout:5/326: readlink d5/l8 0 2023-12-05T13:25:23.947 INFO:tasks.workunit.client.1.smithi052.stdout:3/566: link da/d7a/c8c da/d2e/d40/d6d/cbb 0 2023-12-05T13:25:23.949 INFO:tasks.workunit.client.1.smithi052.stdout:5/327: creat d5/d15/d21/d25/d3f/d5c/f6c x:0 0 0 2023-12-05T13:25:23.950 INFO:tasks.workunit.client.1.smithi052.stdout:3/567: link da/d27/f92 da/dd/fbc 0 2023-12-05T13:25:23.952 INFO:tasks.workunit.client.1.smithi052.stdout:5/328: creat d5/d15/d21/d25/f6d x:0 0 0 2023-12-05T13:25:23.954 INFO:tasks.workunit.client.1.smithi052.stdout:5/329: mkdir d5/d15/d21/d4a/d6e 0 2023-12-05T13:25:23.954 INFO:tasks.workunit.client.1.smithi052.stdout:5/330: write d5/d15/d21/d4a/f5f [4829869,66033] 0 2023-12-05T13:25:24.239 INFO:tasks.workunit.client.1.smithi052.stdout:1/502: truncate d5/d7/f13 8258598 0 2023-12-05T13:25:24.241 INFO:tasks.workunit.client.1.smithi052.stdout:1/503: link d5/d7/c91 d5/d7/d35/d37/d43/c9d 0 2023-12-05T13:25:24.241 INFO:tasks.workunit.client.1.smithi052.stdout:1/504: dread - d5/d7/de/d74/f77 zero size 2023-12-05T13:25:24.248 INFO:tasks.workunit.client.1.smithi052.stdout:9/448: mkdir d3/d2a/d8f 0 2023-12-05T13:25:24.248 INFO:tasks.workunit.client.1.smithi052.stdout:9/449: readlink d3/d11/d3e/l8a 0 2023-12-05T13:25:24.250 INFO:tasks.workunit.client.1.smithi052.stdout:9/450: unlink d3/d11/f69 0 2023-12-05T13:25:24.252 INFO:tasks.workunit.client.1.smithi052.stdout:9/451: symlink d3/d5e/l90 0 2023-12-05T13:25:24.254 INFO:tasks.workunit.client.1.smithi052.stdout:9/452: creat d3/d1e/d41/d86/f91 x:0 0 0 2023-12-05T13:25:24.256 INFO:tasks.workunit.client.1.smithi052.stdout:9/453: mkdir d3/d92 0 2023-12-05T13:25:24.256 INFO:tasks.workunit.client.1.smithi052.stdout:1/505: dwrite d5/d7/d35/d37/d43/f78 [0,4194304] 0 2023-12-05T13:25:24.260 INFO:tasks.workunit.client.1.smithi052.stdout:1/506: rename d5/d7/d35/d2f/d3e/f7d to d5/d7/d35/d37/d68/d2a/f9e 0 2023-12-05T13:25:24.280 INFO:tasks.workunit.client.1.smithi052.stdout:9/454: dwrite d3/d31/f45 [0,4194304] 0 2023-12-05T13:25:24.280 INFO:tasks.workunit.client.1.smithi052.stdout:9/455: readlink d3/d11/d19/l43 0 2023-12-05T13:25:24.280 INFO:tasks.workunit.client.1.smithi052.stdout:1/507: dwrite d5/d7/d35/d37/d68/d17/f88 [0,4194304] 0 2023-12-05T13:25:24.287 INFO:tasks.workunit.client.1.smithi052.stdout:9/456: rename d3/c2d to d3/d1e/d41/d57/c93 0 2023-12-05T13:25:24.287 INFO:tasks.workunit.client.1.smithi052.stdout:1/508: dread d5/d7/d35/d37/d68/d2a/f92 [0,4194304] 0 2023-12-05T13:25:24.287 INFO:tasks.workunit.client.1.smithi052.stdout:1/509: read - d5/d7/d35/d37/d43/f90 zero size 2023-12-05T13:25:24.287 INFO:tasks.workunit.client.1.smithi052.stdout:1/510: truncate d5/d7/d35/d37/d5a/d73/d7e/f6b 150310 0 2023-12-05T13:25:24.287 INFO:tasks.workunit.client.1.smithi052.stdout:1/511: chown d5/d7/d35/d37/d68/d17/c56 539446 1 2023-12-05T13:25:24.290 INFO:tasks.workunit.client.1.smithi052.stdout:9/457: mknod d3/d1e/d41/d57/c94 0 2023-12-05T13:25:24.293 INFO:tasks.workunit.client.1.smithi052.stdout:1/512: creat d5/d7/d35/d37/d68/d2a/f9f x:0 0 0 2023-12-05T13:25:24.294 INFO:tasks.workunit.client.1.smithi052.stdout:9/458: truncate d3/d1e/d41/f46 4053822 0 2023-12-05T13:25:24.300 INFO:tasks.workunit.client.1.smithi052.stdout:0/562: sync 2023-12-05T13:25:24.300 INFO:tasks.workunit.client.1.smithi052.stdout:7/580: sync 2023-12-05T13:25:24.300 INFO:tasks.workunit.client.1.smithi052.stdout:0/563: readlink d0/db/d14/d60/l71 0 2023-12-05T13:25:24.300 INFO:tasks.workunit.client.1.smithi052.stdout:4/546: sync 2023-12-05T13:25:24.300 INFO:tasks.workunit.client.1.smithi052.stdout:7/581: chown d7/d4e/f28 7721 1 2023-12-05T13:25:24.300 INFO:tasks.workunit.client.1.smithi052.stdout:0/564: fdatasync d0/db/d2e/f46 0 2023-12-05T13:25:24.302 INFO:tasks.workunit.client.1.smithi052.stdout:2/581: sync 2023-12-05T13:25:24.302 INFO:tasks.workunit.client.1.smithi052.stdout:9/459: dread d3/d11/f42 [0,4194304] 0 2023-12-05T13:25:24.303 INFO:tasks.workunit.client.1.smithi052.stdout:8/595: sync 2023-12-05T13:25:24.303 INFO:tasks.workunit.client.1.smithi052.stdout:5/331: sync 2023-12-05T13:25:24.303 INFO:tasks.workunit.client.1.smithi052.stdout:3/568: sync 2023-12-05T13:25:24.303 INFO:tasks.workunit.client.1.smithi052.stdout:6/413: sync 2023-12-05T13:25:24.303 INFO:tasks.workunit.client.1.smithi052.stdout:6/414: chown d3/d5/f7c 6 1 2023-12-05T13:25:24.304 INFO:tasks.workunit.client.1.smithi052.stdout:0/565: rmdir d0/db/d52 39 2023-12-05T13:25:24.305 INFO:tasks.workunit.client.1.smithi052.stdout:1/513: getdents d5/d7/d35/d2f/d3e 0 2023-12-05T13:25:24.305 INFO:tasks.workunit.client.1.smithi052.stdout:1/514: chown d5/d7/d35/d37/d68/d69/f82 45266759 1 2023-12-05T13:25:24.312 INFO:tasks.workunit.client.1.smithi052.stdout:7/582: mknod d7/d4e/d45/d50/db7/cc4 0 2023-12-05T13:25:24.312 INFO:tasks.workunit.client.1.smithi052.stdout:7/583: stat d7/d4e/d45/d50/f8f 0 2023-12-05T13:25:24.312 INFO:tasks.workunit.client.1.smithi052.stdout:9/460: symlink d3/d2a/l95 0 2023-12-05T13:25:24.318 INFO:tasks.workunit.client.1.smithi052.stdout:3/569: rename da/d48/d50 to da/d25/d33/d49/dbd 0 2023-12-05T13:25:24.318 INFO:tasks.workunit.client.1.smithi052.stdout:8/596: mkdir d0/d28/d39/d3a/d4f/db5/dc0 0 2023-12-05T13:25:24.320 INFO:tasks.workunit.client.1.smithi052.stdout:1/515: write d5/d7/d35/d2f/d3e/f54 [1089909,128276] 0 2023-12-05T13:25:24.326 INFO:tasks.workunit.client.1.smithi052.stdout:9/461: mkdir d3/d11/d96 0 2023-12-05T13:25:24.327 INFO:tasks.workunit.client.1.smithi052.stdout:0/566: symlink d0/db/d52/d7f/lbb 0 2023-12-05T13:25:24.330 INFO:tasks.workunit.client.1.smithi052.stdout:8/597: write d0/d28/d2b/f7f [2670292,68008] 0 2023-12-05T13:25:24.330 INFO:tasks.workunit.client.1.smithi052.stdout:8/598: fsync d0/f3e 0 2023-12-05T13:25:24.335 INFO:tasks.workunit.client.1.smithi052.stdout:3/570: link l7 da/d25/d33/d49/dbd/lbe 0 2023-12-05T13:25:24.335 INFO:tasks.workunit.client.1.smithi052.stdout:3/571: write da/d25/d33/d89/dae/faf [29291,42368] 0 2023-12-05T13:25:24.335 INFO:tasks.workunit.client.1.smithi052.stdout:4/547: dwrite de/d29/f2e [0,4194304] 0 2023-12-05T13:25:24.338 INFO:tasks.workunit.client.1.smithi052.stdout:9/462: write d3/d1e/d37/d4f/f54 [599801,102589] 0 2023-12-05T13:25:24.339 INFO:tasks.workunit.client.1.smithi052.stdout:1/516: mkdir d5/d26/d75/d7a/da0 0 2023-12-05T13:25:24.339 INFO:tasks.workunit.client.1.smithi052.stdout:1/517: write d5/d7/d35/d2f/d9b/f9c [668875,41418] 0 2023-12-05T13:25:24.339 INFO:tasks.workunit.client.1.smithi052.stdout:6/415: dwrite d3/d5/f34 [0,4194304] 0 2023-12-05T13:25:24.343 INFO:tasks.workunit.client.1.smithi052.stdout:9/463: chown d3/d1e/d37/d4f/l56 141630 1 2023-12-05T13:25:24.343 INFO:tasks.workunit.client.1.smithi052.stdout:2/582: dwrite d2/d13/d37/d5c/f9c [0,4194304] 0 2023-12-05T13:25:24.347 INFO:tasks.workunit.client.1.smithi052.stdout:6/416: getdents d3 0 2023-12-05T13:25:24.355 INFO:tasks.workunit.client.1.smithi052.stdout:7/584: dwrite d7/d4e/d45/d5a/f87 [0,4194304] 0 2023-12-05T13:25:24.356 INFO:tasks.workunit.client.1.smithi052.stdout:6/417: symlink d3/d4/d36/d6f/l8d 0 2023-12-05T13:25:24.356 INFO:tasks.workunit.client.1.smithi052.stdout:6/418: chown d3/d5/d9/c3e 45607 1 2023-12-05T13:25:24.357 INFO:tasks.workunit.client.1.smithi052.stdout:0/567: dwrite d0/db/d33/f35 [0,4194304] 0 2023-12-05T13:25:24.357 INFO:tasks.workunit.client.1.smithi052.stdout:0/568: stat d0/db/d52/d7f/lbb 0 2023-12-05T13:25:24.362 INFO:tasks.workunit.client.1.smithi052.stdout:2/583: mkdir d2/d13/d1e/dae 0 2023-12-05T13:25:24.363 INFO:tasks.workunit.client.1.smithi052.stdout:5/332: dwrite d5/df/d11/d66/f6a [0,4194304] 0 2023-12-05T13:25:24.364 INFO:tasks.workunit.client.1.smithi052.stdout:7/585: truncate d7/f27 982114 0 2023-12-05T13:25:24.368 INFO:tasks.workunit.client.1.smithi052.stdout:1/518: dwrite d5/d7/d35/d37/d68/d69/f82 [0,4194304] 0 2023-12-05T13:25:24.368 INFO:tasks.workunit.client.1.smithi052.stdout:8/599: dwrite d0/d28/d39/d3a/f5b [0,4194304] 0 2023-12-05T13:25:24.368 INFO:tasks.workunit.client.1.smithi052.stdout:0/569: creat d0/db/d52/fbc x:0 0 0 2023-12-05T13:25:24.370 INFO:tasks.workunit.client.1.smithi052.stdout:2/584: truncate d2/d13/d37/f69 450424 0 2023-12-05T13:25:24.370 INFO:tasks.workunit.client.1.smithi052.stdout:2/585: dread - d2/f9f zero size 2023-12-05T13:25:24.370 INFO:tasks.workunit.client.1.smithi052.stdout:9/464: dwrite d3/f3a [0,4194304] 0 2023-12-05T13:25:24.372 INFO:tasks.workunit.client.1.smithi052.stdout:4/548: dwrite de/d1e/f21 [0,4194304] 0 2023-12-05T13:25:24.372 INFO:tasks.workunit.client.1.smithi052.stdout:3/572: dwrite da/dd/f55 [0,4194304] 0 2023-12-05T13:25:24.372 INFO:tasks.workunit.client.1.smithi052.stdout:3/573: getdents da/d2e/d40/d6d/dba 0 2023-12-05T13:25:24.372 INFO:tasks.workunit.client.1.smithi052.stdout:3/574: write da/d25/fb5 [261567,128110] 0 2023-12-05T13:25:24.372 INFO:tasks.workunit.client.1.smithi052.stdout:3/575: stat da/d27/ca1 0 2023-12-05T13:25:24.373 INFO:tasks.workunit.client.1.smithi052.stdout:5/333: truncate d5/f14 4168228 0 2023-12-05T13:25:24.376 INFO:tasks.workunit.client.1.smithi052.stdout:8/600: mkdir d0/de/d12/dc1 0 2023-12-05T13:25:24.376 INFO:tasks.workunit.client.1.smithi052.stdout:8/601: write d0/d28/f7c [1456658,84875] 0 2023-12-05T13:25:24.376 INFO:tasks.workunit.client.1.smithi052.stdout:8/602: write d0/f95 [579627,113188] 0 2023-12-05T13:25:24.377 INFO:tasks.workunit.client.1.smithi052.stdout:0/570: creat d0/db/d20/fbd x:0 0 0 2023-12-05T13:25:24.379 INFO:tasks.workunit.client.1.smithi052.stdout:2/586: unlink d2/d13/d37/l90 0 2023-12-05T13:25:24.382 INFO:tasks.workunit.client.1.smithi052.stdout:1/519: dread d5/d7/d35/d37/d68/d17/f39 [0,4194304] 0 2023-12-05T13:25:24.383 INFO:tasks.workunit.client.1.smithi052.stdout:9/465: symlink d3/d5e/l97 0 2023-12-05T13:25:24.385 INFO:tasks.workunit.client.1.smithi052.stdout:4/549: mknod de/d29/cb7 0 2023-12-05T13:25:24.385 INFO:tasks.workunit.client.1.smithi052.stdout:4/550: dread - de/d91/fa6 zero size 2023-12-05T13:25:24.385 INFO:tasks.workunit.client.1.smithi052.stdout:4/551: truncate de/d1e/f21 5379483 0 2023-12-05T13:25:24.385 INFO:tasks.workunit.client.1.smithi052.stdout:4/552: chown de/d29/d51/da3 3878238 1 2023-12-05T13:25:24.386 INFO:tasks.workunit.client.1.smithi052.stdout:4/553: write de/d29/f5d [3260477,61375] 0 2023-12-05T13:25:24.388 INFO:tasks.workunit.client.1.smithi052.stdout:3/576: link da/d25/d33/d43/d5b/f67 da/d25/d33/d89/fbf 0 2023-12-05T13:25:24.390 INFO:tasks.workunit.client.1.smithi052.stdout:5/334: truncate d5/df/d4b/f4d 686711 0 2023-12-05T13:25:24.390 INFO:tasks.workunit.client.1.smithi052.stdout:8/603: creat d0/d28/fc2 x:0 0 0 2023-12-05T13:25:24.392 INFO:tasks.workunit.client.1.smithi052.stdout:0/571: symlink d0/db/d14/d9b/lbe 0 2023-12-05T13:25:24.393 INFO:tasks.workunit.client.1.smithi052.stdout:2/587: rename d2/d4/f58 to d2/d13/d1e/d6a/faf 0 2023-12-05T13:25:24.402 INFO:tasks.workunit.client.1.smithi052.stdout:1/520: mknod d5/d7/de/d74/d99/ca1 0 2023-12-05T13:25:24.404 INFO:tasks.workunit.client.1.smithi052.stdout:9/466: mknod d3/d31/c98 0 2023-12-05T13:25:24.405 INFO:tasks.workunit.client.1.smithi052.stdout:4/554: mkdir de/d30/d68/d5c/db8 0 2023-12-05T13:25:24.409 INFO:tasks.workunit.client.1.smithi052.stdout:8/604: creat d0/d28/fc3 x:0 0 0 2023-12-05T13:25:24.411 INFO:tasks.workunit.client.1.smithi052.stdout:8/605: write d0/d28/d2b/f7f [4169103,116969] 0 2023-12-05T13:25:24.413 INFO:tasks.workunit.client.1.smithi052.stdout:0/572: unlink d0/db/d1b/d42/l4c 0 2023-12-05T13:25:24.415 INFO:tasks.workunit.client.1.smithi052.stdout:3/577: rename da/d2e/c3e to da/d25/d33/d89/dae/cc0 0 2023-12-05T13:25:24.416 INFO:tasks.workunit.client.1.smithi052.stdout:3/578: chown da/d2e/d40/d6d/cb2 721332 1 2023-12-05T13:25:24.418 INFO:tasks.workunit.client.1.smithi052.stdout:1/521: dwrite d5/d7/d35/d2f/d3e/d62/f97 [0,4194304] 0 2023-12-05T13:25:24.418 INFO:tasks.workunit.client.1.smithi052.stdout:9/467: link d3/d2a/l6d d3/d1e/d41/d57/l99 0 2023-12-05T13:25:24.419 INFO:tasks.workunit.client.1.smithi052.stdout:4/555: stat de/d29/d51/da3/c84 0 2023-12-05T13:25:24.419 INFO:tasks.workunit.client.1.smithi052.stdout:4/556: chown de/f14 586 1 2023-12-05T13:25:24.422 INFO:tasks.workunit.client.1.smithi052.stdout:8/606: symlink d0/de/d27/d43/d44/lc4 0 2023-12-05T13:25:24.422 INFO:tasks.workunit.client.1.smithi052.stdout:8/607: dread - d0/d28/d2b/fa3 zero size 2023-12-05T13:25:24.422 INFO:tasks.workunit.client.1.smithi052.stdout:8/608: truncate d0/d28/d2b/f91 1032973 0 2023-12-05T13:25:24.423 INFO:tasks.workunit.client.1.smithi052.stdout:0/573: mknod d0/db/cbf 0 2023-12-05T13:25:24.424 INFO:tasks.workunit.client.1.smithi052.stdout:5/335: rename d5/d15/f3c to d5/df/d4e/d5b/f6f 0 2023-12-05T13:25:24.426 INFO:tasks.workunit.client.1.smithi052.stdout:3/579: symlink da/d48/lc1 0 2023-12-05T13:25:24.429 INFO:tasks.workunit.client.1.smithi052.stdout:2/588: link d2/d13/d1e/l43 d2/d13/d1e/d6a/d7f/lb0 0 2023-12-05T13:25:24.433 INFO:tasks.workunit.client.1.smithi052.stdout:1/522: symlink d5/d7/d35/d37/d68/d79/la2 0 2023-12-05T13:25:24.433 INFO:tasks.workunit.client.1.smithi052.stdout:1/523: chown d5/d7/d35/d2f/d3e/d62/d85/c8b 2 1 2023-12-05T13:25:24.435 INFO:tasks.workunit.client.1.smithi052.stdout:0/574: truncate d0/db/d20/d50/f5d 3473382 0 2023-12-05T13:25:24.435 INFO:tasks.workunit.client.1.smithi052.stdout:8/609: mkdir d0/de/d12/d29/db3/dc5 0 2023-12-05T13:25:24.435 INFO:tasks.workunit.client.1.smithi052.stdout:8/610: chown d0/c7b 163684 1 2023-12-05T13:25:24.438 INFO:tasks.workunit.client.1.smithi052.stdout:8/611: rmdir d0/d28/d39/d3a/d8f 39 2023-12-05T13:25:24.438 INFO:tasks.workunit.client.1.smithi052.stdout:8/612: chown d0/d28/d2b/c59 2 1 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:9/468: dwrite d3/d31/f87 [0,4194304] 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:3/580: dread da/d25/d33/d43/f80 [0,4194304] 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:3/581: write da/d25/d33/d49/f8a [722133,87599] 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:3/582: dread - da/d25/d33/d89/fb1 zero size 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:3/583: write da/d48/f8b [512266,49027] 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:3/584: write da/d25/d33/d89/dae/faf [712797,87137] 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:8/613: rename d0/d28/fc3 to d0/de/d12/fc6 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:8/614: symlink d0/de/d12/d29/d81/lc7 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:8/615: fdatasync d0/de/d12/d29/f50 0 2023-12-05T13:25:24.443 INFO:tasks.workunit.client.1.smithi052.stdout:3/585: dread da/d25/d33/f97 [0,4194304] 0 2023-12-05T13:25:24.444 INFO:tasks.workunit.client.1.smithi052.stdout:9/469: rename d3/d11/d3e/f79 to d3/d2a/d8f/f9a 0 2023-12-05T13:25:24.444 INFO:tasks.workunit.client.1.smithi052.stdout:3/586: creat da/d25/d33/d49/fc2 x:0 0 0 2023-12-05T13:25:24.445 INFO:tasks.workunit.client.1.smithi052.stdout:9/470: stat d3/d1e/d62/l68 0 2023-12-05T13:25:24.445 INFO:tasks.workunit.client.1.smithi052.stdout:4/557: dwrite de/f4b [0,4194304] 0 2023-12-05T13:25:24.446 INFO:tasks.workunit.client.1.smithi052.stdout:3/587: symlink da/dd/d3d/lc3 0 2023-12-05T13:25:24.446 INFO:tasks.workunit.client.1.smithi052.stdout:9/471: write d3/d11/f48 [152815,127697] 0 2023-12-05T13:25:24.449 INFO:tasks.workunit.client.1.smithi052.stdout:4/558: rmdir de/d29/d51/da3/d6d 39 2023-12-05T13:25:24.449 INFO:tasks.workunit.client.1.smithi052.stdout:2/589: dread d2/f5d [0,4194304] 0 2023-12-05T13:25:24.449 INFO:tasks.workunit.client.1.smithi052.stdout:2/590: readlink d2/d13/d37/d5c/d80/laa 0 2023-12-05T13:25:24.449 INFO:tasks.workunit.client.1.smithi052.stdout:2/591: truncate d2/da4/f79 1794178 0 2023-12-05T13:25:24.451 INFO:tasks.workunit.client.1.smithi052.stdout:9/472: creat d3/d11/d3e/f9b x:0 0 0 2023-12-05T13:25:24.453 INFO:tasks.workunit.client.1.smithi052.stdout:4/559: unlink de/d29/d51/d76/f95 0 2023-12-05T13:25:24.453 INFO:tasks.workunit.client.1.smithi052.stdout:4/560: chown de/d29/f5d 16269 1 2023-12-05T13:25:24.455 INFO:tasks.workunit.client.1.smithi052.stdout:2/592: symlink d2/d4/d63/d6d/lb1 0 2023-12-05T13:25:24.465 INFO:tasks.workunit.client.1.smithi052.stdout:9/473: creat d3/d1e/f9c x:0 0 0 2023-12-05T13:25:24.466 INFO:tasks.workunit.client.1.smithi052.stdout:4/561: rename de/d30/d68/f7c to de/d1e/fb9 0 2023-12-05T13:25:24.466 INFO:tasks.workunit.client.1.smithi052.stdout:4/562: fsync de/d29/f56 0 2023-12-05T13:25:24.467 INFO:tasks.workunit.client.1.smithi052.stdout:9/474: symlink d3/d92/l9d 0 2023-12-05T13:25:24.468 INFO:tasks.workunit.client.1.smithi052.stdout:8/616: dwrite d0/dae/fb1 [0,4194304] 0 2023-12-05T13:25:24.469 INFO:tasks.workunit.client.1.smithi052.stdout:0/575: dwrite d0/f6 [4194304,4194304] 0 2023-12-05T13:25:24.469 INFO:tasks.workunit.client.1.smithi052.stdout:0/576: fdatasync d0/db/d1b/d29/db0/fa0 0 2023-12-05T13:25:24.470 INFO:tasks.workunit.client.1.smithi052.stdout:9/475: chown d3/d1e/d37/d4f/c58 1 1 2023-12-05T13:25:24.475 INFO:tasks.workunit.client.1.smithi052.stdout:3/588: dwrite da/d7a/fa4 [0,4194304] 0 2023-12-05T13:25:24.476 INFO:tasks.workunit.client.1.smithi052.stdout:3/589: write da/d2e/f7f [2464917,670] 0 2023-12-05T13:25:24.476 INFO:tasks.workunit.client.1.smithi052.stdout:8/617: rename d0/d28/d39/d3a/d8f/lb4 to d0/d28/d39/d3a/d9f/lc8 0 2023-12-05T13:25:24.476 INFO:tasks.workunit.client.1.smithi052.stdout:9/476: mkdir d3/d5e/d9e 0 2023-12-05T13:25:24.483 INFO:tasks.workunit.client.1.smithi052.stdout:1/524: write d5/d7/d35/d37/d5a/d73/d7e/f6b [921877,91319] 0 2023-12-05T13:25:24.483 INFO:tasks.workunit.client.1.smithi052.stdout:3/590: creat da/d7a/fc4 x:0 0 0 2023-12-05T13:25:24.483 INFO:tasks.workunit.client.1.smithi052.stdout:3/591: write da/d2e/f85 [1237263,90202] 0 2023-12-05T13:25:24.483 INFO:tasks.workunit.client.1.smithi052.stdout:9/477: unlink d3/f3a 0 2023-12-05T13:25:24.484 INFO:tasks.workunit.client.1.smithi052.stdout:2/593: dwrite d2/d13/f26 [0,4194304] 0 2023-12-05T13:25:24.486 INFO:tasks.workunit.client.1.smithi052.stdout:9/478: truncate d3/d5e/f64 579914 0 2023-12-05T13:25:24.486 INFO:tasks.workunit.client.1.smithi052.stdout:1/525: write d5/d7/d35/d37/d5a/d73/d7e/f6b [154170,57473] 0 2023-12-05T13:25:24.488 INFO:tasks.workunit.client.1.smithi052.stdout:3/592: creat da/d25/d33/fc5 x:0 0 0 2023-12-05T13:25:24.490 INFO:tasks.workunit.client.1.smithi052.stdout:3/593: write da/d25/fb5 [193615,5755] 0 2023-12-05T13:25:24.490 INFO:tasks.workunit.client.1.smithi052.stdout:3/594: write da/d25/d33/d89/dae/faf [847804,1449] 0 2023-12-05T13:25:24.491 INFO:tasks.workunit.client.1.smithi052.stdout:3/595: chown da/d25/f31 3434 1 2023-12-05T13:25:24.491 INFO:tasks.workunit.client.1.smithi052.stdout:1/526: mkdir d5/d26/da3 0 2023-12-05T13:25:24.497 INFO:tasks.workunit.client.1.smithi052.stdout:0/577: dwrite d0/db/d20/f21 [0,4194304] 0 2023-12-05T13:25:24.497 INFO:tasks.workunit.client.1.smithi052.stdout:0/578: chown d0/db/d2e/l75 192592 1 2023-12-05T13:25:24.497 INFO:tasks.workunit.client.1.smithi052.stdout:0/579: write d0/db/d52/d7f/fa7 [206488,10405] 0 2023-12-05T13:25:24.497 INFO:tasks.workunit.client.1.smithi052.stdout:0/580: fsync d0/db/d33/f35 0 2023-12-05T13:25:24.497 INFO:tasks.workunit.client.1.smithi052.stdout:0/581: write d0/db/d1b/d51/d55/f5f [4352609,103638] 0 2023-12-05T13:25:24.499 INFO:tasks.workunit.client.1.smithi052.stdout:5/336: dwrite d5/fa [0,4194304] 0 2023-12-05T13:25:24.500 INFO:tasks.workunit.client.1.smithi052.stdout:4/563: rmdir de/d29/d51 39 2023-12-05T13:25:24.503 INFO:tasks.workunit.client.1.smithi052.stdout:0/582: symlink d0/db/d1b/d7a/lc0 0 2023-12-05T13:25:24.504 INFO:tasks.workunit.client.1.smithi052.stdout:0/583: chown d0/db/d14/d9b/cb8 8961125 1 2023-12-05T13:25:24.507 INFO:tasks.workunit.client.1.smithi052.stdout:0/584: read d0/fa [10390396,87521] 0 2023-12-05T13:25:24.507 INFO:tasks.workunit.client.1.smithi052.stdout:8/618: dwrite d0/d28/d2b/fa3 [0,4194304] 0 2023-12-05T13:25:24.511 INFO:tasks.workunit.client.1.smithi052.stdout:0/585: mknod d0/db/d1b/d51/cc1 0 2023-12-05T13:25:24.514 INFO:tasks.workunit.client.1.smithi052.stdout:8/619: link d0/de/d12/d29/c83 d0/de/d12/cc9 0 2023-12-05T13:25:24.517 INFO:tasks.workunit.client.1.smithi052.stdout:9/479: dwrite d3/d1e/d37/f4d [0,4194304] 0 2023-12-05T13:25:24.517 INFO:tasks.workunit.client.1.smithi052.stdout:3/596: truncate da/d2e/f85 2976740 0 2023-12-05T13:25:24.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/594: dwrite d2/d4/d3f/f97 [0,4194304] 0 2023-12-05T13:25:24.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/595: chown d2/d14/l47 98 1 2023-12-05T13:25:24.520 INFO:tasks.workunit.client.1.smithi052.stdout:5/337: dwrite d5/d15/d21/d25/d3f/f50 [0,4194304] 0 2023-12-05T13:25:24.521 INFO:tasks.workunit.client.1.smithi052.stdout:5/338: write d5/df/d11/f52 [366264,21114] 0 2023-12-05T13:25:24.524 INFO:tasks.workunit.client.1.smithi052.stdout:1/527: write d5/d7/d35/d37/d5a/d73/d7e/f5b [1144160,62265] 0 2023-12-05T13:25:24.536 INFO:tasks.workunit.client.1.smithi052.stdout:8/620: mknod d0/d28/d39/d3a/cca 0 2023-12-05T13:25:24.536 INFO:tasks.workunit.client.1.smithi052.stdout:9/480: mknod d3/d1e/d62/c9f 0 2023-12-05T13:25:24.538 INFO:tasks.workunit.client.1.smithi052.stdout:3/597: rename da/d2e/d40/d9b to da/dd/d3d/dad/dc6 0 2023-12-05T13:25:24.538 INFO:tasks.workunit.client.1.smithi052.stdout:8/621: dread d0/de/d12/f85 [0,4194304] 0 2023-12-05T13:25:24.540 INFO:tasks.workunit.client.1.smithi052.stdout:2/596: mkdir d2/d13/d37/db2 0 2023-12-05T13:25:24.541 INFO:tasks.workunit.client.1.smithi052.stdout:4/564: dwrite de/d1e/f67 [0,4194304] 0 2023-12-05T13:25:24.542 INFO:tasks.workunit.client.1.smithi052.stdout:5/339: symlink d5/d15/l70 0 2023-12-05T13:25:24.546 INFO:tasks.workunit.client.1.smithi052.stdout:9/481: creat d3/d1e/d37/d4f/fa0 x:0 0 0 2023-12-05T13:25:24.546 INFO:tasks.workunit.client.1.smithi052.stdout:9/482: write d3/d1e/d37/d4f/f54 [763582,68148] 0 2023-12-05T13:25:24.546 INFO:tasks.workunit.client.1.smithi052.stdout:3/598: dread da/d2e/f85 [0,4194304] 0 2023-12-05T13:25:24.546 INFO:tasks.workunit.client.1.smithi052.stdout:1/528: truncate d5/d7/d35/d37/d68/d2a/f92 3064158 0 2023-12-05T13:25:24.546 INFO:tasks.workunit.client.1.smithi052.stdout:1/529: fdatasync d5/d7/d35/d37/d68/f32 0 2023-12-05T13:25:24.546 INFO:tasks.workunit.client.1.smithi052.stdout:8/622: mkdir d0/de/d12/d29/dcb 0 2023-12-05T13:25:24.548 INFO:tasks.workunit.client.1.smithi052.stdout:2/597: rmdir d2/d13/d1e 39 2023-12-05T13:25:24.551 INFO:tasks.workunit.client.1.smithi052.stdout:5/340: creat d5/d15/d21/d4a/d6e/f71 x:0 0 0 2023-12-05T13:25:24.552 INFO:tasks.workunit.client.1.smithi052.stdout:4/565: creat de/d30/d68/d5c/fba x:0 0 0 2023-12-05T13:25:24.552 INFO:tasks.workunit.client.1.smithi052.stdout:4/566: stat de/d29/d51/da3/d6d 0 2023-12-05T13:25:24.552 INFO:tasks.workunit.client.1.smithi052.stdout:4/567: fsync de/d29/d51/fb6 0 2023-12-05T13:25:24.552 INFO:tasks.workunit.client.1.smithi052.stdout:7/586: sync 2023-12-05T13:25:24.552 INFO:tasks.workunit.client.1.smithi052.stdout:6/419: sync 2023-12-05T13:25:24.554 INFO:tasks.workunit.client.1.smithi052.stdout:8/623: dread d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:25:24.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/483: creat d3/d1e/d41/d86/fa1 x:0 0 0 2023-12-05T13:25:24.555 INFO:tasks.workunit.client.1.smithi052.stdout:9/484: dread - d3/d31/f78 zero size 2023-12-05T13:25:24.555 INFO:tasks.workunit.client.1.smithi052.stdout:3/599: symlink da/dd/d3d/dad/dc6/lc7 0 2023-12-05T13:25:24.556 INFO:tasks.workunit.client.1.smithi052.stdout:1/530: mkdir d5/d7/d35/d37/d68/da4 0 2023-12-05T13:25:24.557 INFO:tasks.workunit.client.1.smithi052.stdout:2/598: symlink d2/d13/d1e/d6a/d7f/d84/lb3 0 2023-12-05T13:25:24.557 INFO:tasks.workunit.client.1.smithi052.stdout:2/599: chown d2/d13/d1e/f57 3483908 1 2023-12-05T13:25:24.558 INFO:tasks.workunit.client.1.smithi052.stdout:2/600: read d2/d4/d3f/f5b [1824708,92731] 0 2023-12-05T13:25:24.559 INFO:tasks.workunit.client.1.smithi052.stdout:2/601: write d2/d4/d3f/f5b [3325475,110936] 0 2023-12-05T13:25:24.559 INFO:tasks.workunit.client.1.smithi052.stdout:2/602: write d2/d13/f26 [8920563,65714] 0 2023-12-05T13:25:24.559 INFO:tasks.workunit.client.1.smithi052.stdout:2/603: dread - d2/d13/d1e/d6a/d7f/d84/d6e/f7a zero size 2023-12-05T13:25:24.560 INFO:tasks.workunit.client.1.smithi052.stdout:4/568: mkdir de/d30/dac/dbb 0 2023-12-05T13:25:24.560 INFO:tasks.workunit.client.1.smithi052.stdout:4/569: fdatasync de/d29/d51/fb6 0 2023-12-05T13:25:24.561 INFO:tasks.workunit.client.1.smithi052.stdout:6/420: mkdir d3/d4/d6/d26/d8e 0 2023-12-05T13:25:24.563 INFO:tasks.workunit.client.1.smithi052.stdout:7/587: symlink d7/d31/lc5 0 2023-12-05T13:25:24.564 INFO:tasks.workunit.client.1.smithi052.stdout:8/624: mknod d0/d62/ccc 0 2023-12-05T13:25:24.564 INFO:tasks.workunit.client.1.smithi052.stdout:8/625: stat d0/d62/fa9 0 2023-12-05T13:25:24.564 INFO:tasks.workunit.client.1.smithi052.stdout:8/626: dread - d0/d28/d39/d3a/d8f/fb2 zero size 2023-12-05T13:25:24.564 INFO:tasks.workunit.client.1.smithi052.stdout:8/627: chown d0/d28/db0/fbe 39468 1 2023-12-05T13:25:24.564 INFO:tasks.workunit.client.1.smithi052.stdout:8/628: dread - d0/d28/d2b/f96 zero size 2023-12-05T13:25:24.565 INFO:tasks.workunit.client.1.smithi052.stdout:5/341: dread f3 [0,4194304] 0 2023-12-05T13:25:24.565 INFO:tasks.workunit.client.1.smithi052.stdout:9/485: creat d3/d11/fa2 x:0 0 0 2023-12-05T13:25:24.565 INFO:tasks.workunit.client.1.smithi052.stdout:9/486: chown d3/d5e/f64 13 1 2023-12-05T13:25:24.565 INFO:tasks.workunit.client.1.smithi052.stdout:9/487: chown d3/d11/c72 54121707 1 2023-12-05T13:25:24.566 INFO:tasks.workunit.client.1.smithi052.stdout:1/531: write d5/d7/d35/d37/d68/d2a/f49 [524270,122138] 0 2023-12-05T13:25:24.566 INFO:tasks.workunit.client.1.smithi052.stdout:5/342: write d5/df/d11/d66/f6a [1532218,99239] 0 2023-12-05T13:25:24.567 INFO:tasks.workunit.client.1.smithi052.stdout:5/343: write d5/d15/d21/f5e [3829707,39558] 0 2023-12-05T13:25:24.567 INFO:tasks.workunit.client.1.smithi052.stdout:3/600: unlink da/d25/d33/d43/d5b/d94/fa0 0 2023-12-05T13:25:24.575 INFO:tasks.workunit.client.1.smithi052.stdout:4/570: symlink de/lbc 0 2023-12-05T13:25:24.575 INFO:tasks.workunit.client.1.smithi052.stdout:4/571: readlink de/l1c 0 2023-12-05T13:25:24.577 INFO:tasks.workunit.client.1.smithi052.stdout:6/421: creat d3/d4/df/d63/f8f x:0 0 0 2023-12-05T13:25:24.579 INFO:tasks.workunit.client.1.smithi052.stdout:7/588: unlink d7/d4e/d12/d3f/d46/l5e 0 2023-12-05T13:25:24.580 INFO:tasks.workunit.client.1.smithi052.stdout:8/629: rename d0/de/d12/d29/c83 to d0/d28/d39/d3a/ccd 0 2023-12-05T13:25:24.580 INFO:tasks.workunit.client.1.smithi052.stdout:8/630: chown d0/de/d12/d29/db3/dc5 311447 1 2023-12-05T13:25:24.581 INFO:tasks.workunit.client.1.smithi052.stdout:9/488: link d3/d31/c4b d3/d5e/ca3 0 2023-12-05T13:25:24.583 INFO:tasks.workunit.client.1.smithi052.stdout:5/344: rmdir d5/df/d4e/d69 0 2023-12-05T13:25:24.583 INFO:tasks.workunit.client.1.smithi052.stdout:5/345: readlink d5/df/d11/l3e 0 2023-12-05T13:25:24.586 INFO:tasks.workunit.client.1.smithi052.stdout:3/601: truncate da/d7a/fa3 2847797 0 2023-12-05T13:25:24.586 INFO:tasks.workunit.client.1.smithi052.stdout:3/602: stat da/d25/d33/c7b 0 2023-12-05T13:25:24.586 INFO:tasks.workunit.client.1.smithi052.stdout:4/572: link de/d1e/d24/la2 de/d29/d51/d76/d8f/lbd 0 2023-12-05T13:25:24.589 INFO:tasks.workunit.client.1.smithi052.stdout:7/589: rmdir d7/d2e/d81/db5 0 2023-12-05T13:25:24.593 INFO:tasks.workunit.client.1.smithi052.stdout:6/422: symlink d3/d5/d9/d21/d48/d4d/d66/l90 0 2023-12-05T13:25:24.594 INFO:tasks.workunit.client.1.smithi052.stdout:6/423: dread - d3/d4/d6/d26/f5d zero size 2023-12-05T13:25:24.594 INFO:tasks.workunit.client.1.smithi052.stdout:6/424: fdatasync d3/d4/d36/f8b 0 2023-12-05T13:25:24.598 INFO:tasks.workunit.client.1.smithi052.stdout:9/489: symlink d3/d11/d19/la4 0 2023-12-05T13:25:24.598 INFO:tasks.workunit.client.1.smithi052.stdout:7/590: creat d7/d31/d56/d60/fc6 x:0 0 0 2023-12-05T13:25:24.601 INFO:tasks.workunit.client.1.smithi052.stdout:1/532: dwrite d5/d7/f13 [0,4194304] 0 2023-12-05T13:25:24.604 INFO:tasks.workunit.client.1.smithi052.stdout:6/425: mkdir d3/d5/d9/d21/d48/d4d/d66/d91 0 2023-12-05T13:25:24.609 INFO:tasks.workunit.client.1.smithi052.stdout:8/631: dwrite d0/fa [0,4194304] 0 2023-12-05T13:25:24.609 INFO:tasks.workunit.client.1.smithi052.stdout:9/490: mknod d3/d31/ca5 0 2023-12-05T13:25:24.609 INFO:tasks.workunit.client.1.smithi052.stdout:7/591: mkdir d7/d4e/d12/d7d/dc7 0 2023-12-05T13:25:24.609 INFO:tasks.workunit.client.1.smithi052.stdout:9/491: truncate d3/f26 4609648 0 2023-12-05T13:25:24.609 INFO:tasks.workunit.client.1.smithi052.stdout:5/346: dwrite d5/d15/d21/d4a/d6e/f71 [0,4194304] 0 2023-12-05T13:25:24.610 INFO:tasks.workunit.client.1.smithi052.stdout:6/426: mknod d3/c92 0 2023-12-05T13:25:24.611 INFO:tasks.workunit.client.1.smithi052.stdout:3/603: dwrite da/d48/f8b [0,4194304] 0 2023-12-05T13:25:24.618 INFO:tasks.workunit.client.1.smithi052.stdout:3/604: dread da/fe [0,4194304] 0 2023-12-05T13:25:24.618 INFO:tasks.workunit.client.1.smithi052.stdout:7/592: dread d7/d4e/f2b [4194304,4194304] 0 2023-12-05T13:25:24.620 INFO:tasks.workunit.client.1.smithi052.stdout:8/632: mknod d0/cce 0 2023-12-05T13:25:24.623 INFO:tasks.workunit.client.1.smithi052.stdout:8/633: dread d0/d4d/f4c [0,4194304] 0 2023-12-05T13:25:24.623 INFO:tasks.workunit.client.1.smithi052.stdout:8/634: write d0/de/d12/fc6 [26891,125168] 0 2023-12-05T13:25:24.625 INFO:tasks.workunit.client.1.smithi052.stdout:9/492: write d3/d1e/d37/d4f/f67 [111571,112074] 0 2023-12-05T13:25:24.627 INFO:tasks.workunit.client.1.smithi052.stdout:4/573: rename de/d1e to de/d30/d73/dbe 0 2023-12-05T13:25:24.627 INFO:tasks.workunit.client.1.smithi052.stdout:4/574: fsync de/d30/d68/d5c/fba 0 2023-12-05T13:25:24.628 INFO:tasks.workunit.client.1.smithi052.stdout:4/575: chown de/d30/d73/dbe/d24/f4e 0 1 2023-12-05T13:25:24.628 INFO:tasks.workunit.client.1.smithi052.stdout:4/576: fsync de/d29/d51/da3/f82 0 2023-12-05T13:25:24.628 INFO:tasks.workunit.client.1.smithi052.stdout:4/577: stat de/d30/d73/dbe/d24 0 2023-12-05T13:25:24.628 INFO:tasks.workunit.client.1.smithi052.stdout:4/578: chown de/f14 7905827 1 2023-12-05T13:25:24.628 INFO:tasks.workunit.client.1.smithi052.stdout:2/604: dwrite d2/d13/d37/f69 [0,4194304] 0 2023-12-05T13:25:24.631 INFO:tasks.workunit.client.1.smithi052.stdout:5/347: creat d5/df/d4e/d65/f72 x:0 0 0 2023-12-05T13:25:24.633 INFO:tasks.workunit.client.1.smithi052.stdout:6/427: mknod d3/d5/d9/d21/d48/d4d/c93 0 2023-12-05T13:25:24.633 INFO:tasks.workunit.client.1.smithi052.stdout:6/428: chown d3/d4 24720 1 2023-12-05T13:25:24.639 INFO:tasks.workunit.client.1.smithi052.stdout:3/605: mknod da/dd/d3d/dad/dc6/cc8 0 2023-12-05T13:25:24.640 INFO:tasks.workunit.client.1.smithi052.stdout:7/593: mknod d7/d4e/d45/d5a/d16/cc8 0 2023-12-05T13:25:24.641 INFO:tasks.workunit.client.1.smithi052.stdout:8/635: mkdir d0/d28/d2b/dcf 0 2023-12-05T13:25:24.641 INFO:tasks.workunit.client.1.smithi052.stdout:8/636: chown d0/de/d27/d43/d44/l7d 370747641 1 2023-12-05T13:25:24.642 INFO:tasks.workunit.client.1.smithi052.stdout:9/493: link d3/d5e/f76 d3/d92/fa6 0 2023-12-05T13:25:24.644 INFO:tasks.workunit.client.1.smithi052.stdout:4/579: link de/d30/d73/dbe/d24/f6e de/d29/d51/da3/fbf 0 2023-12-05T13:25:24.644 INFO:tasks.workunit.client.1.smithi052.stdout:4/580: stat de/l13 0 2023-12-05T13:25:24.648 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:24 smithi029 ceph-mon[112128]: Deploying cephadm binary to smithi052 2023-12-05T13:25:24.648 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:24 smithi029 ceph-mon[112128]: Deploying cephadm binary to smithi029 2023-12-05T13:25:24.648 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:24 smithi029 ceph-mon[112128]: mgrmap e22: smithi052.ocazcp(active, since 1.00986s) 2023-12-05T13:25:24.648 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:24 smithi029 ceph-mon[112128]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2023-12-05T13:25:24.648 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:24 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:24.648 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:24 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:24.650 INFO:tasks.workunit.client.1.smithi052.stdout:6/429: link d3/d5/d9/f3a d3/d4/d6/f94 0 2023-12-05T13:25:24.652 INFO:tasks.workunit.client.1.smithi052.stdout:3/606: link da/dd/c6b da/d25/d33/d43/d5b/da6/cc9 0 2023-12-05T13:25:24.654 INFO:tasks.workunit.client.1.smithi052.stdout:7/594: truncate d7/d4e/d12/d7d/fa3 546787 0 2023-12-05T13:25:24.654 INFO:tasks.workunit.client.1.smithi052.stdout:8/637: dwrite d0/de/f38 [0,4194304] 0 2023-12-05T13:25:24.656 INFO:tasks.workunit.client.1.smithi052.stdout:9/494: mkdir d3/d5e/da7 0 2023-12-05T13:25:24.658 INFO:tasks.workunit.client.1.smithi052.stdout:4/581: rename de/d30/d73/dbe/fb9 to de/d2b/fc0 0 2023-12-05T13:25:24.660 INFO:tasks.workunit.client.1.smithi052.stdout:6/430: creat d3/d4/d6/d26/f95 x:0 0 0 2023-12-05T13:25:24.664 INFO:tasks.workunit.client.1.smithi052.stdout:7/595: read d7/d31/f3e [438077,71040] 0 2023-12-05T13:25:24.664 INFO:tasks.workunit.client.1.smithi052.stdout:7/596: write d7/d4e/d45/d5a/d66/f8c [790798,120450] 0 2023-12-05T13:25:24.666 INFO:tasks.workunit.client.1.smithi052.stdout:9/495: mkdir d3/d92/da8 0 2023-12-05T13:25:24.666 INFO:tasks.workunit.client.1.smithi052.stdout:9/496: read - d3/d1e/d41/d57/f82 zero size 2023-12-05T13:25:24.666 INFO:tasks.workunit.client.1.smithi052.stdout:4/582: creat de/d29/d51/fc1 x:0 0 0 2023-12-05T13:25:24.667 INFO:tasks.workunit.client.1.smithi052.stdout:4/583: fsync de/d2b/f2d 0 2023-12-05T13:25:24.667 INFO:tasks.workunit.client.1.smithi052.stdout:7/597: write d7/d4e/d45/d5a/d16/f30 [4027675,52700] 0 2023-12-05T13:25:24.668 INFO:tasks.workunit.client.1.smithi052.stdout:6/431: creat d3/d4/df/d27/f96 x:0 0 0 2023-12-05T13:25:24.668 INFO:tasks.workunit.client.1.smithi052.stdout:6/432: truncate d3/d4/df/d63/f71 958641 0 2023-12-05T13:25:24.669 INFO:tasks.workunit.client.1.smithi052.stdout:9/497: link d3/d31/c98 d3/d11/d19/d83/ca9 0 2023-12-05T13:25:24.671 INFO:tasks.workunit.client.1.smithi052.stdout:0/586: sync 2023-12-05T13:25:24.672 INFO:tasks.workunit.client.1.smithi052.stdout:7/598: rename d7/d4e/d12/d3f/c6f to d7/d4e/d86/cc9 0 2023-12-05T13:25:24.673 INFO:tasks.workunit.client.1.smithi052.stdout:3/607: dwrite da/dd/f90 [0,4194304] 0 2023-12-05T13:25:24.674 INFO:tasks.workunit.client.1.smithi052.stdout:6/433: creat d3/d5/d58/f97 x:0 0 0 2023-12-05T13:25:24.674 INFO:tasks.workunit.client.1.smithi052.stdout:4/584: unlink de/d29/d51/d76/d8f/lbd 0 2023-12-05T13:25:24.675 INFO:tasks.workunit.client.1.smithi052.stdout:9/498: symlink d3/d1e/d41/laa 0 2023-12-05T13:25:24.676 INFO:tasks.workunit.client.1.smithi052.stdout:4/585: write de/d29/d51/f6b [3618777,108489] 0 2023-12-05T13:25:24.676 INFO:tasks.workunit.client.1.smithi052.stdout:4/586: chown de/d30/d73/dbe/d24/cab 220988 1 2023-12-05T13:25:24.677 INFO:tasks.workunit.client.1.smithi052.stdout:0/587: getdents d0/db/d1b/d51 0 2023-12-05T13:25:24.679 INFO:tasks.workunit.client.1.smithi052.stdout:7/599: truncate d7/d4e/f1a 5073407 0 2023-12-05T13:25:24.679 INFO:tasks.workunit.client.1.smithi052.stdout:7/600: chown d7/d4e/d45/d79 435786 1 2023-12-05T13:25:24.680 INFO:tasks.workunit.client.1.smithi052.stdout:3/608: dread da/d25/f37 [0,4194304] 0 2023-12-05T13:25:24.683 INFO:tasks.workunit.client.1.smithi052.stdout:6/434: symlink d3/d5/d9/d21/d48/d4d/d81/d82/l98 0 2023-12-05T13:25:24.688 INFO:tasks.workunit.client.1.smithi052.stdout:9/499: symlink d3/d11/d19/d83/lab 0 2023-12-05T13:25:24.688 INFO:tasks.workunit.client.1.smithi052.stdout:9/500: chown d3/c9 200 1 2023-12-05T13:25:24.688 INFO:tasks.workunit.client.1.smithi052.stdout:9/501: dread - d3/d11/fa2 zero size 2023-12-05T13:25:24.689 INFO:tasks.workunit.client.1.smithi052.stdout:5/348: write d5/f14 [3957170,94821] 0 2023-12-05T13:25:24.692 INFO:tasks.workunit.client.1.smithi052.stdout:7/601: mknod d7/d4e/d45/cca 0 2023-12-05T13:25:24.693 INFO:tasks.workunit.client.1.smithi052.stdout:3/609: symlink da/d2e/d40/lca 0 2023-12-05T13:25:24.696 INFO:tasks.workunit.client.1.smithi052.stdout:6/435: rename d3/d5/d9/d21/d48/d4d/d81/d82/l98 to d3/l99 0 2023-12-05T13:25:24.697 INFO:tasks.workunit.client.1.smithi052.stdout:6/436: chown d3/d4/df/d27/f47 0 1 2023-12-05T13:25:24.699 INFO:tasks.workunit.client.1.smithi052.stdout:0/588: truncate d0/db/d20/d50/f5d 1893176 0 2023-12-05T13:25:24.699 INFO:tasks.workunit.client.1.smithi052.stdout:0/589: chown d0/db/d1b/d29/c3c 498 1 2023-12-05T13:25:24.703 INFO:tasks.workunit.client.1.smithi052.stdout:3/610: unlink da/f21 0 2023-12-05T13:25:24.705 INFO:tasks.workunit.client.1.smithi052.stdout:4/587: dwrite de/d30/d73/dbe/d24/f8c [0,4194304] 0 2023-12-05T13:25:24.709 INFO:tasks.workunit.client.1.smithi052.stdout:9/502: dwrite d3/d1e/d37/d4f/f54 [0,4194304] 0 2023-12-05T13:25:24.712 INFO:tasks.workunit.client.1.smithi052.stdout:3/611: stat da/d7a/l82 0 2023-12-05T13:25:24.712 INFO:tasks.workunit.client.1.smithi052.stdout:3/612: read - da/d25/d33/d49/fb0 zero size 2023-12-05T13:25:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:24 smithi052 ceph-mon[121072]: Deploying cephadm binary to smithi052 2023-12-05T13:25:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:24 smithi052 ceph-mon[121072]: Deploying cephadm binary to smithi029 2023-12-05T13:25:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:24 smithi052 ceph-mon[121072]: mgrmap e22: smithi052.ocazcp(active, since 1.00986s) 2023-12-05T13:25:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:24 smithi052 ceph-mon[121072]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2023-12-05T13:25:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:24 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:24 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:24.726 INFO:tasks.workunit.client.1.smithi052.stdout:7/602: dwrite d7/d4e/f36 [0,4194304] 0 2023-12-05T13:25:24.728 INFO:tasks.workunit.client.1.smithi052.stdout:8/638: dwrite d0/d28/d39/d3a/f47 [0,4194304] 0 2023-12-05T13:25:24.730 INFO:tasks.workunit.client.1.smithi052.stdout:7/603: symlink d7/d4e/d45/d79/lcb 0 2023-12-05T13:25:24.730 INFO:tasks.workunit.client.1.smithi052.stdout:8/639: getdents d0/d28/d39 0 2023-12-05T13:25:24.730 INFO:tasks.workunit.client.1.smithi052.stdout:6/437: dwrite d3/d4/d6/f4b [0,4194304] 0 2023-12-05T13:25:24.730 INFO:tasks.workunit.client.1.smithi052.stdout:8/640: readlink d0/de/d12/l80 0 2023-12-05T13:25:24.733 INFO:tasks.workunit.client.1.smithi052.stdout:7/604: rmdir d7/d4e/d45/d5a/d66 39 2023-12-05T13:25:24.736 INFO:tasks.workunit.client.1.smithi052.stdout:4/588: write de/d30/d73/f9a [1001685,41886] 0 2023-12-05T13:25:24.736 INFO:tasks.workunit.client.1.smithi052.stdout:3/613: read da/dd/f90 [2813703,43177] 0 2023-12-05T13:25:24.737 INFO:tasks.workunit.client.1.smithi052.stdout:0/590: dwrite d0/db/d52/d7f/f98 [0,4194304] 0 2023-12-05T13:25:24.737 INFO:tasks.workunit.client.1.smithi052.stdout:0/591: truncate d0/db/d1b/d51/f69 779099 0 2023-12-05T13:25:24.737 INFO:tasks.workunit.client.1.smithi052.stdout:0/592: chown d0/db/d1b/d29/db0/lb2 3 1 2023-12-05T13:25:24.746 INFO:tasks.workunit.client.1.smithi052.stdout:4/589: mknod de/d30/d73/cc2 0 2023-12-05T13:25:24.746 INFO:tasks.workunit.client.1.smithi052.stdout:9/503: dwrite d3/d2a/f4e [4194304,4194304] 0 2023-12-05T13:25:24.746 INFO:tasks.workunit.client.1.smithi052.stdout:4/590: readlink de/d29/d51/da3/lad 0 2023-12-05T13:25:24.746 INFO:tasks.workunit.client.1.smithi052.stdout:7/605: mkdir d7/d4e/d45/d5a/d66/dcc 0 2023-12-05T13:25:24.746 INFO:tasks.workunit.client.1.smithi052.stdout:7/606: write d7/d31/d56/f58 [335920,56143] 0 2023-12-05T13:25:24.752 INFO:tasks.workunit.client.1.smithi052.stdout:4/591: creat de/d29/d51/da3/d6d/fc3 x:0 0 0 2023-12-05T13:25:24.752 INFO:tasks.workunit.client.1.smithi052.stdout:4/592: chown de/d2b/d64/d69/l62 3238879 1 2023-12-05T13:25:24.752 INFO:tasks.workunit.client.1.smithi052.stdout:9/504: unlink d3/d2a/d5c/l85 0 2023-12-05T13:25:24.753 INFO:tasks.workunit.client.1.smithi052.stdout:4/593: mkdir de/d29/d51/d76/dc4 0 2023-12-05T13:25:24.754 INFO:tasks.workunit.client.1.smithi052.stdout:4/594: chown de/d29/d51/da3/d6d/c9c 10037 1 2023-12-05T13:25:24.754 INFO:tasks.workunit.client.1.smithi052.stdout:4/595: read - de/d30/d68/d5c/faf zero size 2023-12-05T13:25:24.755 INFO:tasks.workunit.client.1.smithi052.stdout:9/505: creat d3/d11/d96/fac x:0 0 0 2023-12-05T13:25:24.756 INFO:tasks.workunit.client.1.smithi052.stdout:1/533: sync 2023-12-05T13:25:24.757 INFO:tasks.workunit.client.1.smithi052.stdout:3/614: dwrite da/dd/f26 [0,4194304] 0 2023-12-05T13:25:24.758 INFO:tasks.workunit.client.1.smithi052.stdout:6/438: dwrite d3/d4/df/d27/f56 [0,4194304] 0 2023-12-05T13:25:24.758 INFO:tasks.workunit.client.1.smithi052.stdout:4/596: truncate de/d30/d73/dbe/d24/f6e 1899701 0 2023-12-05T13:25:24.758 INFO:tasks.workunit.client.1.smithi052.stdout:4/597: chown de/d29/d51/da3/d6d/c86 27956813 1 2023-12-05T13:25:24.759 INFO:tasks.workunit.client.1.smithi052.stdout:3/615: write da/d27/f2d [790117,34564] 0 2023-12-05T13:25:24.762 INFO:tasks.workunit.client.1.smithi052.stdout:1/534: creat d5/d7/d35/d37/d68/da4/fa5 x:0 0 0 2023-12-05T13:25:24.762 INFO:tasks.workunit.client.1.smithi052.stdout:1/535: chown d5/d7/d35/d37/d5a/d73/d7e/c8d 34 1 2023-12-05T13:25:24.763 INFO:tasks.workunit.client.1.smithi052.stdout:0/593: dwrite d0/db/d52/d7f/fa7 [0,4194304] 0 2023-12-05T13:25:24.768 INFO:tasks.workunit.client.1.smithi052.stdout:6/439: rmdir d3/d5/d9/d21 39 2023-12-05T13:25:24.771 INFO:tasks.workunit.client.1.smithi052.stdout:6/440: dread d3/d4/d6/f11 [0,4194304] 0 2023-12-05T13:25:24.771 INFO:tasks.workunit.client.1.smithi052.stdout:6/441: write d3/d4/d6/f25 [4332168,111799] 0 2023-12-05T13:25:24.771 INFO:tasks.workunit.client.1.smithi052.stdout:1/536: getdents d5/d7/d35/d2f/d3e/d62 0 2023-12-05T13:25:24.771 INFO:tasks.workunit.client.1.smithi052.stdout:1/537: chown d5/d26/d41/l8a 226136245 1 2023-12-05T13:25:24.772 INFO:tasks.workunit.client.1.smithi052.stdout:4/598: truncate de/d30/f8a 3442571 0 2023-12-05T13:25:24.772 INFO:tasks.workunit.client.1.smithi052.stdout:4/599: chown de/d2b/d64/lb4 75 1 2023-12-05T13:25:24.773 INFO:tasks.workunit.client.1.smithi052.stdout:6/442: mknod d3/d5/d9/d21/d5f/c9a 0 2023-12-05T13:25:24.773 INFO:tasks.workunit.client.1.smithi052.stdout:6/443: chown d3/f19 47479173 1 2023-12-05T13:25:24.775 INFO:tasks.workunit.client.1.smithi052.stdout:1/538: creat d5/d7/de/d74/d99/fa6 x:0 0 0 2023-12-05T13:25:24.777 INFO:tasks.workunit.client.1.smithi052.stdout:4/600: rename de/d30/d68/c63 to de/d30/d73/dbe/cc5 0 2023-12-05T13:25:24.777 INFO:tasks.workunit.client.1.smithi052.stdout:4/601: fsync de/d2b/f2d 0 2023-12-05T13:25:24.779 INFO:tasks.workunit.client.1.smithi052.stdout:6/444: unlink d3/d5/d9/d21/c4a 0 2023-12-05T13:25:24.781 INFO:tasks.workunit.client.1.smithi052.stdout:1/539: link d5/d7/d35/d37/d68/d17/d3c/c45 d5/d7/de/d18/ca7 0 2023-12-05T13:25:24.782 INFO:tasks.workunit.client.1.smithi052.stdout:4/602: symlink de/d2b/d64/lc6 0 2023-12-05T13:25:24.782 INFO:tasks.workunit.client.1.smithi052.stdout:4/603: chown de/d2b/d80 16037 1 2023-12-05T13:25:24.783 INFO:tasks.workunit.client.1.smithi052.stdout:1/540: rmdir d5/d7/d35/d37 39 2023-12-05T13:25:24.783 INFO:tasks.workunit.client.1.smithi052.stdout:1/541: chown d5/d7/d35/d37/d68/l7b 2 1 2023-12-05T13:25:24.785 INFO:tasks.workunit.client.1.smithi052.stdout:4/604: creat de/d29/d51/d76/dc4/fc7 x:0 0 0 2023-12-05T13:25:24.787 INFO:tasks.workunit.client.1.smithi052.stdout:1/542: unlink d5/d7/d35/d2f/c67 0 2023-12-05T13:25:24.787 INFO:tasks.workunit.client.1.smithi052.stdout:1/543: write d5/d7/d35/d37/d68/d2a/f92 [248010,113870] 0 2023-12-05T13:25:24.789 INFO:tasks.workunit.client.1.smithi052.stdout:1/544: getdents d5/d7/d35/d37/d68/d79 0 2023-12-05T13:25:24.791 INFO:tasks.workunit.client.1.smithi052.stdout:1/545: creat d5/fa8 x:0 0 0 2023-12-05T13:25:24.792 INFO:tasks.workunit.client.1.smithi052.stdout:1/546: truncate d5/d7/d35/d37/d68/f55 597039 0 2023-12-05T13:25:24.793 INFO:tasks.workunit.client.1.smithi052.stdout:1/547: write d5/d7/d35/f5c [3162512,47021] 0 2023-12-05T13:25:24.823 INFO:tasks.workunit.client.1.smithi052.stdout:1/548: read d5/d7/f4b [86542,35704] 0 2023-12-05T13:25:24.823 INFO:tasks.workunit.client.1.smithi052.stdout:0/594: read d0/db/d52/f7d [8404718,62702] 0 2023-12-05T13:25:24.826 INFO:tasks.workunit.client.1.smithi052.stdout:1/549: symlink d5/d7/d35/d37/d68/d17/la9 0 2023-12-05T13:25:24.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/506: dwrite d3/d2a/f30 [0,4194304] 0 2023-12-05T13:25:24.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/507: chown d3/d92 0 1 2023-12-05T13:25:24.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/508: stat d3/d1e/d37/d4f/c58 0 2023-12-05T13:25:24.830 INFO:tasks.workunit.client.1.smithi052.stdout:9/509: read - d3/d11/d96/fac zero size 2023-12-05T13:25:24.830 INFO:tasks.workunit.client.1.smithi052.stdout:7/607: dwrite d7/d4e/f61 [4194304,4194304] 0 2023-12-05T13:25:24.834 INFO:tasks.workunit.client.1.smithi052.stdout:3/616: dwrite da/d25/d33/d43/d5b/f67 [0,4194304] 0 2023-12-05T13:25:24.834 INFO:tasks.workunit.client.1.smithi052.stdout:9/510: unlink d3/d1e/d41/laa 0 2023-12-05T13:25:24.834 INFO:tasks.workunit.client.1.smithi052.stdout:9/511: fdatasync d3/d1e/d37/d4f/fa0 0 2023-12-05T13:25:24.836 INFO:tasks.workunit.client.1.smithi052.stdout:4/605: fsync de/d29/d51/da3/d6d/fc3 0 2023-12-05T13:25:24.836 INFO:tasks.workunit.client.1.smithi052.stdout:4/606: fdatasync de/d29/f2e 0 2023-12-05T13:25:24.844 INFO:tasks.workunit.client.1.smithi052.stdout:1/550: dwrite d5/f8 [0,4194304] 0 2023-12-05T13:25:24.845 INFO:tasks.workunit.client.1.smithi052.stdout:1/551: truncate d5/d7/de/d74/f77 538992 0 2023-12-05T13:25:24.845 INFO:tasks.workunit.client.1.smithi052.stdout:1/552: chown d5/d7/f4b 537667743 1 2023-12-05T13:25:24.845 INFO:tasks.workunit.client.1.smithi052.stdout:7/608: creat d7/d4e/d45/d5a/fcd x:0 0 0 2023-12-05T13:25:24.845 INFO:tasks.workunit.client.1.smithi052.stdout:7/609: write d7/d4e/d45/d5a/d63/f6d [924452,7647] 0 2023-12-05T13:25:24.846 INFO:tasks.workunit.client.1.smithi052.stdout:3/617: link l8 da/d25/d33/lcb 0 2023-12-05T13:25:24.848 INFO:tasks.workunit.client.1.smithi052.stdout:9/512: link d3/d5e/f76 d3/d2a/d8f/fad 0 2023-12-05T13:25:24.849 INFO:tasks.workunit.client.1.smithi052.stdout:4/607: mknod de/d29/d51/da3/cc8 0 2023-12-05T13:25:24.855 INFO:tasks.workunit.client.1.smithi052.stdout:7/610: mkdir d7/dce 0 2023-12-05T13:25:24.858 INFO:tasks.workunit.client.1.smithi052.stdout:3/618: unlink da/d2e/d40/f5d 0 2023-12-05T13:25:24.860 INFO:tasks.workunit.client.1.smithi052.stdout:4/608: dread de/d29/f2e [0,4194304] 0 2023-12-05T13:25:24.861 INFO:tasks.workunit.client.1.smithi052.stdout:9/513: dwrite d3/d2a/d8f/fad [0,4194304] 0 2023-12-05T13:25:24.863 INFO:tasks.workunit.client.1.smithi052.stdout:7/611: creat d7/d4e/d45/d5a/fcf x:0 0 0 2023-12-05T13:25:24.866 INFO:tasks.workunit.client.1.smithi052.stdout:9/514: creat d3/d11/d19/d83/fae x:0 0 0 2023-12-05T13:25:24.869 INFO:tasks.workunit.client.1.smithi052.stdout:9/515: mkdir d3/d5e/da7/daf 0 2023-12-05T13:25:24.869 INFO:tasks.workunit.client.1.smithi052.stdout:9/516: chown d3/d1e/d62/l8b 700206 1 2023-12-05T13:25:24.869 INFO:tasks.workunit.client.1.smithi052.stdout:9/517: readlink d3/d1e/l5a 0 2023-12-05T13:25:24.870 INFO:tasks.workunit.client.1.smithi052.stdout:1/553: rename d5/d7/d35/d37/d68 to d5/daa 0 2023-12-05T13:25:24.870 INFO:tasks.workunit.client.1.smithi052.stdout:1/554: readlink d5/daa/d2a/l2b 0 2023-12-05T13:25:24.870 INFO:tasks.workunit.client.1.smithi052.stdout:1/555: readlink d5/d7/de/d18/l34 0 2023-12-05T13:25:24.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/612: link d7/d4e/d45/d93/fbe d7/d4e/d12/fd0 0 2023-12-05T13:25:24.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/613: write d7/d4e/d45/d93/fbe [170518,112663] 0 2023-12-05T13:25:24.872 INFO:tasks.workunit.client.1.smithi052.stdout:0/595: write d0/db/d1b/d42/f45 [1094172,119914] 0 2023-12-05T13:25:24.873 INFO:tasks.workunit.client.1.smithi052.stdout:9/518: rmdir d3/d1e/d62 39 2023-12-05T13:25:24.874 INFO:tasks.workunit.client.1.smithi052.stdout:3/619: rename da/d25/d33/c65 to da/ccc 0 2023-12-05T13:25:24.875 INFO:tasks.workunit.client.1.smithi052.stdout:3/620: write da/dd/f55 [845545,29931] 0 2023-12-05T13:25:24.875 INFO:tasks.workunit.client.1.smithi052.stdout:1/556: creat d5/d7/d35/d2f/d3e/d62/d85/fab x:0 0 0 2023-12-05T13:25:24.878 INFO:tasks.workunit.client.1.smithi052.stdout:7/614: mknod d7/d4e/d45/d5a/d63/d95/cd1 0 2023-12-05T13:25:24.878 INFO:tasks.workunit.client.1.smithi052.stdout:7/615: chown d7/d4e/d12/d3f/d46/f4a 40403 1 2023-12-05T13:25:24.879 INFO:tasks.workunit.client.1.smithi052.stdout:0/596: creat d0/db/d52/d7f/d8f/fc2 x:0 0 0 2023-12-05T13:25:24.881 INFO:tasks.workunit.client.1.smithi052.stdout:9/519: link d3/d1e/d62/l6b d3/d11/d3e/lb0 0 2023-12-05T13:25:24.881 INFO:tasks.workunit.client.1.smithi052.stdout:9/520: write d3/d2a/d5c/f8c [911905,122958] 0 2023-12-05T13:25:24.881 INFO:tasks.workunit.client.1.smithi052.stdout:9/521: write d3/d2a/d8f/f9a [1020783,28586] 0 2023-12-05T13:25:24.882 INFO:tasks.workunit.client.1.smithi052.stdout:1/557: mkdir d5/d7/d35/d37/d5a/d73/dac 0 2023-12-05T13:25:24.883 INFO:tasks.workunit.client.1.smithi052.stdout:7/616: mknod d7/d4e/db4/cd2 0 2023-12-05T13:25:24.883 INFO:tasks.workunit.client.1.smithi052.stdout:7/617: readlink d7/l39 0 2023-12-05T13:25:24.884 INFO:tasks.workunit.client.1.smithi052.stdout:0/597: truncate d0/f6 739043 0 2023-12-05T13:25:24.884 INFO:tasks.workunit.client.1.smithi052.stdout:0/598: fsync d0/f4 0 2023-12-05T13:25:24.884 INFO:tasks.workunit.client.1.smithi052.stdout:3/621: dread f4 [0,4194304] 0 2023-12-05T13:25:24.885 INFO:tasks.workunit.client.1.smithi052.stdout:9/522: creat d3/d5e/da7/daf/fb1 x:0 0 0 2023-12-05T13:25:24.885 INFO:tasks.workunit.client.1.smithi052.stdout:9/523: fdatasync d3/d2a/f30 0 2023-12-05T13:25:24.885 INFO:tasks.workunit.client.1.smithi052.stdout:1/558: mkdir d5/d26/d75/d7a/dad 0 2023-12-05T13:25:24.887 INFO:tasks.workunit.client.1.smithi052.stdout:7/618: mknod d7/d4e/d86/cd3 0 2023-12-05T13:25:24.887 INFO:tasks.workunit.client.1.smithi052.stdout:7/619: write d7/d4e/d45/d5a/fcf [102939,24147] 0 2023-12-05T13:25:24.887 INFO:tasks.workunit.client.1.smithi052.stdout:2/605: sync 2023-12-05T13:25:24.887 INFO:tasks.workunit.client.1.smithi052.stdout:0/599: getdents d0/db/d65 0 2023-12-05T13:25:24.888 INFO:tasks.workunit.client.1.smithi052.stdout:0/600: chown d0/db/d65/l73 232919736 1 2023-12-05T13:25:24.890 INFO:tasks.workunit.client.1.smithi052.stdout:3/622: truncate da/d25/fb5 19919 0 2023-12-05T13:25:24.890 INFO:tasks.workunit.client.1.smithi052.stdout:3/623: chown da/dd/l9e 6556458 1 2023-12-05T13:25:24.890 INFO:tasks.workunit.client.1.smithi052.stdout:3/624: read - da/dd/d3d/f76 zero size 2023-12-05T13:25:24.890 INFO:tasks.workunit.client.1.smithi052.stdout:5/349: sync 2023-12-05T13:25:24.891 INFO:tasks.workunit.client.1.smithi052.stdout:3/625: write da/d25/d33/d43/d5b/f67 [2977131,120780] 0 2023-12-05T13:25:24.891 INFO:tasks.workunit.client.1.smithi052.stdout:9/524: chown d3/d1e/d37/d4f/f65 8057784 1 2023-12-05T13:25:24.891 INFO:tasks.workunit.client.1.smithi052.stdout:9/525: dread - d3/d11/d19/d83/fae zero size 2023-12-05T13:25:24.892 INFO:tasks.workunit.client.1.smithi052.stdout:9/526: write d3/d11/d19/f53 [1834533,71215] 0 2023-12-05T13:25:24.892 INFO:tasks.workunit.client.1.smithi052.stdout:1/559: mkdir d5/d7/d35/d37/d5a/d73/dae 0 2023-12-05T13:25:24.894 INFO:tasks.workunit.client.1.smithi052.stdout:7/620: creat d7/d4e/d86/fd4 x:0 0 0 2023-12-05T13:25:24.894 INFO:tasks.workunit.client.1.smithi052.stdout:7/621: stat d7/d4e/f2b 0 2023-12-05T13:25:24.896 INFO:tasks.workunit.client.1.smithi052.stdout:2/606: mkdir d2/d13/d37/d5c/d80/db4 0 2023-12-05T13:25:24.899 INFO:tasks.workunit.client.1.smithi052.stdout:5/350: mkdir d5/df/d11/d73 0 2023-12-05T13:25:24.901 INFO:tasks.workunit.client.1.smithi052.stdout:3/626: rename da/dd/d3d/dad to da/d25/dcd 0 2023-12-05T13:25:24.904 INFO:tasks.workunit.client.1.smithi052.stdout:9/527: symlink d3/d1e/lb2 0 2023-12-05T13:25:24.904 INFO:tasks.workunit.client.1.smithi052.stdout:9/528: write d3/d1e/d37/d4f/f67 [1078435,63172] 0 2023-12-05T13:25:24.906 INFO:tasks.workunit.client.1.smithi052.stdout:1/560: creat d5/daa/d79/faf x:0 0 0 2023-12-05T13:25:24.908 INFO:tasks.workunit.client.1.smithi052.stdout:0/601: dwrite d0/db/d52/d7f/fa7 [4194304,4194304] 0 2023-12-05T13:25:24.914 INFO:tasks.workunit.client.1.smithi052.stdout:7/622: getdents d7/d4e/d45/d5a/d63/d95 0 2023-12-05T13:25:24.924 INFO:tasks.workunit.client.1.smithi052.stdout:7/623: write d7/d4e/d12/d3f/d46/f47 [8223565,102836] 0 2023-12-05T13:25:24.924 INFO:tasks.workunit.client.1.smithi052.stdout:7/624: write d7/d4e/d12/f34 [4448922,88740] 0 2023-12-05T13:25:24.924 INFO:tasks.workunit.client.1.smithi052.stdout:7/625: chown d7/d4e/d45/d5a/d63/d95/ca5 145881207 1 2023-12-05T13:25:24.924 INFO:tasks.workunit.client.1.smithi052.stdout:7/626: truncate d7/d31/d56/d60/f69 1582243 0 2023-12-05T13:25:24.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/607: dwrite d2/f5d [0,4194304] 0 2023-12-05T13:25:24.933 INFO:tasks.workunit.client.1.smithi052.stdout:9/529: dwrite d3/d1e/d41/d86/f91 [0,4194304] 0 2023-12-05T13:25:24.933 INFO:tasks.workunit.client.1.smithi052.stdout:5/351: dwrite d5/df/d11/f2b [0,4194304] 0 2023-12-05T13:25:24.933 INFO:tasks.workunit.client.1.smithi052.stdout:5/352: dread - d5/d15/d21/d25/d3f/d5c/f4f zero size 2023-12-05T13:25:24.933 INFO:tasks.workunit.client.1.smithi052.stdout:5/353: write d5/df/f36 [885166,73652] 0 2023-12-05T13:25:24.934 INFO:tasks.workunit.client.1.smithi052.stdout:2/608: rename d2/d4/d63/d6d/f85 to d2/d13/d7c/fb5 0 2023-12-05T13:25:24.934 INFO:tasks.workunit.client.1.smithi052.stdout:2/609: stat d2/d13/d37/d5c/d80/c86 0 2023-12-05T13:25:24.935 INFO:tasks.workunit.client.1.smithi052.stdout:3/627: dwrite da/d25/d33/d89/f91 [0,4194304] 0 2023-12-05T13:25:24.938 INFO:tasks.workunit.client.1.smithi052.stdout:1/561: dwrite d5/d7/d35/d37/d5a/d73/f84 [0,4194304] 0 2023-12-05T13:25:24.948 INFO:tasks.workunit.client.1.smithi052.stdout:5/354: mkdir d5/df/d4b/d74 0 2023-12-05T13:25:24.948 INFO:tasks.workunit.client.1.smithi052.stdout:7/627: dwrite d7/d4e/d12/f8b [0,4194304] 0 2023-12-05T13:25:24.949 INFO:tasks.workunit.client.1.smithi052.stdout:2/610: link d2/d13/d1e/d6a/d7f/d84/f4f d2/d13/d37/d5c/fb6 0 2023-12-05T13:25:24.955 INFO:tasks.workunit.client.1.smithi052.stdout:9/530: dwrite d3/d31/f45 [0,4194304] 0 2023-12-05T13:25:24.955 INFO:tasks.workunit.client.1.smithi052.stdout:7/628: write d7/d4e/f36 [404249,77356] 0 2023-12-05T13:25:24.955 INFO:tasks.workunit.client.1.smithi052.stdout:3/628: dwrite da/dd/f90 [4194304,4194304] 0 2023-12-05T13:25:24.963 INFO:tasks.workunit.client.1.smithi052.stdout:5/355: dread d5/df/d4e/d5b/f6f [0,4194304] 0 2023-12-05T13:25:24.963 INFO:tasks.workunit.client.1.smithi052.stdout:2/611: creat d2/d13/d1e/dae/fb7 x:0 0 0 2023-12-05T13:25:24.963 INFO:tasks.workunit.client.1.smithi052.stdout:1/562: mknod d5/d7/d35/d37/d5a/d73/d7e/cb0 0 2023-12-05T13:25:24.963 INFO:tasks.workunit.client.1.smithi052.stdout:1/563: fsync d5/d7/d35/d2f/f7f 0 2023-12-05T13:25:24.964 INFO:tasks.workunit.client.1.smithi052.stdout:9/531: write d3/d1e/d37/d4f/f7d [1178927,49586] 0 2023-12-05T13:25:24.965 INFO:tasks.workunit.client.1.smithi052.stdout:3/629: rename da/d48/f8b to da/d2e/d40/d6d/dba/fce 0 2023-12-05T13:25:24.966 INFO:tasks.workunit.client.1.smithi052.stdout:5/356: creat d5/d15/d21/f75 x:0 0 0 2023-12-05T13:25:24.967 INFO:tasks.workunit.client.1.smithi052.stdout:2/612: creat d2/d13/d37/d61/fb8 x:0 0 0 2023-12-05T13:25:24.968 INFO:tasks.workunit.client.1.smithi052.stdout:1/564: getdents d5/d26 0 2023-12-05T13:25:24.969 INFO:tasks.workunit.client.1.smithi052.stdout:9/532: creat d3/d1e/d41/d57/fb3 x:0 0 0 2023-12-05T13:25:24.969 INFO:tasks.workunit.client.1.smithi052.stdout:7/629: dwrite d7/d4e/d12/f8d [0,4194304] 0 2023-12-05T13:25:24.970 INFO:tasks.workunit.client.1.smithi052.stdout:3/630: mkdir da/d25/d33/d89/dae/dcf 0 2023-12-05T13:25:24.970 INFO:tasks.workunit.client.1.smithi052.stdout:3/631: dread - da/d25/d33/fc5 zero size 2023-12-05T13:25:24.972 INFO:tasks.workunit.client.1.smithi052.stdout:2/613: getdents d2/d13/d45 0 2023-12-05T13:25:24.972 INFO:tasks.workunit.client.1.smithi052.stdout:2/614: stat d2/d13/d48 0 2023-12-05T13:25:24.972 INFO:tasks.workunit.client.1.smithi052.stdout:1/565: mkdir d5/d7/d35/d2f/db1 0 2023-12-05T13:25:24.972 INFO:tasks.workunit.client.1.smithi052.stdout:1/566: stat d5/daa/d2a/l5e 0 2023-12-05T13:25:24.973 INFO:tasks.workunit.client.1.smithi052.stdout:2/615: write d2/f3c [214375,22775] 0 2023-12-05T13:25:24.973 INFO:tasks.workunit.client.1.smithi052.stdout:2/616: write d2/f9f [465312,67051] 0 2023-12-05T13:25:24.975 INFO:tasks.workunit.client.1.smithi052.stdout:2/617: write d2/f2a [600852,54713] 0 2023-12-05T13:25:24.978 INFO:tasks.workunit.client.1.smithi052.stdout:7/630: mkdir d7/dd5 0 2023-12-05T13:25:24.978 INFO:tasks.workunit.client.1.smithi052.stdout:7/631: write d7/d4e/d45/d5a/d63/f6d [1866679,38245] 0 2023-12-05T13:25:24.979 INFO:tasks.workunit.client.1.smithi052.stdout:6/445: sync 2023-12-05T13:25:24.979 INFO:tasks.workunit.client.1.smithi052.stdout:8/641: sync 2023-12-05T13:25:24.980 INFO:tasks.workunit.client.1.smithi052.stdout:6/446: truncate d3/d4/d6/d26/f5d 746785 0 2023-12-05T13:25:24.980 INFO:tasks.workunit.client.1.smithi052.stdout:6/447: getdents d3/d4/d6/d26/d8e 0 2023-12-05T13:25:24.980 INFO:tasks.workunit.client.1.smithi052.stdout:9/533: dread d3/d2a/f59 [0,4194304] 0 2023-12-05T13:25:24.983 INFO:tasks.workunit.client.1.smithi052.stdout:3/632: dread da/d25/f3a [0,4194304] 0 2023-12-05T13:25:24.983 INFO:tasks.workunit.client.1.smithi052.stdout:8/642: read d0/de/f35 [502956,89898] 0 2023-12-05T13:25:24.983 INFO:tasks.workunit.client.1.smithi052.stdout:8/643: stat d0/de/d27/d43/d44/db9 0 2023-12-05T13:25:24.983 INFO:tasks.workunit.client.1.smithi052.stdout:8/644: fsync d0/d28/fc2 0 2023-12-05T13:25:24.983 INFO:tasks.workunit.client.1.smithi052.stdout:8/645: write d0/de/d12/d29/f50 [593571,56567] 0 2023-12-05T13:25:24.986 INFO:tasks.workunit.client.1.smithi052.stdout:5/357: getdents d5/d15/d21 0 2023-12-05T13:25:24.988 INFO:tasks.workunit.client.1.smithi052.stdout:2/618: rename d2/d13/d37/f49 to d2/d13/d37/d8b/fb9 0 2023-12-05T13:25:24.988 INFO:tasks.workunit.client.1.smithi052.stdout:6/448: dread d3/d5/d9/d21/d48/d5b/f7b [0,4194304] 0 2023-12-05T13:25:24.989 INFO:tasks.workunit.client.1.smithi052.stdout:7/632: mknod d7/d31/cd6 0 2023-12-05T13:25:24.989 INFO:tasks.workunit.client.1.smithi052.stdout:7/633: chown d7/c2f 259296114 1 2023-12-05T13:25:24.993 INFO:tasks.workunit.client.1.smithi052.stdout:3/633: mknod da/d25/dcd/dc6/cd0 0 2023-12-05T13:25:24.994 INFO:tasks.workunit.client.1.smithi052.stdout:5/358: dread d5/d15/d21/d25/d3f/d5c/f49 [0,4194304] 0 2023-12-05T13:25:24.997 INFO:tasks.workunit.client.1.smithi052.stdout:8/646: mknod d0/dae/cd0 0 2023-12-05T13:25:24.997 INFO:tasks.workunit.client.1.smithi052.stdout:8/647: chown d0/f11 202469 1 2023-12-05T13:25:24.997 INFO:tasks.workunit.client.1.smithi052.stdout:0/602: sync 2023-12-05T13:25:24.998 INFO:tasks.workunit.client.1.smithi052.stdout:4/609: sync 2023-12-05T13:25:24.998 INFO:tasks.workunit.client.1.smithi052.stdout:0/603: dread - d0/db/d52/fb1 zero size 2023-12-05T13:25:24.998 INFO:tasks.workunit.client.1.smithi052.stdout:0/604: stat d0/db/d1b/d42/f67 0 2023-12-05T13:25:24.998 INFO:tasks.workunit.client.1.smithi052.stdout:9/534: rename d3/d2a/f30 to d3/fb4 0 2023-12-05T13:25:24.999 INFO:tasks.workunit.client.1.smithi052.stdout:6/449: creat d3/d4/df/f9b x:0 0 0 2023-12-05T13:25:24.999 INFO:tasks.workunit.client.1.smithi052.stdout:6/450: chown d3/d4/df/d24 666 1 2023-12-05T13:25:25.000 INFO:tasks.workunit.client.1.smithi052.stdout:7/634: getdents d7/d4e 0 2023-12-05T13:25:25.000 INFO:tasks.workunit.client.1.smithi052.stdout:3/634: creat da/d7a/fd1 x:0 0 0 2023-12-05T13:25:25.000 INFO:tasks.workunit.client.1.smithi052.stdout:3/635: chown da/dd 812 1 2023-12-05T13:25:25.002 INFO:tasks.workunit.client.1.smithi052.stdout:0/605: mknod d0/db/d52/d7f/d8f/cc3 0 2023-12-05T13:25:25.004 INFO:tasks.workunit.client.1.smithi052.stdout:8/648: rename d0/de/f41 to d0/d28/fd1 0 2023-12-05T13:25:25.004 INFO:tasks.workunit.client.1.smithi052.stdout:8/649: chown d0/d28/d2b/c90 13655129 1 2023-12-05T13:25:25.005 INFO:tasks.workunit.client.1.smithi052.stdout:7/635: rmdir d7/d4e/d45/d79/d91 39 2023-12-05T13:25:25.005 INFO:tasks.workunit.client.1.smithi052.stdout:7/636: chown d7/d4e/d45/d5a/d63/l7e 4104953 1 2023-12-05T13:25:25.005 INFO:tasks.workunit.client.1.smithi052.stdout:5/359: dread d5/df/d4b/f4d [0,4194304] 0 2023-12-05T13:25:25.006 INFO:tasks.workunit.client.1.smithi052.stdout:0/606: dread d0/db/d1b/d42/f67 [0,4194304] 0 2023-12-05T13:25:25.009 INFO:tasks.workunit.client.1.smithi052.stdout:3/636: mknod da/dd/d3d/cd2 0 2023-12-05T13:25:25.009 INFO:tasks.workunit.client.1.smithi052.stdout:6/451: dread d3/d5/d9/d21/d48/d5b/f7b [0,4194304] 0 2023-12-05T13:25:25.009 INFO:tasks.workunit.client.1.smithi052.stdout:6/452: write d3/d5/d9/d21/d48/d4d/d66/d74/f87 [37577,41600] 0 2023-12-05T13:25:25.010 INFO:tasks.workunit.client.1.smithi052.stdout:2/619: dwrite d2/f3c [0,4194304] 0 2023-12-05T13:25:25.010 INFO:tasks.workunit.client.1.smithi052.stdout:0/607: getdents d0/db/d2e/d7e 0 2023-12-05T13:25:25.010 INFO:tasks.workunit.client.1.smithi052.stdout:0/608: dread - d0/db/d2e/f47 zero size 2023-12-05T13:25:25.013 INFO:tasks.workunit.client.1.smithi052.stdout:6/453: truncate d3/d5/d9/f2f 3438679 0 2023-12-05T13:25:25.015 INFO:tasks.workunit.client.1.smithi052.stdout:9/535: write d3/fb4 [210139,15171] 0 2023-12-05T13:25:25.015 INFO:tasks.workunit.client.1.smithi052.stdout:0/609: write d0/db/d52/f7d [12332665,102608] 0 2023-12-05T13:25:25.015 INFO:tasks.workunit.client.1.smithi052.stdout:0/610: readlink d0/db/d2e/lb7 0 2023-12-05T13:25:25.017 INFO:tasks.workunit.client.1.smithi052.stdout:2/620: creat d2/d13/d1e/d6a/fba x:0 0 0 2023-12-05T13:25:25.019 INFO:tasks.workunit.client.1.smithi052.stdout:9/536: write d3/d5e/f76 [991457,95185] 0 2023-12-05T13:25:25.019 INFO:tasks.workunit.client.1.smithi052.stdout:9/537: truncate d3/d1e/f9c 532705 0 2023-12-05T13:25:25.023 INFO:tasks.workunit.client.1.smithi052.stdout:3/637: dread da/dd/f90 [4194304,4194304] 0 2023-12-05T13:25:25.025 INFO:tasks.workunit.client.1.smithi052.stdout:4/610: dwrite de/f4b [0,4194304] 0 2023-12-05T13:25:25.025 INFO:tasks.workunit.client.1.smithi052.stdout:4/611: fdatasync de/f12 0 2023-12-05T13:25:25.030 INFO:tasks.workunit.client.1.smithi052.stdout:6/454: mknod d3/d4/d6/d26/d8e/c9c 0 2023-12-05T13:25:25.030 INFO:tasks.workunit.client.1.smithi052.stdout:9/538: unlink d3/d2a/d8f/fad 0 2023-12-05T13:25:25.031 INFO:tasks.workunit.client.1.smithi052.stdout:0/611: mkdir d0/db/d52/dc4 0 2023-12-05T13:25:25.031 INFO:tasks.workunit.client.1.smithi052.stdout:4/612: creat de/d29/d51/da3/fc9 x:0 0 0 2023-12-05T13:25:25.032 INFO:tasks.workunit.client.1.smithi052.stdout:6/455: creat d3/d4/d6/d26/d8e/f9d x:0 0 0 2023-12-05T13:25:25.032 INFO:tasks.workunit.client.1.smithi052.stdout:6/456: stat d3/d4/df/d63/f71 0 2023-12-05T13:25:25.032 INFO:tasks.workunit.client.1.smithi052.stdout:6/457: chown d3/d4/df/c1b 113732113 1 2023-12-05T13:25:25.033 INFO:tasks.workunit.client.1.smithi052.stdout:8/650: dwrite d0/f95 [0,4194304] 0 2023-12-05T13:25:25.033 INFO:tasks.workunit.client.1.smithi052.stdout:8/651: stat d0/d4d/cb8 0 2023-12-05T13:25:25.036 INFO:tasks.workunit.client.1.smithi052.stdout:9/539: creat d3/d5e/d9e/fb5 x:0 0 0 2023-12-05T13:25:25.036 INFO:tasks.workunit.client.1.smithi052.stdout:0/612: write d0/fa [6105157,62815] 0 2023-12-05T13:25:25.036 INFO:tasks.workunit.client.1.smithi052.stdout:7/637: dwrite d7/d4e/d45/d5a/d63/f7a [4194304,4194304] 0 2023-12-05T13:25:25.036 INFO:tasks.workunit.client.1.smithi052.stdout:4/613: symlink de/d2b/d64/lca 0 2023-12-05T13:25:25.039 INFO:tasks.workunit.client.1.smithi052.stdout:6/458: creat d3/d5/d9/d21/d48/d4d/d81/d82/f9e x:0 0 0 2023-12-05T13:25:25.041 INFO:tasks.workunit.client.1.smithi052.stdout:3/638: dwrite da/d25/d33/d89/fb1 [0,4194304] 0 2023-12-05T13:25:25.041 INFO:tasks.workunit.client.1.smithi052.stdout:2/621: dwrite d2/f2f [0,4194304] 0 2023-12-05T13:25:25.041 INFO:tasks.workunit.client.1.smithi052.stdout:2/622: dread - d2/d13/d1e/fab zero size 2023-12-05T13:25:25.044 INFO:tasks.workunit.client.1.smithi052.stdout:8/652: unlink d0/d28/d2b/f96 0 2023-12-05T13:25:25.044 INFO:tasks.workunit.client.1.smithi052.stdout:8/653: fsync d0/dae/fb1 0 2023-12-05T13:25:25.047 INFO:tasks.workunit.client.1.smithi052.stdout:9/540: creat d3/d11/d19/d83/fb6 x:0 0 0 2023-12-05T13:25:25.047 INFO:tasks.workunit.client.1.smithi052.stdout:9/541: chown d3/d1e/f23 84367465 1 2023-12-05T13:25:25.049 INFO:tasks.workunit.client.1.smithi052.stdout:0/613: symlink d0/db/d1b/d29/dba/lc5 0 2023-12-05T13:25:25.055 INFO:tasks.workunit.client.1.smithi052.stdout:7/638: mknod d7/d4e/d45/d50/cd7 0 2023-12-05T13:25:25.055 INFO:tasks.workunit.client.1.smithi052.stdout:7/639: fsync d7/d4e/d45/d5a/d16/f30 0 2023-12-05T13:25:25.055 INFO:tasks.workunit.client.1.smithi052.stdout:7/640: chown d7/d4e/db4 7 1 2023-12-05T13:25:25.057 INFO:tasks.workunit.client.1.smithi052.stdout:4/614: mkdir de/d30/d68/d5c/dcb 0 2023-12-05T13:25:25.057 INFO:tasks.workunit.client.1.smithi052.stdout:8/654: dread d0/de/f35 [0,4194304] 0 2023-12-05T13:25:25.058 INFO:tasks.workunit.client.1.smithi052.stdout:8/655: write d0/fa [4291219,19567] 0 2023-12-05T13:25:25.058 INFO:tasks.workunit.client.1.smithi052.stdout:8/656: truncate d0/de/d27/f92 198462 0 2023-12-05T13:25:25.058 INFO:tasks.workunit.client.1.smithi052.stdout:8/657: read d0/d28/d39/d3a/f5b [1864563,126714] 0 2023-12-05T13:25:25.058 INFO:tasks.workunit.client.1.smithi052.stdout:8/658: chown d0/de/f2f 133141 1 2023-12-05T13:25:25.058 INFO:tasks.workunit.client.1.smithi052.stdout:8/659: fdatasync d0/de/d27/d43/d63/f8b 0 2023-12-05T13:25:25.059 INFO:tasks.workunit.client.1.smithi052.stdout:8/660: chown d0/c8 46712244 1 2023-12-05T13:25:25.059 INFO:tasks.workunit.client.1.smithi052.stdout:6/459: rmdir d3/d4/df/d63 39 2023-12-05T13:25:25.061 INFO:tasks.workunit.client.1.smithi052.stdout:8/661: write d0/d28/fd1 [4960001,29506] 0 2023-12-05T13:25:25.062 INFO:tasks.workunit.client.1.smithi052.stdout:9/542: dwrite d3/d2a/d8f/f9a [0,4194304] 0 2023-12-05T13:25:25.064 INFO:tasks.workunit.client.1.smithi052.stdout:3/639: mknod da/d25/d33/d43/d5b/d96/cd3 0 2023-12-05T13:25:25.064 INFO:tasks.workunit.client.1.smithi052.stdout:5/360: dwrite d5/d15/d21/d25/d3f/d5c/f53 [0,4194304] 0 2023-12-05T13:25:25.066 INFO:tasks.workunit.client.1.smithi052.stdout:5/361: dread d5/df/d11/f52 [0,4194304] 0 2023-12-05T13:25:25.066 INFO:tasks.workunit.client.1.smithi052.stdout:5/362: truncate d5/d15/d21/d25/f6d 189676 0 2023-12-05T13:25:25.068 INFO:tasks.workunit.client.1.smithi052.stdout:7/641: creat d7/dd5/fd8 x:0 0 0 2023-12-05T13:25:25.068 INFO:tasks.workunit.client.1.smithi052.stdout:7/642: readlink d7/d4e/d12/d3f/d46/dab/lc0 0 2023-12-05T13:25:25.070 INFO:tasks.workunit.client.1.smithi052.stdout:9/543: dread d3/d1e/d37/d4f/f54 [0,4194304] 0 2023-12-05T13:25:25.072 INFO:tasks.workunit.client.1.smithi052.stdout:4/615: truncate de/d30/f8a 2669783 0 2023-12-05T13:25:25.073 INFO:tasks.workunit.client.1.smithi052.stdout:4/616: write fa [4026761,80072] 0 2023-12-05T13:25:25.073 INFO:tasks.workunit.client.1.smithi052.stdout:4/617: chown de/d30/d68/c8b 22334817 1 2023-12-05T13:25:25.073 INFO:tasks.workunit.client.1.smithi052.stdout:6/460: creat d3/d5/d58/f9f x:0 0 0 2023-12-05T13:25:25.074 INFO:tasks.workunit.client.1.smithi052.stdout:8/662: mknod d0/de/cd2 0 2023-12-05T13:25:25.074 INFO:tasks.workunit.client.1.smithi052.stdout:8/663: fdatasync d0/d28/f87 0 2023-12-05T13:25:25.078 INFO:tasks.workunit.client.1.smithi052.stdout:2/623: symlink d2/d13/lbb 0 2023-12-05T13:25:25.079 INFO:tasks.workunit.client.1.smithi052.stdout:0/614: write d0/db/d1b/f27 [114273,55102] 0 2023-12-05T13:25:25.086 INFO:tasks.workunit.client.1.smithi052.stdout:4/618: dread de/d30/f8a [0,4194304] 0 2023-12-05T13:25:25.089 INFO:tasks.workunit.client.1.smithi052.stdout:3/640: symlink da/d2e/d40/d6d/ld4 0 2023-12-05T13:25:25.095 INFO:tasks.workunit.client.1.smithi052.stdout:7/643: readlink d7/d4e/d12/l4c 0 2023-12-05T13:25:25.095 INFO:tasks.workunit.client.1.smithi052.stdout:9/544: creat d3/d11/d19/d83/fb7 x:0 0 0 2023-12-05T13:25:25.096 INFO:tasks.workunit.client.1.smithi052.stdout:0/615: dwrite d0/db/d14/f2f [0,4194304] 0 2023-12-05T13:25:25.097 INFO:tasks.workunit.client.1.smithi052.stdout:6/461: symlink d3/d5/d9/d21/d48/d4d/d66/d91/la0 0 2023-12-05T13:25:25.099 INFO:tasks.workunit.client.1.smithi052.stdout:2/624: rmdir d2/d4/d3f 39 2023-12-05T13:25:25.101 INFO:tasks.workunit.client.1.smithi052.stdout:4/619: creat de/d29/d51/da3/d6d/fcc x:0 0 0 2023-12-05T13:25:25.101 INFO:tasks.workunit.client.1.smithi052.stdout:4/620: write de/d2b/d64/f6a [167148,104464] 0 2023-12-05T13:25:25.104 INFO:tasks.workunit.client.1.smithi052.stdout:3/641: link da/dd/d3d/f63 da/d25/d33/d49/fd5 0 2023-12-05T13:25:25.106 INFO:tasks.workunit.client.1.smithi052.stdout:7/644: rename d7/d31/d56/f85 to d7/d4e/d45/d5a/d16/fd9 0 2023-12-05T13:25:25.107 INFO:tasks.workunit.client.1.smithi052.stdout:7/645: write d7/d4e/d12/f34 [1191945,119727] 0 2023-12-05T13:25:25.107 INFO:tasks.workunit.client.1.smithi052.stdout:1/567: sync 2023-12-05T13:25:25.111 INFO:tasks.workunit.client.1.smithi052.stdout:9/545: dread d3/d1e/d37/d4f/f52 [0,4194304] 0 2023-12-05T13:25:25.111 INFO:tasks.workunit.client.1.smithi052.stdout:9/546: fsync d3/d5e/d9e/fb5 0 2023-12-05T13:25:25.112 INFO:tasks.workunit.client.1.smithi052.stdout:1/568: dread d5/d7/f47 [0,4194304] 0 2023-12-05T13:25:25.113 INFO:tasks.workunit.client.1.smithi052.stdout:6/462: link d3/d5/d9/d44/l7d d3/d5/d9/d21/d5f/la1 0 2023-12-05T13:25:25.113 INFO:tasks.workunit.client.1.smithi052.stdout:4/621: symlink de/d30/d68/d5c/lcd 0 2023-12-05T13:25:25.115 INFO:tasks.workunit.client.1.smithi052.stdout:3/642: creat da/d25/d33/fd6 x:0 0 0 2023-12-05T13:25:25.115 INFO:tasks.workunit.client.1.smithi052.stdout:2/625: dwrite d2/d4/f23 [0,4194304] 0 2023-12-05T13:25:25.116 INFO:tasks.workunit.client.1.smithi052.stdout:7/646: truncate d7/d4e/d12/d3f/d46/f5f 1236241 0 2023-12-05T13:25:25.117 INFO:tasks.workunit.client.1.smithi052.stdout:0/616: symlink d0/db/d52/lc6 0 2023-12-05T13:25:25.117 INFO:tasks.workunit.client.1.smithi052.stdout:9/547: link d3/d11/d19/l49 d3/d1e/d62/lb8 0 2023-12-05T13:25:25.117 INFO:tasks.workunit.client.1.smithi052.stdout:9/548: chown d3/l3f 246256 1 2023-12-05T13:25:25.119 INFO:tasks.workunit.client.1.smithi052.stdout:6/463: getdents d3/d4/d6/d26 0 2023-12-05T13:25:25.119 INFO:tasks.workunit.client.1.smithi052.stdout:6/464: truncate d3/d4/d6/f11 2215887 0 2023-12-05T13:25:25.120 INFO:tasks.workunit.client.1.smithi052.stdout:4/622: dread de/d2b/d64/f6a [0,4194304] 0 2023-12-05T13:25:25.120 INFO:tasks.workunit.client.1.smithi052.stdout:4/623: readlink de/d30/d73/dbe/d24/l5b 0 2023-12-05T13:25:25.121 INFO:tasks.workunit.client.1.smithi052.stdout:3/643: symlink da/dd/ld7 0 2023-12-05T13:25:25.123 INFO:tasks.workunit.client.1.smithi052.stdout:2/626: mkdir d2/d14/d62/da7/dbc 0 2023-12-05T13:25:25.123 INFO:tasks.workunit.client.1.smithi052.stdout:7/647: dread d7/d4e/f1a [0,4194304] 0 2023-12-05T13:25:25.124 INFO:tasks.workunit.client.1.smithi052.stdout:3/644: write da/d25/f3a [4148276,33480] 0 2023-12-05T13:25:25.130 INFO:tasks.workunit.client.1.smithi052.stdout:1/569: dwrite d5/d7/d35/d37/d43/f78 [0,4194304] 0 2023-12-05T13:25:25.132 INFO:tasks.workunit.client.1.smithi052.stdout:0/617: link d0/db/d14/d9b/ca9 d0/db/d20/d50/dae/cc7 0 2023-12-05T13:25:25.132 INFO:tasks.workunit.client.1.smithi052.stdout:0/618: chown d0/db/d1b/d42/f45 3 1 2023-12-05T13:25:25.132 INFO:tasks.workunit.client.1.smithi052.stdout:9/549: rename d3/d1e/d62/l6b to d3/d11/d19/d83/lb9 0 2023-12-05T13:25:25.134 INFO:tasks.workunit.client.1.smithi052.stdout:6/465: getdents d3/d5/d9/d21/d48/d4d/d81/d82 0 2023-12-05T13:25:25.134 INFO:tasks.workunit.client.1.smithi052.stdout:4/624: creat de/d30/d73/d85/fce x:0 0 0 2023-12-05T13:25:25.140 INFO:tasks.workunit.client.1.smithi052.stdout:2/627: creat d2/d14/fbd x:0 0 0 2023-12-05T13:25:25.140 INFO:tasks.workunit.client.1.smithi052.stdout:7/648: creat d7/d4e/d45/d5a/d16/dae/fda x:0 0 0 2023-12-05T13:25:25.140 INFO:tasks.workunit.client.1.smithi052.stdout:2/628: write d2/d13/d45/f4d [418748,30216] 0 2023-12-05T13:25:25.140 INFO:tasks.workunit.client.1.smithi052.stdout:2/629: chown d2/d4 16023 1 2023-12-05T13:25:25.140 INFO:tasks.workunit.client.1.smithi052.stdout:2/630: chown d2/da4/f8e 14769409 1 2023-12-05T13:25:25.141 INFO:tasks.workunit.client.1.smithi052.stdout:7/649: read d7/d4e/d45/d5a/f19 [2572812,119265] 0 2023-12-05T13:25:25.142 INFO:tasks.workunit.client.1.smithi052.stdout:3/645: unlink da/f22 0 2023-12-05T13:25:25.144 INFO:tasks.workunit.client.1.smithi052.stdout:0/619: dread d0/fa [4194304,4194304] 0 2023-12-05T13:25:25.144 INFO:tasks.workunit.client.1.smithi052.stdout:1/570: creat d5/d7/de/d74/fb2 x:0 0 0 2023-12-05T13:25:25.145 INFO:tasks.workunit.client.1.smithi052.stdout:0/620: read d0/db/d1b/f37 [1088770,18315] 0 2023-12-05T13:25:25.145 INFO:tasks.workunit.client.1.smithi052.stdout:0/621: write d0/db/d52/d7f/f89 [4894230,91601] 0 2023-12-05T13:25:25.145 INFO:tasks.workunit.client.1.smithi052.stdout:9/550: dwrite d3/d1e/f23 [0,4194304] 0 2023-12-05T13:25:25.147 INFO:tasks.workunit.client.1.smithi052.stdout:6/466: creat d3/d5/d9/d21/d48/d4d/d81/d82/fa2 x:0 0 0 2023-12-05T13:25:25.148 INFO:tasks.workunit.client.1.smithi052.stdout:6/467: write d3/d4/df/d27/f56 [4429458,68019] 0 2023-12-05T13:25:25.148 INFO:tasks.workunit.client.1.smithi052.stdout:4/625: rmdir de/d30/d68 39 2023-12-05T13:25:25.148 INFO:tasks.workunit.client.1.smithi052.stdout:4/626: chown de/d2b/d64/d69/l62 833 1 2023-12-05T13:25:25.149 INFO:tasks.workunit.client.1.smithi052.stdout:2/631: symlink d2/d4/d3f/lbe 0 2023-12-05T13:25:25.152 INFO:tasks.workunit.client.1.smithi052.stdout:7/650: rename d7/d4e/d12/l4c to d7/d4e/d12/d3f/d75/ldb 0 2023-12-05T13:25:25.152 INFO:tasks.workunit.client.1.smithi052.stdout:7/651: chown d7/d4e/d12/d3f/d75/ca4 49422518 1 2023-12-05T13:25:25.153 INFO:tasks.workunit.client.1.smithi052.stdout:3/646: creat da/d2e/d40/fd8 x:0 0 0 2023-12-05T13:25:25.154 INFO:tasks.workunit.client.1.smithi052.stdout:1/571: symlink d5/daa/d69/lb3 0 2023-12-05T13:25:25.154 INFO:tasks.workunit.client.1.smithi052.stdout:1/572: write d5/daa/d2a/f9e [353107,100642] 0 2023-12-05T13:25:25.156 INFO:tasks.workunit.client.1.smithi052.stdout:0/622: creat d0/db/d14/d9b/fc8 x:0 0 0 2023-12-05T13:25:25.158 INFO:tasks.workunit.client.1.smithi052.stdout:5/363: sync 2023-12-05T13:25:25.158 INFO:tasks.workunit.client.1.smithi052.stdout:5/364: dread - d5/df/d4e/d65/f72 zero size 2023-12-05T13:25:25.158 INFO:tasks.workunit.client.1.smithi052.stdout:6/468: mknod d3/d4/d6/d26/ca3 0 2023-12-05T13:25:25.159 INFO:tasks.workunit.client.1.smithi052.stdout:4/627: mkdir de/d29/d51/d76/dc4/dcf 0 2023-12-05T13:25:25.161 INFO:tasks.workunit.client.1.smithi052.stdout:2/632: link d2/d14/d62/l64 d2/d13/d1e/d6a/d7f/d84/lbf 0 2023-12-05T13:25:25.161 INFO:tasks.workunit.client.1.smithi052.stdout:7/652: getdents d7/d4e/d45/d5a/d63 0 2023-12-05T13:25:25.161 INFO:tasks.workunit.client.1.smithi052.stdout:7/653: write d7/d4e/f2b [9028886,107207] 0 2023-12-05T13:25:25.162 INFO:tasks.workunit.client.1.smithi052.stdout:2/633: write d2/d13/d37/f69 [1627550,64893] 0 2023-12-05T13:25:25.162 INFO:tasks.workunit.client.1.smithi052.stdout:2/634: stat d2/f5d 0 2023-12-05T13:25:25.164 INFO:tasks.workunit.client.1.smithi052.stdout:3/647: symlink da/d48/ld9 0 2023-12-05T13:25:25.165 INFO:tasks.workunit.client.1.smithi052.stdout:1/573: rename d5/d7/d35/d2f/d9b/f9c to d5/daa/d17/d3c/fb4 0 2023-12-05T13:25:25.167 INFO:tasks.workunit.client.1.smithi052.stdout:0/623: creat d0/db/d65/fc9 x:0 0 0 2023-12-05T13:25:25.168 INFO:tasks.workunit.client.1.smithi052.stdout:0/624: write d0/db/d14/f59 [202138,119792] 0 2023-12-05T13:25:25.169 INFO:tasks.workunit.client.1.smithi052.stdout:5/365: mkdir d5/d46/d76 0 2023-12-05T13:25:25.173 INFO:tasks.workunit.client.1.smithi052.stdout:6/469: link d3/d5/f5a d3/d5/d9/d21/d48/d4d/d66/d91/fa4 0 2023-12-05T13:25:25.177 INFO:tasks.workunit.client.1.smithi052.stdout:4/628: mknod de/d2b/d80/cd0 0 2023-12-05T13:25:25.177 INFO:tasks.workunit.client.1.smithi052.stdout:4/629: chown de/l10 6 1 2023-12-05T13:25:25.180 INFO:tasks.workunit.client.1.smithi052.stdout:4/630: write de/f4b [1090607,90077] 0 2023-12-05T13:25:25.180 INFO:tasks.workunit.client.1.smithi052.stdout:2/635: getdents d2/d13 0 2023-12-05T13:25:25.180 INFO:tasks.workunit.client.1.smithi052.stdout:4/631: chown de/d30/d73/dbe/f21 4442825 1 2023-12-05T13:25:25.180 INFO:tasks.workunit.client.1.smithi052.stdout:2/636: readlink d2/d13/d1e/d6a/d7f/d84/d3a/l44 0 2023-12-05T13:25:25.181 INFO:tasks.workunit.client.1.smithi052.stdout:7/654: dwrite d7/d4e/d45/fb6 [0,4194304] 0 2023-12-05T13:25:25.182 INFO:tasks.workunit.client.1.smithi052.stdout:1/574: creat d5/d7/d35/d2f/fb5 x:0 0 0 2023-12-05T13:25:25.184 INFO:tasks.workunit.client.1.smithi052.stdout:0/625: rename d0/f4 to d0/db/d1b/d29/db0/fca 0 2023-12-05T13:25:25.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/470: rename d3/d4/df/d63/f8f to d3/d4/df/d63/fa5 0 2023-12-05T13:25:25.185 INFO:tasks.workunit.client.1.smithi052.stdout:5/366: dwrite d5/d15/d21/d4a/d6e/f71 [0,4194304] 0 2023-12-05T13:25:25.187 INFO:tasks.workunit.client.1.smithi052.stdout:4/632: mkdir de/d30/dd1 0 2023-12-05T13:25:25.188 INFO:tasks.workunit.client.1.smithi052.stdout:3/648: dwrite da/d7a/fc4 [0,4194304] 0 2023-12-05T13:25:25.188 INFO:tasks.workunit.client.1.smithi052.stdout:2/637: getdents d2/d13/d1e 0 2023-12-05T13:25:25.189 INFO:tasks.workunit.client.1.smithi052.stdout:8/664: sync 2023-12-05T13:25:25.189 INFO:tasks.workunit.client.1.smithi052.stdout:8/665: fdatasync d0/de/d27/d43/d44/f49 0 2023-12-05T13:25:25.190 INFO:tasks.workunit.client.1.smithi052.stdout:8/666: write d0/d28/d2b/f31 [964444,103185] 0 2023-12-05T13:25:25.191 INFO:tasks.workunit.client.1.smithi052.stdout:7/655: mknod d7/d4e/d45/d5a/d63/cdc 0 2023-12-05T13:25:25.192 INFO:tasks.workunit.client.1.smithi052.stdout:1/575: creat d5/d7/de/d74/fb6 x:0 0 0 2023-12-05T13:25:25.192 INFO:tasks.workunit.client.1.smithi052.stdout:7/656: write d7/d4e/d12/f43 [909356,109997] 0 2023-12-05T13:25:25.194 INFO:tasks.workunit.client.1.smithi052.stdout:0/626: getdents d0/db/d1b/d7a 0 2023-12-05T13:25:25.194 INFO:tasks.workunit.client.1.smithi052.stdout:0/627: chown d0/db/d14/f40 60978903 1 2023-12-05T13:25:25.195 INFO:tasks.workunit.client.1.smithi052.stdout:6/471: mknod d3/d5/d9/d21/d48/d4d/d81/ca6 0 2023-12-05T13:25:25.197 INFO:tasks.workunit.client.1.smithi052.stdout:5/367: mkdir d5/df/d11/d73/d77 0 2023-12-05T13:25:25.198 INFO:tasks.workunit.client.1.smithi052.stdout:4/633: creat de/d2b/d64/d69/fd2 x:0 0 0 2023-12-05T13:25:25.201 INFO:tasks.workunit.client.1.smithi052.stdout:3/649: truncate da/d7a/fa3 837602 0 2023-12-05T13:25:25.203 INFO:tasks.workunit.client.1.smithi052.stdout:8/667: unlink d0/de/fa1 0 2023-12-05T13:25:25.204 INFO:tasks.workunit.client.1.smithi052.stdout:1/576: rmdir d5/d7/d35/d2f/d3e 39 2023-12-05T13:25:25.204 INFO:tasks.workunit.client.1.smithi052.stdout:1/577: truncate d5/daa/da4/fa5 172732 0 2023-12-05T13:25:25.205 INFO:tasks.workunit.client.1.smithi052.stdout:7/657: link d7/d4e/d45/cca d7/d4e/d45/d93/cdd 0 2023-12-05T13:25:25.206 INFO:tasks.workunit.client.1.smithi052.stdout:6/472: creat d3/d4/df/fa7 x:0 0 0 2023-12-05T13:25:25.206 INFO:tasks.workunit.client.1.smithi052.stdout:6/473: chown d3/d4/d6 4329 1 2023-12-05T13:25:25.206 INFO:tasks.workunit.client.1.smithi052.stdout:0/628: dread d0/f82 [0,4194304] 0 2023-12-05T13:25:25.207 INFO:tasks.workunit.client.1.smithi052.stdout:5/368: truncate d5/d15/d21/d25/f6d 169402 0 2023-12-05T13:25:25.209 INFO:tasks.workunit.client.1.smithi052.stdout:4/634: creat de/d2b/d64/fd3 x:0 0 0 2023-12-05T13:25:25.210 INFO:tasks.workunit.client.1.smithi052.stdout:3/650: unlink da/d25/d33/d49/f8a 0 2023-12-05T13:25:25.212 INFO:tasks.workunit.client.1.smithi052.stdout:8/668: mkdir d0/de/d12/dc1/dd3 0 2023-12-05T13:25:25.214 INFO:tasks.workunit.client.1.smithi052.stdout:1/578: rename d5/d7/d35/d37/d5a/d73/d7e/f5b to d5/d7/de/d74/d99/fb7 0 2023-12-05T13:25:25.214 INFO:tasks.workunit.client.1.smithi052.stdout:1/579: write d5/d7/de/f96 [253621,101195] 0 2023-12-05T13:25:25.216 INFO:tasks.workunit.client.1.smithi052.stdout:6/474: symlink d3/d5/d9/d21/d48/d4d/d66/d91/la8 0 2023-12-05T13:25:25.216 INFO:tasks.workunit.client.1.smithi052.stdout:6/475: write d3/f19 [4463149,8859] 0 2023-12-05T13:25:25.218 INFO:tasks.workunit.client.1.smithi052.stdout:0/629: getdents d0 0 2023-12-05T13:25:25.220 INFO:tasks.workunit.client.1.smithi052.stdout:4/635: truncate de/d30/f8a 949576 0 2023-12-05T13:25:25.220 INFO:tasks.workunit.client.1.smithi052.stdout:5/369: dwrite d5/d15/d21/f60 [0,4194304] 0 2023-12-05T13:25:25.222 INFO:tasks.workunit.client.1.smithi052.stdout:4/636: dread de/d2b/d64/f6a [0,4194304] 0 2023-12-05T13:25:25.222 INFO:tasks.workunit.client.1.smithi052.stdout:3/651: mkdir da/dd/d3d/dda 0 2023-12-05T13:25:25.228 INFO:tasks.workunit.client.1.smithi052.stdout:8/669: creat d0/d28/d2b/d53/d56/fd4 x:0 0 0 2023-12-05T13:25:25.229 INFO:tasks.workunit.client.1.smithi052.stdout:1/580: unlink d5/daa/d17/c42 0 2023-12-05T13:25:25.229 INFO:tasks.workunit.client.1.smithi052.stdout:8/670: write d0/de/d27/d43/d44/f49 [4370255,93815] 0 2023-12-05T13:25:25.230 INFO:tasks.workunit.client.1.smithi052.stdout:2/638: dwrite d2/d13/d48/f5e [0,4194304] 0 2023-12-05T13:25:25.231 INFO:tasks.workunit.client.1.smithi052.stdout:2/639: write d2/d4/f83 [242482,82096] 0 2023-12-05T13:25:25.231 INFO:tasks.workunit.client.1.smithi052.stdout:2/640: write d2/d13/d1e/d6a/fba [15181,30654] 0 2023-12-05T13:25:25.231 INFO:tasks.workunit.client.1.smithi052.stdout:2/641: write d2/d4/f83 [838502,97763] 0 2023-12-05T13:25:25.231 INFO:tasks.workunit.client.1.smithi052.stdout:0/630: rename d0/db/d1b/d42 to d0/dcb 0 2023-12-05T13:25:25.231 INFO:tasks.workunit.client.1.smithi052.stdout:0/631: write d0/fd [9547080,59237] 0 2023-12-05T13:25:25.233 INFO:tasks.workunit.client.1.smithi052.stdout:5/370: unlink d5/df/d11/l28 0 2023-12-05T13:25:25.233 INFO:tasks.workunit.client.1.smithi052.stdout:5/371: chown d5/d15/l70 0 1 2023-12-05T13:25:25.233 INFO:tasks.workunit.client.1.smithi052.stdout:5/372: readlink d5/d15/l58 0 2023-12-05T13:25:25.236 INFO:tasks.workunit.client.1.smithi052.stdout:7/658: rmdir d7/d2e/d81 0 2023-12-05T13:25:25.240 INFO:tasks.workunit.client.1.smithi052.stdout:1/581: truncate d5/daa/d2a/f92 384012 0 2023-12-05T13:25:25.242 INFO:tasks.workunit.client.1.smithi052.stdout:0/632: write d0/db/d52/d7f/f98 [745529,45174] 0 2023-12-05T13:25:25.244 INFO:tasks.workunit.client.1.smithi052.stdout:3/652: dwrite da/d27/f92 [4194304,4194304] 0 2023-12-05T13:25:25.244 INFO:tasks.workunit.client.1.smithi052.stdout:3/653: stat da/d2e/d40/d6d/dba/fce 0 2023-12-05T13:25:25.244 INFO:tasks.workunit.client.1.smithi052.stdout:3/654: readlink da/d25/l52 0 2023-12-05T13:25:25.244 INFO:tasks.workunit.client.1.smithi052.stdout:8/671: getdents d0/de/d98 0 2023-12-05T13:25:25.245 INFO:tasks.workunit.client.1.smithi052.stdout:3/655: write da/f23 [3765087,113776] 0 2023-12-05T13:25:25.245 INFO:tasks.workunit.client.1.smithi052.stdout:3/656: write da/d25/d33/fc5 [844316,6007] 0 2023-12-05T13:25:25.245 INFO:tasks.workunit.client.1.smithi052.stdout:6/476: symlink d3/d4/d36/la9 0 2023-12-05T13:25:25.249 INFO:tasks.workunit.client.1.smithi052.stdout:8/672: write d0/f5 [415164,112767] 0 2023-12-05T13:25:25.249 INFO:tasks.workunit.client.1.smithi052.stdout:8/673: fsync d0/f11 0 2023-12-05T13:25:25.249 INFO:tasks.workunit.client.1.smithi052.stdout:8/674: chown d0/de/d27/d43/d44/l6d 9 1 2023-12-05T13:25:25.251 INFO:tasks.workunit.client.1.smithi052.stdout:2/642: link d2/f2a d2/d14/d62/da7/fc0 0 2023-12-05T13:25:25.252 INFO:tasks.workunit.client.1.smithi052.stdout:2/643: write d2/d14/d62/da7/fad [343730,12876] 0 2023-12-05T13:25:25.254 INFO:tasks.workunit.client.1.smithi052.stdout:4/637: rename de/d29/d51/da3/c7d to de/d29/d51/d76/dc4/cd4 0 2023-12-05T13:25:25.254 INFO:tasks.workunit.client.1.smithi052.stdout:4/638: fdatasync de/d29/d51/f6b 0 2023-12-05T13:25:25.255 INFO:tasks.workunit.client.1.smithi052.stdout:4/639: write de/f4b [2648768,24622] 0 2023-12-05T13:25:25.255 INFO:tasks.workunit.client.1.smithi052.stdout:4/640: fdatasync de/d30/d73/dbe/d24/f4e 0 2023-12-05T13:25:25.257 INFO:tasks.workunit.client.1.smithi052.stdout:1/582: creat d5/d7/d35/d2f/d3e/d62/fb8 x:0 0 0 2023-12-05T13:25:25.257 INFO:tasks.workunit.client.1.smithi052.stdout:1/583: fdatasync d5/daa/d2a/f49 0 2023-12-05T13:25:25.260 INFO:tasks.workunit.client.1.smithi052.stdout:0/633: mkdir d0/db/d2e/d7e/dcc 0 2023-12-05T13:25:25.260 INFO:tasks.workunit.client.1.smithi052.stdout:0/634: truncate d0/db/d20/fbd 118321 0 2023-12-05T13:25:25.261 INFO:tasks.workunit.client.1.smithi052.stdout:0/635: read d0/db/d33/f70 [3621417,112245] 0 2023-12-05T13:25:25.276 INFO:tasks.workunit.client.1.smithi052.stdout:3/657: mknod da/d25/d33/d49/dbd/cdb 0 2023-12-05T13:25:25.277 INFO:tasks.workunit.client.1.smithi052.stdout:6/477: truncate d3/d5/d9/f64 1518034 0 2023-12-05T13:25:25.277 INFO:tasks.workunit.client.1.smithi052.stdout:6/478: write d3/d4/d6/d26/d6d/f7e [943732,130435] 0 2023-12-05T13:25:25.277 INFO:tasks.workunit.client.1.smithi052.stdout:6/479: truncate d3/d4/df/fa7 732516 0 2023-12-05T13:25:25.279 INFO:tasks.workunit.client.1.smithi052.stdout:8/675: creat d0/de/fd5 x:0 0 0 2023-12-05T13:25:25.280 INFO:tasks.workunit.client.1.smithi052.stdout:2/644: symlink d2/d13/d1e/dae/lc1 0 2023-12-05T13:25:25.280 INFO:tasks.workunit.client.1.smithi052.stdout:2/645: chown d2/f3c 136 1 2023-12-05T13:25:25.281 INFO:tasks.workunit.client.1.smithi052.stdout:2/646: write d2/d13/d37/d8b/fb9 [1057766,93068] 0 2023-12-05T13:25:25.281 INFO:tasks.workunit.client.1.smithi052.stdout:2/647: stat d2/d13/d1e/f3d 0 2023-12-05T13:25:25.283 INFO:tasks.workunit.client.1.smithi052.stdout:5/373: rename d5/d15/f18 to d5/df/d11/d73/d77/f78 0 2023-12-05T13:25:25.291 INFO:tasks.workunit.client.1.smithi052.stdout:4/641: mknod de/d30/d73/cd5 0 2023-12-05T13:25:25.291 INFO:tasks.workunit.client.1.smithi052.stdout:4/642: readlink de/d30/l90 0 2023-12-05T13:25:25.291 INFO:tasks.workunit.client.1.smithi052.stdout:1/584: creat d5/d26/da3/fb9 x:0 0 0 2023-12-05T13:25:25.291 INFO:tasks.workunit.client.1.smithi052.stdout:0/636: mkdir d0/db/d1b/d51/d55/d66/dcd 0 2023-12-05T13:25:25.291 INFO:tasks.workunit.client.1.smithi052.stdout:4/643: dread - de/d30/d73/d85/fce zero size 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:3/658: mkdir da/dd/d3d/dda/ddc 0 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:4/644: readlink de/d29/l77 0 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:6/480: mknod d3/d5/d9/d21/d48/d4d/d66/d91/caa 0 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:6/481: write d3/d4/d6/f11 [747618,60029] 0 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:6/482: write d3/d4/d36/d6f/f85 [435998,40848] 0 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:1/585: write d5/d7/de/f96 [111541,17664] 0 2023-12-05T13:25:25.292 INFO:tasks.workunit.client.1.smithi052.stdout:1/586: truncate d5/fa8 508980 0 2023-12-05T13:25:25.293 INFO:tasks.workunit.client.1.smithi052.stdout:2/648: creat d2/d13/d1e/fc2 x:0 0 0 2023-12-05T13:25:25.295 INFO:tasks.workunit.client.1.smithi052.stdout:8/676: rename d0/ca0 to d0/d28/d39/d3a/d8f/cd6 0 2023-12-05T13:25:25.296 INFO:tasks.workunit.client.1.smithi052.stdout:9/551: sync 2023-12-05T13:25:25.300 INFO:tasks.workunit.client.1.smithi052.stdout:3/659: link da/d48/c7d da/d2e/d40/d6d/cdd 0 2023-12-05T13:25:25.303 INFO:tasks.workunit.client.1.smithi052.stdout:6/483: mkdir d3/d5/d9/d44/dab 0 2023-12-05T13:25:25.305 INFO:tasks.workunit.client.1.smithi052.stdout:1/587: mkdir d5/d7/d35/d37/d5a/d73/d7e/d65/dba 0 2023-12-05T13:25:25.305 INFO:tasks.workunit.client.1.smithi052.stdout:1/588: fdatasync f4 0 2023-12-05T13:25:25.305 INFO:tasks.workunit.client.1.smithi052.stdout:1/589: readlink d5/d7/d35/d37/l63 0 2023-12-05T13:25:25.307 INFO:tasks.workunit.client.1.smithi052.stdout:2/649: unlink d2/d13/d1e/d6a/d7f/d84/d3a/ca5 0 2023-12-05T13:25:25.307 INFO:tasks.workunit.client.1.smithi052.stdout:2/650: write d2/d13/d1e/f3d [1921603,13105] 0 2023-12-05T13:25:25.308 INFO:tasks.workunit.client.1.smithi052.stdout:4/645: dwrite de/f87 [0,4194304] 0 2023-12-05T13:25:25.314 INFO:tasks.workunit.client.1.smithi052.stdout:5/374: rename d5/df/d4e/d5b/f6f to d5/f79 0 2023-12-05T13:25:25.314 INFO:tasks.workunit.client.1.smithi052.stdout:9/552: truncate d3/d11/d19/f2e 2740543 0 2023-12-05T13:25:25.315 INFO:tasks.workunit.client.1.smithi052.stdout:6/484: creat d3/d5/d9/d21/fac x:0 0 0 2023-12-05T13:25:25.315 INFO:tasks.workunit.client.1.smithi052.stdout:2/651: rmdir d2/d13/d1e/d6a/d7f/d84/d6e 39 2023-12-05T13:25:25.315 INFO:tasks.workunit.client.1.smithi052.stdout:1/590: link d5/f2c d5/d7/d35/d37/d5a/d73/dac/fbb 0 2023-12-05T13:25:25.318 INFO:tasks.workunit.client.1.smithi052.stdout:4/646: mknod de/d30/d68/d5c/db8/cd6 0 2023-12-05T13:25:25.319 INFO:tasks.workunit.client.1.smithi052.stdout:0/637: rename d0/db/d1b/d29/db0/f95 to d0/db/d52/d7f/fce 0 2023-12-05T13:25:25.321 INFO:tasks.workunit.client.1.smithi052.stdout:5/375: creat d5/d15/f7a x:0 0 0 2023-12-05T13:25:25.322 INFO:tasks.workunit.client.1.smithi052.stdout:4/647: dread de/d30/d68/f50 [0,4194304] 0 2023-12-05T13:25:25.322 INFO:tasks.workunit.client.1.smithi052.stdout:6/485: truncate d3/d4/d6/f25 2339788 0 2023-12-05T13:25:25.326 INFO:tasks.workunit.client.1.smithi052.stdout:2/652: mkdir d2/d13/d1e/dae/dc3 0 2023-12-05T13:25:25.326 INFO:tasks.workunit.client.1.smithi052.stdout:2/653: fsync d2/d13/d1e/f3d 0 2023-12-05T13:25:25.326 INFO:tasks.workunit.client.1.smithi052.stdout:1/591: mkdir d5/d7/d35/d37/d43/dbc 0 2023-12-05T13:25:25.333 INFO:tasks.workunit.client.1.smithi052.stdout:8/677: rename d0/d4d/c6c to d0/de/d12/d29/db3/dc5/cd7 0 2023-12-05T13:25:25.334 INFO:tasks.workunit.client.1.smithi052.stdout:5/376: dwrite d5/d15/f31 [0,4194304] 0 2023-12-05T13:25:25.338 INFO:tasks.workunit.client.1.smithi052.stdout:6/486: mknod d3/d4/df/d24/cad 0 2023-12-05T13:25:25.339 INFO:tasks.workunit.client.1.smithi052.stdout:2/654: getdents d2/d13/d1e/d6a/d7f 0 2023-12-05T13:25:25.340 INFO:tasks.workunit.client.1.smithi052.stdout:8/678: dread d0/de/d27/f57 [0,4194304] 0 2023-12-05T13:25:25.341 INFO:tasks.workunit.client.1.smithi052.stdout:1/592: truncate d5/daa/f32 2730012 0 2023-12-05T13:25:25.343 INFO:tasks.workunit.client.0.smithi029.stderr:++ readlink -f fsstress 2023-12-05T13:25:25.344 INFO:tasks.workunit.client.0.smithi029.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-05T13:25:25.344 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2023-12-05T13:25:25.344 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T13:25:25.345 INFO:tasks.workunit.client.0.smithi029.stderr:+ popd 2023-12-05T13:25:25.345 INFO:tasks.workunit.client.0.smithi029.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-05T13:25:25.345 INFO:tasks.workunit.client.0.smithi029.stderr:++ mktemp -d -p . 2023-12-05T13:25:25.345 INFO:tasks.workunit.client.1.smithi052.stdout:5/377: rename d5/d15/f7a to d5/f7b 0 2023-12-05T13:25:25.347 INFO:tasks.workunit.client.1.smithi052.stdout:2/655: mkdir d2/d13/d37/d5c/d80/dc4 0 2023-12-05T13:25:25.350 INFO:tasks.workunit.client.0.smithi029.stderr:+ T=./tmp.nMPhzWxL2m 2023-12-05T13:25:25.350 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.nMPhzWxL2m -l 1 -n 1000 -p 10 -v 2023-12-05T13:25:25.352 INFO:tasks.workunit.client.1.smithi052.stdout:8/679: creat d0/de/d27/d43/d44/fd8 x:0 0 0 2023-12-05T13:25:25.356 INFO:tasks.workunit.client.1.smithi052.stdout:1/593: mkdir d5/d26/d41/dbd 0 2023-12-05T13:25:25.357 INFO:tasks.workunit.client.0.smithi029.stdout:seed = 1701466424 2023-12-05T13:25:25.362 INFO:tasks.workunit.client.1.smithi052.stdout:2/656: mkdir d2/d13/d1e/d6a/d7f/dc5 0 2023-12-05T13:25:25.364 INFO:tasks.workunit.client.1.smithi052.stdout:1/594: rename d5/daa/d2a/f9f to d5/d7/d35/d37/fbe 0 2023-12-05T13:25:25.365 INFO:tasks.workunit.client.0.smithi029.stdout:0/0: dread - no filename 2023-12-05T13:25:25.365 INFO:tasks.workunit.client.0.smithi029.stdout:0/1: fsync - no filename 2023-12-05T13:25:25.365 INFO:tasks.workunit.client.0.smithi029.stdout:0/2: dwrite - no filename 2023-12-05T13:25:25.365 INFO:tasks.workunit.client.0.smithi029.stdout:0/3: write - no filename 2023-12-05T13:25:25.365 INFO:tasks.workunit.client.1.smithi052.stdout:5/378: dwrite f4 [0,4194304] 0 2023-12-05T13:25:25.366 INFO:tasks.workunit.client.1.smithi052.stdout:1/595: mkdir d5/d26/dbf 0 2023-12-05T13:25:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/0: truncate - no filename 2023-12-05T13:25:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/1: dwrite - no filename 2023-12-05T13:25:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/2: dread - no filename 2023-12-05T13:25:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/3: chown . 3531 1 2023-12-05T13:25:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/4: stat - no entries 2023-12-05T13:25:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:1/5: chown . 173 1 2023-12-05T13:25:25.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/4: creat f0 x:0 0 0 2023-12-05T13:25:25.373 INFO:tasks.workunit.client.0.smithi029.stdout:3/0: rename - no filename 2023-12-05T13:25:25.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/1: rmdir - no directory 2023-12-05T13:25:25.374 INFO:tasks.workunit.client.1.smithi052.stdout:8/680: dwrite d0/d28/d39/d3a/d8f/fb2 [0,4194304] 0 2023-12-05T13:25:25.374 INFO:tasks.workunit.client.1.smithi052.stdout:5/379: creat d5/df/d4b/d74/f7c x:0 0 0 2023-12-05T13:25:25.375 INFO:tasks.workunit.client.0.smithi029.stdout:1/6: creat f0 x:0 0 0 2023-12-05T13:25:25.376 INFO:tasks.workunit.client.0.smithi029.stdout:1/7: dread - f0 zero size 2023-12-05T13:25:25.376 INFO:tasks.workunit.client.0.smithi029.stdout:1/8: read - f0 zero size 2023-12-05T13:25:25.376 INFO:tasks.workunit.client.1.smithi052.stdout:1/596: mknod d5/d7/de/d74/d99/cc0 0 2023-12-05T13:25:25.378 INFO:tasks.workunit.client.1.smithi052.stdout:1/597: write d5/d7/f13 [5432059,121263] 0 2023-12-05T13:25:25.379 INFO:tasks.workunit.client.1.smithi052.stdout:1/598: write d5/daa/d69/f82 [2997969,72226] 0 2023-12-05T13:25:25.379 INFO:tasks.workunit.client.1.smithi052.stdout:1/599: write d5/d7/de/d74/f77 [1181828,96558] 0 2023-12-05T13:25:25.379 INFO:tasks.workunit.client.1.smithi052.stdout:1/600: fdatasync d5/d26/d41/f5f 0 2023-12-05T13:25:25.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/2: symlink l0 0 2023-12-05T13:25:25.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/3: chown l0 1 1 2023-12-05T13:25:25.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/4: read - no filename 2023-12-05T13:25:25.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/5: truncate - no filename 2023-12-05T13:25:25.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/6: truncate - no filename 2023-12-05T13:25:25.388 INFO:tasks.workunit.client.0.smithi029.stdout:1/9: mknod c1 0 2023-12-05T13:25:25.388 INFO:tasks.workunit.client.0.smithi029.stdout:1/10: dread - f0 zero size 2023-12-05T13:25:25.388 INFO:tasks.workunit.client.0.smithi029.stdout:1/11: rmdir - no directory 2023-12-05T13:25:25.390 INFO:tasks.workunit.client.0.smithi029.stdout:5/0: chown . 2492309 1 2023-12-05T13:25:25.391 INFO:tasks.workunit.client.0.smithi029.stdout:4/0: mkdir d0 0 2023-12-05T13:25:25.393 INFO:tasks.workunit.client.0.smithi029.stdout:6/0: rename - no filename 2023-12-05T13:25:25.394 INFO:tasks.workunit.client.0.smithi029.stdout:5/1: symlink l0 0 2023-12-05T13:25:25.394 INFO:tasks.workunit.client.0.smithi029.stdout:5/2: stat l0 0 2023-12-05T13:25:25.394 INFO:tasks.workunit.client.0.smithi029.stdout:5/3: write - no filename 2023-12-05T13:25:25.397 INFO:tasks.workunit.client.0.smithi029.stdout:4/1: mkdir d0/d1 0 2023-12-05T13:25:25.398 INFO:tasks.workunit.client.0.smithi029.stdout:7/0: stat - no entries 2023-12-05T13:25:25.398 INFO:tasks.workunit.client.1.smithi052.stdout:1/601: dwrite d5/d7/d35/d2f/f7f [0,4194304] 0 2023-12-05T13:25:25.399 INFO:tasks.workunit.client.0.smithi029.stdout:6/1: mknod c0 0 2023-12-05T13:25:25.399 INFO:tasks.workunit.client.0.smithi029.stdout:6/2: dread - no filename 2023-12-05T13:25:25.401 INFO:tasks.workunit.client.0.smithi029.stdout:5/4: mkdir d1 0 2023-12-05T13:25:25.404 INFO:tasks.workunit.client.1.smithi052.stdout:1/602: creat d5/d7/d35/d37/d5a/d73/d76/fc1 x:0 0 0 2023-12-05T13:25:25.404 INFO:tasks.workunit.client.1.smithi052.stdout:1/603: stat d5/daa/d17/d3c/f80 0 2023-12-05T13:25:25.404 INFO:tasks.workunit.client.1.smithi052.stdout:1/604: stat d5/d7/d35/d37/d5a/d73/d7e/c8e 0 2023-12-05T13:25:25.406 INFO:tasks.workunit.client.0.smithi029.stdout:8/0: dwrite - no filename 2023-12-05T13:25:25.406 INFO:tasks.workunit.client.1.smithi052.stdout:1/605: dread d5/daa/d2a/f49 [0,4194304] 0 2023-12-05T13:25:25.407 INFO:tasks.workunit.client.0.smithi029.stdout:7/1: mknod c0 0 2023-12-05T13:25:25.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/3: symlink l1 0 2023-12-05T13:25:25.408 INFO:tasks.workunit.client.0.smithi029.stdout:6/4: write - no filename 2023-12-05T13:25:25.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/5: truncate - no filename 2023-12-05T13:25:25.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/6: write - no filename 2023-12-05T13:25:25.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/7: dwrite - no filename 2023-12-05T13:25:25.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/8: stat l1 0 2023-12-05T13:25:25.409 INFO:tasks.workunit.client.0.smithi029.stdout:5/5: mknod d1/c2 0 2023-12-05T13:25:25.411 INFO:tasks.workunit.client.0.smithi029.stdout:2/0: getdents . 0 2023-12-05T13:25:25.411 INFO:tasks.workunit.client.0.smithi029.stdout:2/1: write - no filename 2023-12-05T13:25:25.412 INFO:tasks.workunit.client.0.smithi029.stdout:8/1: creat f0 x:0 0 0 2023-12-05T13:25:25.414 INFO:tasks.workunit.client.0.smithi029.stdout:7/2: creat f1 x:0 0 0 2023-12-05T13:25:25.414 INFO:tasks.workunit.client.0.smithi029.stdout:7/3: dread - f1 zero size 2023-12-05T13:25:25.414 INFO:tasks.workunit.client.0.smithi029.stdout:7/4: write f1 [326513,83286] 0 2023-12-05T13:25:25.415 INFO:tasks.workunit.client.0.smithi029.stdout:7/5: read f1 [311516,63950] 0 2023-12-05T13:25:25.415 INFO:tasks.workunit.client.0.smithi029.stdout:6/9: rename l1 to l2 0 2023-12-05T13:25:25.415 INFO:tasks.workunit.client.0.smithi029.stdout:6/10: dread - no filename 2023-12-05T13:25:25.417 INFO:tasks.workunit.client.0.smithi029.stdout:5/6: creat d1/f3 x:0 0 0 2023-12-05T13:25:25.417 INFO:tasks.workunit.client.0.smithi029.stdout:5/7: chown d1 4 1 2023-12-05T13:25:25.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/0: rename - no filename 2023-12-05T13:25:25.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/1: dread - no filename 2023-12-05T13:25:25.418 INFO:tasks.workunit.client.0.smithi029.stdout:9/2: fdatasync - no filename 2023-12-05T13:25:25.419 INFO:tasks.workunit.client.0.smithi029.stdout:9/3: getdents . 0 2023-12-05T13:25:25.419 INFO:tasks.workunit.client.0.smithi029.stdout:2/2: mknod c0 0 2023-12-05T13:25:25.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/2: symlink l1 0 2023-12-05T13:25:25.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/3: rmdir - no directory 2023-12-05T13:25:25.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/4: write f0 [642028,16911] 0 2023-12-05T13:25:25.422 INFO:tasks.workunit.client.0.smithi029.stdout:6/11: mkdir d3 0 2023-12-05T13:25:25.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/8: creat d1/f4 x:0 0 0 2023-12-05T13:25:25.423 INFO:tasks.workunit.client.0.smithi029.stdout:5/9: dread - d1/f3 zero size 2023-12-05T13:25:25.424 INFO:tasks.workunit.client.0.smithi029.stdout:9/4: mknod c0 0 2023-12-05T13:25:25.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/3: rename c0 to c1 0 2023-12-05T13:25:25.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/4: write - no filename 2023-12-05T13:25:25.425 INFO:tasks.workunit.client.0.smithi029.stdout:2/5: chown c1 7 1 2023-12-05T13:25:25.426 INFO:tasks.workunit.client.0.smithi029.stdout:8/5: mknod c2 0 2023-12-05T13:25:25.428 INFO:tasks.workunit.client.0.smithi029.stdout:6/12: rmdir d3 0 2023-12-05T13:25:25.428 INFO:tasks.workunit.client.0.smithi029.stdout:6/13: chown l2 24315 1 2023-12-05T13:25:25.429 INFO:tasks.workunit.client.0.smithi029.stdout:9/5: rename c0 to c1 0 2023-12-05T13:25:25.429 INFO:tasks.workunit.client.0.smithi029.stdout:9/6: truncate - no filename 2023-12-05T13:25:25.435 INFO:tasks.workunit.client.1.smithi052.stdout:2/657: dwrite d2/f3c [0,4194304] 0 2023-12-05T13:25:25.437 INFO:tasks.workunit.client.1.smithi052.stdout:5/380: dread d5/d15/d21/d4a/d6e/f71 [0,4194304] 0 2023-12-05T13:25:25.437 INFO:tasks.workunit.client.0.smithi029.stdout:8/6: dread f0 [0,4194304] 0 2023-12-05T13:25:25.438 INFO:tasks.workunit.client.1.smithi052.stdout:5/381: write d5/d15/d21/f60 [2203760,25023] 0 2023-12-05T13:25:25.441 INFO:tasks.workunit.client.1.smithi052.stdout:7/659: sync 2023-12-05T13:25:25.442 INFO:tasks.workunit.client.0.smithi029.stdout:8/7: mknod c3 0 2023-12-05T13:25:25.443 INFO:tasks.workunit.client.0.smithi029.stdout:7/6: dwrite f1 [0,4194304] 0 2023-12-05T13:25:25.447 INFO:tasks.workunit.client.1.smithi052.stdout:4/648: dwrite de/d30/d73/dbe/d24/f6e [0,4194304] 0 2023-12-05T13:25:25.448 INFO:tasks.workunit.client.1.smithi052.stdout:5/382: unlink f3 0 2023-12-05T13:25:25.449 INFO:tasks.workunit.client.1.smithi052.stdout:7/660: truncate d7/d31/f55 3000931 0 2023-12-05T13:25:25.454 INFO:tasks.workunit.client.0.smithi029.stdout:1/12: dwrite f0 [0,4194304] 0 2023-12-05T13:25:25.456 INFO:tasks.workunit.client.1.smithi052.stdout:2/658: dwrite d2/d13/d1e/d6a/d7f/d84/f55 [4194304,4194304] 0 2023-12-05T13:25:25.457 INFO:tasks.workunit.client.0.smithi029.stdout:7/7: unlink c0 0 2023-12-05T13:25:25.457 INFO:tasks.workunit.client.0.smithi029.stdout:7/8: rmdir - no directory 2023-12-05T13:25:25.459 INFO:tasks.workunit.client.0.smithi029.stdout:8/8: dwrite f0 [0,4194304] 0 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/7: getdents . 0 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/8: dwrite - no filename 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/9: dread - no filename 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/10: dread - no filename 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/11: dwrite - no filename 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/12: dwrite - no filename 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/13: dread - no filename 2023-12-05T13:25:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/14: dwrite - no filename 2023-12-05T13:25:25.465 INFO:tasks.workunit.client.0.smithi029.stdout:8/9: read f0 [3618310,108900] 0 2023-12-05T13:25:25.465 INFO:tasks.workunit.client.1.smithi052.stdout:4/649: symlink de/d29/d51/d76/ld7 0 2023-12-05T13:25:25.466 INFO:tasks.workunit.client.0.smithi029.stdout:8/10: read f0 [3387398,82764] 0 2023-12-05T13:25:25.467 INFO:tasks.workunit.client.1.smithi052.stdout:5/383: symlink d5/df/d4b/l7d 0 2023-12-05T13:25:25.468 INFO:tasks.workunit.client.1.smithi052.stdout:5/384: truncate d5/d15/d21/f75 964901 0 2023-12-05T13:25:25.472 INFO:tasks.workunit.client.0.smithi029.stdout:7/9: dwrite f1 [0,4194304] 0 2023-12-05T13:25:25.472 INFO:tasks.workunit.client.0.smithi029.stdout:7/10: stat f1 0 2023-12-05T13:25:25.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/15: unlink l0 0 2023-12-05T13:25:25.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/16: rename - no filename 2023-12-05T13:25:25.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/17: chown . 2002 1 2023-12-05T13:25:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:4/2: getdents d0 0 2023-12-05T13:25:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:4/3: chown d0/d1 176223 1 2023-12-05T13:25:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:4/4: dread - no filename 2023-12-05T13:25:25.475 INFO:tasks.workunit.client.1.smithi052.stdout:7/661: symlink d7/d4e/d12/d3f/d75/lde 0 2023-12-05T13:25:25.475 INFO:tasks.workunit.client.1.smithi052.stdout:5/385: dread d5/df/d11/d73/d77/f78 [0,4194304] 0 2023-12-05T13:25:25.476 INFO:tasks.workunit.client.0.smithi029.stdout:8/11: creat f4 x:0 0 0 2023-12-05T13:25:25.478 INFO:tasks.workunit.client.1.smithi052.stdout:2/659: link d2/d13/d1e/l43 d2/d13/d1e/d6a/d7f/lc6 0 2023-12-05T13:25:25.479 INFO:tasks.workunit.client.0.smithi029.stdout:7/11: dread f1 [0,4194304] 0 2023-12-05T13:25:25.480 INFO:tasks.workunit.client.0.smithi029.stdout:7/12: chown f1 0 1 2023-12-05T13:25:25.480 INFO:tasks.workunit.client.0.smithi029.stdout:7/13: truncate f1 4670831 0 2023-12-05T13:25:25.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/18: mkdir d1 0 2023-12-05T13:25:25.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/19: fdatasync - no filename 2023-12-05T13:25:25.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/20: fdatasync - no filename 2023-12-05T13:25:25.481 INFO:tasks.workunit.client.1.smithi052.stdout:2/660: dread d2/d13/d1e/f3d [0,4194304] 0 2023-12-05T13:25:25.481 INFO:tasks.workunit.client.1.smithi052.stdout:2/661: chown d2/d13/d37/d5c/d80/laa 110 1 2023-12-05T13:25:25.481 INFO:tasks.workunit.client.1.smithi052.stdout:2/662: fsync d2/d13/d37/d61/fb8 0 2023-12-05T13:25:25.482 INFO:tasks.workunit.client.1.smithi052.stdout:2/663: stat d2/d4/d63/f76 0 2023-12-05T13:25:25.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/5: mknod d0/d1/c2 0 2023-12-05T13:25:25.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/6: read - no filename 2023-12-05T13:25:25.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/7: stat d0/d1 0 2023-12-05T13:25:25.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/8: dwrite - no filename 2023-12-05T13:25:25.483 INFO:tasks.workunit.client.1.smithi052.stdout:7/662: getdents d7/d4e/d12/d3f/d46 0 2023-12-05T13:25:25.484 INFO:tasks.workunit.client.0.smithi029.stdout:8/12: mkdir d5 0 2023-12-05T13:25:25.484 INFO:tasks.workunit.client.0.smithi029.stdout:8/13: getdents d5 0 2023-12-05T13:25:25.485 INFO:tasks.workunit.client.1.smithi052.stdout:5/386: mknod d5/d46/d76/c7e 0 2023-12-05T13:25:25.486 INFO:tasks.workunit.client.0.smithi029.stdout:7/14: mknod c2 0 2023-12-05T13:25:25.489 INFO:tasks.workunit.client.0.smithi029.stdout:3/21: creat d1/f2 x:0 0 0 2023-12-05T13:25:25.489 INFO:tasks.workunit.client.1.smithi052.stdout:4/650: dwrite de/d29/f56 [0,4194304] 0 2023-12-05T13:25:25.489 INFO:tasks.workunit.client.1.smithi052.stdout:4/651: fdatasync de/d29/d51/da3/d6d/fc3 0 2023-12-05T13:25:25.493 INFO:tasks.workunit.client.1.smithi052.stdout:7/663: creat d7/d31/fdf x:0 0 0 2023-12-05T13:25:25.493 INFO:tasks.workunit.client.1.smithi052.stdout:5/387: mkdir d5/d7f 0 2023-12-05T13:25:25.493 INFO:tasks.workunit.client.1.smithi052.stdout:5/388: chown d5/d15/d21/f2e 5 1 2023-12-05T13:25:25.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/14: mkdir d5/d6 0 2023-12-05T13:25:25.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/15: creat f3 x:0 0 0 2023-12-05T13:25:25.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/16: fdatasync f1 0 2023-12-05T13:25:25.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/17: dread - f3 zero size 2023-12-05T13:25:25.499 INFO:tasks.workunit.client.0.smithi029.stdout:6/14: link l2 l4 0 2023-12-05T13:25:25.499 INFO:tasks.workunit.client.1.smithi052.stdout:2/664: dwrite d2/d13/d1e/d6a/d7f/d84/d6e/f7a [0,4194304] 0 2023-12-05T13:25:25.499 INFO:tasks.workunit.client.1.smithi052.stdout:2/665: fdatasync d2/d13/d37/d8b/fb9 0 2023-12-05T13:25:25.501 INFO:tasks.workunit.client.0.smithi029.stdout:3/22: dwrite d1/f2 [0,4194304] 0 2023-12-05T13:25:25.501 INFO:tasks.workunit.client.1.smithi052.stdout:4/652: creat de/d30/d73/dbe/d24/fd8 x:0 0 0 2023-12-05T13:25:25.502 INFO:tasks.workunit.client.1.smithi052.stdout:2/666: dread d2/d13/f22 [0,4194304] 0 2023-12-05T13:25:25.502 INFO:tasks.workunit.client.0.smithi029.stdout:8/15: symlink d5/d6/l7 0 2023-12-05T13:25:25.504 INFO:tasks.workunit.client.1.smithi052.stdout:7/664: rename d7/d4e/d12/d3f/f44 to d7/d4e/d45/d5a/fe0 0 2023-12-05T13:25:25.504 INFO:tasks.workunit.client.0.smithi029.stdout:5/10: fsync d1/f4 0 2023-12-05T13:25:25.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/18: mknod c4 0 2023-12-05T13:25:25.506 INFO:tasks.workunit.client.1.smithi052.stdout:7/665: write d7/d4e/d12/f29 [2504693,100530] 0 2023-12-05T13:25:25.506 INFO:tasks.workunit.client.1.smithi052.stdout:7/666: truncate d7/d4e/d45/d5a/fe0 1112207 0 2023-12-05T13:25:25.506 INFO:tasks.workunit.client.1.smithi052.stdout:5/389: mknod d5/df/d4e/d5b/c80 0 2023-12-05T13:25:25.506 INFO:tasks.workunit.client.1.smithi052.stdout:5/390: write d5/d15/d21/d25/f6d [639205,126835] 0 2023-12-05T13:25:25.508 INFO:tasks.workunit.client.0.smithi029.stdout:6/15: stat l2 0 2023-12-05T13:25:25.508 INFO:tasks.workunit.client.0.smithi029.stdout:6/16: readlink l4 0 2023-12-05T13:25:25.508 INFO:tasks.workunit.client.0.smithi029.stdout:6/17: chown l2 0 1 2023-12-05T13:25:25.514 INFO:tasks.workunit.client.0.smithi029.stdout:9/7: getdents . 0 2023-12-05T13:25:25.514 INFO:tasks.workunit.client.1.smithi052.stdout:5/391: dread d5/d15/d21/d25/d3f/f50 [0,4194304] 0 2023-12-05T13:25:25.514 INFO:tasks.workunit.client.1.smithi052.stdout:2/667: dread d2/d13/d1e/fa8 [0,4194304] 0 2023-12-05T13:25:25.515 INFO:tasks.workunit.client.1.smithi052.stdout:2/668: dread - d2/d13/d1e/dae/fb7 zero size 2023-12-05T13:25:25.519 INFO:tasks.workunit.client.1.smithi052.stdout:4/653: symlink de/d30/d73/dbe/ld9 0 2023-12-05T13:25:25.520 INFO:tasks.workunit.client.1.smithi052.stdout:7/667: symlink d7/d4e/d12/d3f/d46/le1 0 2023-12-05T13:25:25.520 INFO:tasks.workunit.client.1.smithi052.stdout:4/654: write de/f98 [764759,130080] 0 2023-12-05T13:25:25.520 INFO:tasks.workunit.client.1.smithi052.stdout:4/655: fsync de/d30/d73/f9a 0 2023-12-05T13:25:25.520 INFO:tasks.workunit.client.1.smithi052.stdout:4/656: dread - de/d30/d73/fa1 zero size 2023-12-05T13:25:25.520 INFO:tasks.workunit.client.0.smithi029.stdout:8/16: link l1 d5/d6/l8 0 2023-12-05T13:25:25.520 INFO:tasks.workunit.client.0.smithi029.stdout:8/17: stat c3 0 2023-12-05T13:25:25.522 INFO:tasks.workunit.client.1.smithi052.stdout:3/660: sync 2023-12-05T13:25:25.522 INFO:tasks.workunit.client.1.smithi052.stdout:3/661: chown da/d25/d33/d49/dbd/d74 243841 1 2023-12-05T13:25:25.522 INFO:tasks.workunit.client.1.smithi052.stdout:3/662: fsync da/d25/d33/d43/d5b/fb3 0 2023-12-05T13:25:25.522 INFO:tasks.workunit.client.0.smithi029.stdout:5/11: rename d1/f3 to d1/f5 0 2023-12-05T13:25:25.525 INFO:tasks.workunit.client.0.smithi029.stdout:7/19: dwrite f1 [0,4194304] 0 2023-12-05T13:25:25.525 INFO:tasks.workunit.client.0.smithi029.stdout:6/18: creat f5 x:0 0 0 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:5/392: creat d5/df/d4e/d5b/f81 x:0 0 0 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:4/657: dread fa [4194304,4194304] 0 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:5/393: write d5/df/d4b/d74/f7c [27727,66310] 0 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:5/394: chown d5/df/f17 30709 1 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:5/395: dread - d5/df/d4e/d5b/f81 zero size 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:4/658: write de/d30/d73/fa1 [425038,63529] 0 2023-12-05T13:25:25.526 INFO:tasks.workunit.client.1.smithi052.stdout:2/669: mknod d2/d13/d37/d61/cc7 0 2023-12-05T13:25:25.528 INFO:tasks.workunit.client.0.smithi029.stdout:9/8: link c1 c2 0 2023-12-05T13:25:25.528 INFO:tasks.workunit.client.0.smithi029.stdout:9/9: write - no filename 2023-12-05T13:25:25.528 INFO:tasks.workunit.client.0.smithi029.stdout:9/10: chown c2 53093 1 2023-12-05T13:25:25.529 INFO:tasks.workunit.client.1.smithi052.stdout:7/668: dread d7/d4e/d45/fbb [0,4194304] 0 2023-12-05T13:25:25.529 INFO:tasks.workunit.client.1.smithi052.stdout:7/669: write d7/d4e/d45/d5a/d16/f7c [1319464,128103] 0 2023-12-05T13:25:25.529 INFO:tasks.workunit.client.1.smithi052.stdout:3/663: creat da/fde x:0 0 0 2023-12-05T13:25:25.532 INFO:tasks.workunit.client.1.smithi052.stdout:5/396: creat d5/df/d4e/d5b/f82 x:0 0 0 2023-12-05T13:25:25.533 INFO:tasks.workunit.client.0.smithi029.stdout:8/18: rename f0 to d5/d6/f9 0 2023-12-05T13:25:25.535 INFO:tasks.workunit.client.1.smithi052.stdout:4/659: mknod de/d29/d51/d76/cda 0 2023-12-05T13:25:25.536 INFO:tasks.workunit.client.0.smithi029.stdout:5/12: mknod d1/c6 0 2023-12-05T13:25:25.536 INFO:tasks.workunit.client.0.smithi029.stdout:5/13: readlink l0 0 2023-12-05T13:25:25.538 INFO:tasks.workunit.client.1.smithi052.stdout:2/670: symlink d2/d13/d37/db2/lc8 0 2023-12-05T13:25:25.539 INFO:tasks.workunit.client.1.smithi052.stdout:0/638: sync 2023-12-05T13:25:25.539 INFO:tasks.workunit.client.1.smithi052.stdout:9/553: sync 2023-12-05T13:25:25.540 INFO:tasks.workunit.client.1.smithi052.stdout:7/670: rmdir d7/d4e/d45/d5a/d66/dcc 0 2023-12-05T13:25:25.543 INFO:tasks.workunit.client.1.smithi052.stdout:5/397: unlink d5/d15/d21/f3a 0 2023-12-05T13:25:25.544 INFO:tasks.workunit.client.0.smithi029.stdout:1/13: dwrite f0 [4194304,4194304] 0 2023-12-05T13:25:25.545 INFO:tasks.workunit.client.1.smithi052.stdout:4/660: creat de/d30/d94/fdb x:0 0 0 2023-12-05T13:25:25.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/11: mknod c3 0 2023-12-05T13:25:25.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/12: chown c2 29294 1 2023-12-05T13:25:25.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/13: write - no filename 2023-12-05T13:25:25.552 INFO:tasks.workunit.client.1.smithi052.stdout:2/671: unlink d2/d13/d37/d61/l8a 0 2023-12-05T13:25:25.553 INFO:tasks.workunit.client.1.smithi052.stdout:3/664: dwrite da/d7a/fa3 [0,4194304] 0 2023-12-05T13:25:25.553 INFO:tasks.workunit.client.1.smithi052.stdout:3/665: fdatasync da/d25/d33/fc5 0 2023-12-05T13:25:25.553 INFO:tasks.workunit.client.1.smithi052.stdout:5/398: dread d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:25:25.553 INFO:tasks.workunit.client.1.smithi052.stdout:0/639: mkdir d0/db/d1b/d51/d55/d66/dcf 0 2023-12-05T13:25:25.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/554: creat d3/d1e/d62/fba x:0 0 0 2023-12-05T13:25:25.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/555: fdatasync d3/d1e/f23 0 2023-12-05T13:25:25.555 INFO:tasks.workunit.client.0.smithi029.stdout:5/14: dwrite d1/f5 [0,4194304] 0 2023-12-05T13:25:25.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/671: link d7/d4e/d12/d3f/d46/c8e d7/d4e/d45/d5a/d63/d95/ce2 0 2023-12-05T13:25:25.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/672: fsync d7/d4e/d45/d50/f8f 0 2023-12-05T13:25:25.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/673: readlink d7/l32 0 2023-12-05T13:25:25.564 INFO:tasks.workunit.client.0.smithi029.stdout:7/20: getdents . 0 2023-12-05T13:25:25.566 INFO:tasks.workunit.client.1.smithi052.stdout:7/674: dread d7/d4e/f2b [0,4194304] 0 2023-12-05T13:25:25.567 INFO:tasks.workunit.client.1.smithi052.stdout:4/661: mkdir de/d30/d68/d5c/db8/ddc 0 2023-12-05T13:25:25.567 INFO:tasks.workunit.client.1.smithi052.stdout:6/487: sync 2023-12-05T13:25:25.567 INFO:tasks.workunit.client.1.smithi052.stdout:1/606: sync 2023-12-05T13:25:25.567 INFO:tasks.workunit.client.1.smithi052.stdout:8/681: sync 2023-12-05T13:25:25.567 INFO:tasks.workunit.client.1.smithi052.stdout:7/675: write d7/d4e/d12/f29 [3428960,97902] 0 2023-12-05T13:25:25.569 INFO:tasks.workunit.client.1.smithi052.stdout:0/640: rmdir d0/db/d14/d60 39 2023-12-05T13:25:25.570 INFO:tasks.workunit.client.0.smithi029.stdout:9/14: rename c2 to c4 0 2023-12-05T13:25:25.575 INFO:tasks.workunit.client.0.smithi029.stdout:7/21: dread f1 [0,4194304] 0 2023-12-05T13:25:25.575 INFO:tasks.workunit.client.0.smithi029.stdout:7/22: fdatasync f3 0 2023-12-05T13:25:25.576 INFO:tasks.workunit.client.0.smithi029.stdout:3/23: truncate d1/f2 1739576 0 2023-12-05T13:25:25.576 INFO:tasks.workunit.client.1.smithi052.stdout:9/556: creat d3/d2a/fbb x:0 0 0 2023-12-05T13:25:25.577 INFO:tasks.workunit.client.1.smithi052.stdout:4/662: unlink de/d30/d73/cd5 0 2023-12-05T13:25:25.579 INFO:tasks.workunit.client.1.smithi052.stdout:7/676: unlink d7/d4e/db4/cd2 0 2023-12-05T13:25:25.580 INFO:tasks.workunit.client.1.smithi052.stdout:8/682: write d0/de/d27/d43/d63/f8b [2367562,124099] 0 2023-12-05T13:25:25.580 INFO:tasks.workunit.client.0.smithi029.stdout:7/23: symlink l5 0 2023-12-05T13:25:25.580 INFO:tasks.workunit.client.0.smithi029.stdout:7/24: read - f3 zero size 2023-12-05T13:25:25.581 INFO:tasks.workunit.client.0.smithi029.stdout:7/25: write f3 [968188,122393] 0 2023-12-05T13:25:25.581 INFO:tasks.workunit.client.1.smithi052.stdout:1/607: dread d5/d7/d35/d2f/d3e/f54 [4194304,4194304] 0 2023-12-05T13:25:25.582 INFO:tasks.workunit.client.1.smithi052.stdout:0/641: creat d0/fd0 x:0 0 0 2023-12-05T13:25:25.582 INFO:tasks.workunit.client.1.smithi052.stdout:6/488: write d3/d4/df/d24/f75 [1677882,46987] 0 2023-12-05T13:25:25.582 INFO:tasks.workunit.client.1.smithi052.stdout:6/489: write d3/d5/d9/f2e [2320716,68701] 0 2023-12-05T13:25:25.582 INFO:tasks.workunit.client.1.smithi052.stdout:0/642: write d0/fd [8747467,55397] 0 2023-12-05T13:25:25.583 INFO:tasks.workunit.client.0.smithi029.stdout:3/24: creat d1/f3 x:0 0 0 2023-12-05T13:25:25.587 INFO:tasks.workunit.client.1.smithi052.stdout:2/672: dwrite d2/d14/f66 [8388608,4194304] 0 2023-12-05T13:25:25.588 INFO:tasks.workunit.client.0.smithi029.stdout:5/15: dwrite d1/f5 [0,4194304] 0 2023-12-05T13:25:25.588 INFO:tasks.workunit.client.0.smithi029.stdout:6/19: fsync f5 0 2023-12-05T13:25:25.590 INFO:tasks.workunit.client.1.smithi052.stdout:9/557: getdents d3/d5e/da7/daf 0 2023-12-05T13:25:25.590 INFO:tasks.workunit.client.1.smithi052.stdout:4/663: mkdir de/d30/d73/dbe/d24/ddd 0 2023-12-05T13:25:25.590 INFO:tasks.workunit.client.1.smithi052.stdout:3/666: dwrite da/d2e/f85 [0,4194304] 0 2023-12-05T13:25:25.590 INFO:tasks.workunit.client.1.smithi052.stdout:7/677: creat d7/d31/d56/d60/d72/fe3 x:0 0 0 2023-12-05T13:25:25.590 INFO:tasks.workunit.client.1.smithi052.stdout:3/667: write da/d25/d33/d43/f80 [5145773,53336] 0 2023-12-05T13:25:25.590 INFO:tasks.workunit.client.1.smithi052.stdout:5/399: dwrite d5/df/f17 [0,4194304] 0 2023-12-05T13:25:25.592 INFO:tasks.workunit.client.1.smithi052.stdout:8/683: dread d0/fa [0,4194304] 0 2023-12-05T13:25:25.592 INFO:tasks.workunit.client.1.smithi052.stdout:1/608: mkdir d5/daa/d17/d3c/dc2 0 2023-12-05T13:25:25.592 INFO:tasks.workunit.client.1.smithi052.stdout:1/609: chown d5/daa/f55 4166765 1 2023-12-05T13:25:25.592 INFO:tasks.workunit.client.1.smithi052.stdout:1/610: write d5/d7/d35/d37/d5a/d73/d76/fc1 [629769,72918] 0 2023-12-05T13:25:25.592 INFO:tasks.workunit.client.1.smithi052.stdout:1/611: getdents d5/d7/d35/d37/d5a/d73/dae 0 2023-12-05T13:25:25.593 INFO:tasks.workunit.client.0.smithi029.stdout:5/16: rename d1/f5 to d1/f7 0 2023-12-05T13:25:25.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/20: mkdir d6 0 2023-12-05T13:25:25.597 INFO:tasks.workunit.client.1.smithi052.stdout:6/490: mknod d3/cae 0 2023-12-05T13:25:25.599 INFO:tasks.workunit.client.0.smithi029.stdout:5/17: creat d1/f8 x:0 0 0 2023-12-05T13:25:25.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/21: symlink d6/l7 0 2023-12-05T13:25:25.604 INFO:tasks.workunit.client.0.smithi029.stdout:7/26: dwrite f1 [4194304,4194304] 0 2023-12-05T13:25:25.605 INFO:tasks.workunit.client.0.smithi029.stdout:7/27: truncate f3 1822884 0 2023-12-05T13:25:25.606 INFO:tasks.workunit.client.1.smithi052.stdout:0/643: creat d0/db/d14/fd1 x:0 0 0 2023-12-05T13:25:25.606 INFO:tasks.workunit.client.1.smithi052.stdout:0/644: truncate d0/db/d2e/f47 249743 0 2023-12-05T13:25:25.607 INFO:tasks.workunit.client.0.smithi029.stdout:5/18: symlink d1/l9 0 2023-12-05T13:25:25.614 INFO:tasks.workunit.client.0.smithi029.stdout:6/22: rmdir d6 39 2023-12-05T13:25:25.614 INFO:tasks.workunit.client.0.smithi029.stdout:3/25: dwrite d1/f3 [0,4194304] 0 2023-12-05T13:25:25.615 INFO:tasks.workunit.client.1.smithi052.stdout:2/673: mknod d2/d14/d62/da7/dbc/cc9 0 2023-12-05T13:25:25.615 INFO:tasks.workunit.client.1.smithi052.stdout:0/645: dread d0/db/d14/d60/f7b [0,4194304] 0 2023-12-05T13:25:25.615 INFO:tasks.workunit.client.1.smithi052.stdout:5/400: dwrite d5/d15/d21/d25/d3f/d5c/f4f [0,4194304] 0 2023-12-05T13:25:25.615 INFO:tasks.workunit.client.1.smithi052.stdout:2/674: read d2/f2f [3130182,13447] 0 2023-12-05T13:25:25.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/14: truncate f0 5654287 0 2023-12-05T13:25:25.619 INFO:tasks.workunit.client.1.smithi052.stdout:9/558: symlink d3/d2a/d5c/lbc 0 2023-12-05T13:25:25.623 INFO:tasks.workunit.client.1.smithi052.stdout:4/664: link de/d30/d68/d5c/fba de/fde 0 2023-12-05T13:25:25.624 INFO:tasks.workunit.client.0.smithi029.stdout:6/23: rename d6/l7 to d6/l8 0 2023-12-05T13:25:25.625 INFO:tasks.workunit.client.1.smithi052.stdout:2/675: dread d2/d4/f89 [0,4194304] 0 2023-12-05T13:25:25.628 INFO:tasks.workunit.client.1.smithi052.stdout:3/668: creat da/dd/d3d/fdf x:0 0 0 2023-12-05T13:25:25.630 INFO:tasks.workunit.client.0.smithi029.stdout:7/28: dwrite f3 [0,4194304] 0 2023-12-05T13:25:25.631 INFO:tasks.workunit.client.1.smithi052.stdout:7/678: creat d7/d4e/d12/d3f/d75/fe4 x:0 0 0 2023-12-05T13:25:25.635 INFO:tasks.workunit.client.0.smithi029.stdout:3/26: rename d1/f3 to d1/f4 0 2023-12-05T13:25:25.635 INFO:tasks.workunit.client.0.smithi029.stdout:3/27: rename d1 to d1/d5 22 2023-12-05T13:25:25.640 INFO:tasks.workunit.client.0.smithi029.stdout:6/24: creat d6/f9 x:0 0 0 2023-12-05T13:25:25.640 INFO:tasks.workunit.client.0.smithi029.stdout:6/25: dread - d6/f9 zero size 2023-12-05T13:25:25.640 INFO:tasks.workunit.client.0.smithi029.stdout:6/26: dread - f5 zero size 2023-12-05T13:25:25.640 INFO:tasks.workunit.client.0.smithi029.stdout:6/27: truncate f5 345357 0 2023-12-05T13:25:25.641 INFO:tasks.workunit.client.0.smithi029.stdout:6/28: dread f5 [0,4194304] 0 2023-12-05T13:25:25.641 INFO:tasks.workunit.client.0.smithi029.stdout:6/29: truncate d6/f9 64653 0 2023-12-05T13:25:25.642 INFO:tasks.workunit.client.1.smithi052.stdout:8/684: symlink d0/de/d12/d29/db3/dc5/ld9 0 2023-12-05T13:25:25.642 INFO:tasks.workunit.client.1.smithi052.stdout:8/685: fsync d0/de/f2f 0 2023-12-05T13:25:25.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/612: creat d5/d7/de/d74/d99/fc3 x:0 0 0 2023-12-05T13:25:25.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/613: stat d5/d7/d35/c70 0 2023-12-05T13:25:25.648 INFO:tasks.workunit.client.0.smithi029.stdout:5/19: truncate d1/f7 2091963 0 2023-12-05T13:25:25.649 INFO:tasks.workunit.client.1.smithi052.stdout:2/676: dwrite d2/d4/f89 [0,4194304] 0 2023-12-05T13:25:25.649 INFO:tasks.workunit.client.1.smithi052.stdout:2/677: fsync d2/d13/d1e/f46 0 2023-12-05T13:25:25.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/29: mkdir d6 0 2023-12-05T13:25:25.652 INFO:tasks.workunit.client.1.smithi052.stdout:6/491: mknod d3/d5/d9/d21/caf 0 2023-12-05T13:25:25.652 INFO:tasks.workunit.client.1.smithi052.stdout:6/492: read - d3/d5/d9/d21/fac zero size 2023-12-05T13:25:25.653 INFO:tasks.workunit.client.0.smithi029.stdout:3/28: mkdir d1/d6 0 2023-12-05T13:25:25.654 INFO:tasks.workunit.client.0.smithi029.stdout:3/29: read d1/f2 [624497,53581] 0 2023-12-05T13:25:25.654 INFO:tasks.workunit.client.0.smithi029.stdout:3/30: write d1/f2 [2491366,3138] 0 2023-12-05T13:25:25.655 INFO:tasks.workunit.client.0.smithi029.stdout:5/20: link d1/c6 d1/ca 0 2023-12-05T13:25:25.657 INFO:tasks.workunit.client.1.smithi052.stdout:0/646: creat d0/db/d52/d7f/fd2 x:0 0 0 2023-12-05T13:25:25.659 INFO:tasks.workunit.client.0.smithi029.stdout:7/30: creat d6/f7 x:0 0 0 2023-12-05T13:25:25.660 INFO:tasks.workunit.client.1.smithi052.stdout:1/614: dwrite d5/daa/d17/f39 [4194304,4194304] 0 2023-12-05T13:25:25.660 INFO:tasks.workunit.client.1.smithi052.stdout:1/615: chown d5/daa 339639 1 2023-12-05T13:25:25.660 INFO:tasks.workunit.client.0.smithi029.stdout:6/30: dwrite d6/f9 [0,4194304] 0 2023-12-05T13:25:25.664 INFO:tasks.workunit.client.0.smithi029.stdout:3/31: symlink d1/l7 0 2023-12-05T13:25:25.665 INFO:tasks.workunit.client.1.smithi052.stdout:5/401: symlink d5/d15/d21/d25/d3f/d5c/l83 0 2023-12-05T13:25:25.665 INFO:tasks.workunit.client.1.smithi052.stdout:5/402: fsync f4 0 2023-12-05T13:25:25.667 INFO:tasks.workunit.client.1.smithi052.stdout:6/493: dwrite d3/d4/f55 [8388608,4194304] 0 2023-12-05T13:25:25.667 INFO:tasks.workunit.client.1.smithi052.stdout:9/559: mkdir d3/d1e/d62/dbd 0 2023-12-05T13:25:25.667 INFO:tasks.workunit.client.1.smithi052.stdout:5/403: dread d5/df/d11/f52 [0,4194304] 0 2023-12-05T13:25:25.668 INFO:tasks.workunit.client.1.smithi052.stdout:5/404: stat d5/d15/d21/d25/d3f/f50 0 2023-12-05T13:25:25.668 INFO:tasks.workunit.client.0.smithi029.stdout:7/31: mknod d6/c8 0 2023-12-05T13:25:25.668 INFO:tasks.workunit.client.0.smithi029.stdout:7/32: truncate f1 9130514 0 2023-12-05T13:25:25.668 INFO:tasks.workunit.client.1.smithi052.stdout:5/405: write d5/f9 [1036107,66872] 0 2023-12-05T13:25:25.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/15: read f0 [3534398,61174] 0 2023-12-05T13:25:25.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/16: chown f0 99977236 1 2023-12-05T13:25:25.672 INFO:tasks.workunit.client.1.smithi052.stdout:4/665: symlink de/d30/d73/dbe/ldf 0 2023-12-05T13:25:25.672 INFO:tasks.workunit.client.1.smithi052.stdout:3/669: mkdir da/d25/dcd/de0 0 2023-12-05T13:25:25.675 INFO:tasks.workunit.client.1.smithi052.stdout:7/679: link d7/d4e/d12/d3f/f7f d7/d4e/d12/d3f/fe5 0 2023-12-05T13:25:25.675 INFO:tasks.workunit.client.1.smithi052.stdout:7/680: fsync d7/d4e/d45/d5a/d63/f7a 0 2023-12-05T13:25:25.676 INFO:tasks.workunit.client.0.smithi029.stdout:6/31: creat d6/fa x:0 0 0 2023-12-05T13:25:25.678 INFO:tasks.workunit.client.0.smithi029.stdout:6/32: dread f5 [0,4194304] 0 2023-12-05T13:25:25.679 INFO:tasks.workunit.client.0.smithi029.stdout:3/32: symlink d1/l8 0 2023-12-05T13:25:25.686 INFO:tasks.workunit.client.0.smithi029.stdout:7/33: rename d6/f7 to d6/f9 0 2023-12-05T13:25:25.686 INFO:tasks.workunit.client.0.smithi029.stdout:7/34: stat d6 0 2023-12-05T13:25:25.686 INFO:tasks.workunit.client.1.smithi052.stdout:8/686: mknod d0/de/d12/d29/db3/dc5/cda 0 2023-12-05T13:25:25.686 INFO:tasks.workunit.client.1.smithi052.stdout:4/666: dwrite de/d29/d51/da3/d6d/fb5 [0,4194304] 0 2023-12-05T13:25:25.687 INFO:tasks.workunit.client.1.smithi052.stdout:4/667: chown de/d30/d73/c78 14864 1 2023-12-05T13:25:25.687 INFO:tasks.workunit.client.1.smithi052.stdout:4/668: chown de/d29/d51/d76 134 1 2023-12-05T13:25:25.687 INFO:tasks.workunit.client.1.smithi052.stdout:4/669: dread - de/d30/d68/d5c/faf zero size 2023-12-05T13:25:25.687 INFO:tasks.workunit.client.0.smithi029.stdout:1/17: mknod c2 0 2023-12-05T13:25:25.689 INFO:tasks.workunit.client.0.smithi029.stdout:7/35: dread f1 [0,4194304] 0 2023-12-05T13:25:25.689 INFO:tasks.workunit.client.1.smithi052.stdout:2/678: rename d2/d13/d1e/f3d to d2/d13/d1e/d6a/d7f/d84/d6e/fca 0 2023-12-05T13:25:25.690 INFO:tasks.workunit.client.0.smithi029.stdout:7/36: read f1 [7748772,17382] 0 2023-12-05T13:25:25.690 INFO:tasks.workunit.client.1.smithi052.stdout:2/679: read d2/d13/f22 [1929926,75391] 0 2023-12-05T13:25:25.691 INFO:tasks.workunit.client.0.smithi029.stdout:6/33: mknod d6/cb 0 2023-12-05T13:25:25.692 INFO:tasks.workunit.client.1.smithi052.stdout:0/647: truncate d0/db/d1b/d51/d55/d66/f86 3817334 0 2023-12-05T13:25:25.696 INFO:tasks.workunit.client.1.smithi052.stdout:1/616: unlink d5/d7/d35/d2f/fb5 0 2023-12-05T13:25:25.696 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:25 smithi029 ceph-mon[112128]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2023-12-05T13:25:25.696 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:25 smithi029 ceph-mon[112128]: [05/Dec/2023:13:25:24] ENGINE Bus STARTING 2023-12-05T13:25:25.696 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:25 smithi029 ceph-mon[112128]: mgrmap e23: smithi052.ocazcp(active, since 2s) 2023-12-05T13:25:25.698 INFO:tasks.workunit.client.0.smithi029.stdout:1/18: dread f0 [0,4194304] 0 2023-12-05T13:25:25.701 INFO:tasks.workunit.client.0.smithi029.stdout:6/34: rename d6/f9 to d6/fc 0 2023-12-05T13:25:25.701 INFO:tasks.workunit.client.0.smithi029.stdout:6/35: chown c0 6 1 2023-12-05T13:25:25.702 INFO:tasks.workunit.client.1.smithi052.stdout:6/494: getdents d3/d5/d9/d21/d48/d4d/d81/d82 0 2023-12-05T13:25:25.703 INFO:tasks.workunit.client.0.smithi029.stdout:3/33: truncate d1/f4 1785774 0 2023-12-05T13:25:25.704 INFO:tasks.workunit.client.1.smithi052.stdout:1/617: read d5/d7/de/f96 [226682,75939] 0 2023-12-05T13:25:25.704 INFO:tasks.workunit.client.1.smithi052.stdout:1/618: getdents d5/d7/de/d74/d98 0 2023-12-05T13:25:25.705 INFO:tasks.workunit.client.1.smithi052.stdout:9/560: mkdir d3/d5e/da7/daf/dbe 0 2023-12-05T13:25:25.706 INFO:tasks.workunit.client.1.smithi052.stdout:9/561: write d3/d1e/d41/d86/f91 [2103109,121703] 0 2023-12-05T13:25:25.706 INFO:tasks.workunit.client.0.smithi029.stdout:7/37: rename f3 to d6/fa 0 2023-12-05T13:25:25.707 INFO:tasks.workunit.client.1.smithi052.stdout:5/406: getdents d5 0 2023-12-05T13:25:25.707 INFO:tasks.workunit.client.0.smithi029.stdout:5/21: dread d1/f7 [0,4194304] 0 2023-12-05T13:25:25.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/38: write d6/fa [1862846,94813] 0 2023-12-05T13:25:25.709 INFO:tasks.workunit.client.0.smithi029.stdout:1/19: creat f3 x:0 0 0 2023-12-05T13:25:25.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/22: write d1/f7 [412511,81341] 0 2023-12-05T13:25:25.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/23: write d1/f4 [613245,130993] 0 2023-12-05T13:25:25.710 INFO:tasks.workunit.client.1.smithi052.stdout:3/670: mknod da/d25/d33/d89/dae/ce1 0 2023-12-05T13:25:25.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/36: symlink d6/ld 0 2023-12-05T13:25:25.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/37: fdatasync d6/fc 0 2023-12-05T13:25:25.714 INFO:tasks.workunit.client.1.smithi052.stdout:5/407: dread d5/d15/f31 [0,4194304] 0 2023-12-05T13:25:25.715 INFO:tasks.workunit.client.1.smithi052.stdout:5/408: truncate d5/fa 5061075 0 2023-12-05T13:25:25.715 INFO:tasks.workunit.client.1.smithi052.stdout:7/681: truncate d7/d4e/d12/d3f/f80 2301192 0 2023-12-05T13:25:25.717 INFO:tasks.workunit.client.0.smithi029.stdout:3/34: link d1/l8 d1/l9 0 2023-12-05T13:25:25.719 INFO:tasks.workunit.client.1.smithi052.stdout:8/687: creat d0/d28/d2b/fdb x:0 0 0 2023-12-05T13:25:25.722 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:25 smithi052 ceph-mon[121072]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2023-12-05T13:25:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:25 smithi052 ceph-mon[121072]: [05/Dec/2023:13:25:24] ENGINE Bus STARTING 2023-12-05T13:25:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:25 smithi052 ceph-mon[121072]: mgrmap e23: smithi052.ocazcp(active, since 2s) 2023-12-05T13:25:25.723 INFO:tasks.workunit.client.0.smithi029.stdout:1/20: link c2 c4 0 2023-12-05T13:25:25.725 INFO:tasks.workunit.client.0.smithi029.stdout:7/39: dwrite f1 [8388608,4194304] 0 2023-12-05T13:25:25.725 INFO:tasks.workunit.client.0.smithi029.stdout:7/40: chown f1 0 1 2023-12-05T13:25:25.726 INFO:tasks.workunit.client.0.smithi029.stdout:6/38: creat d6/fe x:0 0 0 2023-12-05T13:25:25.729 INFO:tasks.workunit.client.0.smithi029.stdout:3/35: unlink d1/l9 0 2023-12-05T13:25:25.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/24: dwrite d1/f4 [0,4194304] 0 2023-12-05T13:25:25.731 INFO:tasks.workunit.client.1.smithi052.stdout:4/670: mknod de/d29/ce0 0 2023-12-05T13:25:25.734 INFO:tasks.workunit.client.0.smithi029.stdout:7/41: symlink d6/lb 0 2023-12-05T13:25:25.734 INFO:tasks.workunit.client.0.smithi029.stdout:7/42: read - d6/f9 zero size 2023-12-05T13:25:25.735 INFO:tasks.workunit.client.1.smithi052.stdout:2/680: mkdir d2/d4/d63/d6d/dcb 0 2023-12-05T13:25:25.736 INFO:tasks.workunit.client.0.smithi029.stdout:6/39: symlink d6/lf 0 2023-12-05T13:25:25.740 INFO:tasks.workunit.client.1.smithi052.stdout:0/648: rename d0/db/c16 to d0/db/d1b/d7a/cd3 0 2023-12-05T13:25:25.740 INFO:tasks.workunit.client.1.smithi052.stdout:0/649: write d0/db/d52/fbc [149434,13824] 0 2023-12-05T13:25:25.742 INFO:tasks.workunit.client.1.smithi052.stdout:6/495: link d3/d5/d9/c3e d3/d4/d6/d26/d8e/cb0 0 2023-12-05T13:25:25.745 INFO:tasks.workunit.client.1.smithi052.stdout:1/619: creat d5/d26/d75/fc4 x:0 0 0 2023-12-05T13:25:25.745 INFO:tasks.workunit.client.1.smithi052.stdout:1/620: chown d5/d7 0 1 2023-12-05T13:25:25.746 INFO:tasks.workunit.client.0.smithi029.stdout:1/21: dwrite f3 [0,4194304] 0 2023-12-05T13:25:25.747 INFO:tasks.workunit.client.0.smithi029.stdout:6/40: creat d6/f10 x:0 0 0 2023-12-05T13:25:25.747 INFO:tasks.workunit.client.0.smithi029.stdout:6/41: truncate d6/fe 678676 0 2023-12-05T13:25:25.748 INFO:tasks.workunit.client.1.smithi052.stdout:9/562: creat d3/d5e/d9e/fbf x:0 0 0 2023-12-05T13:25:25.750 INFO:tasks.workunit.client.1.smithi052.stdout:3/671: symlink da/dd/d3d/le2 0 2023-12-05T13:25:25.759 INFO:tasks.workunit.client.1.smithi052.stdout:5/409: mkdir d5/df/d11/d66/d84 0 2023-12-05T13:25:25.760 INFO:tasks.workunit.client.1.smithi052.stdout:6/496: dwrite d3/d5/d9/d52/f54 [4194304,4194304] 0 2023-12-05T13:25:25.761 INFO:tasks.workunit.client.0.smithi029.stdout:1/22: creat f5 x:0 0 0 2023-12-05T13:25:25.763 INFO:tasks.workunit.client.0.smithi029.stdout:1/23: fdatasync f0 0 2023-12-05T13:25:25.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/42: creat d6/f11 x:0 0 0 2023-12-05T13:25:25.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/43: chown d6/fe 14877 1 2023-12-05T13:25:25.763 INFO:tasks.workunit.client.1.smithi052.stdout:7/682: rmdir d7/d4e/d12/d7d 39 2023-12-05T13:25:25.764 INFO:tasks.workunit.client.1.smithi052.stdout:8/688: mknod d0/d62/cdc 0 2023-12-05T13:25:25.768 INFO:tasks.workunit.client.1.smithi052.stdout:4/671: creat de/d2b/d64/fe1 x:0 0 0 2023-12-05T13:25:25.768 INFO:tasks.workunit.client.1.smithi052.stdout:4/672: fdatasync de/d30/d73/d85/fce 0 2023-12-05T13:25:25.768 INFO:tasks.workunit.client.0.smithi029.stdout:6/44: mknod d6/c12 0 2023-12-05T13:25:25.768 INFO:tasks.workunit.client.0.smithi029.stdout:6/45: truncate f5 844286 0 2023-12-05T13:25:25.775 INFO:tasks.workunit.client.1.smithi052.stdout:5/410: dread d5/d15/d21/d25/d3f/d5c/f4f [0,4194304] 0 2023-12-05T13:25:25.779 INFO:tasks.workunit.client.1.smithi052.stdout:0/650: creat d0/db/d20/d50/dae/fd4 x:0 0 0 2023-12-05T13:25:25.779 INFO:tasks.workunit.client.1.smithi052.stdout:1/621: creat d5/d7/d35/d37/d5a/d73/dac/fc5 x:0 0 0 2023-12-05T13:25:25.779 INFO:tasks.workunit.client.1.smithi052.stdout:0/651: write d0/db/d20/f5a [4295621,32997] 0 2023-12-05T13:25:25.779 INFO:tasks.workunit.client.1.smithi052.stdout:1/622: write d5/d7/d35/d37/d5a/d73/d76/fc1 [1310298,124552] 0 2023-12-05T13:25:25.779 INFO:tasks.workunit.client.1.smithi052.stdout:1/623: truncate d5/d7/de/d74/fb2 795326 0 2023-12-05T13:25:25.779 INFO:tasks.workunit.client.0.smithi029.stdout:6/46: symlink d6/l13 0 2023-12-05T13:25:25.782 INFO:tasks.workunit.client.0.smithi029.stdout:3/36: dwrite d1/f4 [0,4194304] 0 2023-12-05T13:25:25.783 INFO:tasks.workunit.client.1.smithi052.stdout:9/563: mkdir d3/d1e/dc0 0 2023-12-05T13:25:25.783 INFO:tasks.workunit.client.1.smithi052.stdout:9/564: chown d3/d1e/d37 782565143 1 2023-12-05T13:25:25.784 INFO:tasks.workunit.client.0.smithi029.stdout:7/43: getdents d6 0 2023-12-05T13:25:25.785 INFO:tasks.workunit.client.0.smithi029.stdout:7/44: write f1 [3715674,108475] 0 2023-12-05T13:25:25.786 INFO:tasks.workunit.client.0.smithi029.stdout:7/45: getdents d6 0 2023-12-05T13:25:25.786 INFO:tasks.workunit.client.0.smithi029.stdout:7/46: write d6/f9 [269374,77721] 0 2023-12-05T13:25:25.786 INFO:tasks.workunit.client.0.smithi029.stdout:7/47: getdents d6 0 2023-12-05T13:25:25.786 INFO:tasks.workunit.client.0.smithi029.stdout:1/24: dwrite f0 [4194304,4194304] 0 2023-12-05T13:25:25.786 INFO:tasks.workunit.client.0.smithi029.stdout:6/47: mkdir d6/d14 0 2023-12-05T13:25:25.788 INFO:tasks.workunit.client.0.smithi029.stdout:6/48: write d6/fc [2225072,6289] 0 2023-12-05T13:25:25.789 INFO:tasks.workunit.client.0.smithi029.stdout:3/37: unlink d1/l7 0 2023-12-05T13:25:25.793 INFO:tasks.workunit.client.1.smithi052.stdout:4/673: dwrite de/d29/d51/d76/dc4/fc7 [0,4194304] 0 2023-12-05T13:25:25.794 INFO:tasks.workunit.client.0.smithi029.stdout:3/38: rename d1/f4 to d1/d6/fa 0 2023-12-05T13:25:25.795 INFO:tasks.workunit.client.0.smithi029.stdout:3/39: write d1/f2 [1067188,14969] 0 2023-12-05T13:25:25.797 INFO:tasks.workunit.client.1.smithi052.stdout:6/497: rename d3/d4/df/d63/fa5 to d3/d5/d9/d44/dab/fb1 0 2023-12-05T13:25:25.800 INFO:tasks.workunit.client.0.smithi029.stdout:5/25: truncate d1/f4 3505395 0 2023-12-05T13:25:25.804 INFO:tasks.workunit.client.0.smithi029.stdout:5/26: creat d1/fb x:0 0 0 2023-12-05T13:25:25.807 INFO:tasks.workunit.client.1.smithi052.stdout:7/683: link d7/d4e/d45/d5a/fe0 d7/d4e/d45/d5a/d16/dae/fe6 0 2023-12-05T13:25:25.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/27: mkdir d1/dc 0 2023-12-05T13:25:25.810 INFO:tasks.workunit.client.0.smithi029.stdout:5/28: write d1/f7 [576714,33140] 0 2023-12-05T13:25:25.811 INFO:tasks.workunit.client.1.smithi052.stdout:8/689: mknod d0/d4d/cdd 0 2023-12-05T13:25:25.811 INFO:tasks.workunit.client.1.smithi052.stdout:7/684: write d7/d4e/d12/d3f/d46/f5f [830629,65271] 0 2023-12-05T13:25:25.813 INFO:tasks.workunit.client.0.smithi029.stdout:5/29: mknod d1/cd 0 2023-12-05T13:25:25.813 INFO:tasks.workunit.client.0.smithi029.stdout:6/49: dwrite d6/fa [0,4194304] 0 2023-12-05T13:25:25.813 INFO:tasks.workunit.client.0.smithi029.stdout:1/25: dwrite f5 [0,4194304] 0 2023-12-05T13:25:25.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/30: mkdir d1/dc/de 0 2023-12-05T13:25:25.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/31: write d1/fb [105137,63262] 0 2023-12-05T13:25:25.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/48: dwrite d6/fa [4194304,4194304] 0 2023-12-05T13:25:25.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/49: chown c4 12959 1 2023-12-05T13:25:25.830 INFO:tasks.workunit.client.0.smithi029.stdout:6/50: mknod d6/c15 0 2023-12-05T13:25:25.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/51: dread - d6/f10 zero size 2023-12-05T13:25:25.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/52: write d6/fe [1436174,33989] 0 2023-12-05T13:25:25.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/53: getdents d6/d14 0 2023-12-05T13:25:25.834 INFO:tasks.workunit.client.1.smithi052.stdout:5/411: mknod d5/df/d4b/c85 0 2023-12-05T13:25:25.838 INFO:tasks.workunit.client.1.smithi052.stdout:2/681: dwrite d2/da4/f79 [0,4194304] 0 2023-12-05T13:25:25.838 INFO:tasks.workunit.client.1.smithi052.stdout:2/682: dread - d2/d4/d3f/f92 zero size 2023-12-05T13:25:25.839 INFO:tasks.workunit.client.1.smithi052.stdout:0/652: truncate d0/db/d20/d50/f92 682853 0 2023-12-05T13:25:25.839 INFO:tasks.workunit.client.0.smithi029.stdout:7/50: creat d6/fc x:0 0 0 2023-12-05T13:25:25.839 INFO:tasks.workunit.client.0.smithi029.stdout:1/26: dwrite f5 [0,4194304] 0 2023-12-05T13:25:25.839 INFO:tasks.workunit.client.0.smithi029.stdout:1/27: write f0 [8435039,46501] 0 2023-12-05T13:25:25.840 INFO:tasks.workunit.client.0.smithi029.stdout:3/40: truncate d1/d6/fa 753067 0 2023-12-05T13:25:25.842 INFO:tasks.workunit.client.0.smithi029.stdout:6/54: symlink d6/l16 0 2023-12-05T13:25:25.844 INFO:tasks.workunit.client.1.smithi052.stdout:9/565: creat d3/d2a/d8f/fc1 x:0 0 0 2023-12-05T13:25:25.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/28: creat f6 x:0 0 0 2023-12-05T13:25:25.849 INFO:tasks.workunit.client.0.smithi029.stdout:6/55: symlink d6/l17 0 2023-12-05T13:25:25.856 INFO:tasks.workunit.client.1.smithi052.stdout:4/674: truncate de/d30/d73/f9a 391311 0 2023-12-05T13:25:25.859 INFO:tasks.workunit.client.1.smithi052.stdout:6/498: link d3/d5/d9/d44/l6a d3/d4/df/d27/lb2 0 2023-12-05T13:25:25.859 INFO:tasks.workunit.client.0.smithi029.stdout:5/32: dwrite d1/f7 [0,4194304] 0 2023-12-05T13:25:25.863 INFO:tasks.workunit.client.1.smithi052.stdout:1/624: rename d5/d7/d35/d37/d5a/d73/d7e/d65 to d5/d7/de/d74/d99/dc6 0 2023-12-05T13:25:25.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/51: dwrite f1 [0,4194304] 0 2023-12-05T13:25:25.863 INFO:tasks.workunit.client.0.smithi029.stdout:7/52: fsync d6/f9 0 2023-12-05T13:25:25.866 INFO:tasks.workunit.client.0.smithi029.stdout:5/33: dread d1/f4 [0,4194304] 0 2023-12-05T13:25:25.871 INFO:tasks.workunit.client.1.smithi052.stdout:5/412: mknod d5/d15/d21/d4a/c86 0 2023-12-05T13:25:25.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/29: dwrite f6 [0,4194304] 0 2023-12-05T13:25:25.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/56: creat d6/f18 x:0 0 0 2023-12-05T13:25:25.871 INFO:tasks.workunit.client.0.smithi029.stdout:6/57: getdents d6/d14 0 2023-12-05T13:25:25.876 INFO:tasks.workunit.client.0.smithi029.stdout:7/53: unlink d6/c8 0 2023-12-05T13:25:25.877 INFO:tasks.workunit.client.1.smithi052.stdout:2/683: truncate d2/d4/d63/f76 1164530 0 2023-12-05T13:25:25.878 INFO:tasks.workunit.client.1.smithi052.stdout:5/413: write d5/df/d11/d66/f6a [1888035,86233] 0 2023-12-05T13:25:25.879 INFO:tasks.workunit.client.0.smithi029.stdout:5/34: mknod d1/dc/cf 0 2023-12-05T13:25:25.881 INFO:tasks.workunit.client.1.smithi052.stdout:2/684: dread d2/d13/f22 [0,4194304] 0 2023-12-05T13:25:25.881 INFO:tasks.workunit.client.1.smithi052.stdout:0/653: symlink d0/db/d2e/d53/ld5 0 2023-12-05T13:25:25.886 INFO:tasks.workunit.client.0.smithi029.stdout:1/30: mkdir d7 0 2023-12-05T13:25:25.886 INFO:tasks.workunit.client.0.smithi029.stdout:1/31: readlink - no filename 2023-12-05T13:25:25.889 INFO:tasks.workunit.client.0.smithi029.stdout:6/58: symlink d6/l19 0 2023-12-05T13:25:25.889 INFO:tasks.workunit.client.0.smithi029.stdout:6/59: read - d6/f11 zero size 2023-12-05T13:25:25.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/60: write d6/f18 [447244,42726] 0 2023-12-05T13:25:25.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/61: write d6/fc [3874872,23833] 0 2023-12-05T13:25:25.891 INFO:tasks.workunit.client.0.smithi029.stdout:7/54: symlink d6/ld 0 2023-12-05T13:25:25.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/55: dread d6/f9 [0,4194304] 0 2023-12-05T13:25:25.897 INFO:tasks.workunit.client.0.smithi029.stdout:5/35: truncate d1/f4 1774071 0 2023-12-05T13:25:25.898 INFO:tasks.workunit.client.1.smithi052.stdout:9/566: getdents d3/d1e/d41 0 2023-12-05T13:25:25.900 INFO:tasks.workunit.client.1.smithi052.stdout:0/654: dwrite d0/db/d20/fbd [0,4194304] 0 2023-12-05T13:25:25.901 INFO:tasks.workunit.client.0.smithi029.stdout:1/32: rename f0 to d7/f8 0 2023-12-05T13:25:25.903 INFO:tasks.workunit.client.1.smithi052.stdout:4/675: mkdir de/d30/d68/d5c/de2 0 2023-12-05T13:25:25.903 INFO:tasks.workunit.client.1.smithi052.stdout:4/676: chown de/d30/d68/c96 18375 1 2023-12-05T13:25:25.907 INFO:tasks.workunit.client.0.smithi029.stdout:1/33: rename f6 to d7/f9 0 2023-12-05T13:25:25.910 INFO:tasks.workunit.client.1.smithi052.stdout:7/685: write d7/d4e/d12/d3f/f80 [176490,91683] 0 2023-12-05T13:25:25.910 INFO:tasks.workunit.client.1.smithi052.stdout:7/686: fsync d7/d31/f3e 0 2023-12-05T13:25:25.910 INFO:tasks.workunit.client.1.smithi052.stdout:7/687: chown d7/d4e/d12/d3f/d75/ca1 16681307 1 2023-12-05T13:25:25.915 INFO:tasks.workunit.client.0.smithi029.stdout:1/34: write f5 [3104690,58069] 0 2023-12-05T13:25:25.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/56: dwrite d6/fa [4194304,4194304] 0 2023-12-05T13:25:25.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/57: write d6/fc [760338,25059] 0 2023-12-05T13:25:25.916 INFO:tasks.workunit.client.1.smithi052.stdout:8/690: rename d0/d62/fad to d0/de/d27/d43/fde 0 2023-12-05T13:25:25.916 INFO:tasks.workunit.client.1.smithi052.stdout:1/625: mkdir d5/d7/d35/d37/d5a/d73/dac/dc7 0 2023-12-05T13:25:25.916 INFO:tasks.workunit.client.1.smithi052.stdout:5/414: creat d5/f87 x:0 0 0 2023-12-05T13:25:25.917 INFO:tasks.workunit.client.0.smithi029.stdout:6/62: dwrite d6/fa [0,4194304] 0 2023-12-05T13:25:25.919 INFO:tasks.workunit.client.1.smithi052.stdout:2/685: getdents d2/d4/d63 0 2023-12-05T13:25:25.922 INFO:tasks.workunit.client.1.smithi052.stdout:9/567: creat d3/d5e/d9e/fc2 x:0 0 0 2023-12-05T13:25:25.925 INFO:tasks.workunit.client.1.smithi052.stdout:4/677: dwrite de/d2b/f5a [4194304,4194304] 0 2023-12-05T13:25:25.925 INFO:tasks.workunit.client.1.smithi052.stdout:4/678: write de/d30/d68/d5c/fba [345932,47118] 0 2023-12-05T13:25:25.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/35: dwrite d7/f8 [8388608,4194304] 0 2023-12-05T13:25:25.929 INFO:tasks.workunit.client.1.smithi052.stdout:6/499: dwrite d3/d5/d9/d21/f23 [0,4194304] 0 2023-12-05T13:25:25.930 INFO:tasks.workunit.client.0.smithi029.stdout:1/36: write f3 [3924057,76988] 0 2023-12-05T13:25:25.930 INFO:tasks.workunit.client.0.smithi029.stdout:6/63: symlink d6/l1a 0 2023-12-05T13:25:25.932 INFO:tasks.workunit.client.1.smithi052.stdout:9/568: dread d3/d31/f45 [0,4194304] 0 2023-12-05T13:25:25.932 INFO:tasks.workunit.client.0.smithi029.stdout:1/37: creat d7/fa x:0 0 0 2023-12-05T13:25:25.932 INFO:tasks.workunit.client.1.smithi052.stdout:0/655: creat d0/db/d1b/fd6 x:0 0 0 2023-12-05T13:25:25.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/64: dread d6/fe [0,4194304] 0 2023-12-05T13:25:25.933 INFO:tasks.workunit.client.0.smithi029.stdout:6/65: chown l4 2071 1 2023-12-05T13:25:25.935 INFO:tasks.workunit.client.1.smithi052.stdout:7/688: unlink d7/d4e/d12/d3f/d75/ldb 0 2023-12-05T13:25:25.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/38: creat d7/fb x:0 0 0 2023-12-05T13:25:25.937 INFO:tasks.workunit.client.0.smithi029.stdout:7/58: getdents d6 0 2023-12-05T13:25:25.938 INFO:tasks.workunit.client.1.smithi052.stdout:7/689: read d7/d4e/d45/fb6 [2709157,103323] 0 2023-12-05T13:25:25.938 INFO:tasks.workunit.client.1.smithi052.stdout:3/672: sync 2023-12-05T13:25:25.939 INFO:tasks.workunit.client.0.smithi029.stdout:7/59: write f1 [1462616,111405] 0 2023-12-05T13:25:25.939 INFO:tasks.workunit.client.0.smithi029.stdout:1/39: fsync f5 0 2023-12-05T13:25:25.939 INFO:tasks.workunit.client.1.smithi052.stdout:8/691: mknod d0/de/d27/d43/da2/cdf 0 2023-12-05T13:25:25.942 INFO:tasks.workunit.client.1.smithi052.stdout:3/673: dread da/fe [0,4194304] 0 2023-12-05T13:25:25.943 INFO:tasks.workunit.client.0.smithi029.stdout:7/60: write f1 [2339247,113201] 0 2023-12-05T13:25:25.943 INFO:tasks.workunit.client.0.smithi029.stdout:6/66: rename d6/c12 to d6/c1b 0 2023-12-05T13:25:25.943 INFO:tasks.workunit.client.1.smithi052.stdout:1/626: rmdir d5/d26 39 2023-12-05T13:25:25.944 INFO:tasks.workunit.client.1.smithi052.stdout:1/627: write d5/d7/de/d74/d99/dc6/f7c [1103851,92167] 0 2023-12-05T13:25:25.946 INFO:tasks.workunit.client.1.smithi052.stdout:5/415: mkdir d5/d15/d21/d25/d3f/d88 0 2023-12-05T13:25:25.946 INFO:tasks.workunit.client.0.smithi029.stdout:1/40: creat d7/fc x:0 0 0 2023-12-05T13:25:25.948 INFO:tasks.workunit.client.1.smithi052.stdout:2/686: rename d2/d13/d1e/d6a/d7f/d84/d6e/l75 to d2/d13/d1e/d6a/d7f/lcc 0 2023-12-05T13:25:25.949 INFO:tasks.workunit.client.1.smithi052.stdout:2/687: chown d2/d13/d48/l65 21 1 2023-12-05T13:25:25.949 INFO:tasks.workunit.client.0.smithi029.stdout:7/61: mknod d6/ce 0 2023-12-05T13:25:25.949 INFO:tasks.workunit.client.0.smithi029.stdout:7/62: chown d6/ld 6 1 2023-12-05T13:25:25.951 INFO:tasks.workunit.client.0.smithi029.stdout:7/63: write d6/fa [260692,122053] 0 2023-12-05T13:25:25.953 INFO:tasks.workunit.client.1.smithi052.stdout:4/679: mkdir de/d30/dac/de3 0 2023-12-05T13:25:25.957 INFO:tasks.workunit.client.0.smithi029.stdout:7/64: write d6/fa [7048483,82971] 0 2023-12-05T13:25:25.957 INFO:tasks.workunit.client.1.smithi052.stdout:6/500: symlink d3/d4/df/d63/lb3 0 2023-12-05T13:25:25.960 INFO:tasks.workunit.client.0.smithi029.stdout:6/67: dwrite d6/f18 [0,4194304] 0 2023-12-05T13:25:25.960 INFO:tasks.workunit.client.0.smithi029.stdout:7/65: mkdir d6/df 0 2023-12-05T13:25:25.961 INFO:tasks.workunit.client.0.smithi029.stdout:7/66: read d6/fa [8058680,41703] 0 2023-12-05T13:25:25.962 INFO:tasks.workunit.client.1.smithi052.stdout:0/656: creat d0/db/d2e/d53/d80/fd7 x:0 0 0 2023-12-05T13:25:25.963 INFO:tasks.workunit.client.0.smithi029.stdout:7/67: dread d6/f9 [0,4194304] 0 2023-12-05T13:25:25.967 INFO:tasks.workunit.client.0.smithi029.stdout:7/68: symlink d6/df/l10 0 2023-12-05T13:25:25.969 INFO:tasks.workunit.client.1.smithi052.stdout:7/690: creat d7/d31/d56/fe7 x:0 0 0 2023-12-05T13:25:25.970 INFO:tasks.workunit.client.1.smithi052.stdout:7/691: readlink d7/d4e/d12/d3f/d75/lde 0 2023-12-05T13:25:25.970 INFO:tasks.workunit.client.1.smithi052.stdout:8/692: creat d0/de/d12/dc1/fe0 x:0 0 0 2023-12-05T13:25:25.975 INFO:tasks.workunit.client.1.smithi052.stdout:3/674: symlink da/d25/d33/d43/d5b/le3 0 2023-12-05T13:25:25.975 INFO:tasks.workunit.client.1.smithi052.stdout:5/416: creat d5/d15/d21/d4a/f89 x:0 0 0 2023-12-05T13:25:25.977 INFO:tasks.workunit.client.1.smithi052.stdout:9/569: dwrite d3/d5e/f76 [0,4194304] 0 2023-12-05T13:25:25.977 INFO:tasks.workunit.client.1.smithi052.stdout:9/570: fdatasync d3/d11/fa2 0 2023-12-05T13:25:25.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/68: rmdir d6/d14 0 2023-12-05T13:25:25.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/69: fsync d6/f11 0 2023-12-05T13:25:25.981 INFO:tasks.workunit.client.1.smithi052.stdout:1/628: rename d5/d7/c10 to d5/d7/d35/d37/cc8 0 2023-12-05T13:25:25.981 INFO:tasks.workunit.client.1.smithi052.stdout:1/629: write d5/daa/da4/fa5 [1011987,38842] 0 2023-12-05T13:25:25.981 INFO:tasks.workunit.client.1.smithi052.stdout:1/630: stat d5/daa/l6e 0 2023-12-05T13:25:25.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/688: getdents d2/d4 0 2023-12-05T13:25:25.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/689: chown d2/d13/d1e/l2d 15318 1 2023-12-05T13:25:25.983 INFO:tasks.workunit.client.1.smithi052.stdout:6/501: dwrite d3/d5/d9/d21/d48/d4d/d66/d91/fa4 [0,4194304] 0 2023-12-05T13:25:25.984 INFO:tasks.workunit.client.1.smithi052.stdout:2/690: write d2/d14/d62/da7/fad [526916,9434] 0 2023-12-05T13:25:25.986 INFO:tasks.workunit.client.0.smithi029.stdout:1/41: rmdir d7 39 2023-12-05T13:25:25.991 INFO:tasks.workunit.client.0.smithi029.stdout:6/70: dread d6/f18 [0,4194304] 0 2023-12-05T13:25:25.991 INFO:tasks.workunit.client.0.smithi029.stdout:1/42: creat d7/fd x:0 0 0 2023-12-05T13:25:25.991 INFO:tasks.workunit.client.0.smithi029.stdout:1/43: stat f5 0 2023-12-05T13:25:25.992 INFO:tasks.workunit.client.1.smithi052.stdout:0/657: mknod d0/db/d1b/d7a/d8b/cd8 0 2023-12-05T13:25:25.994 INFO:tasks.workunit.client.1.smithi052.stdout:7/692: getdents d7/d4e/d45/d98 0 2023-12-05T13:25:25.995 INFO:tasks.workunit.client.0.smithi029.stdout:7/69: dwrite d6/fa [4194304,4194304] 0 2023-12-05T13:25:25.996 INFO:tasks.workunit.client.0.smithi029.stdout:7/70: write d6/f9 [332205,10350] 0 2023-12-05T13:25:25.996 INFO:tasks.workunit.client.0.smithi029.stdout:7/71: chown d6/fa 252156 1 2023-12-05T13:25:25.996 INFO:tasks.workunit.client.1.smithi052.stdout:3/675: unlink da/d7a/l82 0 2023-12-05T13:25:25.997 INFO:tasks.workunit.client.0.smithi029.stdout:1/44: truncate f5 787881 0 2023-12-05T13:25:25.997 INFO:tasks.workunit.client.0.smithi029.stdout:1/45: write d7/fd [1047609,10524] 0 2023-12-05T13:25:26.003 INFO:tasks.workunit.client.0.smithi029.stdout:6/71: creat d6/f1c x:0 0 0 2023-12-05T13:25:26.003 INFO:tasks.workunit.client.1.smithi052.stdout:9/571: rmdir d3/d11/d96 39 2023-12-05T13:25:26.007 INFO:tasks.workunit.client.1.smithi052.stdout:8/693: rename d0/de/d12/d29/f50 to d0/d28/d39/fe1 0 2023-12-05T13:25:26.010 INFO:tasks.workunit.client.1.smithi052.stdout:1/631: getdents d5 0 2023-12-05T13:25:26.013 INFO:tasks.workunit.client.1.smithi052.stdout:9/572: dread d3/d1e/d41/d86/f91 [0,4194304] 0 2023-12-05T13:25:26.014 INFO:tasks.workunit.client.0.smithi029.stdout:6/72: mkdir d6/d1d 0 2023-12-05T13:25:26.015 INFO:tasks.workunit.client.1.smithi052.stdout:0/658: dwrite d0/db/d65/fc9 [0,4194304] 0 2023-12-05T13:25:26.015 INFO:tasks.workunit.client.1.smithi052.stdout:0/659: chown d0/db/d52/d7f/f98 157816451 1 2023-12-05T13:25:26.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/72: dwrite d6/fa [8388608,4194304] 0 2023-12-05T13:25:26.021 INFO:tasks.workunit.client.1.smithi052.stdout:1/632: dread d5/d7/f12 [4194304,4194304] 0 2023-12-05T13:25:26.023 INFO:tasks.workunit.client.1.smithi052.stdout:7/693: creat d7/d31/d56/d60/d72/fe8 x:0 0 0 2023-12-05T13:25:26.023 INFO:tasks.workunit.client.1.smithi052.stdout:7/694: stat d7/d4e/d45/d5a/d66/f8c 0 2023-12-05T13:25:26.023 INFO:tasks.workunit.client.1.smithi052.stdout:6/502: dread d3/d5/d9/f64 [0,4194304] 0 2023-12-05T13:25:26.024 INFO:tasks.workunit.client.1.smithi052.stdout:7/695: dread d7/d4e/d45/d5a/d16/fd9 [0,4194304] 0 2023-12-05T13:25:26.024 INFO:tasks.workunit.client.1.smithi052.stdout:3/676: mknod da/d25/dcd/de0/ce4 0 2023-12-05T13:25:26.025 INFO:tasks.workunit.client.1.smithi052.stdout:3/677: fdatasync da/dd/d3d/f87 0 2023-12-05T13:25:26.025 INFO:tasks.workunit.client.1.smithi052.stdout:3/678: dread - da/d25/dcd/dc6/fa8 zero size 2023-12-05T13:25:26.025 INFO:tasks.workunit.client.1.smithi052.stdout:3/679: write da/d25/d33/d49/fc2 [693876,109756] 0 2023-12-05T13:25:26.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/73: creat d6/f11 x:0 0 0 2023-12-05T13:25:26.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/74: write d6/fc [1808678,68736] 0 2023-12-05T13:25:26.027 INFO:tasks.workunit.client.1.smithi052.stdout:8/694: unlink d0/c7b 0 2023-12-05T13:25:26.029 INFO:tasks.workunit.client.1.smithi052.stdout:5/417: rename d5/df/d4b/c85 to d5/df/c8a 0 2023-12-05T13:25:26.029 INFO:tasks.workunit.client.1.smithi052.stdout:5/418: chown d5/df 207 1 2023-12-05T13:25:26.030 INFO:tasks.workunit.client.0.smithi029.stdout:7/75: symlink d6/df/l12 0 2023-12-05T13:25:26.030 INFO:tasks.workunit.client.0.smithi029.stdout:7/76: chown d6/ce 39728 1 2023-12-05T13:25:26.031 INFO:tasks.workunit.client.1.smithi052.stdout:9/573: mknod d3/d1e/cc3 0 2023-12-05T13:25:26.032 INFO:tasks.workunit.client.0.smithi029.stdout:7/77: creat d6/f13 x:0 0 0 2023-12-05T13:25:26.034 INFO:tasks.workunit.client.0.smithi029.stdout:6/73: rmdir d6 39 2023-12-05T13:25:26.035 INFO:tasks.workunit.client.0.smithi029.stdout:7/78: rename d6/df/l12 to d6/df/l14 0 2023-12-05T13:25:26.037 INFO:tasks.workunit.client.1.smithi052.stdout:0/660: unlink d0/fd 0 2023-12-05T13:25:26.038 INFO:tasks.workunit.client.0.smithi029.stdout:6/74: unlink d6/l17 0 2023-12-05T13:25:26.039 INFO:tasks.workunit.client.0.smithi029.stdout:6/75: write d6/f18 [3177667,74126] 0 2023-12-05T13:25:26.039 INFO:tasks.workunit.client.1.smithi052.stdout:1/633: rmdir d5/daa/d2a 39 2023-12-05T13:25:26.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/79: creat d6/f15 x:0 0 0 2023-12-05T13:25:26.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/80: truncate d6/fc 1909305 0 2023-12-05T13:25:26.044 INFO:tasks.workunit.client.1.smithi052.stdout:7/696: truncate d7/d4e/d45/d5a/d16/f7c 485364 0 2023-12-05T13:25:26.044 INFO:tasks.workunit.client.1.smithi052.stdout:7/697: truncate d7/d31/fdf 293538 0 2023-12-05T13:25:26.044 INFO:tasks.workunit.client.1.smithi052.stdout:7/698: chown d7/d4e/d12/d3f/d46/f47 2 1 2023-12-05T13:25:26.044 INFO:tasks.workunit.client.1.smithi052.stdout:3/680: getdents da/d25/d33/d51 0 2023-12-05T13:25:26.047 INFO:tasks.workunit.client.1.smithi052.stdout:8/695: truncate d0/d28/d2b/f91 118978 0 2023-12-05T13:25:26.048 INFO:tasks.workunit.client.1.smithi052.stdout:8/696: chown d0/d62/c65 1602782 1 2023-12-05T13:25:26.048 INFO:tasks.workunit.client.1.smithi052.stdout:8/697: read d0/f11 [2956601,112959] 0 2023-12-05T13:25:26.050 INFO:tasks.workunit.client.1.smithi052.stdout:2/691: rename d2/d14/f5a to d2/d4/d3f/d9d/fcd 0 2023-12-05T13:25:26.052 INFO:tasks.workunit.client.1.smithi052.stdout:5/419: mkdir d5/df/d11/d73/d8b 0 2023-12-05T13:25:26.052 INFO:tasks.workunit.client.1.smithi052.stdout:5/420: getdents d5/d7f 0 2023-12-05T13:25:26.052 INFO:tasks.workunit.client.1.smithi052.stdout:5/421: fdatasync d5/d15/d21/d25/d3f/f5a 0 2023-12-05T13:25:26.053 INFO:tasks.workunit.client.1.smithi052.stdout:9/574: creat d3/d1e/d41/d57/fc4 x:0 0 0 2023-12-05T13:25:26.054 INFO:tasks.workunit.client.1.smithi052.stdout:1/634: creat d5/d7/d35/d2f/d9b/fc9 x:0 0 0 2023-12-05T13:25:26.054 INFO:tasks.workunit.client.1.smithi052.stdout:1/635: chown d5/d7/de/d18/ca7 4499840 1 2023-12-05T13:25:26.056 INFO:tasks.workunit.client.1.smithi052.stdout:7/699: mknod d7/dd5/ce9 0 2023-12-05T13:25:26.056 INFO:tasks.workunit.client.1.smithi052.stdout:7/700: chown d7/d4e/d45/cca 1789 1 2023-12-05T13:25:26.056 INFO:tasks.workunit.client.1.smithi052.stdout:7/701: getdents d7/dce 0 2023-12-05T13:25:26.057 INFO:tasks.workunit.client.1.smithi052.stdout:3/681: creat da/dd/fe5 x:0 0 0 2023-12-05T13:25:26.059 INFO:tasks.workunit.client.1.smithi052.stdout:8/698: symlink d0/d28/d39/d3a/le2 0 2023-12-05T13:25:26.059 INFO:tasks.workunit.client.1.smithi052.stdout:8/699: write d0/d28/d2b/fdb [207707,65067] 0 2023-12-05T13:25:26.060 INFO:tasks.workunit.client.1.smithi052.stdout:8/700: write d0/de/d27/f4e [3826093,43803] 0 2023-12-05T13:25:26.061 INFO:tasks.workunit.client.1.smithi052.stdout:1/636: dread d5/daa/d69/f82 [0,4194304] 0 2023-12-05T13:25:26.062 INFO:tasks.workunit.client.1.smithi052.stdout:6/503: rename d3/d5/d9/d52/c59 to d3/d5/d9/d21/d48/d4d/d81/cb4 0 2023-12-05T13:25:26.064 INFO:tasks.workunit.client.1.smithi052.stdout:2/692: truncate d2/d13/f36 1707632 0 2023-12-05T13:25:26.067 INFO:tasks.workunit.client.1.smithi052.stdout:5/422: link d5/d46/c45 d5/df/d11/c8c 0 2023-12-05T13:25:26.067 INFO:tasks.workunit.client.1.smithi052.stdout:5/423: chown d5/d46/c43 1 1 2023-12-05T13:25:26.067 INFO:tasks.workunit.client.0.smithi029.stdout:6/76: truncate f5 535664 0 2023-12-05T13:25:26.072 INFO:tasks.workunit.client.1.smithi052.stdout:7/702: rmdir d7/d31/d56/d60/d72 39 2023-12-05T13:25:26.072 INFO:tasks.workunit.client.1.smithi052.stdout:7/703: write d7/d4e/d45/d5a/f7b [151537,94052] 0 2023-12-05T13:25:26.073 INFO:tasks.workunit.client.1.smithi052.stdout:1/637: dread d5/d7/f13 [4194304,4194304] 0 2023-12-05T13:25:26.073 INFO:tasks.workunit.client.1.smithi052.stdout:1/638: readlink d5/d7/de/d18/l34 0 2023-12-05T13:25:26.073 INFO:tasks.workunit.client.1.smithi052.stdout:3/682: truncate da/f23 1087867 0 2023-12-05T13:25:26.073 INFO:tasks.workunit.client.1.smithi052.stdout:1/639: getdents d5/d26/d41/dbd 0 2023-12-05T13:25:26.073 INFO:tasks.workunit.client.1.smithi052.stdout:1/640: fdatasync d5/d7/d35/d2f/d3e/d62/d85/fab 0 2023-12-05T13:25:26.077 INFO:tasks.workunit.client.1.smithi052.stdout:8/701: getdents d0/de/d27 0 2023-12-05T13:25:26.078 INFO:tasks.workunit.client.0.smithi029.stdout:6/77: write d6/f18 [725050,27439] 0 2023-12-05T13:25:26.082 INFO:tasks.workunit.client.1.smithi052.stdout:6/504: rmdir d3/d5/d9/d21/d48/d4d/d66/d6c 0 2023-12-05T13:25:26.083 INFO:tasks.workunit.client.1.smithi052.stdout:8/702: dread d0/de/d12/f85 [0,4194304] 0 2023-12-05T13:25:26.083 INFO:tasks.workunit.client.1.smithi052.stdout:2/693: dwrite d2/d4/d3f/f5b [4194304,4194304] 0 2023-12-05T13:25:26.083 INFO:tasks.workunit.client.1.smithi052.stdout:7/704: dread d7/d4e/f61 [4194304,4194304] 0 2023-12-05T13:25:26.084 INFO:tasks.workunit.client.1.smithi052.stdout:7/705: chown d7/d31/d56/lac 156276763 1 2023-12-05T13:25:26.085 INFO:tasks.workunit.client.1.smithi052.stdout:5/424: dwrite d5/df/d4b/d74/f7c [0,4194304] 0 2023-12-05T13:25:26.085 INFO:tasks.workunit.client.1.smithi052.stdout:5/425: fdatasync d5/fc 0 2023-12-05T13:25:26.086 INFO:tasks.workunit.client.1.smithi052.stdout:3/683: creat da/d25/d33/d49/dbd/fe6 x:0 0 0 2023-12-05T13:25:26.087 INFO:tasks.workunit.client.0.smithi029.stdout:6/78: rename c0 to d6/d1d/c1e 0 2023-12-05T13:25:26.094 INFO:tasks.workunit.client.1.smithi052.stdout:8/703: mknod d0/d28/d39/d3a/d4f/db5/dc0/ce3 0 2023-12-05T13:25:26.097 INFO:tasks.workunit.client.1.smithi052.stdout:2/694: link d2/d4/d3f/l68 d2/d13/d37/lce 0 2023-12-05T13:25:26.097 INFO:tasks.workunit.client.1.smithi052.stdout:2/695: chown d2/d4/d63/d6d/dcb 2001899182 1 2023-12-05T13:25:26.098 INFO:tasks.workunit.client.0.smithi029.stdout:6/79: fsync f5 0 2023-12-05T13:25:26.099 INFO:tasks.workunit.client.1.smithi052.stdout:2/696: read d2/d13/f26 [4668681,129631] 0 2023-12-05T13:25:26.099 INFO:tasks.workunit.client.1.smithi052.stdout:2/697: readlink d2/d13/d1e/d6a/d7f/d84/d3a/l44 0 2023-12-05T13:25:26.099 INFO:tasks.workunit.client.1.smithi052.stdout:2/698: stat d2/d13/d1e/f57 0 2023-12-05T13:25:26.099 INFO:tasks.workunit.client.1.smithi052.stdout:7/706: creat d7/d4e/d12/d7d/fea x:0 0 0 2023-12-05T13:25:26.101 INFO:tasks.workunit.client.1.smithi052.stdout:1/641: dwrite d5/daa/da4/fa5 [0,4194304] 0 2023-12-05T13:25:26.101 INFO:tasks.workunit.client.0.smithi029.stdout:6/80: mknod d6/d1d/c1f 0 2023-12-05T13:25:26.102 INFO:tasks.workunit.client.1.smithi052.stdout:1/642: write d5/f2c [2433783,114945] 0 2023-12-05T13:25:26.104 INFO:tasks.workunit.client.1.smithi052.stdout:4/680: sync 2023-12-05T13:25:26.104 INFO:tasks.workunit.client.1.smithi052.stdout:4/681: getdents de/d30/dac/dbb 0 2023-12-05T13:25:26.104 INFO:tasks.workunit.client.1.smithi052.stdout:4/682: dread - de/d91/fa6 zero size 2023-12-05T13:25:26.104 INFO:tasks.workunit.client.1.smithi052.stdout:4/683: getdents de/d30/d68/d5c/dcb 0 2023-12-05T13:25:26.104 INFO:tasks.workunit.client.1.smithi052.stdout:3/684: mkdir da/d25/d33/d43/d5b/da6/de7 0 2023-12-05T13:25:26.109 INFO:tasks.workunit.client.1.smithi052.stdout:5/426: dwrite d5/f87 [0,4194304] 0 2023-12-05T13:25:26.109 INFO:tasks.workunit.client.1.smithi052.stdout:5/427: read - d5/d15/d21/d4a/f89 zero size 2023-12-05T13:25:26.110 INFO:tasks.workunit.client.1.smithi052.stdout:0/661: rename d0/fa to d0/db/d1b/d51/fd9 0 2023-12-05T13:25:26.111 INFO:tasks.workunit.client.1.smithi052.stdout:8/704: truncate d0/d51/f76 3900290 0 2023-12-05T13:25:26.115 INFO:tasks.workunit.client.1.smithi052.stdout:7/707: creat d7/feb x:0 0 0 2023-12-05T13:25:26.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/81: dwrite d6/fe [0,4194304] 0 2023-12-05T13:25:26.117 INFO:tasks.workunit.client.1.smithi052.stdout:1/643: rmdir d5 39 2023-12-05T13:25:26.121 INFO:tasks.workunit.client.1.smithi052.stdout:5/428: dread f4 [0,4194304] 0 2023-12-05T13:25:26.121 INFO:tasks.workunit.client.1.smithi052.stdout:5/429: fdatasync d5/df/f17 0 2023-12-05T13:25:26.121 INFO:tasks.workunit.client.1.smithi052.stdout:5/430: chown d5/d7f 411 1 2023-12-05T13:25:26.123 INFO:tasks.workunit.client.1.smithi052.stdout:4/684: mkdir de/d30/d73/dbe/d24/ddd/de4 0 2023-12-05T13:25:26.126 INFO:tasks.workunit.client.0.smithi029.stdout:6/82: unlink l2 0 2023-12-05T13:25:26.127 INFO:tasks.workunit.client.1.smithi052.stdout:4/685: write de/f11 [884291,91167] 0 2023-12-05T13:25:26.127 INFO:tasks.workunit.client.1.smithi052.stdout:4/686: readlink de/d29/lb3 0 2023-12-05T13:25:26.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/687: read de/d2b/f5a [4098148,68938] 0 2023-12-05T13:25:26.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/688: fdatasync de/d30/d73/dbe/d24/f6e 0 2023-12-05T13:25:26.129 INFO:tasks.workunit.client.1.smithi052.stdout:7/708: dwrite d7/d4e/d12/d3f/d46/f4a [0,4194304] 0 2023-12-05T13:25:26.129 INFO:tasks.workunit.client.1.smithi052.stdout:7/709: chown d7/d4e/d45/d5a/d63/f6d 70339 1 2023-12-05T13:25:26.130 INFO:tasks.workunit.client.0.smithi029.stdout:6/83: mknod d6/c20 0 2023-12-05T13:25:26.132 INFO:tasks.workunit.client.1.smithi052.stdout:9/575: rename d3/d2a/d5c/c63 to d3/cc5 0 2023-12-05T13:25:26.134 INFO:tasks.workunit.client.0.smithi029.stdout:6/84: mkdir d6/d21 0 2023-12-05T13:25:26.136 INFO:tasks.workunit.client.1.smithi052.stdout:8/705: mkdir d0/d28/d2b/de4 0 2023-12-05T13:25:26.138 INFO:tasks.workunit.client.1.smithi052.stdout:1/644: creat d5/d7/d35/d37/d5a/d73/fca x:0 0 0 2023-12-05T13:25:26.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/85: symlink d6/d21/l22 0 2023-12-05T13:25:26.139 INFO:tasks.workunit.client.0.smithi029.stdout:6/86: read d6/fe [3971278,62694] 0 2023-12-05T13:25:26.145 INFO:tasks.workunit.client.1.smithi052.stdout:4/689: getdents de/d29 0 2023-12-05T13:25:26.149 INFO:tasks.workunit.client.1.smithi052.stdout:7/710: mkdir d7/d4e/d45/d98/dec 0 2023-12-05T13:25:26.151 INFO:tasks.workunit.client.1.smithi052.stdout:4/690: dread de/d30/d68/f50 [0,4194304] 0 2023-12-05T13:25:26.151 INFO:tasks.workunit.client.1.smithi052.stdout:4/691: chown de/f87 0 1 2023-12-05T13:25:26.152 INFO:tasks.workunit.client.1.smithi052.stdout:4/692: chown de/d30/d73/dbe/ldf 27131325 1 2023-12-05T13:25:26.155 INFO:tasks.workunit.client.0.smithi029.stdout:6/87: dwrite d6/f10 [0,4194304] 0 2023-12-05T13:25:26.160 INFO:tasks.workunit.client.1.smithi052.stdout:6/505: rename d3/f50 to d3/d5/d9/d21/d48/d4d/d66/d91/fb5 0 2023-12-05T13:25:26.163 INFO:tasks.workunit.client.1.smithi052.stdout:9/576: symlink d3/d92/da8/lc6 0 2023-12-05T13:25:26.166 INFO:tasks.workunit.client.1.smithi052.stdout:8/706: mkdir d0/de5 0 2023-12-05T13:25:26.166 INFO:tasks.workunit.client.1.smithi052.stdout:8/707: fdatasync d0/fa 0 2023-12-05T13:25:26.166 INFO:tasks.workunit.client.1.smithi052.stdout:8/708: chown d0/de/d27 101 1 2023-12-05T13:25:26.167 INFO:tasks.workunit.client.1.smithi052.stdout:8/709: truncate d0/d28/d2b/f31 1619380 0 2023-12-05T13:25:26.167 INFO:tasks.workunit.client.1.smithi052.stdout:4/693: rmdir de/d30/dac/de3 0 2023-12-05T13:25:26.169 INFO:tasks.workunit.client.1.smithi052.stdout:2/699: rename d2/d4/d3f/f5b to d2/d13/d37/d8b/fcf 0 2023-12-05T13:25:26.171 INFO:tasks.workunit.client.0.smithi029.stdout:6/88: dread d6/fe [0,4194304] 0 2023-12-05T13:25:26.173 INFO:tasks.workunit.client.1.smithi052.stdout:9/577: unlink d3/d11/d19/d83/lab 0 2023-12-05T13:25:26.175 INFO:tasks.workunit.client.1.smithi052.stdout:8/710: mkdir d0/d28/d2b/dcf/de6 0 2023-12-05T13:25:26.175 INFO:tasks.workunit.client.1.smithi052.stdout:8/711: chown d0/de/d12/d29/dcb 4625485 1 2023-12-05T13:25:26.175 INFO:tasks.workunit.client.1.smithi052.stdout:8/712: fdatasync d0/d28/f8c 0 2023-12-05T13:25:26.175 INFO:tasks.workunit.client.1.smithi052.stdout:8/713: dread - d0/de/d27/d43/d44/db9/fbd zero size 2023-12-05T13:25:26.175 INFO:tasks.workunit.client.1.smithi052.stdout:0/662: dread d0/db/f96 [0,4194304] 0 2023-12-05T13:25:26.175 INFO:tasks.workunit.client.1.smithi052.stdout:7/711: dwrite d7/d31/f3e [0,4194304] 0 2023-12-05T13:25:26.176 INFO:tasks.workunit.client.0.smithi029.stdout:6/89: symlink d6/d21/l23 0 2023-12-05T13:25:26.182 INFO:tasks.workunit.client.1.smithi052.stdout:3/685: rename da/d25/dcd/dc6/cc8 to da/d2e/ce8 0 2023-12-05T13:25:26.182 INFO:tasks.workunit.client.1.smithi052.stdout:3/686: fsync da/f9d 0 2023-12-05T13:25:26.183 INFO:tasks.workunit.client.1.smithi052.stdout:3/687: stat da/dd/l9e 0 2023-12-05T13:25:26.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/506: truncate d3/d5/d9/f2f 3064935 0 2023-12-05T13:25:26.185 INFO:tasks.workunit.client.1.smithi052.stdout:9/578: truncate d3/d1e/d37/d4f/f77 1189877 0 2023-12-05T13:25:26.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/579: write d3/d2a/f59 [3079858,99570] 0 2023-12-05T13:25:26.190 INFO:tasks.workunit.client.1.smithi052.stdout:7/712: link d7/d4e/d45/d5a/d16/c3a d7/d4e/d45/d5a/d63/d95/dba/ced 0 2023-12-05T13:25:26.192 INFO:tasks.workunit.client.1.smithi052.stdout:1/645: rename d5/daa/f6a to d5/daa/d79/fcb 0 2023-12-05T13:25:26.192 INFO:tasks.workunit.client.1.smithi052.stdout:3/688: creat da/dd/d3d/fe9 x:0 0 0 2023-12-05T13:25:26.193 INFO:tasks.workunit.client.1.smithi052.stdout:3/689: fdatasync da/dd/fe5 0 2023-12-05T13:25:26.193 INFO:tasks.workunit.client.1.smithi052.stdout:3/690: truncate da/d25/d33/d89/fb1 4456941 0 2023-12-05T13:25:26.193 INFO:tasks.workunit.client.1.smithi052.stdout:3/691: write da/fe [1839204,26202] 0 2023-12-05T13:25:26.194 INFO:tasks.workunit.client.1.smithi052.stdout:6/507: mknod d3/d4/df/d24/cb6 0 2023-12-05T13:25:26.195 INFO:tasks.workunit.client.1.smithi052.stdout:7/713: getdents d7/d4e/d45/d79 0 2023-12-05T13:25:26.197 INFO:tasks.workunit.client.1.smithi052.stdout:8/714: dwrite d0/d28/d2b/d53/d56/fd4 [0,4194304] 0 2023-12-05T13:25:26.197 INFO:tasks.workunit.client.1.smithi052.stdout:0/663: dwrite d0/db/d20/f21 [4194304,4194304] 0 2023-12-05T13:25:26.197 INFO:tasks.workunit.client.1.smithi052.stdout:4/694: rename de/f12 to de/d29/d51/da3/fe5 0 2023-12-05T13:25:26.198 INFO:tasks.workunit.client.1.smithi052.stdout:2/700: dwrite d2/d13/d1e/f57 [0,4194304] 0 2023-12-05T13:25:26.198 INFO:tasks.workunit.client.1.smithi052.stdout:1/646: mkdir d5/d7/de/d74/d99/dcc 0 2023-12-05T13:25:26.201 INFO:tasks.workunit.client.0.smithi029.stdout:6/90: dwrite d6/fa [0,4194304] 0 2023-12-05T13:25:26.203 INFO:tasks.workunit.client.1.smithi052.stdout:1/647: dread d5/d26/d41/f5f [0,4194304] 0 2023-12-05T13:25:26.205 INFO:tasks.workunit.client.1.smithi052.stdout:6/508: link d3/d5/d9/d21/d48/d4d/d81/ca6 d3/d5/d9/d21/d48/cb7 0 2023-12-05T13:25:26.205 INFO:tasks.workunit.client.1.smithi052.stdout:6/509: truncate d3/d4/df/fa7 1114380 0 2023-12-05T13:25:26.207 INFO:tasks.workunit.client.1.smithi052.stdout:7/714: symlink d7/d4e/d12/d3f/d75/lee 0 2023-12-05T13:25:26.210 INFO:tasks.workunit.client.0.smithi029.stdout:6/91: creat d6/d1d/f24 x:0 0 0 2023-12-05T13:25:26.211 INFO:tasks.workunit.client.0.smithi029.stdout:6/92: write d6/fe [287881,4685] 0 2023-12-05T13:25:26.212 INFO:tasks.workunit.client.1.smithi052.stdout:5/431: sync 2023-12-05T13:25:26.215 INFO:tasks.workunit.client.1.smithi052.stdout:8/715: unlink d0/d28/l71 0 2023-12-05T13:25:26.218 INFO:tasks.workunit.client.0.smithi029.stdout:6/93: unlink d6/d21/l22 0 2023-12-05T13:25:26.219 INFO:tasks.workunit.client.0.smithi029.stdout:6/94: chown d6/f11 281005899 1 2023-12-05T13:25:26.223 INFO:tasks.workunit.client.1.smithi052.stdout:3/692: dwrite da/f9d [0,4194304] 0 2023-12-05T13:25:26.223 INFO:tasks.workunit.client.1.smithi052.stdout:2/701: dwrite d2/d14/d62/da7/fc0 [0,4194304] 0 2023-12-05T13:25:26.223 INFO:tasks.workunit.client.1.smithi052.stdout:5/432: dread d5/d15/d21/d25/d3f/d5c/f53 [0,4194304] 0 2023-12-05T13:25:26.223 INFO:tasks.workunit.client.1.smithi052.stdout:2/702: fsync d2/f3c 0 2023-12-05T13:25:26.223 INFO:tasks.workunit.client.1.smithi052.stdout:5/433: dread - d5/d15/d21/d25/d3f/d5c/f6c zero size 2023-12-05T13:25:26.223 INFO:tasks.workunit.client.1.smithi052.stdout:2/703: read - d2/d13/d1e/fc2 zero size 2023-12-05T13:25:26.224 INFO:tasks.workunit.client.1.smithi052.stdout:4/695: unlink de/d30/d73/dbe/f67 0 2023-12-05T13:25:26.224 INFO:tasks.workunit.client.1.smithi052.stdout:5/434: read d5/df/d4b/f4d [585521,30848] 0 2023-12-05T13:25:26.228 INFO:tasks.workunit.client.0.smithi029.stdout:6/95: rename d6/ld to d6/d21/l25 0 2023-12-05T13:25:26.231 INFO:tasks.workunit.client.1.smithi052.stdout:1/648: mkdir d5/d26/da3/dcd 0 2023-12-05T13:25:26.233 INFO:tasks.workunit.client.1.smithi052.stdout:6/510: mkdir d3/d5/d9/d21/db8 0 2023-12-05T13:25:26.236 INFO:tasks.workunit.client.1.smithi052.stdout:7/715: rename d7/d4e/d12/f29 to d7/d4e/d12/d3f/d46/fef 0 2023-12-05T13:25:26.240 INFO:tasks.workunit.client.1.smithi052.stdout:8/716: dread d0/d28/d2b/f91 [0,4194304] 0 2023-12-05T13:25:26.240 INFO:tasks.workunit.client.1.smithi052.stdout:8/717: chown d0/de/d27/d43/d44/f49 53 1 2023-12-05T13:25:26.247 INFO:tasks.workunit.client.0.smithi029.stdout:6/96: dwrite d6/fe [0,4194304] 0 2023-12-05T13:25:26.248 INFO:tasks.workunit.client.1.smithi052.stdout:6/511: dwrite d3/d5/d9/f3a [0,4194304] 0 2023-12-05T13:25:26.249 INFO:tasks.workunit.client.1.smithi052.stdout:0/664: link d0/db/cbf d0/db/d2e/cda 0 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/693: creat da/d25/d33/d49/dbd/d74/fea x:0 0 0 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:6/512: dread d3/d4/d6/d26/d6d/f7e [0,4194304] 0 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:6/513: write d3/d4/df/d24/f8a [638453,51735] 0 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/694: read da/d27/f92 [7334511,990] 0 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/695: readlink da/d48/l4b 0 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/696: chown da/d25/d33/d43 0 1 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/697: read - da/d25/d33/fd6 zero size 2023-12-05T13:25:26.251 INFO:tasks.workunit.client.1.smithi052.stdout:3/698: truncate da/dd/d3d/fe9 691777 0 2023-12-05T13:25:26.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/97: rmdir d6/d1d 39 2023-12-05T13:25:26.254 INFO:tasks.workunit.client.1.smithi052.stdout:2/704: mkdir d2/d13/d1e/dae/dc3/dd0 0 2023-12-05T13:25:26.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/98: unlink d6/l16 0 2023-12-05T13:25:26.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/99: truncate d6/d1d/f24 1048221 0 2023-12-05T13:25:26.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/100: stat d6/d21/l23 0 2023-12-05T13:25:26.262 INFO:tasks.workunit.client.1.smithi052.stdout:4/696: creat de/d30/d68/d5c/db8/fe6 x:0 0 0 2023-12-05T13:25:26.262 INFO:tasks.workunit.client.1.smithi052.stdout:4/697: chown de/d2b 2 1 2023-12-05T13:25:26.263 INFO:tasks.workunit.client.0.smithi029.stdout:6/101: stat d6/l8 0 2023-12-05T13:25:26.263 INFO:tasks.workunit.client.0.smithi029.stdout:6/102: chown d6/l13 18954 1 2023-12-05T13:25:26.263 INFO:tasks.workunit.client.0.smithi029.stdout:6/103: fdatasync d6/d1d/f24 0 2023-12-05T13:25:26.264 INFO:tasks.workunit.client.1.smithi052.stdout:5/435: mkdir d5/df/d8d 0 2023-12-05T13:25:26.266 INFO:tasks.workunit.client.1.smithi052.stdout:1/649: rmdir d5/d7/d35/d2f/d3e 39 2023-12-05T13:25:26.268 INFO:tasks.workunit.client.1.smithi052.stdout:2/705: dwrite d2/f2f [4194304,4194304] 0 2023-12-05T13:25:26.268 INFO:tasks.workunit.client.1.smithi052.stdout:2/706: chown d2/l20 0 1 2023-12-05T13:25:26.271 INFO:tasks.workunit.client.1.smithi052.stdout:7/716: mknod d7/d31/d56/cf0 0 2023-12-05T13:25:26.271 INFO:tasks.workunit.client.1.smithi052.stdout:8/718: mknod d0/d28/d39/d3a/d9f/ce7 0 2023-12-05T13:25:26.271 INFO:tasks.workunit.client.1.smithi052.stdout:8/719: fsync d0/de/fd5 0 2023-12-05T13:25:26.274 INFO:tasks.workunit.client.1.smithi052.stdout:6/514: getdents d3/d5/d9/d44 0 2023-12-05T13:25:26.277 INFO:tasks.workunit.client.1.smithi052.stdout:3/699: unlink da/d25/cb4 0 2023-12-05T13:25:26.277 INFO:tasks.workunit.client.1.smithi052.stdout:3/700: chown da/d25/d33/d43/d5b/c68 2832 1 2023-12-05T13:25:26.277 INFO:tasks.workunit.client.1.smithi052.stdout:3/701: stat da/d25/d33/d43/d5b/f5c 0 2023-12-05T13:25:26.280 INFO:tasks.workunit.client.1.smithi052.stdout:5/436: creat d5/df/d8d/f8e x:0 0 0 2023-12-05T13:25:26.280 INFO:tasks.workunit.client.1.smithi052.stdout:1/650: dread d5/d7/d35/d2f/d3e/f58 [0,4194304] 0 2023-12-05T13:25:26.282 INFO:tasks.workunit.client.1.smithi052.stdout:2/707: dread d2/d13/d45/f4a [0,4194304] 0 2023-12-05T13:25:26.284 INFO:tasks.workunit.client.1.smithi052.stdout:2/708: read d2/d13/f36 [1327600,126865] 0 2023-12-05T13:25:26.287 INFO:tasks.workunit.client.1.smithi052.stdout:6/515: rename d3/d4/df/d63/l77 to d3/d4/d6/d26/d8e/lb9 0 2023-12-05T13:25:26.290 INFO:tasks.workunit.client.1.smithi052.stdout:1/651: rename d5/d7/d35/d37/d5a/d73/dac/fc5 to d5/daa/d2a/fce 0 2023-12-05T13:25:26.290 INFO:tasks.workunit.client.1.smithi052.stdout:1/652: read - d5/d7/d35/d2f/d3e/d62/d85/fab zero size 2023-12-05T13:25:26.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/104: truncate d6/d1d/f24 386825 0 2023-12-05T13:25:26.298 INFO:tasks.workunit.client.1.smithi052.stdout:7/717: dwrite d7/d4e/d45/d5a/d63/d95/dba/fc3 [0,4194304] 0 2023-12-05T13:25:26.298 INFO:tasks.workunit.client.1.smithi052.stdout:5/437: dread d5/f79 [0,4194304] 0 2023-12-05T13:25:26.299 INFO:tasks.workunit.client.1.smithi052.stdout:6/516: dread d3/d5/d9/f3a [0,4194304] 0 2023-12-05T13:25:26.301 INFO:tasks.workunit.client.0.smithi029.stdout:6/105: mknod d6/d1d/c26 0 2023-12-05T13:25:26.301 INFO:tasks.workunit.client.0.smithi029.stdout:6/106: readlink d6/l8 0 2023-12-05T13:25:26.303 INFO:tasks.workunit.client.0.smithi029.stdout:6/107: symlink d6/l27 0 2023-12-05T13:25:26.303 INFO:tasks.workunit.client.1.smithi052.stdout:3/702: dwrite da/d25/d33/f97 [0,4194304] 0 2023-12-05T13:25:26.307 INFO:tasks.workunit.client.1.smithi052.stdout:7/718: getdents d7/d4e/d12/d3f/d46/dab 0 2023-12-05T13:25:26.307 INFO:tasks.workunit.client.1.smithi052.stdout:2/709: dwrite d2/d13/d48/f91 [0,4194304] 0 2023-12-05T13:25:26.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/108: link d6/f1c d6/d21/f28 0 2023-12-05T13:25:26.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/109: stat d6/fc 0 2023-12-05T13:25:26.312 INFO:tasks.workunit.client.1.smithi052.stdout:6/517: truncate d3/d4/df/d63/f70 611040 0 2023-12-05T13:25:26.316 INFO:tasks.workunit.client.1.smithi052.stdout:3/703: getdents da/d25/d33/d49/dbd/d74 0 2023-12-05T13:25:26.320 INFO:tasks.workunit.client.1.smithi052.stdout:1/653: dwrite d5/daa/f32 [0,4194304] 0 2023-12-05T13:25:26.322 INFO:tasks.workunit.client.1.smithi052.stdout:6/518: link d3/d5/d9/d44/l6a d3/d5/d9/d52/lba 0 2023-12-05T13:25:26.322 INFO:tasks.workunit.client.1.smithi052.stdout:6/519: write d3/d4/df/d27/f96 [991198,54259] 0 2023-12-05T13:25:26.322 INFO:tasks.workunit.client.1.smithi052.stdout:3/704: write da/fe [1289263,107291] 0 2023-12-05T13:25:26.322 INFO:tasks.workunit.client.1.smithi052.stdout:2/710: mknod d2/d4/d63/d6d/dcb/cd1 0 2023-12-05T13:25:26.325 INFO:tasks.workunit.client.1.smithi052.stdout:1/654: dread d5/d7/d35/d37/d5a/d73/d76/fc1 [0,4194304] 0 2023-12-05T13:25:26.325 INFO:tasks.workunit.client.1.smithi052.stdout:1/655: chown d5/daa/d2a/f9e 25063 1 2023-12-05T13:25:26.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/110: fdatasync d6/f18 0 2023-12-05T13:25:26.328 INFO:tasks.workunit.client.1.smithi052.stdout:5/438: dwrite d5/df/d11/f52 [0,4194304] 0 2023-12-05T13:25:26.328 INFO:tasks.workunit.client.1.smithi052.stdout:5/439: stat d5/df/d4e/d65/f72 0 2023-12-05T13:25:26.330 INFO:tasks.workunit.client.1.smithi052.stdout:3/705: truncate da/d7a/fc4 326082 0 2023-12-05T13:25:26.333 INFO:tasks.workunit.client.0.smithi029.stdout:6/111: read d6/d1d/f24 [287585,116938] 0 2023-12-05T13:25:26.334 INFO:tasks.workunit.client.1.smithi052.stdout:7/719: dwrite d7/d4e/d45/d5a/d16/f7c [0,4194304] 0 2023-12-05T13:25:26.336 INFO:tasks.workunit.client.1.smithi052.stdout:5/440: unlink d5/d15/l70 0 2023-12-05T13:25:26.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/112: truncate d6/fc 3703685 0 2023-12-05T13:25:26.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/113: dread - d6/f1c zero size 2023-12-05T13:25:26.337 INFO:tasks.workunit.client.0.smithi029.stdout:6/114: chown d6/c20 652 1 2023-12-05T13:25:26.340 INFO:tasks.workunit.client.1.smithi052.stdout:6/520: dread d3/d4/df/f2a [0,4194304] 0 2023-12-05T13:25:26.344 INFO:tasks.workunit.client.1.smithi052.stdout:2/711: dread d2/f59 [4194304,4194304] 0 2023-12-05T13:25:26.349 INFO:tasks.workunit.client.1.smithi052.stdout:5/441: mkdir d5/d46/d76/d8f 0 2023-12-05T13:25:26.350 INFO:tasks.workunit.client.1.smithi052.stdout:0/665: dwrite d0/f82 [0,4194304] 0 2023-12-05T13:25:26.350 INFO:tasks.workunit.client.1.smithi052.stdout:0/666: chown d0 11709931 1 2023-12-05T13:25:26.350 INFO:tasks.workunit.client.0.smithi029.stdout:6/115: mkdir d6/d29 0 2023-12-05T13:25:26.352 INFO:tasks.workunit.client.1.smithi052.stdout:2/712: rename d2/d13/d45/l9e to d2/d13/d37/d5c/d80/db4/ld2 0 2023-12-05T13:25:26.352 INFO:tasks.workunit.client.1.smithi052.stdout:5/442: rename d5/df/d11/d73 to d5/df/d11/d73/d8b/d90 22 2023-12-05T13:25:26.354 INFO:tasks.workunit.client.0.smithi029.stdout:6/116: symlink d6/d21/l2a 0 2023-12-05T13:25:26.354 INFO:tasks.workunit.client.0.smithi029.stdout:6/117: fdatasync d6/fc 0 2023-12-05T13:25:26.359 INFO:tasks.workunit.client.1.smithi052.stdout:3/706: write da/d25/f6f [3812586,117123] 0 2023-12-05T13:25:26.359 INFO:tasks.workunit.client.1.smithi052.stdout:3/707: write da/d25/d33/d49/dbd/d74/fea [119331,44327] 0 2023-12-05T13:25:26.360 INFO:tasks.workunit.client.1.smithi052.stdout:5/443: unlink d5/d15/c1b 0 2023-12-05T13:25:26.360 INFO:tasks.workunit.client.1.smithi052.stdout:0/667: mkdir d0/db/d33/ddb 0 2023-12-05T13:25:26.361 INFO:tasks.workunit.client.1.smithi052.stdout:5/444: dread - d5/df/d4e/d5b/f82 zero size 2023-12-05T13:25:26.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/668: write d0/db/d52/fbc [945559,115855] 0 2023-12-05T13:25:26.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/669: fsync d0/db/d33/f35 0 2023-12-05T13:25:26.361 INFO:tasks.workunit.client.1.smithi052.stdout:1/656: dwrite d5/daa/d79/faf [0,4194304] 0 2023-12-05T13:25:26.361 INFO:tasks.workunit.client.1.smithi052.stdout:1/657: readlink d5/d26/d75/l87 0 2023-12-05T13:25:26.361 INFO:tasks.workunit.client.1.smithi052.stdout:7/720: dwrite d7/d4e/d12/f34 [0,4194304] 0 2023-12-05T13:25:26.362 INFO:tasks.workunit.client.1.smithi052.stdout:7/721: write d7/d4e/d45/d5a/f96 [124739,72042] 0 2023-12-05T13:25:26.364 INFO:tasks.workunit.client.1.smithi052.stdout:5/445: write d5/f87 [286773,122867] 0 2023-12-05T13:25:26.364 INFO:tasks.workunit.client.1.smithi052.stdout:5/446: fsync d5/d15/d21/d25/d3f/d5c/f6c 0 2023-12-05T13:25:26.364 INFO:tasks.workunit.client.1.smithi052.stdout:5/447: readlink d5/d15/d21/d25/d3f/l6b 0 2023-12-05T13:25:26.366 INFO:tasks.workunit.client.0.smithi029.stdout:6/118: dread d6/f10 [0,4194304] 0 2023-12-05T13:25:26.368 INFO:tasks.workunit.client.1.smithi052.stdout:0/670: symlink d0/db/d20/ldc 0 2023-12-05T13:25:26.368 INFO:tasks.workunit.client.1.smithi052.stdout:0/671: stat d0/db/d2e/d53/d80 0 2023-12-05T13:25:26.370 INFO:tasks.workunit.client.1.smithi052.stdout:6/521: dwrite d3/d5/d58/f84 [0,4194304] 0 2023-12-05T13:25:26.370 INFO:tasks.workunit.client.1.smithi052.stdout:6/522: read - d3/d5/d58/f97 zero size 2023-12-05T13:25:26.371 INFO:tasks.workunit.client.1.smithi052.stdout:3/708: dread da/d27/f3b [0,4194304] 0 2023-12-05T13:25:26.371 INFO:tasks.workunit.client.1.smithi052.stdout:1/658: symlink d5/d7/d35/d2f/d3e/d62/d85/lcf 0 2023-12-05T13:25:26.371 INFO:tasks.workunit.client.1.smithi052.stdout:1/659: chown d5/d7/d35/d37/d5a/d73/d7e/f6b 5 1 2023-12-05T13:25:26.371 INFO:tasks.workunit.client.1.smithi052.stdout:1/660: getdents d5/d7/d35/d37/d5a/d73/d7e/d4f 0 2023-12-05T13:25:26.371 INFO:tasks.workunit.client.1.smithi052.stdout:2/713: dwrite d2/d13/d37/d5c/f9c [0,4194304] 0 2023-12-05T13:25:26.380 INFO:tasks.workunit.client.1.smithi052.stdout:9/580: sync 2023-12-05T13:25:26.380 INFO:tasks.workunit.client.1.smithi052.stdout:9/581: write d3/d11/d3e/f9b [590726,112556] 0 2023-12-05T13:25:26.380 INFO:tasks.workunit.client.1.smithi052.stdout:9/582: fdatasync d3/d11/d19/d83/fb7 0 2023-12-05T13:25:26.380 INFO:tasks.workunit.client.1.smithi052.stdout:0/672: write d0/f1a [5021022,34274] 0 2023-12-05T13:25:26.383 INFO:tasks.workunit.client.1.smithi052.stdout:6/523: dread d3/d4/d6/f4b [0,4194304] 0 2023-12-05T13:25:26.384 INFO:tasks.workunit.client.1.smithi052.stdout:7/722: dwrite d7/d4e/d12/d7d/fea [0,4194304] 0 2023-12-05T13:25:26.384 INFO:tasks.workunit.client.1.smithi052.stdout:7/723: dread - d7/d31/d56/d60/d72/fe3 zero size 2023-12-05T13:25:26.387 INFO:tasks.workunit.client.1.smithi052.stdout:3/709: creat da/d25/d33/d43/d5b/da6/de7/feb x:0 0 0 2023-12-05T13:25:26.387 INFO:tasks.workunit.client.1.smithi052.stdout:3/710: write da/d25/d33/d49/fb0 [814984,97805] 0 2023-12-05T13:25:26.387 INFO:tasks.workunit.client.1.smithi052.stdout:3/711: dread - da/dd/d3d/f76 zero size 2023-12-05T13:25:26.390 INFO:tasks.workunit.client.1.smithi052.stdout:1/661: rename d5/d7/f47 to d5/d26/da3/fd0 0 2023-12-05T13:25:26.392 INFO:tasks.workunit.client.1.smithi052.stdout:2/714: getdents d2/d13/d37/d61 0 2023-12-05T13:25:26.395 INFO:tasks.workunit.client.0.smithi029.stdout:6/119: dwrite d6/d21/f28 [0,4194304] 0 2023-12-05T13:25:26.396 INFO:tasks.workunit.client.1.smithi052.stdout:5/448: dwrite f4 [0,4194304] 0 2023-12-05T13:25:26.397 INFO:tasks.workunit.client.1.smithi052.stdout:0/673: creat d0/db/d52/d7f/fdd x:0 0 0 2023-12-05T13:25:26.404 INFO:tasks.workunit.client.1.smithi052.stdout:7/724: rmdir d7/d4e/d45 39 2023-12-05T13:25:26.405 INFO:tasks.workunit.client.1.smithi052.stdout:3/712: mkdir da/d27/dec 0 2023-12-05T13:25:26.406 INFO:tasks.workunit.client.1.smithi052.stdout:9/583: dwrite d3/d11/d3e/f7c [0,4194304] 0 2023-12-05T13:25:26.406 INFO:tasks.workunit.client.1.smithi052.stdout:1/662: link d5/d7/d52/l53 d5/d7/d35/d37/d5a/d73/dac/dc7/ld1 0 2023-12-05T13:25:26.406 INFO:tasks.workunit.client.1.smithi052.stdout:1/663: stat d5/d7 0 2023-12-05T13:25:26.407 INFO:tasks.workunit.client.0.smithi029.stdout:6/120: dread d6/d21/f28 [0,4194304] 0 2023-12-05T13:25:26.409 INFO:tasks.workunit.client.1.smithi052.stdout:2/715: rename d2/d14 to d2/d13/d48/dd3 0 2023-12-05T13:25:26.413 INFO:tasks.workunit.client.0.smithi029.stdout:6/121: dread f5 [0,4194304] 0 2023-12-05T13:25:26.414 INFO:tasks.workunit.client.1.smithi052.stdout:4/698: sync 2023-12-05T13:25:26.414 INFO:tasks.workunit.client.1.smithi052.stdout:8/720: sync 2023-12-05T13:25:26.417 INFO:tasks.workunit.client.1.smithi052.stdout:5/449: mkdir d5/d15/d21/d4a/d6e/d91 0 2023-12-05T13:25:26.417 INFO:tasks.workunit.client.1.smithi052.stdout:5/450: chown d5/d15/c1f 524 1 2023-12-05T13:25:26.418 INFO:tasks.workunit.client.1.smithi052.stdout:2/716: dread d2/d4/d3f/f97 [0,4194304] 0 2023-12-05T13:25:26.419 INFO:tasks.workunit.client.1.smithi052.stdout:3/713: mkdir da/d25/d33/d43/d5b/d96/ded 0 2023-12-05T13:25:26.419 INFO:tasks.workunit.client.1.smithi052.stdout:3/714: stat da/d2e/l38 0 2023-12-05T13:25:26.421 INFO:tasks.workunit.client.1.smithi052.stdout:2/717: write d2/d13/d37/d61/f6c [1371229,31015] 0 2023-12-05T13:25:26.422 INFO:tasks.workunit.client.1.smithi052.stdout:9/584: symlink d3/d5e/da7/daf/dbe/lc7 0 2023-12-05T13:25:26.424 INFO:tasks.workunit.client.1.smithi052.stdout:1/664: creat d5/daa/fd2 x:0 0 0 2023-12-05T13:25:26.424 INFO:tasks.workunit.client.1.smithi052.stdout:8/721: dread d0/de/d27/f4e [4194304,4194304] 0 2023-12-05T13:25:26.424 INFO:tasks.workunit.client.1.smithi052.stdout:8/722: getdents d0/de/d12/d29/dcb 0 2023-12-05T13:25:26.426 INFO:tasks.workunit.client.1.smithi052.stdout:0/674: rename d0/db/d1b/d7a/cb9 to d0/db/d1b/d51/d55/d66/cde 0 2023-12-05T13:25:26.428 INFO:tasks.workunit.client.1.smithi052.stdout:5/451: link d5/df/d4b/l7d d5/df/d4e/d5b/l92 0 2023-12-05T13:25:26.430 INFO:tasks.workunit.client.1.smithi052.stdout:7/725: symlink d7/d4e/d12/lf1 0 2023-12-05T13:25:26.430 INFO:tasks.workunit.client.1.smithi052.stdout:7/726: chown d7/dce 52 1 2023-12-05T13:25:26.432 INFO:tasks.workunit.client.1.smithi052.stdout:9/585: mknod d3/d92/da8/cc8 0 2023-12-05T13:25:26.440 INFO:tasks.workunit.client.0.smithi029.stdout:6/122: dwrite d6/fe [4194304,4194304] 0 2023-12-05T13:25:26.441 INFO:tasks.workunit.client.0.smithi029.stdout:6/123: stat d6/d1d/c1f 0 2023-12-05T13:25:26.445 INFO:tasks.workunit.client.1.smithi052.stdout:5/452: dwrite d5/d15/f31 [0,4194304] 0 2023-12-05T13:25:26.446 INFO:tasks.workunit.client.1.smithi052.stdout:1/665: unlink d5/d7/de/c61 0 2023-12-05T13:25:26.446 INFO:tasks.workunit.client.1.smithi052.stdout:8/723: creat d0/de/d27/d43/da2/fe8 x:0 0 0 2023-12-05T13:25:26.446 INFO:tasks.workunit.client.1.smithi052.stdout:0/675: mkdir d0/db/d2e/d53/d80/ddf 0 2023-12-05T13:25:26.446 INFO:tasks.workunit.client.1.smithi052.stdout:7/727: creat d7/d4e/d12/d3f/d46/ff2 x:0 0 0 2023-12-05T13:25:26.446 INFO:tasks.workunit.client.1.smithi052.stdout:7/728: write d7/d4e/d12/f8b [4482103,82303] 0 2023-12-05T13:25:26.446 INFO:tasks.workunit.client.1.smithi052.stdout:3/715: rename da/d25/l6a to da/dd/d3d/dda/ddc/lee 0 2023-12-05T13:25:26.447 INFO:tasks.workunit.client.0.smithi029.stdout:6/124: unlink d6/c20 0 2023-12-05T13:25:26.450 INFO:tasks.workunit.client.1.smithi052.stdout:5/453: dread d5/d15/d21/d25/f6d [0,4194304] 0 2023-12-05T13:25:26.450 INFO:tasks.workunit.client.1.smithi052.stdout:5/454: dread - d5/df/d4e/d65/f72 zero size 2023-12-05T13:25:26.451 INFO:tasks.workunit.client.1.smithi052.stdout:2/718: dwrite d2/d13/f36 [0,4194304] 0 2023-12-05T13:25:26.451 INFO:tasks.workunit.client.1.smithi052.stdout:5/455: read d5/d15/d21/f60 [650605,126606] 0 2023-12-05T13:25:26.451 INFO:tasks.workunit.client.1.smithi052.stdout:5/456: readlink d5/d15/d21/l56 0 2023-12-05T13:25:26.451 INFO:tasks.workunit.client.1.smithi052.stdout:5/457: write d5/d15/d21/d25/d3f/d5c/f6c [5365,17558] 0 2023-12-05T13:25:26.451 INFO:tasks.workunit.client.1.smithi052.stdout:0/676: dread d0/db/d1b/d51/d55/f5f [0,4194304] 0 2023-12-05T13:25:26.451 INFO:tasks.workunit.client.1.smithi052.stdout:0/677: write d0/db/d14/f59 [1231743,20437] 0 2023-12-05T13:25:26.452 INFO:tasks.workunit.client.0.smithi029.stdout:6/125: creat d6/d1d/f2b x:0 0 0 2023-12-05T13:25:26.455 INFO:tasks.workunit.client.1.smithi052.stdout:1/666: mkdir d5/d7/d35/d37/dd3 0 2023-12-05T13:25:26.456 INFO:tasks.workunit.client.1.smithi052.stdout:0/678: write d0/db/d33/f70 [1702790,112500] 0 2023-12-05T13:25:26.456 INFO:tasks.workunit.client.1.smithi052.stdout:8/724: creat d0/de/d12/d29/dcb/fe9 x:0 0 0 2023-12-05T13:25:26.456 INFO:tasks.workunit.client.1.smithi052.stdout:8/725: readlink d0/d28/d39/d3a/l4b 0 2023-12-05T13:25:26.457 INFO:tasks.workunit.client.0.smithi029.stdout:6/126: mknod d6/d29/c2c 0 2023-12-05T13:25:26.461 INFO:tasks.workunit.client.1.smithi052.stdout:7/729: symlink d7/d4e/d45/d5a/d66/lf3 0 2023-12-05T13:25:26.461 INFO:tasks.workunit.client.1.smithi052.stdout:7/730: getdents d7/dce 0 2023-12-05T13:25:26.462 INFO:tasks.workunit.client.0.smithi029.stdout:6/127: unlink d6/d1d/c1f 0 2023-12-05T13:25:26.463 INFO:tasks.workunit.client.0.smithi029.stdout:6/128: chown d6/fa 3060947 1 2023-12-05T13:25:26.464 INFO:tasks.workunit.client.1.smithi052.stdout:2/719: creat d2/d13/d37/d5c/d80/db4/fd4 x:0 0 0 2023-12-05T13:25:26.465 INFO:tasks.workunit.client.1.smithi052.stdout:3/716: dwrite da/d27/f2b [0,4194304] 0 2023-12-05T13:25:26.466 INFO:tasks.workunit.client.1.smithi052.stdout:5/458: creat d5/df/d11/d73/f93 x:0 0 0 2023-12-05T13:25:26.467 INFO:tasks.workunit.client.0.smithi029.stdout:6/129: mknod d6/d21/c2d 0 2023-12-05T13:25:26.471 INFO:tasks.workunit.client.0.smithi029.stdout:6/130: link d6/d21/c2d d6/c2e 0 2023-12-05T13:25:26.475 INFO:tasks.workunit.client.1.smithi052.stdout:1/667: rename d5/d7/d52 to d5/d7/d35/d37/d5a/dd4 0 2023-12-05T13:25:26.475 INFO:tasks.workunit.client.0.smithi029.stdout:6/131: mknod d6/c2f 0 2023-12-05T13:25:26.479 INFO:tasks.workunit.client.0.smithi029.stdout:6/132: mknod d6/c30 0 2023-12-05T13:25:26.481 INFO:tasks.workunit.client.1.smithi052.stdout:0/679: truncate d0/db/d1b/d51/d55/f7c 2309978 0 2023-12-05T13:25:26.482 INFO:tasks.workunit.client.1.smithi052.stdout:8/726: mknod d0/d28/d39/d3a/d8f/cea 0 2023-12-05T13:25:26.485 INFO:tasks.workunit.client.1.smithi052.stdout:7/731: mknod d7/d4e/d45/d98/dec/cf4 0 2023-12-05T13:25:26.485 INFO:tasks.workunit.client.1.smithi052.stdout:7/732: fsync d7/d4e/d86/fd4 0 2023-12-05T13:25:26.485 INFO:tasks.workunit.client.1.smithi052.stdout:7/733: write d7/d2e/fa9 [4652609,72092] 0 2023-12-05T13:25:26.490 INFO:tasks.workunit.client.1.smithi052.stdout:2/720: dwrite d2/d13/d1e/d6a/d7f/d84/f4f [0,4194304] 0 2023-12-05T13:25:26.492 INFO:tasks.workunit.client.1.smithi052.stdout:3/717: unlink f4 0 2023-12-05T13:25:26.492 INFO:tasks.workunit.client.1.smithi052.stdout:3/718: readlink da/d25/l52 0 2023-12-05T13:25:26.494 INFO:tasks.workunit.client.1.smithi052.stdout:1/668: truncate d5/d7/f50 3039357 0 2023-12-05T13:25:26.494 INFO:tasks.workunit.client.1.smithi052.stdout:1/669: read - d5/d7/de/d74/d99/fa6 zero size 2023-12-05T13:25:26.496 INFO:tasks.workunit.client.1.smithi052.stdout:0/680: symlink d0/db/le0 0 2023-12-05T13:25:26.497 INFO:tasks.workunit.client.1.smithi052.stdout:8/727: truncate d0/de/d27/f57 3582662 0 2023-12-05T13:25:26.498 INFO:tasks.workunit.client.1.smithi052.stdout:5/459: dwrite d5/df/d11/d73/f93 [0,4194304] 0 2023-12-05T13:25:26.498 INFO:tasks.workunit.client.1.smithi052.stdout:5/460: readlink d5/d15/d21/d25/l68 0 2023-12-05T13:25:26.502 INFO:tasks.workunit.client.1.smithi052.stdout:0/681: chown d0/db/d2e/c41 413097342 1 2023-12-05T13:25:26.503 INFO:tasks.workunit.client.1.smithi052.stdout:3/719: dread da/d25/f31 [0,4194304] 0 2023-12-05T13:25:26.503 INFO:tasks.workunit.client.1.smithi052.stdout:3/720: dread - da/fde zero size 2023-12-05T13:25:26.504 INFO:tasks.workunit.client.1.smithi052.stdout:3/721: write da/dd/fe5 [9639,108886] 0 2023-12-05T13:25:26.506 INFO:tasks.workunit.client.1.smithi052.stdout:3/722: write da/d2e/d40/d6d/dba/fce [1665706,125402] 0 2023-12-05T13:25:26.506 INFO:tasks.workunit.client.1.smithi052.stdout:3/723: fdatasync da/d25/f3a 0 2023-12-05T13:25:26.506 INFO:tasks.workunit.client.1.smithi052.stdout:8/728: symlink d0/d28/d2b/d53/leb 0 2023-12-05T13:25:26.506 INFO:tasks.workunit.client.1.smithi052.stdout:7/734: dwrite d7/d4e/d12/fd0 [0,4194304] 0 2023-12-05T13:25:26.506 INFO:tasks.workunit.client.1.smithi052.stdout:7/735: stat d7/d31/d56/d60/f69 0 2023-12-05T13:25:26.507 INFO:tasks.workunit.client.0.smithi029.stdout:6/133: truncate d6/fa 4848 0 2023-12-05T13:25:26.509 INFO:tasks.workunit.client.1.smithi052.stdout:5/461: creat d5/df/d11/d66/f94 x:0 0 0 2023-12-05T13:25:26.511 INFO:tasks.workunit.client.1.smithi052.stdout:8/729: creat d0/d28/d2b/d53/d56/fec x:0 0 0 2023-12-05T13:25:26.512 INFO:tasks.workunit.client.1.smithi052.stdout:3/724: write da/d25/d33/d49/f7e [5517623,101555] 0 2023-12-05T13:25:26.513 INFO:tasks.workunit.client.1.smithi052.stdout:3/725: chown da/d2e 7114 1 2023-12-05T13:25:26.513 INFO:tasks.workunit.client.1.smithi052.stdout:0/682: dread d0/db/d14/f2f [0,4194304] 0 2023-12-05T13:25:26.516 INFO:tasks.workunit.client.0.smithi029.stdout:6/134: dread d6/fe [0,4194304] 0 2023-12-05T13:25:26.516 INFO:tasks.workunit.client.1.smithi052.stdout:1/670: read d5/d7/f50 [2338567,46263] 0 2023-12-05T13:25:26.516 INFO:tasks.workunit.client.1.smithi052.stdout:3/726: dread da/f23 [0,4194304] 0 2023-12-05T13:25:26.517 INFO:tasks.workunit.client.1.smithi052.stdout:1/671: fsync d5/f8 0 2023-12-05T13:25:26.517 INFO:tasks.workunit.client.1.smithi052.stdout:3/727: fsync da/d25/d33/d49/fb0 0 2023-12-05T13:25:26.518 INFO:tasks.workunit.client.1.smithi052.stdout:7/736: rename d7/d4e/d45/d5a/d63/d95/dba/lc2 to d7/d4e/d12/d3f/d46/lf5 0 2023-12-05T13:25:26.518 INFO:tasks.workunit.client.1.smithi052.stdout:5/462: creat d5/df/d4b/f95 x:0 0 0 2023-12-05T13:25:26.520 INFO:tasks.workunit.client.0.smithi029.stdout:6/135: creat d6/d21/f31 x:0 0 0 2023-12-05T13:25:26.520 INFO:tasks.workunit.client.0.smithi029.stdout:6/136: dread - d6/d1d/f2b zero size 2023-12-05T13:25:26.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/137: chown d6/d1d/f2b 107376149 1 2023-12-05T13:25:26.521 INFO:tasks.workunit.client.0.smithi029.stdout:6/138: readlink d6/d21/l23 0 2023-12-05T13:25:26.522 INFO:tasks.workunit.client.1.smithi052.stdout:8/730: rmdir d0/d28/d2b/d53 39 2023-12-05T13:25:26.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/139: mknod d6/d29/c32 0 2023-12-05T13:25:26.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/140: chown d6/d1d/f24 1 1 2023-12-05T13:25:26.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/141: fsync d6/d21/f28 0 2023-12-05T13:25:26.523 INFO:tasks.workunit.client.1.smithi052.stdout:1/672: truncate d5/d7/f4b 174842 0 2023-12-05T13:25:26.525 INFO:tasks.workunit.client.1.smithi052.stdout:3/728: link da/d25/f3a da/dd/d3d/dda/fef 0 2023-12-05T13:25:26.527 INFO:tasks.workunit.client.1.smithi052.stdout:1/673: dread d5/d26/d41/f5f [0,4194304] 0 2023-12-05T13:25:26.527 INFO:tasks.workunit.client.0.smithi029.stdout:6/142: symlink d6/d21/l33 0 2023-12-05T13:25:26.527 INFO:tasks.workunit.client.0.smithi029.stdout:6/143: dread - d6/f11 zero size 2023-12-05T13:25:26.531 INFO:tasks.workunit.client.1.smithi052.stdout:7/737: mkdir d7/d4e/d12/d3f/d46/dab/df6 0 2023-12-05T13:25:26.533 INFO:tasks.workunit.client.1.smithi052.stdout:5/463: truncate d5/fc 2632400 0 2023-12-05T13:25:26.533 INFO:tasks.workunit.client.1.smithi052.stdout:5/464: truncate d5/df/d4e/d65/f72 341481 0 2023-12-05T13:25:26.533 INFO:tasks.workunit.client.1.smithi052.stdout:8/731: rmdir d0/de/d12/d29/db3/dc5 39 2023-12-05T13:25:26.536 INFO:tasks.workunit.client.1.smithi052.stdout:3/729: creat da/d25/d33/d51/ff0 x:0 0 0 2023-12-05T13:25:26.537 INFO:tasks.workunit.client.1.smithi052.stdout:1/674: mknod d5/d26/d75/d7a/dad/cd5 0 2023-12-05T13:25:26.542 INFO:tasks.workunit.client.1.smithi052.stdout:5/465: dread d5/df/d11/d73/f93 [0,4194304] 0 2023-12-05T13:25:26.542 INFO:tasks.workunit.client.1.smithi052.stdout:5/466: write d5/f87 [4951944,111408] 0 2023-12-05T13:25:26.543 INFO:tasks.workunit.client.1.smithi052.stdout:0/683: rename d0/db/d14/d60/l71 to d0/db/d52/le1 0 2023-12-05T13:25:26.543 INFO:tasks.workunit.client.1.smithi052.stdout:7/738: creat d7/d4e/db4/ff7 x:0 0 0 2023-12-05T13:25:26.543 INFO:tasks.workunit.client.1.smithi052.stdout:8/732: truncate d0/d28/d2b/f91 454437 0 2023-12-05T13:25:26.543 INFO:tasks.workunit.client.1.smithi052.stdout:7/739: read d7/d4e/d45/d5a/fe0 [930385,80231] 0 2023-12-05T13:25:26.543 INFO:tasks.workunit.client.1.smithi052.stdout:1/675: creat d5/d26/d75/d7a/fd6 x:0 0 0 2023-12-05T13:25:26.545 INFO:tasks.workunit.client.1.smithi052.stdout:0/684: read d0/db/d52/f7d [11608288,98966] 0 2023-12-05T13:25:26.545 INFO:tasks.workunit.client.1.smithi052.stdout:0/685: fdatasync d0/db/d1b/d51/f69 0 2023-12-05T13:25:26.547 INFO:tasks.workunit.client.0.smithi029.stdout:6/144: dwrite d6/d1d/f24 [0,4194304] 0 2023-12-05T13:25:26.548 INFO:tasks.workunit.client.1.smithi052.stdout:3/730: rename da/c1b to da/dd/cf1 0 2023-12-05T13:25:26.549 INFO:tasks.workunit.client.1.smithi052.stdout:8/733: symlink d0/d28/d39/d3a/led 0 2023-12-05T13:25:26.551 INFO:tasks.workunit.client.1.smithi052.stdout:7/740: truncate d7/d4e/d45/d5a/f19 862579 0 2023-12-05T13:25:26.551 INFO:tasks.workunit.client.1.smithi052.stdout:7/741: stat d7/d4e/d45/d5a/d16/cc8 0 2023-12-05T13:25:26.551 INFO:tasks.workunit.client.1.smithi052.stdout:7/742: readlink d7/l1e 0 2023-12-05T13:25:26.553 INFO:tasks.workunit.client.1.smithi052.stdout:7/743: write d7/d31/d56/d60/f76 [8002809,69521] 0 2023-12-05T13:25:26.556 INFO:tasks.workunit.client.1.smithi052.stdout:5/467: rename d5/d15/d21/f60 to d5/df/d11/d73/f96 0 2023-12-05T13:25:26.558 INFO:tasks.workunit.client.1.smithi052.stdout:3/731: mknod da/d25/d33/d89/dae/dcf/cf2 0 2023-12-05T13:25:26.561 INFO:tasks.workunit.client.1.smithi052.stdout:1/676: rename d5/d7/c11 to d5/daa/d17/d3c/cd7 0 2023-12-05T13:25:26.561 INFO:tasks.workunit.client.1.smithi052.stdout:1/677: dread - d5/d7/d35/d37/fbe zero size 2023-12-05T13:25:26.563 INFO:tasks.workunit.client.0.smithi029.stdout:6/145: dwrite d6/fa [0,4194304] 0 2023-12-05T13:25:26.569 INFO:tasks.workunit.client.1.smithi052.stdout:3/732: creat da/d25/d33/d89/dae/dcf/ff3 x:0 0 0 2023-12-05T13:25:26.569 INFO:tasks.workunit.client.1.smithi052.stdout:3/733: fdatasync da/d25/f6f 0 2023-12-05T13:25:26.569 INFO:tasks.workunit.client.1.smithi052.stdout:3/734: write da/d25/d33/d49/f73 [3904830,52312] 0 2023-12-05T13:25:26.571 INFO:tasks.workunit.client.1.smithi052.stdout:8/734: rename d0/de/d12/c16 to d0/de/cee 0 2023-12-05T13:25:26.574 INFO:tasks.workunit.client.1.smithi052.stdout:3/735: link da/d25/d33/c41 da/d2e/d40/d6d/dba/cf4 0 2023-12-05T13:25:26.577 INFO:tasks.workunit.client.1.smithi052.stdout:7/744: rename d7/d4e/d12/d3f/d75/lee to d7/d4e/d12/d3f/d46/d4d/lf8 0 2023-12-05T13:25:26.578 INFO:tasks.workunit.client.1.smithi052.stdout:8/735: symlink d0/de/lef 0 2023-12-05T13:25:26.579 INFO:tasks.workunit.client.1.smithi052.stdout:8/736: read d0/d28/f87 [249298,22483] 0 2023-12-05T13:25:26.581 INFO:tasks.workunit.client.1.smithi052.stdout:4/699: sync 2023-12-05T13:25:26.581 INFO:tasks.workunit.client.1.smithi052.stdout:6/524: sync 2023-12-05T13:25:26.582 INFO:tasks.workunit.client.1.smithi052.stdout:6/525: chown d3/d5/d9/d21/d48/d4d/d66/d91/la8 28225 1 2023-12-05T13:25:26.582 INFO:tasks.workunit.client.1.smithi052.stdout:4/700: write de/d30/d94/fdb [719911,56369] 0 2023-12-05T13:25:26.582 INFO:tasks.workunit.client.1.smithi052.stdout:6/526: write d3/d4/d6/d26/f95 [1016495,87426] 0 2023-12-05T13:25:26.583 INFO:tasks.workunit.client.1.smithi052.stdout:3/736: creat da/dd/d3d/dda/ddc/ff5 x:0 0 0 2023-12-05T13:25:26.584 INFO:tasks.workunit.client.1.smithi052.stdout:1/678: rename d5/d7/f50 to d5/d7/d35/d37/fd8 0 2023-12-05T13:25:26.585 INFO:tasks.workunit.client.1.smithi052.stdout:7/745: mkdir d7/d4e/d45/d79/df9 0 2023-12-05T13:25:26.590 INFO:tasks.workunit.client.1.smithi052.stdout:8/737: mknod d0/d28/d39/d3a/d4f/cf0 0 2023-12-05T13:25:26.590 INFO:tasks.workunit.client.1.smithi052.stdout:4/701: creat de/d30/dac/dbb/fe7 x:0 0 0 2023-12-05T13:25:26.590 INFO:tasks.workunit.client.1.smithi052.stdout:4/702: chown de/d29/d51/da3/fbf 42 1 2023-12-05T13:25:26.590 INFO:tasks.workunit.client.1.smithi052.stdout:5/468: rmdir d5/d15 39 2023-12-05T13:25:26.590 INFO:tasks.workunit.client.1.smithi052.stdout:5/469: chown d5/f79 41923963 1 2023-12-05T13:25:26.591 INFO:tasks.workunit.client.1.smithi052.stdout:3/737: creat da/d2e/d40/d6d/ff6 x:0 0 0 2023-12-05T13:25:26.591 INFO:tasks.workunit.client.1.smithi052.stdout:3/738: chown da/c20 0 1 2023-12-05T13:25:26.592 INFO:tasks.workunit.client.1.smithi052.stdout:3/739: write da/dd/f26 [449255,58024] 0 2023-12-05T13:25:26.592 INFO:tasks.workunit.client.1.smithi052.stdout:3/740: stat da/dd/f30 0 2023-12-05T13:25:26.598 INFO:tasks.workunit.client.1.smithi052.stdout:6/527: dwrite d3/d5/d58/f9f [0,4194304] 0 2023-12-05T13:25:26.598 INFO:tasks.workunit.client.1.smithi052.stdout:6/528: chown d3/d4/df/d24/f8a 3055162 1 2023-12-05T13:25:26.599 INFO:tasks.workunit.client.1.smithi052.stdout:1/679: truncate d5/d7/d35/d37/d5a/d73/d7e/f6b 201658 0 2023-12-05T13:25:26.600 INFO:tasks.workunit.client.1.smithi052.stdout:6/529: dread d3/d5/d9/d21/d48/d4d/d66/d91/fb5 [0,4194304] 0 2023-12-05T13:25:26.602 INFO:tasks.workunit.client.1.smithi052.stdout:1/680: write d5/d7/f13 [6815189,52179] 0 2023-12-05T13:25:26.602 INFO:tasks.workunit.client.1.smithi052.stdout:8/738: link d0/d28/l5d d0/de/d12/dc1/lf1 0 2023-12-05T13:25:26.603 INFO:tasks.workunit.client.1.smithi052.stdout:4/703: truncate de/d29/d51/f6b 715745 0 2023-12-05T13:25:26.605 INFO:tasks.workunit.client.1.smithi052.stdout:5/470: mknod d5/c97 0 2023-12-05T13:25:26.608 INFO:tasks.workunit.client.1.smithi052.stdout:7/746: dwrite d7/d4e/d12/d3f/d75/fe4 [0,4194304] 0 2023-12-05T13:25:26.608 INFO:tasks.workunit.client.1.smithi052.stdout:5/471: dread d5/df/f36 [0,4194304] 0 2023-12-05T13:25:26.608 INFO:tasks.workunit.client.1.smithi052.stdout:7/747: chown d7/d4e/d45/d5a/caa 798234967 1 2023-12-05T13:25:26.609 INFO:tasks.workunit.client.1.smithi052.stdout:5/472: fdatasync d5/d15/d21/d25/d3f/f50 0 2023-12-05T13:25:26.609 INFO:tasks.workunit.client.1.smithi052.stdout:7/748: fdatasync d7/d4e/d45/d5a/d63/d95/fbd 0 2023-12-05T13:25:26.609 INFO:tasks.workunit.client.1.smithi052.stdout:7/749: stat d7/d4e/d45/d93/fb0 0 2023-12-05T13:25:26.609 INFO:tasks.workunit.client.1.smithi052.stdout:6/530: creat d3/fbb x:0 0 0 2023-12-05T13:25:26.615 INFO:tasks.workunit.client.1.smithi052.stdout:3/741: dwrite da/d27/f3b [0,4194304] 0 2023-12-05T13:25:26.615 INFO:tasks.workunit.client.1.smithi052.stdout:8/739: truncate d0/de/f22 1251484 0 2023-12-05T13:25:26.615 INFO:tasks.workunit.client.1.smithi052.stdout:4/704: creat de/d30/d68/fe8 x:0 0 0 2023-12-05T13:25:26.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/681: dwrite d5/d26/da3/fb9 [0,4194304] 0 2023-12-05T13:25:26.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/682: chown d5/d7/de/d74/fb6 3282 1 2023-12-05T13:25:26.618 INFO:tasks.workunit.client.1.smithi052.stdout:5/473: unlink d5/d46/c45 0 2023-12-05T13:25:26.619 INFO:tasks.workunit.client.1.smithi052.stdout:1/683: read d5/d26/da3/fb9 [2405779,91594] 0 2023-12-05T13:25:26.620 INFO:tasks.workunit.client.1.smithi052.stdout:6/531: mknod d3/d5/d9/d21/d48/d4d/d81/d82/cbc 0 2023-12-05T13:25:26.625 INFO:tasks.workunit.client.1.smithi052.stdout:7/750: dwrite d7/d4e/d45/d5a/d16/dae/fda [0,4194304] 0 2023-12-05T13:25:26.626 INFO:tasks.workunit.client.1.smithi052.stdout:7/751: chown d7/d4e/d12/d3f/d46 36 1 2023-12-05T13:25:26.626 INFO:tasks.workunit.client.1.smithi052.stdout:7/752: chown d7/d4e/d45/d5a/caa 595232 1 2023-12-05T13:25:26.628 INFO:tasks.workunit.client.1.smithi052.stdout:3/742: symlink da/d25/d33/lf7 0 2023-12-05T13:25:26.629 INFO:tasks.workunit.client.1.smithi052.stdout:3/743: fsync da/d27/f3b 0 2023-12-05T13:25:26.629 INFO:tasks.workunit.client.1.smithi052.stdout:4/705: unlink de/d29/d51/da3/fbf 0 2023-12-05T13:25:26.629 INFO:tasks.workunit.client.1.smithi052.stdout:8/740: truncate d0/de/d27/f57 1151339 0 2023-12-05T13:25:26.632 INFO:tasks.workunit.client.1.smithi052.stdout:4/706: write de/f33 [1801098,128722] 0 2023-12-05T13:25:26.632 INFO:tasks.workunit.client.1.smithi052.stdout:4/707: read de/f4b [1746776,128597] 0 2023-12-05T13:25:26.634 INFO:tasks.workunit.client.1.smithi052.stdout:1/684: dread d5/d7/d35/d2f/d3e/f54 [4194304,4194304] 0 2023-12-05T13:25:26.637 INFO:tasks.workunit.client.1.smithi052.stdout:1/685: dread d5/daa/f55 [0,4194304] 0 2023-12-05T13:25:26.637 INFO:tasks.workunit.client.1.smithi052.stdout:1/686: readlink d5/daa/d17/d3c/l59 0 2023-12-05T13:25:26.637 INFO:tasks.workunit.client.1.smithi052.stdout:1/687: fsync d5/d26/d41/f5f 0 2023-12-05T13:25:26.637 INFO:tasks.workunit.client.1.smithi052.stdout:7/753: rename d7/d4e/d45/d5a/f7b to d7/d4e/d45/ffa 0 2023-12-05T13:25:26.642 INFO:tasks.workunit.client.1.smithi052.stdout:8/741: truncate d0/f95 1993647 0 2023-12-05T13:25:26.642 INFO:tasks.workunit.client.1.smithi052.stdout:5/474: dwrite d5/df/d4b/d74/f7c [0,4194304] 0 2023-12-05T13:25:26.643 INFO:tasks.workunit.client.1.smithi052.stdout:6/532: dwrite d3/d5/d9/d21/fac [0,4194304] 0 2023-12-05T13:25:26.644 INFO:tasks.workunit.client.1.smithi052.stdout:7/754: creat d7/d4e/d12/d3f/d46/ffb x:0 0 0 2023-12-05T13:25:26.644 INFO:tasks.workunit.client.1.smithi052.stdout:1/688: rename d5/d7/de/d74/d99/fc3 to d5/d7/de/d74/d99/dc6/fd9 0 2023-12-05T13:25:26.644 INFO:tasks.workunit.client.1.smithi052.stdout:1/689: stat d5/d7/d35/d37/l63 0 2023-12-05T13:25:26.655 INFO:tasks.workunit.client.1.smithi052.stdout:7/755: creat d7/d4e/d86/ffc x:0 0 0 2023-12-05T13:25:26.659 INFO:tasks.workunit.client.1.smithi052.stdout:6/533: rename d3/d4/d6/f94 to d3/d5/d58/fbd 0 2023-12-05T13:25:26.659 INFO:tasks.workunit.client.1.smithi052.stdout:1/690: unlink d5/d7/d35/d2f/d3e/d62/d85/lcf 0 2023-12-05T13:25:26.671 INFO:tasks.workunit.client.1.smithi052.stdout:8/742: dwrite d0/d28/d39/d3a/f5b [4194304,4194304] 0 2023-12-05T13:25:26.671 INFO:tasks.workunit.client.1.smithi052.stdout:7/756: dread d7/d4e/d45/d93/fbe [0,4194304] 0 2023-12-05T13:25:26.672 INFO:tasks.workunit.client.1.smithi052.stdout:3/744: dwrite da/dd/d3d/fdf [0,4194304] 0 2023-12-05T13:25:26.672 INFO:tasks.workunit.client.1.smithi052.stdout:5/475: dwrite d5/d15/d21/d25/d3f/f50 [4194304,4194304] 0 2023-12-05T13:25:26.672 INFO:tasks.workunit.client.1.smithi052.stdout:4/708: dwrite f4 [0,4194304] 0 2023-12-05T13:25:26.675 INFO:tasks.workunit.client.1.smithi052.stdout:8/743: creat d0/d62/ff2 x:0 0 0 2023-12-05T13:25:26.678 INFO:tasks.workunit.client.1.smithi052.stdout:8/744: write d0/de/f1f [3769743,42099] 0 2023-12-05T13:25:26.678 INFO:tasks.workunit.client.1.smithi052.stdout:8/745: readlink d0/d28/d39/l40 0 2023-12-05T13:25:26.678 INFO:tasks.workunit.client.1.smithi052.stdout:5/476: dread d5/d15/d21/d25/d3f/d5c/f53 [0,4194304] 0 2023-12-05T13:25:26.678 INFO:tasks.workunit.client.1.smithi052.stdout:1/691: dwrite d5/d7/de/d74/d99/dc6/fd9 [0,4194304] 0 2023-12-05T13:25:26.679 INFO:tasks.workunit.client.1.smithi052.stdout:1/692: getdents d5/d7/d35/d37/dd3 0 2023-12-05T13:25:26.679 INFO:tasks.workunit.client.1.smithi052.stdout:3/745: creat da/d25/ff8 x:0 0 0 2023-12-05T13:25:26.679 INFO:tasks.workunit.client.1.smithi052.stdout:6/534: dwrite d3/d4/df/d24/f4f [0,4194304] 0 2023-12-05T13:25:26.679 INFO:tasks.workunit.client.1.smithi052.stdout:6/535: fdatasync d3/d5/d9/d21/fac 0 2023-12-05T13:25:26.679 INFO:tasks.workunit.client.1.smithi052.stdout:6/536: chown d3/fbb 423482 1 2023-12-05T13:25:26.680 INFO:tasks.workunit.client.1.smithi052.stdout:8/746: dread d0/de/d27/f57 [0,4194304] 0 2023-12-05T13:25:26.687 INFO:tasks.workunit.client.1.smithi052.stdout:4/709: mknod de/d30/d68/d5c/db8/ddc/ce9 0 2023-12-05T13:25:26.691 INFO:tasks.workunit.client.1.smithi052.stdout:1/693: mknod d5/d26/d75/d7a/dad/cda 0 2023-12-05T13:25:26.693 INFO:tasks.workunit.client.1.smithi052.stdout:3/746: creat da/d48/ff9 x:0 0 0 2023-12-05T13:25:26.696 INFO:tasks.workunit.client.1.smithi052.stdout:2/721: sync 2023-12-05T13:25:26.696 INFO:tasks.workunit.client.1.smithi052.stdout:9/586: sync 2023-12-05T13:25:26.697 INFO:tasks.workunit.client.1.smithi052.stdout:4/710: creat de/d30/d68/d5c/db8/ddc/fea x:0 0 0 2023-12-05T13:25:26.700 INFO:tasks.workunit.client.1.smithi052.stdout:5/477: mknod d5/df/d11/d73/c98 0 2023-12-05T13:25:26.701 INFO:tasks.workunit.client.1.smithi052.stdout:1/694: rename d5/d7/de/f96 to d5/daa/d79/fdb 0 2023-12-05T13:25:26.703 INFO:tasks.workunit.client.1.smithi052.stdout:8/747: dread d0/de/f22 [0,4194304] 0 2023-12-05T13:25:26.703 INFO:tasks.workunit.client.1.smithi052.stdout:2/722: symlink d2/d13/d48/dd3/d62/ld5 0 2023-12-05T13:25:26.704 INFO:tasks.workunit.client.1.smithi052.stdout:1/695: write d5/d7/d35/f71 [253049,7999] 0 2023-12-05T13:25:26.704 INFO:tasks.workunit.client.1.smithi052.stdout:1/696: truncate d5/daa/f72 950541 0 2023-12-05T13:25:26.704 INFO:tasks.workunit.client.1.smithi052.stdout:1/697: stat d5/d7/d35/d2f/d3e/d62/d85/c93 0 2023-12-05T13:25:26.705 INFO:tasks.workunit.client.1.smithi052.stdout:4/711: creat de/d30/dac/dbb/feb x:0 0 0 2023-12-05T13:25:26.705 INFO:tasks.workunit.client.1.smithi052.stdout:2/723: dread d2/f9f [0,4194304] 0 2023-12-05T13:25:26.706 INFO:tasks.workunit.client.1.smithi052.stdout:2/724: getdents d2/d13 0 2023-12-05T13:25:26.706 INFO:tasks.workunit.client.1.smithi052.stdout:7/757: dwrite d7/d31/d56/d60/f69 [0,4194304] 0 2023-12-05T13:25:26.706 INFO:tasks.workunit.client.1.smithi052.stdout:7/758: fsync d7/d4e/d45/d93/fbe 0 2023-12-05T13:25:26.706 INFO:tasks.workunit.client.1.smithi052.stdout:5/478: creat d5/d15/d21/d4a/d6e/f99 x:0 0 0 2023-12-05T13:25:26.708 INFO:tasks.workunit.client.1.smithi052.stdout:3/747: rename da/d25/d33/d51/ff0 to da/d25/d33/d43/d5b/d94/ffa 0 2023-12-05T13:25:26.708 INFO:tasks.workunit.client.1.smithi052.stdout:0/686: sync 2023-12-05T13:25:26.711 INFO:tasks.workunit.client.1.smithi052.stdout:5/479: dread d5/df/d11/d73/d77/f78 [0,4194304] 0 2023-12-05T13:25:26.712 INFO:tasks.workunit.client.1.smithi052.stdout:2/725: creat d2/d13/d48/dd3/d62/da7/fd6 x:0 0 0 2023-12-05T13:25:26.712 INFO:tasks.workunit.client.1.smithi052.stdout:2/726: stat d2/d13/f26 0 2023-12-05T13:25:26.712 INFO:tasks.workunit.client.1.smithi052.stdout:2/727: truncate d2/f2a 5166598 0 2023-12-05T13:25:26.712 INFO:tasks.workunit.client.1.smithi052.stdout:2/728: truncate d2/d4/d3f/d9d/fa2 1253719 0 2023-12-05T13:25:26.716 INFO:tasks.workunit.client.1.smithi052.stdout:7/759: symlink d7/d4e/d45/d93/lfd 0 2023-12-05T13:25:26.717 INFO:tasks.workunit.client.1.smithi052.stdout:3/748: unlink da/d25/dcd/de0/ce4 0 2023-12-05T13:25:26.718 INFO:tasks.workunit.client.1.smithi052.stdout:9/587: dwrite d3/d5e/da7/daf/fb1 [0,4194304] 0 2023-12-05T13:25:26.718 INFO:tasks.workunit.client.1.smithi052.stdout:7/760: mkdir d7/d4e/d45/d5a/dfe 0 2023-12-05T13:25:26.718 INFO:tasks.workunit.client.1.smithi052.stdout:1/698: rename d5/daa/d17/la9 to d5/d26/ldc 0 2023-12-05T13:25:26.719 INFO:tasks.workunit.client.1.smithi052.stdout:0/687: mknod d0/ce2 0 2023-12-05T13:25:26.721 INFO:tasks.workunit.client.1.smithi052.stdout:3/749: mkdir da/d25/d33/d89/dae/dcf/dfb 0 2023-12-05T13:25:26.722 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:26 smithi052 ceph-mon[121072]: [05/Dec/2023:13:25:24] ENGINE Serving on http://172.21.15.52:8765 2023-12-05T13:25:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:26 smithi052 ceph-mon[121072]: [05/Dec/2023:13:25:25] ENGINE Serving on https://172.21.15.52:7150 2023-12-05T13:25:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:26 smithi052 ceph-mon[121072]: [05/Dec/2023:13:25:25] ENGINE Bus STARTED 2023-12-05T13:25:26.725 INFO:tasks.workunit.client.1.smithi052.stdout:5/480: dwrite d5/fa [4194304,4194304] 0 2023-12-05T13:25:26.726 INFO:tasks.workunit.client.1.smithi052.stdout:9/588: mkdir d3/d1e/d62/dbd/dc9 0 2023-12-05T13:25:26.727 INFO:tasks.workunit.client.1.smithi052.stdout:1/699: symlink d5/d7/d35/d37/d5a/d73/d7e/d4f/ldd 0 2023-12-05T13:25:26.728 INFO:tasks.workunit.client.1.smithi052.stdout:0/688: stat d0/db/d1b/d51/d55/d66/cde 0 2023-12-05T13:25:26.729 INFO:tasks.workunit.client.1.smithi052.stdout:3/750: creat da/d2e/ffc x:0 0 0 2023-12-05T13:25:26.730 INFO:tasks.workunit.client.1.smithi052.stdout:4/712: dwrite de/d29/d51/da3/d6d/fb5 [0,4194304] 0 2023-12-05T13:25:26.730 INFO:tasks.workunit.client.1.smithi052.stdout:4/713: dread - de/d29/d51/da3/fc9 zero size 2023-12-05T13:25:26.730 INFO:tasks.workunit.client.1.smithi052.stdout:5/481: mknod d5/df/d4e/d5b/c9a 0 2023-12-05T13:25:26.733 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:26 smithi029 ceph-mon[112128]: [05/Dec/2023:13:25:24] ENGINE Serving on http://172.21.15.52:8765 2023-12-05T13:25:26.734 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:26 smithi029 ceph-mon[112128]: [05/Dec/2023:13:25:25] ENGINE Serving on https://172.21.15.52:7150 2023-12-05T13:25:26.734 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:26 smithi029 ceph-mon[112128]: [05/Dec/2023:13:25:25] ENGINE Bus STARTED 2023-12-05T13:25:26.735 INFO:tasks.workunit.client.1.smithi052.stdout:1/700: rename d5/d7/d35/d37/d5a/d73/d7e/d4f/l94 to d5/d26/d41/lde 0 2023-12-05T13:25:26.735 INFO:tasks.workunit.client.1.smithi052.stdout:0/689: rmdir d0 39 2023-12-05T13:25:26.737 INFO:tasks.workunit.client.1.smithi052.stdout:1/701: dread d5/d7/f4b [0,4194304] 0 2023-12-05T13:25:26.737 INFO:tasks.workunit.client.1.smithi052.stdout:3/751: mkdir da/d25/d33/d49/dbd/dfd 0 2023-12-05T13:25:26.737 INFO:tasks.workunit.client.1.smithi052.stdout:0/690: write d0/db/d20/fbd [1275325,114509] 0 2023-12-05T13:25:26.738 INFO:tasks.workunit.client.1.smithi052.stdout:7/761: dwrite d7/d4e/f2b [8388608,4194304] 0 2023-12-05T13:25:26.739 INFO:tasks.workunit.client.1.smithi052.stdout:4/714: creat de/d30/d73/fec x:0 0 0 2023-12-05T13:25:26.740 INFO:tasks.workunit.client.1.smithi052.stdout:5/482: creat d5/df/d11/d73/d8b/f9b x:0 0 0 2023-12-05T13:25:26.741 INFO:tasks.workunit.client.1.smithi052.stdout:7/762: dread d7/d4e/d45/d5a/d63/f6d [0,4194304] 0 2023-12-05T13:25:26.741 INFO:tasks.workunit.client.1.smithi052.stdout:1/702: rename d5/d7/cf to d5/d7/d35/cdf 0 2023-12-05T13:25:26.742 INFO:tasks.workunit.client.1.smithi052.stdout:3/752: creat da/d25/d33/d89/dae/dcf/ffe x:0 0 0 2023-12-05T13:25:26.743 INFO:tasks.workunit.client.1.smithi052.stdout:5/483: dread d5/df/f36 [0,4194304] 0 2023-12-05T13:25:26.743 INFO:tasks.workunit.client.1.smithi052.stdout:9/589: rmdir d3/d1e 39 2023-12-05T13:25:26.745 INFO:tasks.workunit.client.1.smithi052.stdout:0/691: rmdir d0/db/d52 39 2023-12-05T13:25:26.747 INFO:tasks.workunit.client.1.smithi052.stdout:3/753: creat da/d2e/d40/fff x:0 0 0 2023-12-05T13:25:26.749 INFO:tasks.workunit.client.1.smithi052.stdout:7/763: write d7/d4e/d12/d3f/d75/fe4 [393827,5384] 0 2023-12-05T13:25:26.756 INFO:tasks.workunit.client.1.smithi052.stdout:5/484: truncate d5/d15/d21/d4a/d6e/f71 1576872 0 2023-12-05T13:25:26.756 INFO:tasks.workunit.client.1.smithi052.stdout:9/590: rmdir d3/d92/da8 39 2023-12-05T13:25:26.756 INFO:tasks.workunit.client.1.smithi052.stdout:3/754: symlink da/d25/d33/d89/dae/dcf/dfb/l100 0 2023-12-05T13:25:26.758 INFO:tasks.workunit.client.1.smithi052.stdout:7/764: creat d7/d4e/d45/d98/dec/fff x:0 0 0 2023-12-05T13:25:26.759 INFO:tasks.workunit.client.1.smithi052.stdout:9/591: creat d3/d2a/fca x:0 0 0 2023-12-05T13:25:26.761 INFO:tasks.workunit.client.1.smithi052.stdout:5/485: symlink d5/d46/d76/l9c 0 2023-12-05T13:25:26.761 INFO:tasks.workunit.client.1.smithi052.stdout:7/765: creat d7/d4e/db4/f100 x:0 0 0 2023-12-05T13:25:26.762 INFO:tasks.workunit.client.1.smithi052.stdout:9/592: link d3/d92/da8/cc8 d3/d5e/d9e/ccb 0 2023-12-05T13:25:26.767 INFO:tasks.workunit.client.1.smithi052.stdout:9/593: link d3/d1e/d37/d4f/f52 d3/d11/fcc 0 2023-12-05T13:25:26.770 INFO:tasks.workunit.client.1.smithi052.stdout:9/594: mknod d3/d1e/d37/d4f/ccd 0 2023-12-05T13:25:26.770 INFO:tasks.workunit.client.1.smithi052.stdout:1/703: dwrite d5/d7/d35/d37/d5a/d73/d7e/f6b [0,4194304] 0 2023-12-05T13:25:26.771 INFO:tasks.workunit.client.1.smithi052.stdout:9/595: rmdir d3/d1e/d62 39 2023-12-05T13:25:26.771 INFO:tasks.workunit.client.1.smithi052.stdout:9/596: chown d3/d2a/d5c/f71 265555812 1 2023-12-05T13:25:26.771 INFO:tasks.workunit.client.1.smithi052.stdout:9/597: stat d3/d1e 0 2023-12-05T13:25:26.775 INFO:tasks.workunit.client.1.smithi052.stdout:9/598: mkdir d3/d5e/d9e/dce 0 2023-12-05T13:25:26.775 INFO:tasks.workunit.client.1.smithi052.stdout:9/599: readlink d3/d11/d19/l49 0 2023-12-05T13:25:26.776 INFO:tasks.workunit.client.1.smithi052.stdout:4/715: dwrite de/d30/f8a [0,4194304] 0 2023-12-05T13:25:26.777 INFO:tasks.workunit.client.1.smithi052.stdout:4/716: mkdir de/d30/d94/ded 0 2023-12-05T13:25:26.780 INFO:tasks.workunit.client.1.smithi052.stdout:4/717: mknod de/d2b/d80/cee 0 2023-12-05T13:25:26.783 INFO:tasks.workunit.client.1.smithi052.stdout:3/755: dwrite da/dd/d3d/f9c [0,4194304] 0 2023-12-05T13:25:26.787 INFO:tasks.workunit.client.1.smithi052.stdout:9/600: dread d3/d11/d19/f27 [4194304,4194304] 0 2023-12-05T13:25:26.788 INFO:tasks.workunit.client.1.smithi052.stdout:5/486: dwrite d5/d15/d21/d25/d3f/d5c/f53 [0,4194304] 0 2023-12-05T13:25:26.789 INFO:tasks.workunit.client.1.smithi052.stdout:9/601: read d3/d92/fa6 [1906800,38587] 0 2023-12-05T13:25:26.790 INFO:tasks.workunit.client.1.smithi052.stdout:1/704: dwrite d5/daa/d79/fdb [0,4194304] 0 2023-12-05T13:25:26.794 INFO:tasks.workunit.client.1.smithi052.stdout:4/718: dwrite de/d2b/d64/d69/f9e [0,4194304] 0 2023-12-05T13:25:26.795 INFO:tasks.workunit.client.1.smithi052.stdout:4/719: truncate de/d29/d51/da3/d6d/fc3 525363 0 2023-12-05T13:25:26.796 INFO:tasks.workunit.client.1.smithi052.stdout:3/756: unlink da/d25/dcd/dc6/cd0 0 2023-12-05T13:25:26.796 INFO:tasks.workunit.client.1.smithi052.stdout:3/757: truncate da/fde 972933 0 2023-12-05T13:25:26.807 INFO:tasks.workunit.client.1.smithi052.stdout:3/758: read da/d7a/fa4 [3051578,50012] 0 2023-12-05T13:25:26.807 INFO:tasks.workunit.client.1.smithi052.stdout:1/705: symlink d5/d7/d35/d37/d43/le0 0 2023-12-05T13:25:26.807 INFO:tasks.workunit.client.1.smithi052.stdout:3/759: fsync da/d25/d33/fd6 0 2023-12-05T13:25:26.811 INFO:tasks.workunit.client.1.smithi052.stdout:1/706: dread d5/d7/d35/d37/d5a/d73/d76/fc1 [0,4194304] 0 2023-12-05T13:25:26.812 INFO:tasks.workunit.client.1.smithi052.stdout:4/720: dwrite fa [4194304,4194304] 0 2023-12-05T13:25:26.812 INFO:tasks.workunit.client.1.smithi052.stdout:4/721: write de/d30/d68/f8d [1492448,102847] 0 2023-12-05T13:25:26.812 INFO:tasks.workunit.client.1.smithi052.stdout:4/722: truncate de/d2b/d64/fe1 20548 0 2023-12-05T13:25:26.812 INFO:tasks.workunit.client.1.smithi052.stdout:4/723: truncate de/d29/d51/f6b 1429192 0 2023-12-05T13:25:26.812 INFO:tasks.workunit.client.1.smithi052.stdout:5/487: dwrite d5/d15/d21/f5e [0,4194304] 0 2023-12-05T13:25:26.812 INFO:tasks.workunit.client.1.smithi052.stdout:5/488: fsync d5/df/f36 0 2023-12-05T13:25:26.814 INFO:tasks.workunit.client.1.smithi052.stdout:6/537: sync 2023-12-05T13:25:26.814 INFO:tasks.workunit.client.1.smithi052.stdout:3/760: creat da/f101 x:0 0 0 2023-12-05T13:25:26.815 INFO:tasks.workunit.client.1.smithi052.stdout:3/761: read da/dd/d3d/f87 [758972,124617] 0 2023-12-05T13:25:26.815 INFO:tasks.workunit.client.1.smithi052.stdout:1/707: symlink d5/d7/d35/d37/d5a/d73/dae/le1 0 2023-12-05T13:25:26.821 INFO:tasks.workunit.client.1.smithi052.stdout:5/489: link d5/c55 d5/df/d11/c9d 0 2023-12-05T13:25:26.821 INFO:tasks.workunit.client.1.smithi052.stdout:6/538: dread d3/d4/d6/f25 [0,4194304] 0 2023-12-05T13:25:26.828 INFO:tasks.workunit.client.1.smithi052.stdout:5/490: symlink d5/l9e 0 2023-12-05T13:25:26.828 INFO:tasks.workunit.client.1.smithi052.stdout:5/491: truncate d5/df/f17 4229141 0 2023-12-05T13:25:26.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/602: dwrite d3/d11/d3e/f7c [0,4194304] 0 2023-12-05T13:25:26.830 INFO:tasks.workunit.client.1.smithi052.stdout:1/708: dwrite d5/d7/d35/d2f/d9b/fc9 [0,4194304] 0 2023-12-05T13:25:26.830 INFO:tasks.workunit.client.1.smithi052.stdout:3/762: dread da/dd/fbc [0,4194304] 0 2023-12-05T13:25:26.832 INFO:tasks.workunit.client.1.smithi052.stdout:5/492: link d5/d46/c43 d5/df/d4e/d65/c9f 0 2023-12-05T13:25:26.833 INFO:tasks.workunit.client.1.smithi052.stdout:5/493: chown d5/df/d4b 247 1 2023-12-05T13:25:26.833 INFO:tasks.workunit.client.1.smithi052.stdout:4/724: dwrite de/d29/d51/f57 [0,4194304] 0 2023-12-05T13:25:26.833 INFO:tasks.workunit.client.1.smithi052.stdout:4/725: readlink de/d29/d51/d76/d8f/l97 0 2023-12-05T13:25:26.834 INFO:tasks.workunit.client.1.smithi052.stdout:9/603: getdents d3/d2a/d5c 0 2023-12-05T13:25:26.834 INFO:tasks.workunit.client.1.smithi052.stdout:4/726: read de/d30/d73/fa1 [292709,92112] 0 2023-12-05T13:25:26.836 INFO:tasks.workunit.client.1.smithi052.stdout:1/709: truncate d5/daa/f32 331464 0 2023-12-05T13:25:26.837 INFO:tasks.workunit.client.1.smithi052.stdout:3/763: getdents da/d25/d33/d43 0 2023-12-05T13:25:26.838 INFO:tasks.workunit.client.1.smithi052.stdout:5/494: creat d5/df/fa0 x:0 0 0 2023-12-05T13:25:26.838 INFO:tasks.workunit.client.1.smithi052.stdout:6/539: dwrite d3/d5/d9/d52/f54 [4194304,4194304] 0 2023-12-05T13:25:26.840 INFO:tasks.workunit.client.1.smithi052.stdout:9/604: symlink d3/d11/d19/d83/lcf 0 2023-12-05T13:25:26.840 INFO:tasks.workunit.client.1.smithi052.stdout:9/605: dread - d3/d1e/d41/d86/fa1 zero size 2023-12-05T13:25:26.840 INFO:tasks.workunit.client.1.smithi052.stdout:4/727: mkdir de/d30/d68/d5c/db8/ddc/def 0 2023-12-05T13:25:26.842 INFO:tasks.workunit.client.1.smithi052.stdout:1/710: symlink d5/daa/d17/d3c/dc2/le2 0 2023-12-05T13:25:26.842 INFO:tasks.workunit.client.1.smithi052.stdout:1/711: chown d5/d26/l33 649111171 1 2023-12-05T13:25:26.842 INFO:tasks.workunit.client.1.smithi052.stdout:1/712: fsync d5/d26/f66 0 2023-12-05T13:25:26.842 INFO:tasks.workunit.client.1.smithi052.stdout:3/764: creat da/d25/dcd/de0/f102 x:0 0 0 2023-12-05T13:25:26.843 INFO:tasks.workunit.client.1.smithi052.stdout:3/765: write da/d25/d33/d43/d5b/da6/de7/feb [844540,45999] 0 2023-12-05T13:25:26.844 INFO:tasks.workunit.client.1.smithi052.stdout:1/713: dread d5/d7/de/d74/f77 [0,4194304] 0 2023-12-05T13:25:26.844 INFO:tasks.workunit.client.1.smithi052.stdout:1/714: fdatasync d5/d7/d35/d2f/d3e/f54 0 2023-12-05T13:25:26.844 INFO:tasks.workunit.client.1.smithi052.stdout:1/715: fdatasync d5/d7/d35/d2f/d3e/f54 0 2023-12-05T13:25:26.845 INFO:tasks.workunit.client.1.smithi052.stdout:9/606: rename d3/d5e/da7/daf/fb1 to d3/d5e/da7/daf/fd0 0 2023-12-05T13:25:26.845 INFO:tasks.workunit.client.1.smithi052.stdout:9/607: fsync d3/d11/f42 0 2023-12-05T13:25:26.846 INFO:tasks.workunit.client.1.smithi052.stdout:4/728: creat de/d2b/ff0 x:0 0 0 2023-12-05T13:25:26.850 INFO:tasks.workunit.client.1.smithi052.stdout:3/766: mkdir da/dd/d3d/d103 0 2023-12-05T13:25:26.850 INFO:tasks.workunit.client.1.smithi052.stdout:5/495: truncate d5/df/d11/d66/f6a 3170965 0 2023-12-05T13:25:26.850 INFO:tasks.workunit.client.1.smithi052.stdout:5/496: stat d5/df/d4e/d5b/c80 0 2023-12-05T13:25:26.852 INFO:tasks.workunit.client.1.smithi052.stdout:1/716: link d5/d7/c91 d5/daa/d17/ce3 0 2023-12-05T13:25:26.852 INFO:tasks.workunit.client.1.smithi052.stdout:1/717: chown d5/d26/d75/d7a/da0 76 1 2023-12-05T13:25:26.854 INFO:tasks.workunit.client.1.smithi052.stdout:9/608: rename d3/d11/d19/f29 to d3/d5e/fd1 0 2023-12-05T13:25:26.854 INFO:tasks.workunit.client.1.smithi052.stdout:2/729: sync 2023-12-05T13:25:26.855 INFO:tasks.workunit.client.1.smithi052.stdout:8/748: sync 2023-12-05T13:25:26.856 INFO:tasks.workunit.client.1.smithi052.stdout:4/729: creat de/d29/d51/ff1 x:0 0 0 2023-12-05T13:25:26.857 INFO:tasks.workunit.client.1.smithi052.stdout:3/767: mkdir da/d25/d33/d49/dbd/d104 0 2023-12-05T13:25:26.859 INFO:tasks.workunit.client.1.smithi052.stdout:1/718: mkdir d5/d7/d35/d2f/d9b/de4 0 2023-12-05T13:25:26.860 INFO:tasks.workunit.client.1.smithi052.stdout:0/692: sync 2023-12-05T13:25:26.860 INFO:tasks.workunit.client.1.smithi052.stdout:0/693: readlink d0/db/d2e/d7e/da6/la8 0 2023-12-05T13:25:26.860 INFO:tasks.workunit.client.1.smithi052.stdout:0/694: chown d0/db/le0 7583580 1 2023-12-05T13:25:26.860 INFO:tasks.workunit.client.1.smithi052.stdout:0/695: dread - d0/db/d20/d50/dae/fd4 zero size 2023-12-05T13:25:26.861 INFO:tasks.workunit.client.1.smithi052.stdout:9/609: mkdir d3/d1e/dd2 0 2023-12-05T13:25:26.862 INFO:tasks.workunit.client.1.smithi052.stdout:8/749: mkdir d0/dae/df3 0 2023-12-05T13:25:26.862 INFO:tasks.workunit.client.1.smithi052.stdout:8/750: write d0/de/d12/d29/dcb/fe9 [899103,48357] 0 2023-12-05T13:25:26.862 INFO:tasks.workunit.client.1.smithi052.stdout:8/751: chown d0/d28/d2b/d53/la7 15230 1 2023-12-05T13:25:26.862 INFO:tasks.workunit.client.1.smithi052.stdout:7/766: sync 2023-12-05T13:25:26.862 INFO:tasks.workunit.client.1.smithi052.stdout:2/730: creat d2/d13/d1e/fd7 x:0 0 0 2023-12-05T13:25:26.864 INFO:tasks.workunit.client.1.smithi052.stdout:4/730: mkdir de/d29/d51/da3/d6d/df2 0 2023-12-05T13:25:26.864 INFO:tasks.workunit.client.1.smithi052.stdout:4/731: dread - de/fb0 zero size 2023-12-05T13:25:26.865 INFO:tasks.workunit.client.1.smithi052.stdout:1/719: mkdir d5/d26/de5 0 2023-12-05T13:25:26.866 INFO:tasks.workunit.client.1.smithi052.stdout:0/696: link d0/db/d1b/c6b d0/db/d2e/d7e/da6/ce3 0 2023-12-05T13:25:26.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/610: link d3/d1e/d62/l8b d3/d11/d19/ld3 0 2023-12-05T13:25:26.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/611: stat d3/d5e/l90 0 2023-12-05T13:25:26.869 INFO:tasks.workunit.client.1.smithi052.stdout:8/752: creat d0/de/d12/d29/db3/dc5/ff4 x:0 0 0 2023-12-05T13:25:26.870 INFO:tasks.workunit.client.1.smithi052.stdout:7/767: stat d7/d4e/c1b 0 2023-12-05T13:25:26.870 INFO:tasks.workunit.client.1.smithi052.stdout:7/768: fsync d7/d31/f55 0 2023-12-05T13:25:26.871 INFO:tasks.workunit.client.1.smithi052.stdout:2/731: creat d2/d13/d48/dd3/d62/da7/dbc/fd8 x:0 0 0 2023-12-05T13:25:26.872 INFO:tasks.workunit.client.1.smithi052.stdout:4/732: mkdir de/d2b/d80/df3 0 2023-12-05T13:25:26.873 INFO:tasks.workunit.client.1.smithi052.stdout:1/720: link d5/d7/de/d74/fb2 d5/d7/d35/d37/d5a/d73/d76/fe6 0 2023-12-05T13:25:26.874 INFO:tasks.workunit.client.1.smithi052.stdout:1/721: write d5/d7/d35/f3d [9053773,50298] 0 2023-12-05T13:25:26.876 INFO:tasks.workunit.client.1.smithi052.stdout:9/612: mkdir d3/d5e/d9e/dd4 0 2023-12-05T13:25:26.876 INFO:tasks.workunit.client.1.smithi052.stdout:8/753: truncate d0/d28/d2b/f7f 3801803 0 2023-12-05T13:25:26.878 INFO:tasks.workunit.client.1.smithi052.stdout:7/769: truncate d7/d4e/d45/d5a/d16/dae/fe6 479199 0 2023-12-05T13:25:26.878 INFO:tasks.workunit.client.1.smithi052.stdout:7/770: fdatasync d7/d4e/d45/d5a/d16/f33 0 2023-12-05T13:25:26.879 INFO:tasks.workunit.client.1.smithi052.stdout:7/771: read d7/d31/d56/d60/f76 [8262140,72145] 0 2023-12-05T13:25:26.879 INFO:tasks.workunit.client.1.smithi052.stdout:7/772: dread - d7/d31/d56/fe7 zero size 2023-12-05T13:25:26.880 INFO:tasks.workunit.client.1.smithi052.stdout:2/732: truncate d2/d13/f36 2781949 0 2023-12-05T13:25:26.880 INFO:tasks.workunit.client.1.smithi052.stdout:4/733: link de/d30/d68/d5c/db8/ddc/fea de/d30/d68/d5c/de2/ff4 0 2023-12-05T13:25:26.883 INFO:tasks.workunit.client.1.smithi052.stdout:1/722: mkdir d5/d7/d35/d37/d5a/d73/d76/de7 0 2023-12-05T13:25:26.883 INFO:tasks.workunit.client.1.smithi052.stdout:1/723: truncate d5/daa/f32 937138 0 2023-12-05T13:25:26.884 INFO:tasks.workunit.client.1.smithi052.stdout:9/613: truncate d3/d2a/d5c/f8c 384612 0 2023-12-05T13:25:26.884 INFO:tasks.workunit.client.1.smithi052.stdout:9/614: fdatasync d3/d5e/f64 0 2023-12-05T13:25:26.884 INFO:tasks.workunit.client.1.smithi052.stdout:9/615: chown d3/d5e/da7/daf/dbe 13165 1 2023-12-05T13:25:26.884 INFO:tasks.workunit.client.1.smithi052.stdout:8/754: mknod d0/dae/cf5 0 2023-12-05T13:25:26.886 INFO:tasks.workunit.client.1.smithi052.stdout:7/773: mkdir d7/d4e/d45/d79/d91/d101 0 2023-12-05T13:25:26.887 INFO:tasks.workunit.client.1.smithi052.stdout:2/733: unlink d2/d13/d37/f69 0 2023-12-05T13:25:26.887 INFO:tasks.workunit.client.1.smithi052.stdout:0/697: dwrite d0/f2b [0,4194304] 0 2023-12-05T13:25:26.890 INFO:tasks.workunit.client.1.smithi052.stdout:1/724: link d5/d7/d35/f5c d5/d7/d35/d37/d43/fe8 0 2023-12-05T13:25:26.892 INFO:tasks.workunit.client.1.smithi052.stdout:8/755: symlink d0/de/d98/d9c/lf6 0 2023-12-05T13:25:26.894 INFO:tasks.workunit.client.1.smithi052.stdout:7/774: creat d7/d4e/d45/d98/f102 x:0 0 0 2023-12-05T13:25:26.894 INFO:tasks.workunit.client.1.smithi052.stdout:7/775: write d7/d4e/db4/ff7 [556039,72476] 0 2023-12-05T13:25:26.895 INFO:tasks.workunit.client.1.smithi052.stdout:2/734: mknod d2/d13/d7c/cd9 0 2023-12-05T13:25:26.897 INFO:tasks.workunit.client.1.smithi052.stdout:4/734: dwrite de/d30/f42 [4194304,4194304] 0 2023-12-05T13:25:26.897 INFO:tasks.workunit.client.1.smithi052.stdout:9/616: dread d3/f26 [0,4194304] 0 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:9/617: chown d3/d11/d3e/f4c 13013 1 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:4/735: chown de/l10 45091734 1 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/698: mknod d0/db/d52/d7f/ce4 0 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/699: stat d0/db/d14/d9b 0 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/700: fdatasync d0/db/d20/fa5 0 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/701: rename d0/db/d2e/d53/d80 to d0/db/d2e/d53/d80/ddf/de5 22 2023-12-05T13:25:26.898 INFO:tasks.workunit.client.1.smithi052.stdout:1/725: getdents d5/d7/d35/d37/d5a 0 2023-12-05T13:25:26.904 INFO:tasks.workunit.client.1.smithi052.stdout:4/736: dread de/d2b/fc0 [0,4194304] 0 2023-12-05T13:25:26.905 INFO:tasks.workunit.client.1.smithi052.stdout:8/756: creat d0/d62/ff7 x:0 0 0 2023-12-05T13:25:26.906 INFO:tasks.workunit.client.1.smithi052.stdout:2/735: dread d2/f2a [0,4194304] 0 2023-12-05T13:25:26.906 INFO:tasks.workunit.client.1.smithi052.stdout:2/736: stat d2/d13/d1e/fd7 0 2023-12-05T13:25:26.906 INFO:tasks.workunit.client.1.smithi052.stdout:4/737: write de/d30/d68/f8d [565286,95254] 0 2023-12-05T13:25:26.907 INFO:tasks.workunit.client.1.smithi052.stdout:7/776: link d7/d4e/d86/cc9 d7/d4e/d45/d50/db7/c103 0 2023-12-05T13:25:26.910 INFO:tasks.workunit.client.1.smithi052.stdout:9/618: mkdir d3/d5e/da7/dd5 0 2023-12-05T13:25:26.910 INFO:tasks.workunit.client.1.smithi052.stdout:7/777: write d7/d4e/d12/d3f/d46/f47 [83872,113110] 0 2023-12-05T13:25:26.911 INFO:tasks.workunit.client.1.smithi052.stdout:0/702: creat d0/db/d1b/d51/fe6 x:0 0 0 2023-12-05T13:25:26.912 INFO:tasks.workunit.client.1.smithi052.stdout:1/726: creat d5/daa/d17/d3c/fe9 x:0 0 0 2023-12-05T13:25:26.914 INFO:tasks.workunit.client.1.smithi052.stdout:8/757: symlink d0/de/d27/d43/lf8 0 2023-12-05T13:25:26.914 INFO:tasks.workunit.client.1.smithi052.stdout:8/758: stat d0/d4d 0 2023-12-05T13:25:26.921 INFO:tasks.workunit.client.1.smithi052.stdout:2/737: rename d2/d13/d48/dd3/d62/da7/dbc to d2/d13/d1e/d6a/dda 0 2023-12-05T13:25:26.925 INFO:tasks.workunit.client.1.smithi052.stdout:7/778: mkdir d7/d2e/d104 0 2023-12-05T13:25:26.926 INFO:tasks.workunit.client.1.smithi052.stdout:9/619: symlink d3/d5e/da7/daf/ld6 0 2023-12-05T13:25:26.926 INFO:tasks.workunit.client.1.smithi052.stdout:9/620: write d3/d11/f33 [133200,54000] 0 2023-12-05T13:25:26.930 INFO:tasks.workunit.client.1.smithi052.stdout:0/703: rmdir d0/db/d33/ddb 0 2023-12-05T13:25:26.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/738: creat d2/d13/d37/d5c/d80/dc4/fdb x:0 0 0 2023-12-05T13:25:26.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/739: chown d2/d13/d1e/f57 1721 1 2023-12-05T13:25:26.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/740: write d2/d13/d1e/dae/fb7 [995702,68523] 0 2023-12-05T13:25:26.930 INFO:tasks.workunit.client.1.smithi052.stdout:1/727: dwrite d5/d7/d35/d2f/d3e/d62/d85/fab [0,4194304] 0 2023-12-05T13:25:26.930 INFO:tasks.workunit.client.1.smithi052.stdout:1/728: readlink d5/d7/d35/d37/d5a/d73/d7e/d4f/ldd 0 2023-12-05T13:25:26.931 INFO:tasks.workunit.client.1.smithi052.stdout:1/729: readlink d5/d7/de/l48 0 2023-12-05T13:25:26.931 INFO:tasks.workunit.client.1.smithi052.stdout:8/759: dwrite d0/d28/d2b/f7f [4194304,4194304] 0 2023-12-05T13:25:26.931 INFO:tasks.workunit.client.1.smithi052.stdout:9/621: mknod d3/d92/da8/cd7 0 2023-12-05T13:25:26.931 INFO:tasks.workunit.client.1.smithi052.stdout:2/741: read d2/d13/d48/dd3/f39 [301262,25281] 0 2023-12-05T13:25:26.937 INFO:tasks.workunit.client.1.smithi052.stdout:1/730: mkdir d5/d26/d41/dbd/dea 0 2023-12-05T13:25:26.942 INFO:tasks.workunit.client.1.smithi052.stdout:9/622: rmdir d3/d1e/dc0 0 2023-12-05T13:25:26.943 INFO:tasks.workunit.client.1.smithi052.stdout:2/742: mknod d2/d4/cdc 0 2023-12-05T13:25:26.946 INFO:tasks.workunit.client.1.smithi052.stdout:1/731: mkdir d5/d26/d41/deb 0 2023-12-05T13:25:26.946 INFO:tasks.workunit.client.1.smithi052.stdout:1/732: write d5/daa/d17/d3c/f80 [221816,54409] 0 2023-12-05T13:25:26.947 INFO:tasks.workunit.client.1.smithi052.stdout:7/779: dwrite d7/d4e/d45/d50/f8f [0,4194304] 0 2023-12-05T13:25:26.947 INFO:tasks.workunit.client.1.smithi052.stdout:7/780: fsync d7/d31/f55 0 2023-12-05T13:25:26.948 INFO:tasks.workunit.client.1.smithi052.stdout:0/704: dwrite d0/fd0 [0,4194304] 0 2023-12-05T13:25:26.948 INFO:tasks.workunit.client.1.smithi052.stdout:0/705: chown d0/db/d14/d9b/fc8 4298972 1 2023-12-05T13:25:26.948 INFO:tasks.workunit.client.1.smithi052.stdout:0/706: getdents d0/db/d1b/d51/d55/d66/dcd 0 2023-12-05T13:25:26.949 INFO:tasks.workunit.client.1.smithi052.stdout:7/781: write d7/d4e/d12/f43 [1881130,35633] 0 2023-12-05T13:25:26.951 INFO:tasks.workunit.client.1.smithi052.stdout:2/743: mkdir d2/d13/d48/dd3/d62/ddd 0 2023-12-05T13:25:26.952 INFO:tasks.workunit.client.1.smithi052.stdout:1/733: rmdir d5/daa/d69 39 2023-12-05T13:25:26.954 INFO:tasks.workunit.client.1.smithi052.stdout:1/734: read d5/f2c [5465852,21238] 0 2023-12-05T13:25:26.956 INFO:tasks.workunit.client.1.smithi052.stdout:0/707: rename d0/db/d52/d7f/ce4 to d0/db/d1b/d7a/d8b/ce7 0 2023-12-05T13:25:26.957 INFO:tasks.workunit.client.1.smithi052.stdout:6/540: sync 2023-12-05T13:25:26.957 INFO:tasks.workunit.client.1.smithi052.stdout:6/541: dread - d3/d4/d6/d26/d8e/f9d zero size 2023-12-05T13:25:26.957 INFO:tasks.workunit.client.1.smithi052.stdout:9/623: dwrite d3/d5e/d9e/fbf [0,4194304] 0 2023-12-05T13:25:26.957 INFO:tasks.workunit.client.1.smithi052.stdout:9/624: chown d3/d5e/l90 237578364 1 2023-12-05T13:25:26.958 INFO:tasks.workunit.client.1.smithi052.stdout:7/782: symlink d7/d2e/d104/l105 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:2/744: unlink d2/d13/d45/c96 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:0/708: symlink d0/db/d2e/d53/d80/le8 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:2/745: write d2/d13/d1e/d6a/faf [390388,62961] 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:2/746: chown d2/d13/d1e/d6a/d7f/d84/d6e 1276490 1 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:1/735: truncate d5/d7/de/d74/d99/dc6/fd9 2562852 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:6/542: symlink d3/d4/d6/d26/d6d/lbe 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:6/543: write d3/d4/d36/d6f/f85 [540454,108221] 0 2023-12-05T13:25:26.963 INFO:tasks.workunit.client.1.smithi052.stdout:6/544: dread - d3/d5/d9/d21/d5f/f67 zero size 2023-12-05T13:25:26.966 INFO:tasks.workunit.client.1.smithi052.stdout:7/783: creat d7/d4e/d45/d98/f106 x:0 0 0 2023-12-05T13:25:26.968 INFO:tasks.workunit.client.1.smithi052.stdout:1/736: getdents d5/d7/de 0 2023-12-05T13:25:26.968 INFO:tasks.workunit.client.1.smithi052.stdout:1/737: readlink d5/d7/de/d18/l34 0 2023-12-05T13:25:26.968 INFO:tasks.workunit.client.1.smithi052.stdout:1/738: truncate d5/fa8 876491 0 2023-12-05T13:25:26.969 INFO:tasks.workunit.client.1.smithi052.stdout:6/545: rmdir d3/d5/d9/d44 39 2023-12-05T13:25:26.971 INFO:tasks.workunit.client.1.smithi052.stdout:7/784: mkdir d7/d4e/d45/d79/df9/d107 0 2023-12-05T13:25:26.971 INFO:tasks.workunit.client.1.smithi052.stdout:7/785: fsync d7/d4e/d45/fbb 0 2023-12-05T13:25:26.974 INFO:tasks.workunit.client.1.smithi052.stdout:0/709: symlink d0/le9 0 2023-12-05T13:25:26.975 INFO:tasks.workunit.client.1.smithi052.stdout:1/739: creat d5/d7/d35/d37/d5a/d73/d7e/d4f/fec x:0 0 0 2023-12-05T13:25:26.975 INFO:tasks.workunit.client.1.smithi052.stdout:1/740: chown d5/d7/d35/d37/d5a/d73 11558 1 2023-12-05T13:25:26.977 INFO:tasks.workunit.client.1.smithi052.stdout:7/786: creat d7/d4e/d45/d5a/d63/d95/f108 x:0 0 0 2023-12-05T13:25:26.981 INFO:tasks.workunit.client.1.smithi052.stdout:0/710: mkdir d0/db/d2e/d7e/da6/dea 0 2023-12-05T13:25:26.981 INFO:tasks.workunit.client.1.smithi052.stdout:0/711: stat d0/db/d1b/d51/f69 0 2023-12-05T13:25:26.983 INFO:tasks.workunit.client.1.smithi052.stdout:1/741: mknod d5/d26/d41/deb/ced 0 2023-12-05T13:25:26.985 INFO:tasks.workunit.client.1.smithi052.stdout:7/787: creat d7/d4e/d12/d3f/d46/dab/df6/f109 x:0 0 0 2023-12-05T13:25:26.985 INFO:tasks.workunit.client.1.smithi052.stdout:7/788: write d7/d4e/d12/d3f/d46/f5f [1368015,16426] 0 2023-12-05T13:25:26.986 INFO:tasks.workunit.client.1.smithi052.stdout:9/625: dwrite d3/d11/f42 [0,4194304] 0 2023-12-05T13:25:26.986 INFO:tasks.workunit.client.1.smithi052.stdout:8/760: dwrite d0/de/d27/f92 [0,4194304] 0 2023-12-05T13:25:26.987 INFO:tasks.workunit.client.1.smithi052.stdout:2/747: dwrite d2/d13/d1e/dae/fb7 [0,4194304] 0 2023-12-05T13:25:26.993 INFO:tasks.workunit.client.1.smithi052.stdout:1/742: creat d5/d26/de5/fee x:0 0 0 2023-12-05T13:25:26.994 INFO:tasks.workunit.client.1.smithi052.stdout:1/743: write d5/daa/f55 [544426,12581] 0 2023-12-05T13:25:26.994 INFO:tasks.workunit.client.1.smithi052.stdout:1/744: chown d5/d7/d35/d2f/db1 32 1 2023-12-05T13:25:26.994 INFO:tasks.workunit.client.1.smithi052.stdout:5/497: sync 2023-12-05T13:25:26.995 INFO:tasks.workunit.client.1.smithi052.stdout:7/789: rmdir d7/d4e/d45/d5a/d66 39 2023-12-05T13:25:26.996 INFO:tasks.workunit.client.1.smithi052.stdout:7/790: stat d7/d4e/d45/d5a/d66 0 2023-12-05T13:25:26.996 INFO:tasks.workunit.client.1.smithi052.stdout:7/791: getdents d7/d4e/d45/d79/d91/d101 0 2023-12-05T13:25:26.997 INFO:tasks.workunit.client.1.smithi052.stdout:7/792: write d7/d4e/d12/f34 [1545186,48100] 0 2023-12-05T13:25:27.002 INFO:tasks.workunit.client.1.smithi052.stdout:8/761: rename d0/d28/d2b/d53/la7 to d0/d28/d2b/lf9 0 2023-12-05T13:25:27.007 INFO:tasks.workunit.client.1.smithi052.stdout:9/626: dwrite d3/d11/f21 [0,4194304] 0 2023-12-05T13:25:27.007 INFO:tasks.workunit.client.1.smithi052.stdout:9/627: dread - d3/d2a/fbb zero size 2023-12-05T13:25:27.011 INFO:tasks.workunit.client.1.smithi052.stdout:0/712: dwrite d0/dcb/f45 [0,4194304] 0 2023-12-05T13:25:27.014 INFO:tasks.workunit.client.1.smithi052.stdout:1/745: unlink d5/d7/d35/d37/fd8 0 2023-12-05T13:25:27.014 INFO:tasks.workunit.client.1.smithi052.stdout:1/746: truncate d5/d7/de/d74/f77 1641054 0 2023-12-05T13:25:27.014 INFO:tasks.workunit.client.1.smithi052.stdout:7/793: dwrite d7/d4e/d45/d5a/fcd [0,4194304] 0 2023-12-05T13:25:27.014 INFO:tasks.workunit.client.1.smithi052.stdout:7/794: write d7/d4e/d12/d3f/d46/ffb [647774,63126] 0 2023-12-05T13:25:27.014 INFO:tasks.workunit.client.1.smithi052.stdout:7/795: fdatasync d7/d4e/d45/d5a/d16/f33 0 2023-12-05T13:25:27.014 INFO:tasks.workunit.client.1.smithi052.stdout:5/498: creat d5/df/d11/d73/d77/fa1 x:0 0 0 2023-12-05T13:25:27.017 INFO:tasks.workunit.client.1.smithi052.stdout:5/499: dread d5/d15/d21/d25/f6d [0,4194304] 0 2023-12-05T13:25:27.017 INFO:tasks.workunit.client.1.smithi052.stdout:8/762: symlink d0/d28/d39/d3a/d8f/lfa 0 2023-12-05T13:25:27.022 INFO:tasks.workunit.client.1.smithi052.stdout:1/747: mkdir d5/d26/da3/dcd/def 0 2023-12-05T13:25:27.022 INFO:tasks.workunit.client.1.smithi052.stdout:4/738: sync 2023-12-05T13:25:27.022 INFO:tasks.workunit.client.1.smithi052.stdout:3/768: sync 2023-12-05T13:25:27.025 INFO:tasks.workunit.client.1.smithi052.stdout:7/796: truncate d7/d4e/d45/d5a/d66/fb8 1346179 0 2023-12-05T13:25:27.028 INFO:tasks.workunit.client.1.smithi052.stdout:5/500: mknod d5/df/d11/d73/ca2 0 2023-12-05T13:25:27.029 INFO:tasks.workunit.client.1.smithi052.stdout:9/628: truncate d3/d11/d19/f2e 3706349 0 2023-12-05T13:25:27.029 INFO:tasks.workunit.client.1.smithi052.stdout:7/797: write d7/d31/f3e [2242117,26522] 0 2023-12-05T13:25:27.029 INFO:tasks.workunit.client.1.smithi052.stdout:7/798: readlink d7/d4e/d12/d3f/d46/l9d 0 2023-12-05T13:25:27.030 INFO:tasks.workunit.client.1.smithi052.stdout:8/763: rmdir d0/d28/d39/d3a/d8f 39 2023-12-05T13:25:27.033 INFO:tasks.workunit.client.1.smithi052.stdout:4/739: rename de/d30/l46 to de/d30/d68/d5c/dcb/lf5 0 2023-12-05T13:25:27.033 INFO:tasks.workunit.client.1.smithi052.stdout:5/501: getdents d5/df/d11/d73/d77 0 2023-12-05T13:25:27.033 INFO:tasks.workunit.client.1.smithi052.stdout:5/502: dread - d5/df/fa0 zero size 2023-12-05T13:25:27.035 INFO:tasks.workunit.client.1.smithi052.stdout:9/629: unlink d3/d5e/l97 0 2023-12-05T13:25:27.035 INFO:tasks.workunit.client.1.smithi052.stdout:9/630: dread - d3/d5e/d9e/fb5 zero size 2023-12-05T13:25:27.035 INFO:tasks.workunit.client.1.smithi052.stdout:9/631: dread - d3/d11/d3e/f4c zero size 2023-12-05T13:25:27.036 INFO:tasks.workunit.client.1.smithi052.stdout:8/764: write d0/d28/d2b/d53/d56/fd4 [3370281,62381] 0 2023-12-05T13:25:27.036 INFO:tasks.workunit.client.1.smithi052.stdout:8/765: chown d0/dae/fb1 126525 1 2023-12-05T13:25:27.037 INFO:tasks.workunit.client.1.smithi052.stdout:7/799: creat d7/dd5/f10a x:0 0 0 2023-12-05T13:25:27.038 INFO:tasks.workunit.client.1.smithi052.stdout:9/632: dread d3/d1e/d37/d4f/f65 [0,4194304] 0 2023-12-05T13:25:27.039 INFO:tasks.workunit.client.1.smithi052.stdout:4/740: rename de/d2b/c93 to de/d29/d51/da3/d6d/df2/cf6 0 2023-12-05T13:25:27.039 INFO:tasks.workunit.client.1.smithi052.stdout:5/503: rename d5/df/d11/d73/d77 to d5/df/d11/d73/d77/da3 22 2023-12-05T13:25:27.040 INFO:tasks.workunit.client.1.smithi052.stdout:8/766: truncate d0/de/f35 2229738 0 2023-12-05T13:25:27.042 INFO:tasks.workunit.client.1.smithi052.stdout:3/769: dwrite da/d25/d33/d49/f7e [0,4194304] 0 2023-12-05T13:25:27.042 INFO:tasks.workunit.client.1.smithi052.stdout:1/748: dwrite d5/daa/d17/d3c/fe9 [0,4194304] 0 2023-12-05T13:25:27.042 INFO:tasks.workunit.client.1.smithi052.stdout:1/749: fsync d5/daa/f32 0 2023-12-05T13:25:27.042 INFO:tasks.workunit.client.1.smithi052.stdout:9/633: mknod d3/d1e/d37/cd8 0 2023-12-05T13:25:27.042 INFO:tasks.workunit.client.1.smithi052.stdout:9/634: chown d3/d31/f87 18614640 1 2023-12-05T13:25:27.043 INFO:tasks.workunit.client.1.smithi052.stdout:9/635: write d3/d2a/f4e [5116621,51877] 0 2023-12-05T13:25:27.043 INFO:tasks.workunit.client.1.smithi052.stdout:5/504: mkdir d5/df/d4e/da4 0 2023-12-05T13:25:27.044 INFO:tasks.workunit.client.1.smithi052.stdout:5/505: fsync d5/df/d4e/d5b/f81 0 2023-12-05T13:25:27.046 INFO:tasks.workunit.client.1.smithi052.stdout:4/741: link de/d2b/d64/d69/f9e de/d30/d68/d5c/ff7 0 2023-12-05T13:25:27.048 INFO:tasks.workunit.client.1.smithi052.stdout:4/742: dread de/d30/d68/d5c/fba [0,4194304] 0 2023-12-05T13:25:27.048 INFO:tasks.workunit.client.1.smithi052.stdout:4/743: fsync de/d2b/d64/f6a 0 2023-12-05T13:25:27.048 INFO:tasks.workunit.client.1.smithi052.stdout:4/744: readlink de/d2b/l41 0 2023-12-05T13:25:27.048 INFO:tasks.workunit.client.1.smithi052.stdout:4/745: chown de/f14 114 1 2023-12-05T13:25:27.049 INFO:tasks.workunit.client.1.smithi052.stdout:8/767: creat d0/d28/d2b/dcf/ffb x:0 0 0 2023-12-05T13:25:27.055 INFO:tasks.workunit.client.1.smithi052.stdout:3/770: unlink da/d25/d33/d49/dbd/l59 0 2023-12-05T13:25:27.055 INFO:tasks.workunit.client.1.smithi052.stdout:3/771: stat da/dd/fbc 0 2023-12-05T13:25:27.056 INFO:tasks.workunit.client.1.smithi052.stdout:3/772: write da/d25/d33/d49/f7e [1436734,48581] 0 2023-12-05T13:25:27.057 INFO:tasks.workunit.client.1.smithi052.stdout:1/750: mkdir d5/d26/d41/dbd/df0 0 2023-12-05T13:25:27.064 INFO:tasks.workunit.client.1.smithi052.stdout:9/636: rename d3/c9 to d3/d1e/cd9 0 2023-12-05T13:25:27.064 INFO:tasks.workunit.client.1.smithi052.stdout:9/637: write d3/f6a [23558,52882] 0 2023-12-05T13:25:27.071 INFO:tasks.workunit.client.1.smithi052.stdout:4/746: mkdir de/d30/d68/df8 0 2023-12-05T13:25:27.071 INFO:tasks.workunit.client.1.smithi052.stdout:8/768: mknod d0/de/d27/d43/d44/cfc 0 2023-12-05T13:25:27.071 INFO:tasks.workunit.client.1.smithi052.stdout:8/769: dread - d0/d28/f8c zero size 2023-12-05T13:25:27.072 INFO:tasks.workunit.client.1.smithi052.stdout:4/747: write de/d2b/d64/fe1 [1003943,55029] 0 2023-12-05T13:25:27.072 INFO:tasks.workunit.client.1.smithi052.stdout:4/748: truncate de/d29/f56 4841118 0 2023-12-05T13:25:27.072 INFO:tasks.workunit.client.1.smithi052.stdout:1/751: mkdir d5/d7/df1 0 2023-12-05T13:25:27.072 INFO:tasks.workunit.client.1.smithi052.stdout:1/752: chown d5/d26/d41/dbd 1689 1 2023-12-05T13:25:27.073 INFO:tasks.workunit.client.1.smithi052.stdout:5/506: truncate d5/df/d11/f52 680775 0 2023-12-05T13:25:27.074 INFO:tasks.workunit.client.1.smithi052.stdout:3/773: dwrite da/d7a/fa4 [0,4194304] 0 2023-12-05T13:25:27.076 INFO:tasks.workunit.client.1.smithi052.stdout:8/770: creat d0/d62/ffd x:0 0 0 2023-12-05T13:25:27.077 INFO:tasks.workunit.client.1.smithi052.stdout:4/749: link de/d29/d51/d76/la7 de/d30/d68/d5c/db8/lf9 0 2023-12-05T13:25:27.080 INFO:tasks.workunit.client.1.smithi052.stdout:5/507: creat d5/d15/d21/fa5 x:0 0 0 2023-12-05T13:25:27.081 INFO:tasks.workunit.client.1.smithi052.stdout:1/753: dread d5/d7/d35/d37/d5a/d73/f84 [0,4194304] 0 2023-12-05T13:25:27.081 INFO:tasks.workunit.client.1.smithi052.stdout:1/754: chown d5/d7/de/d74/d99/fa6 626429 1 2023-12-05T13:25:27.083 INFO:tasks.workunit.client.1.smithi052.stdout:3/774: unlink da/d25/d33/d51/c62 0 2023-12-05T13:25:27.083 INFO:tasks.workunit.client.1.smithi052.stdout:3/775: chown da/d25/dcd 0 1 2023-12-05T13:25:27.086 INFO:tasks.workunit.client.1.smithi052.stdout:5/508: rmdir d5/df/d11/d73/d77 39 2023-12-05T13:25:27.087 INFO:tasks.workunit.client.1.smithi052.stdout:1/755: truncate d5/f2c 4967656 0 2023-12-05T13:25:27.089 INFO:tasks.workunit.client.1.smithi052.stdout:3/776: creat da/d25/d33/d89/dae/dcf/f105 x:0 0 0 2023-12-05T13:25:27.090 INFO:tasks.workunit.client.1.smithi052.stdout:9/638: dwrite d3/d11/d3e/f7c [0,4194304] 0 2023-12-05T13:25:27.091 INFO:tasks.workunit.client.1.smithi052.stdout:9/639: dread d3/d2a/f3c [0,4194304] 0 2023-12-05T13:25:27.092 INFO:tasks.workunit.client.1.smithi052.stdout:5/509: rename d5/d15/d21/d25/d3f to d5/d15/d21/d4a/d6e/d91/da6 0 2023-12-05T13:25:27.094 INFO:tasks.workunit.client.1.smithi052.stdout:1/756: creat d5/daa/d17/ff2 x:0 0 0 2023-12-05T13:25:27.095 INFO:tasks.workunit.client.1.smithi052.stdout:4/750: dwrite de/f98 [0,4194304] 0 2023-12-05T13:25:27.096 INFO:tasks.workunit.client.1.smithi052.stdout:3/777: mknod da/d25/d33/d49/c106 0 2023-12-05T13:25:27.098 INFO:tasks.workunit.client.1.smithi052.stdout:9/640: creat d3/d5e/da7/fda x:0 0 0 2023-12-05T13:25:27.099 INFO:tasks.workunit.client.1.smithi052.stdout:5/510: mkdir d5/d15/d21/d4a/d6e/d91/da6/d88/da7 0 2023-12-05T13:25:27.102 INFO:tasks.workunit.client.1.smithi052.stdout:1/757: dread d5/daa/d69/f82 [0,4194304] 0 2023-12-05T13:25:27.102 INFO:tasks.workunit.client.1.smithi052.stdout:1/758: chown d5/daa/d17/ff2 53554 1 2023-12-05T13:25:27.102 INFO:tasks.workunit.client.1.smithi052.stdout:1/759: write d5/d7/d35/d37/d43/f90 [708480,48150] 0 2023-12-05T13:25:27.102 INFO:tasks.workunit.client.1.smithi052.stdout:1/760: readlink d5/d7/d35/d37/d5a/dd4/l53 0 2023-12-05T13:25:27.103 INFO:tasks.workunit.client.1.smithi052.stdout:1/761: write d5/d7/de/d74/d99/dc6/f7c [2115151,99994] 0 2023-12-05T13:25:27.103 INFO:tasks.workunit.client.1.smithi052.stdout:1/762: fsync d5/d26/d75/d7a/fd6 0 2023-12-05T13:25:27.103 INFO:tasks.workunit.client.1.smithi052.stdout:3/778: getdents da/d25/d33/d43/d5b/da6 0 2023-12-05T13:25:27.104 INFO:tasks.workunit.client.1.smithi052.stdout:4/751: creat de/d30/d68/d5c/dcb/ffa x:0 0 0 2023-12-05T13:25:27.107 INFO:tasks.workunit.client.1.smithi052.stdout:9/641: rename d3/d1e/d41/d57/l7b to d3/d5e/d9e/ldb 0 2023-12-05T13:25:27.107 INFO:tasks.workunit.client.1.smithi052.stdout:9/642: write d3/d2a/d5c/f8c [1275008,99229] 0 2023-12-05T13:25:27.107 INFO:tasks.workunit.client.1.smithi052.stdout:9/643: truncate d3/d11/d19/d83/fb7 126114 0 2023-12-05T13:25:27.107 INFO:tasks.workunit.client.1.smithi052.stdout:3/779: write da/f23 [499794,55586] 0 2023-12-05T13:25:27.108 INFO:tasks.workunit.client.1.smithi052.stdout:4/752: fsync de/d30/d73/dbe/d24/f35 0 2023-12-05T13:25:27.109 INFO:tasks.workunit.client.1.smithi052.stdout:3/780: write da/f6e [2234300,116301] 0 2023-12-05T13:25:27.109 INFO:tasks.workunit.client.1.smithi052.stdout:3/781: chown da/d25/d33/l45 650 1 2023-12-05T13:25:27.109 INFO:tasks.workunit.client.1.smithi052.stdout:4/753: read de/d2b/fc0 [473851,16506] 0 2023-12-05T13:25:27.111 INFO:tasks.workunit.client.1.smithi052.stdout:9/644: rename d3/d1e/l5a to d3/d11/d19/ldc 0 2023-12-05T13:25:27.113 INFO:tasks.workunit.client.1.smithi052.stdout:6/546: sync 2023-12-05T13:25:27.113 INFO:tasks.workunit.client.1.smithi052.stdout:6/547: chown d3/d4/d6/d26/c2d 851556134 1 2023-12-05T13:25:27.113 INFO:tasks.workunit.client.1.smithi052.stdout:6/548: chown d3/d5/d9/d21/d48/d4d/d81/d82/cbc 23 1 2023-12-05T13:25:27.114 INFO:tasks.workunit.client.1.smithi052.stdout:3/782: mkdir da/d2e/d107 0 2023-12-05T13:25:27.115 INFO:tasks.workunit.client.1.smithi052.stdout:4/754: symlink de/d30/lfb 0 2023-12-05T13:25:27.117 INFO:tasks.workunit.client.1.smithi052.stdout:1/763: dwrite d5/daa/d79/fcb [0,4194304] 0 2023-12-05T13:25:27.117 INFO:tasks.workunit.client.1.smithi052.stdout:6/549: truncate d3/d4/d36/f8b 2823090 0 2023-12-05T13:25:27.118 INFO:tasks.workunit.client.1.smithi052.stdout:5/511: dwrite d5/df/f61 [0,4194304] 0 2023-12-05T13:25:27.121 INFO:tasks.workunit.client.1.smithi052.stdout:1/764: symlink d5/d7/d35/d2f/d3e/d62/d85/lf3 0 2023-12-05T13:25:27.122 INFO:tasks.workunit.client.1.smithi052.stdout:1/765: write d5/daa/d79/faf [4041124,85811] 0 2023-12-05T13:25:27.124 INFO:tasks.workunit.client.1.smithi052.stdout:6/550: link d3/d4/d36/d6f/f85 d3/d5/d9/d21/d48/d4d/d81/fbf 0 2023-12-05T13:25:27.125 INFO:tasks.workunit.client.1.smithi052.stdout:3/783: dread da/d25/d33/d49/fd5 [0,4194304] 0 2023-12-05T13:25:27.125 INFO:tasks.workunit.client.1.smithi052.stdout:3/784: chown da/f23 21 1 2023-12-05T13:25:27.125 INFO:tasks.workunit.client.1.smithi052.stdout:3/785: write da/d25/d33/d89/dae/faf [1328554,38870] 0 2023-12-05T13:25:27.125 INFO:tasks.workunit.client.1.smithi052.stdout:3/786: chown da/dd/d3d/f76 17530 1 2023-12-05T13:25:27.126 INFO:tasks.workunit.client.1.smithi052.stdout:9/645: getdents d3/d1e/d41/d57 0 2023-12-05T13:25:27.126 INFO:tasks.workunit.client.1.smithi052.stdout:9/646: write d3/d11/f33 [639141,38864] 0 2023-12-05T13:25:27.127 INFO:tasks.workunit.client.1.smithi052.stdout:5/512: mkdir d5/df/d4e/da8 0 2023-12-05T13:25:27.130 INFO:tasks.workunit.client.1.smithi052.stdout:6/551: link d3/d4/d6/d26/l33 d3/d5/d9/d21/d48/d4d/d66/d91/lc0 0 2023-12-05T13:25:27.132 INFO:tasks.workunit.client.1.smithi052.stdout:1/766: dread d5/d7/d35/d37/d5a/d73/dac/fbb [0,4194304] 0 2023-12-05T13:25:27.134 INFO:tasks.workunit.client.1.smithi052.stdout:4/755: dwrite de/d30/d73/dbe/d24/f4e [4194304,4194304] 0 2023-12-05T13:25:27.141 INFO:tasks.workunit.client.1.smithi052.stdout:9/647: link d3/d2a/d8f/fc1 d3/d5e/fdd 0 2023-12-05T13:25:27.142 INFO:tasks.workunit.client.1.smithi052.stdout:9/648: chown d3/d1e/f9c 123124093 1 2023-12-05T13:25:27.144 INFO:tasks.workunit.client.1.smithi052.stdout:5/513: fsync d5/df/d11/f26 0 2023-12-05T13:25:27.144 INFO:tasks.workunit.client.1.smithi052.stdout:3/787: dwrite da/d25/d33/d89/fbf [0,4194304] 0 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:3/788: read da/d25/d33/d89/dae/faf [583373,69200] 0 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:3/789: write da/d25/d33/d89/dae/dcf/f105 [531573,54447] 0 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:3/790: chown da/d2e/c54 212643 1 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:3/791: readlink da/d25/d33/d43/d5b/l72 0 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:6/552: creat d3/d5/d9/d21/d48/d5b/fc1 x:0 0 0 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:9/649: write d3/d31/f87 [2808650,61376] 0 2023-12-05T13:25:27.146 INFO:tasks.workunit.client.1.smithi052.stdout:9/650: stat d3/d1e/f23 0 2023-12-05T13:25:27.147 INFO:tasks.workunit.client.1.smithi052.stdout:9/651: dread - d3/d11/d96/fac zero size 2023-12-05T13:25:27.149 INFO:tasks.workunit.client.1.smithi052.stdout:6/553: dread d3/d5/d9/f64 [0,4194304] 0 2023-12-05T13:25:27.149 INFO:tasks.workunit.client.1.smithi052.stdout:6/554: chown d3/d4/d6/d26/ca3 9476 1 2023-12-05T13:25:27.149 INFO:tasks.workunit.client.1.smithi052.stdout:9/652: dread d3/d2a/d5c/f8c [0,4194304] 0 2023-12-05T13:25:27.153 INFO:tasks.workunit.client.1.smithi052.stdout:5/514: creat d5/d46/d76/fa9 x:0 0 0 2023-12-05T13:25:27.153 INFO:tasks.workunit.client.1.smithi052.stdout:5/515: chown d5/df/d11/d73/d77/f78 625231379 1 2023-12-05T13:25:27.153 INFO:tasks.workunit.client.1.smithi052.stdout:5/516: read - d5/df/d4b/f95 zero size 2023-12-05T13:25:27.155 INFO:tasks.workunit.client.1.smithi052.stdout:6/555: rename d3/d5/d9/d21/db8 to d3/d5/d9/d21/d48/d4d/d81/dc2 0 2023-12-05T13:25:27.156 INFO:tasks.workunit.client.1.smithi052.stdout:6/556: rmdir d3/d5/d9/d21/d48 39 2023-12-05T13:25:27.157 INFO:tasks.workunit.client.1.smithi052.stdout:3/792: dread da/d25/d33/f97 [0,4194304] 0 2023-12-05T13:25:27.157 INFO:tasks.workunit.client.1.smithi052.stdout:9/653: rename d3/d1e/d41/f46 to d3/d1e/d41/d57/fde 0 2023-12-05T13:25:27.160 INFO:tasks.workunit.client.1.smithi052.stdout:6/557: rename d3/d5/d9/d21/fac to d3/d5/d9/d21/d48/d5b/fc3 0 2023-12-05T13:25:27.160 INFO:tasks.workunit.client.1.smithi052.stdout:9/654: truncate d3/d5e/d9e/fbf 3386628 0 2023-12-05T13:25:27.160 INFO:tasks.workunit.client.1.smithi052.stdout:9/655: readlink d3/d11/d19/d83/lcf 0 2023-12-05T13:25:27.162 INFO:tasks.workunit.client.1.smithi052.stdout:1/767: dwrite f4 [0,4194304] 0 2023-12-05T13:25:27.162 INFO:tasks.workunit.client.1.smithi052.stdout:6/558: write d3/d4/d6/f4b [1207167,42202] 0 2023-12-05T13:25:27.164 INFO:tasks.workunit.client.1.smithi052.stdout:1/768: unlink d5/d7/de/d74/d99/fb7 0 2023-12-05T13:25:27.165 INFO:tasks.workunit.client.1.smithi052.stdout:1/769: write d5/d26/da3/fd0 [227949,58388] 0 2023-12-05T13:25:27.171 INFO:tasks.workunit.client.1.smithi052.stdout:2/748: sync 2023-12-05T13:25:27.171 INFO:tasks.workunit.client.1.smithi052.stdout:2/749: unlink d2/d13/d48/l65 0 2023-12-05T13:25:27.172 INFO:tasks.workunit.client.1.smithi052.stdout:2/750: stat d2/d13/d37/d5c/d80/db4/ld2 0 2023-12-05T13:25:27.173 INFO:tasks.workunit.client.1.smithi052.stdout:2/751: readlink d2/d4/d3f/lbe 0 2023-12-05T13:25:27.173 INFO:tasks.workunit.client.1.smithi052.stdout:2/752: fsync d2/d4/d3f/d9d/fa2 0 2023-12-05T13:25:27.174 INFO:tasks.workunit.client.1.smithi052.stdout:2/753: creat d2/d13/d1e/fde x:0 0 0 2023-12-05T13:25:27.175 INFO:tasks.workunit.client.1.smithi052.stdout:2/754: read d2/f5d [1789930,18185] 0 2023-12-05T13:25:27.178 INFO:tasks.workunit.client.1.smithi052.stdout:2/755: rmdir d2/d13/d48/dd3/d62/da7 39 2023-12-05T13:25:27.182 INFO:tasks.workunit.client.1.smithi052.stdout:2/756: write d2/f59 [8335935,33128] 0 2023-12-05T13:25:27.182 INFO:tasks.workunit.client.1.smithi052.stdout:5/517: dwrite d5/df/d11/d73/f96 [4194304,4194304] 0 2023-12-05T13:25:27.184 INFO:tasks.workunit.client.1.smithi052.stdout:9/656: dwrite d3/d5e/da7/fda [0,4194304] 0 2023-12-05T13:25:27.184 INFO:tasks.workunit.client.1.smithi052.stdout:9/657: rename d3 to d3/d11/d3e/ddf 22 2023-12-05T13:25:27.184 INFO:tasks.workunit.client.1.smithi052.stdout:9/658: readlink d3/d11/d19/l49 0 2023-12-05T13:25:27.186 INFO:tasks.workunit.client.1.smithi052.stdout:9/659: creat d3/d1e/fe0 x:0 0 0 2023-12-05T13:25:27.187 INFO:tasks.workunit.client.1.smithi052.stdout:9/660: truncate d3/d11/d3e/f6e 2838669 0 2023-12-05T13:25:27.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/661: write d3/d1e/d37/d4f/f77 [894429,130323] 0 2023-12-05T13:25:27.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/662: dread - d3/d2a/d5c/f71 zero size 2023-12-05T13:25:27.188 INFO:tasks.workunit.client.1.smithi052.stdout:2/757: write d2/d13/d48/dd3/f8f [859360,114205] 0 2023-12-05T13:25:27.188 INFO:tasks.workunit.client.1.smithi052.stdout:6/559: dwrite d3/d4/d36/d6f/f85 [0,4194304] 0 2023-12-05T13:25:27.189 INFO:tasks.workunit.client.1.smithi052.stdout:6/560: truncate d3/d5/d9/d21/d48/d4d/f78 1104446 0 2023-12-05T13:25:27.189 INFO:tasks.workunit.client.1.smithi052.stdout:3/793: dwrite da/f23 [0,4194304] 0 2023-12-05T13:25:27.189 INFO:tasks.workunit.client.1.smithi052.stdout:1/770: dwrite d5/daa/d17/d3c/fb4 [0,4194304] 0 2023-12-05T13:25:27.190 INFO:tasks.workunit.client.1.smithi052.stdout:1/771: dread d5/d7/f4b [0,4194304] 0 2023-12-05T13:25:27.190 INFO:tasks.workunit.client.1.smithi052.stdout:9/663: rmdir d3/d5e/da7/dd5 0 2023-12-05T13:25:27.195 INFO:tasks.workunit.client.1.smithi052.stdout:2/758: creat d2/d13/d7c/fdf x:0 0 0 2023-12-05T13:25:27.195 INFO:tasks.workunit.client.1.smithi052.stdout:2/759: fdatasync d2/d13/d1e/f54 0 2023-12-05T13:25:27.196 INFO:tasks.workunit.client.1.smithi052.stdout:2/760: fdatasync d2/d13/d48/f67 0 2023-12-05T13:25:27.200 INFO:tasks.workunit.client.1.smithi052.stdout:6/561: mkdir d3/d5/d9/d21/dc4 0 2023-12-05T13:25:27.201 INFO:tasks.workunit.client.1.smithi052.stdout:5/518: dwrite d5/f79 [0,4194304] 0 2023-12-05T13:25:27.206 INFO:tasks.workunit.client.1.smithi052.stdout:3/794: dread da/d25/d33/d89/dae/dcf/f105 [0,4194304] 0 2023-12-05T13:25:27.208 INFO:tasks.workunit.client.1.smithi052.stdout:1/772: truncate d5/d7/f12 2098808 0 2023-12-05T13:25:27.209 INFO:tasks.workunit.client.1.smithi052.stdout:6/562: dread d3/d5/d58/f9f [0,4194304] 0 2023-12-05T13:25:27.209 INFO:tasks.workunit.client.1.smithi052.stdout:2/761: symlink d2/le0 0 2023-12-05T13:25:27.209 INFO:tasks.workunit.client.1.smithi052.stdout:6/563: chown d3/d5/d9/d21/d48/d5b 206842725 1 2023-12-05T13:25:27.211 INFO:tasks.workunit.client.1.smithi052.stdout:5/519: link d5/fc d5/d46/faa 0 2023-12-05T13:25:27.212 INFO:tasks.workunit.client.1.smithi052.stdout:5/520: dread - d5/df/d11/d66/f94 zero size 2023-12-05T13:25:27.213 INFO:tasks.workunit.client.1.smithi052.stdout:1/773: rename d5/d7/de/d74/d99/dc6/f7c to d5/d26/ff4 0 2023-12-05T13:25:27.214 INFO:tasks.workunit.client.1.smithi052.stdout:9/664: dwrite d3/d5e/d9e/fbf [0,4194304] 0 2023-12-05T13:25:27.215 INFO:tasks.workunit.client.1.smithi052.stdout:6/564: rename d3/d4/df/c1b to d3/d5/d9/d21/d48/d4d/cc5 0 2023-12-05T13:25:27.216 INFO:tasks.workunit.client.1.smithi052.stdout:6/565: chown d3/d5/d9/d21/d48/d4d/d66/d74 59 1 2023-12-05T13:25:27.216 INFO:tasks.workunit.client.1.smithi052.stdout:3/795: dread da/d2e/f7f [0,4194304] 0 2023-12-05T13:25:27.217 INFO:tasks.workunit.client.1.smithi052.stdout:1/774: unlink f4 0 2023-12-05T13:25:27.217 INFO:tasks.workunit.client.1.smithi052.stdout:9/665: write d3/d5e/da7/daf/fd0 [4076922,77368] 0 2023-12-05T13:25:27.220 INFO:tasks.workunit.client.1.smithi052.stdout:6/566: getdents d3/d5/d9/d52 0 2023-12-05T13:25:27.220 INFO:tasks.workunit.client.1.smithi052.stdout:6/567: chown d3/d5/d9/d21/d48/d4d/cc5 156811 1 2023-12-05T13:25:27.220 INFO:tasks.workunit.client.1.smithi052.stdout:6/568: write d3/d5/d9/d21/d48/d4d/d66/d74/f87 [635107,83325] 0 2023-12-05T13:25:27.221 INFO:tasks.workunit.client.1.smithi052.stdout:3/796: mknod da/d25/d33/d49/dbd/c108 0 2023-12-05T13:25:27.221 INFO:tasks.workunit.client.1.smithi052.stdout:6/569: write d3/d5/f5a [930935,31012] 0 2023-12-05T13:25:27.222 INFO:tasks.workunit.client.1.smithi052.stdout:1/775: rename d5/daa/d17/ff2 to d5/daa/d79/ff5 0 2023-12-05T13:25:27.222 INFO:tasks.workunit.client.1.smithi052.stdout:1/776: stat d5/d7/d35/d37/d5a/d73/dae 0 2023-12-05T13:25:27.222 INFO:tasks.workunit.client.1.smithi052.stdout:5/521: dread d5/d15/d21/f5e [0,4194304] 0 2023-12-05T13:25:27.223 INFO:tasks.workunit.client.1.smithi052.stdout:5/522: stat d5/df/d11/d73/f93 0 2023-12-05T13:25:27.223 INFO:tasks.workunit.client.1.smithi052.stdout:5/523: fsync d5/df/d4b/f95 0 2023-12-05T13:25:27.224 INFO:tasks.workunit.client.1.smithi052.stdout:9/666: mkdir d3/d92/de1 0 2023-12-05T13:25:27.224 INFO:tasks.workunit.client.1.smithi052.stdout:9/667: fsync d3/d2a/d5c/f71 0 2023-12-05T13:25:27.224 INFO:tasks.workunit.client.1.smithi052.stdout:9/668: chown d3/d11/d96/fac 903275387 1 2023-12-05T13:25:27.224 INFO:tasks.workunit.client.1.smithi052.stdout:4/756: sync 2023-12-05T13:25:27.224 INFO:tasks.workunit.client.1.smithi052.stdout:8/771: sync 2023-12-05T13:25:27.224 INFO:tasks.workunit.client.1.smithi052.stdout:0/713: sync 2023-12-05T13:25:27.225 INFO:tasks.workunit.client.1.smithi052.stdout:9/669: dread d3/d5e/fd1 [0,4194304] 0 2023-12-05T13:25:27.225 INFO:tasks.workunit.client.1.smithi052.stdout:9/670: write d3/d1e/d41/d86/f91 [2222221,2994] 0 2023-12-05T13:25:27.225 INFO:tasks.workunit.client.1.smithi052.stdout:6/570: symlink d3/d5/d9/d21/d48/lc6 0 2023-12-05T13:25:27.225 INFO:tasks.workunit.client.1.smithi052.stdout:6/571: chown d3/d5/d58/l73 721925 1 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:1/777: symlink d5/d7/d35/d2f/d3e/lf6 0 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:1/778: chown d5/d7/de/d74/d99/cc0 7076 1 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:1/779: fsync d5/daa/da4/fa5 0 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:1/780: write d5/d7/d35/d2f/d3e/d62/d85/fab [4869442,63146] 0 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:1/781: chown d5/daa/fd2 193687 1 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:7/800: sync 2023-12-05T13:25:27.227 INFO:tasks.workunit.client.1.smithi052.stdout:7/801: chown d7/d4e/d45/d5a/d63/d95/cd1 3 1 2023-12-05T13:25:27.228 INFO:tasks.workunit.client.1.smithi052.stdout:5/524: mkdir d5/d15/d21/d4a/d6e/d91/da6/d5c/dab 0 2023-12-05T13:25:27.228 INFO:tasks.workunit.client.1.smithi052.stdout:5/525: chown d5/d46/c43 50497284 1 2023-12-05T13:25:27.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/757: symlink de/d29/lfc 0 2023-12-05T13:25:27.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/758: chown de/d30/dac 179872 1 2023-12-05T13:25:27.232 INFO:tasks.workunit.client.1.smithi052.stdout:8/772: mknod d0/de/d12/d29/db3/cfe 0 2023-12-05T13:25:27.232 INFO:tasks.workunit.client.1.smithi052.stdout:8/773: chown d0/dae/cf5 91942 1 2023-12-05T13:25:27.232 INFO:tasks.workunit.client.1.smithi052.stdout:8/774: chown d0/d28/d39/d3a/l4b 38257327 1 2023-12-05T13:25:27.234 INFO:tasks.workunit.client.1.smithi052.stdout:5/526: dread d5/fc [0,4194304] 0 2023-12-05T13:25:27.234 INFO:tasks.workunit.client.1.smithi052.stdout:5/527: readlink d5/l24 0 2023-12-05T13:25:27.235 INFO:tasks.workunit.client.1.smithi052.stdout:0/714: rename d0/db/d2e/d53/d80/c9a to d0/db/d1b/d29/ceb 0 2023-12-05T13:25:27.238 INFO:tasks.workunit.client.1.smithi052.stdout:6/572: dread d3/d5/d9/d21/d48/d5b/fc3 [0,4194304] 0 2023-12-05T13:25:27.239 INFO:tasks.workunit.client.1.smithi052.stdout:6/573: dread d3/d5/d9/d21/d48/d4d/d66/d74/f87 [0,4194304] 0 2023-12-05T13:25:27.240 INFO:tasks.workunit.client.1.smithi052.stdout:6/574: dread - d3/d5/f7c zero size 2023-12-05T13:25:27.240 INFO:tasks.workunit.client.1.smithi052.stdout:1/782: unlink d5/d7/d35/d37/d43/c9d 0 2023-12-05T13:25:27.241 INFO:tasks.workunit.client.1.smithi052.stdout:7/802: mknod d7/d4e/d45/d98/c10b 0 2023-12-05T13:25:27.241 INFO:tasks.workunit.client.1.smithi052.stdout:7/803: chown d7/d4e/d12/d3f/d46/d4d/lf8 34 1 2023-12-05T13:25:27.243 INFO:tasks.workunit.client.1.smithi052.stdout:4/759: truncate de/d30/d68/f50 1282790 0 2023-12-05T13:25:27.243 INFO:tasks.workunit.client.1.smithi052.stdout:4/760: chown de/d29/ce0 753445931 1 2023-12-05T13:25:27.243 INFO:tasks.workunit.client.1.smithi052.stdout:4/761: stat de/d30/d73/fa1 0 2023-12-05T13:25:27.244 INFO:tasks.workunit.client.1.smithi052.stdout:8/775: creat d0/de/d12/d29/db3/dc5/fff x:0 0 0 2023-12-05T13:25:27.244 INFO:tasks.workunit.client.1.smithi052.stdout:5/528: rmdir d5/d15 39 2023-12-05T13:25:27.246 INFO:tasks.workunit.client.1.smithi052.stdout:9/671: rename d3/d1e/dd2 to d3/d11/d19/de2 0 2023-12-05T13:25:27.246 INFO:tasks.workunit.client.1.smithi052.stdout:9/672: chown d3/d31/l8d 6281976 1 2023-12-05T13:25:27.246 INFO:tasks.workunit.client.1.smithi052.stdout:0/715: symlink d0/db/d1b/d29/db0/lec 0 2023-12-05T13:25:27.248 INFO:tasks.workunit.client.1.smithi052.stdout:1/783: symlink d5/d26/dbf/lf7 0 2023-12-05T13:25:27.251 INFO:tasks.workunit.client.1.smithi052.stdout:4/762: getdents de/d91 0 2023-12-05T13:25:27.253 INFO:tasks.workunit.client.1.smithi052.stdout:9/673: write d3/d11/d19/f27 [2938732,19188] 0 2023-12-05T13:25:27.253 INFO:tasks.workunit.client.1.smithi052.stdout:8/776: creat d0/de/d12/dc1/dd3/f100 x:0 0 0 2023-12-05T13:25:27.254 INFO:tasks.workunit.client.1.smithi052.stdout:5/529: mkdir d5/d15/d21/d4a/d6e/d91/da6/d5c/dab/dac 0 2023-12-05T13:25:27.257 INFO:tasks.workunit.client.1.smithi052.stdout:6/575: rename d3/d4/d6/l57 to d3/d5/d9/d44/lc7 0 2023-12-05T13:25:27.259 INFO:tasks.workunit.client.1.smithi052.stdout:7/804: dwrite d7/d31/fdf [0,4194304] 0 2023-12-05T13:25:27.259 INFO:tasks.workunit.client.1.smithi052.stdout:7/805: chown d7/d4e/d45/f5b 5680 1 2023-12-05T13:25:27.259 INFO:tasks.workunit.client.1.smithi052.stdout:0/716: link d0/db/d20/l74 d0/dcb/led 0 2023-12-05T13:25:27.259 INFO:tasks.workunit.client.1.smithi052.stdout:0/717: readlink d0/db/d52/le1 0 2023-12-05T13:25:27.261 INFO:tasks.workunit.client.1.smithi052.stdout:0/718: write d0/db/d33/f70 [1609611,125498] 0 2023-12-05T13:25:27.266 INFO:tasks.workunit.client.1.smithi052.stdout:1/784: creat d5/daa/d79/ff8 x:0 0 0 2023-12-05T13:25:27.266 INFO:tasks.workunit.client.1.smithi052.stdout:4/763: creat de/d30/d68/d5c/dcb/ffd x:0 0 0 2023-12-05T13:25:27.268 INFO:tasks.workunit.client.1.smithi052.stdout:9/674: creat d3/d5e/d9e/fe3 x:0 0 0 2023-12-05T13:25:27.272 INFO:tasks.workunit.client.1.smithi052.stdout:8/777: dwrite d0/d28/db0/fbe [0,4194304] 0 2023-12-05T13:25:27.280 INFO:tasks.workunit.client.1.smithi052.stdout:6/576: dread d3/d4/f55 [0,4194304] 0 2023-12-05T13:25:27.280 INFO:tasks.workunit.client.1.smithi052.stdout:6/577: chown d3/d5/d9/d21/d5f/f67 572161322 1 2023-12-05T13:25:27.283 INFO:tasks.workunit.client.1.smithi052.stdout:8/778: dread d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:25:27.283 INFO:tasks.workunit.client.1.smithi052.stdout:8/779: write d0/de/d27/d43/d44/fd8 [438895,98218] 0 2023-12-05T13:25:27.291 INFO:tasks.workunit.client.1.smithi052.stdout:5/530: dwrite d5/d15/d21/d25/f6d [0,4194304] 0 2023-12-05T13:25:27.337 INFO:tasks.workunit.client.1.smithi052.stdout:7/806: getdents d7/d4e/db4 0 2023-12-05T13:25:27.343 INFO:tasks.workunit.client.1.smithi052.stdout:0/719: dread d0/f6 [0,4194304] 0 2023-12-05T13:25:27.345 INFO:tasks.workunit.client.1.smithi052.stdout:1/785: mknod d5/d7/d35/d37/dd3/cf9 0 2023-12-05T13:25:27.345 INFO:tasks.workunit.client.1.smithi052.stdout:9/675: mknod d3/d11/d19/d83/ce4 0 2023-12-05T13:25:27.345 INFO:tasks.workunit.client.1.smithi052.stdout:9/676: chown d3/d1e/d41 0 1 2023-12-05T13:25:27.353 INFO:tasks.workunit.client.1.smithi052.stdout:8/780: mknod d0/de/d86/c101 0 2023-12-05T13:25:27.359 INFO:tasks.workunit.client.1.smithi052.stdout:1/786: dwrite d5/d7/f4b [0,4194304] 0 2023-12-05T13:25:27.360 INFO:tasks.workunit.client.1.smithi052.stdout:5/531: creat d5/df/d11/d66/fad x:0 0 0 2023-12-05T13:25:27.361 INFO:tasks.workunit.client.1.smithi052.stdout:7/807: rename d7/d4e/d45/d5a/f96 to d7/d4e/d12/d3f/d46/dab/df6/f10c 0 2023-12-05T13:25:27.362 INFO:tasks.workunit.client.1.smithi052.stdout:0/720: mkdir d0/db/d2e/d7e/dcc/dee 0 2023-12-05T13:25:27.364 INFO:tasks.workunit.client.1.smithi052.stdout:9/677: creat d3/d5e/d9e/fe5 x:0 0 0 2023-12-05T13:25:27.365 INFO:tasks.workunit.client.1.smithi052.stdout:9/678: chown d3/d1e/d37/d4f/c58 16873212 1 2023-12-05T13:25:27.366 INFO:tasks.workunit.client.1.smithi052.stdout:1/787: link d5/daa/d2a/f92 d5/d26/da3/dcd/def/ffa 0 2023-12-05T13:25:27.367 INFO:tasks.workunit.client.1.smithi052.stdout:5/532: truncate d5/d15/f31 2869774 0 2023-12-05T13:25:27.371 INFO:tasks.workunit.client.1.smithi052.stdout:8/781: rename d0/d4d/f4c to d0/de/d98/f102 0 2023-12-05T13:25:27.375 INFO:tasks.workunit.client.1.smithi052.stdout:0/721: symlink d0/db/d1b/d29/db0/lef 0 2023-12-05T13:25:27.376 INFO:tasks.workunit.client.1.smithi052.stdout:9/679: creat d3/d92/da8/fe6 x:0 0 0 2023-12-05T13:25:27.378 INFO:tasks.workunit.client.1.smithi052.stdout:1/788: mknod d5/d7/d35/d2f/cfb 0 2023-12-05T13:25:27.379 INFO:tasks.workunit.client.1.smithi052.stdout:7/808: dwrite d7/d4e/d45/d5a/fcd [0,4194304] 0 2023-12-05T13:25:27.379 INFO:tasks.workunit.client.1.smithi052.stdout:7/809: chown d7/d2e/l3c 484653 1 2023-12-05T13:25:27.379 INFO:tasks.workunit.client.1.smithi052.stdout:7/810: readlink d7/d4e/d86/l90 0 2023-12-05T13:25:27.381 INFO:tasks.workunit.client.1.smithi052.stdout:5/533: rename d5/d46/d76/l9c to d5/df/d4e/d65/lae 0 2023-12-05T13:25:27.385 INFO:tasks.workunit.client.1.smithi052.stdout:1/789: mkdir d5/daa/d17/d9a/dfc 0 2023-12-05T13:25:27.385 INFO:tasks.workunit.client.1.smithi052.stdout:1/790: write d5/daa/fd2 [151951,85090] 0 2023-12-05T13:25:27.385 INFO:tasks.workunit.client.1.smithi052.stdout:1/791: dread - d5/d7/de/d74/d99/fa6 zero size 2023-12-05T13:25:27.388 INFO:tasks.workunit.client.1.smithi052.stdout:7/811: mknod d7/d4e/d12/d3f/d75/c10d 0 2023-12-05T13:25:27.391 INFO:tasks.workunit.client.1.smithi052.stdout:8/782: rename d0/d62/fa9 to d0/dae/f103 0 2023-12-05T13:25:27.395 INFO:tasks.workunit.client.1.smithi052.stdout:7/812: mknod d7/d4e/d12/d7d/c10e 0 2023-12-05T13:25:27.397 INFO:tasks.workunit.client.1.smithi052.stdout:8/783: rmdir d0/de/d27/d43 39 2023-12-05T13:25:27.400 INFO:tasks.workunit.client.1.smithi052.stdout:7/813: mkdir d7/dce/d10f 0 2023-12-05T13:25:27.400 INFO:tasks.workunit.client.1.smithi052.stdout:9/680: dwrite d3/d2a/f59 [0,4194304] 0 2023-12-05T13:25:27.401 INFO:tasks.workunit.client.1.smithi052.stdout:8/784: unlink d0/de/d12/dc1/lf1 0 2023-12-05T13:25:27.401 INFO:tasks.workunit.client.1.smithi052.stdout:7/814: dread d7/d4e/d45/d5a/fe0 [0,4194304] 0 2023-12-05T13:25:27.407 INFO:tasks.workunit.client.1.smithi052.stdout:7/815: link d7/d4e/d12/d3f/d46/l9e d7/d4e/d86/l110 0 2023-12-05T13:25:27.407 INFO:tasks.workunit.client.1.smithi052.stdout:9/681: mknod d3/d1e/d37/d4f/ce7 0 2023-12-05T13:25:27.409 INFO:tasks.workunit.client.1.smithi052.stdout:1/792: dwrite d5/daa/da4/fa5 [0,4194304] 0 2023-12-05T13:25:27.412 INFO:tasks.workunit.client.1.smithi052.stdout:7/816: rename d7/d4e/d45/d5a/fcf to d7/d4e/d12/d7d/f111 0 2023-12-05T13:25:27.421 INFO:tasks.workunit.client.1.smithi052.stdout:8/785: dwrite d0/de/d12/d29/db3/dc5/ff4 [0,4194304] 0 2023-12-05T13:25:27.428 INFO:tasks.workunit.client.1.smithi052.stdout:8/786: creat d0/d28/d2b/de4/f104 x:0 0 0 2023-12-05T13:25:27.430 INFO:tasks.workunit.client.1.smithi052.stdout:7/817: dwrite d7/d4e/d45/d93/fb0 [0,4194304] 0 2023-12-05T13:25:27.431 INFO:tasks.workunit.client.1.smithi052.stdout:9/682: dwrite d3/d2a/d8f/fc1 [0,4194304] 0 2023-12-05T13:25:27.431 INFO:tasks.workunit.client.1.smithi052.stdout:1/793: dwrite d5/f64 [0,4194304] 0 2023-12-05T13:25:27.434 INFO:tasks.workunit.client.1.smithi052.stdout:7/818: symlink d7/dce/d10f/l112 0 2023-12-05T13:25:27.441 INFO:tasks.workunit.client.1.smithi052.stdout:8/787: dwrite d0/de/d98/fba [0,4194304] 0 2023-12-05T13:25:27.443 INFO:tasks.workunit.client.1.smithi052.stdout:1/794: mkdir d5/d26/dbf/dfd 0 2023-12-05T13:25:27.444 INFO:tasks.workunit.client.1.smithi052.stdout:1/795: fsync d5/d7/d35/d2f/d3e/d62/f97 0 2023-12-05T13:25:27.446 INFO:tasks.workunit.client.1.smithi052.stdout:7/819: symlink d7/d2e/l113 0 2023-12-05T13:25:27.452 INFO:tasks.workunit.client.1.smithi052.stdout:8/788: truncate d0/d28/d39/d3a/f67 3421309 0 2023-12-05T13:25:27.452 INFO:tasks.workunit.client.1.smithi052.stdout:8/789: fsync d0/de/d27/d43/d63/f8b 0 2023-12-05T13:25:27.452 INFO:tasks.workunit.client.1.smithi052.stdout:8/790: truncate d0/d28/d2b/dcf/ffb 960225 0 2023-12-05T13:25:27.455 INFO:tasks.workunit.client.1.smithi052.stdout:1/796: rename d5/d26/d75/d7a/da0 to d5/d26/d41/dfe 0 2023-12-05T13:25:27.455 INFO:tasks.workunit.client.1.smithi052.stdout:1/797: truncate d5/daa/d2a/f92 847192 0 2023-12-05T13:25:27.458 INFO:tasks.workunit.client.1.smithi052.stdout:7/820: symlink d7/d4e/d45/d79/df9/l114 0 2023-12-05T13:25:27.458 INFO:tasks.workunit.client.1.smithi052.stdout:7/821: chown d7/d4e/d45/d79/d91 75093615 1 2023-12-05T13:25:27.460 INFO:tasks.workunit.client.1.smithi052.stdout:8/791: mknod d0/de/d12/d29/c105 0 2023-12-05T13:25:27.462 INFO:tasks.workunit.client.1.smithi052.stdout:7/822: dread d7/d31/d56/f58 [0,4194304] 0 2023-12-05T13:25:27.462 INFO:tasks.workunit.client.1.smithi052.stdout:1/798: creat d5/daa/d17/d9a/fff x:0 0 0 2023-12-05T13:25:27.463 INFO:tasks.workunit.client.1.smithi052.stdout:8/792: write d0/de/d98/fba [1027047,46799] 0 2023-12-05T13:25:27.464 INFO:tasks.workunit.client.1.smithi052.stdout:7/823: unlink d7/d4e/d45/d50/cc1 0 2023-12-05T13:25:27.466 INFO:tasks.workunit.client.1.smithi052.stdout:1/799: truncate d5/daa/d17/f39 66346 0 2023-12-05T13:25:27.467 INFO:tasks.workunit.client.1.smithi052.stdout:8/793: creat d0/de/d98/d9c/f106 x:0 0 0 2023-12-05T13:25:27.468 INFO:tasks.workunit.client.1.smithi052.stdout:8/794: creat d0/de/d12/d29/db3/dc5/f107 x:0 0 0 2023-12-05T13:25:27.470 INFO:tasks.workunit.client.1.smithi052.stdout:8/795: getdents d0/d28/d39/d3a/d4f 0 2023-12-05T13:25:27.472 INFO:tasks.workunit.client.1.smithi052.stdout:8/796: dread d0/de/d27/f57 [0,4194304] 0 2023-12-05T13:25:27.474 INFO:tasks.workunit.client.1.smithi052.stdout:1/800: write d5/d7/d35/d2f/f7f [1926779,61405] 0 2023-12-05T13:25:27.475 INFO:tasks.workunit.client.1.smithi052.stdout:8/797: getdents d0/d28 0 2023-12-05T13:25:27.475 INFO:tasks.workunit.client.1.smithi052.stdout:8/798: stat d0/c8 0 2023-12-05T13:25:27.478 INFO:tasks.workunit.client.1.smithi052.stdout:8/799: creat d0/d28/f108 x:0 0 0 2023-12-05T13:25:27.479 INFO:tasks.workunit.client.1.smithi052.stdout:8/800: chown d0/d28/d2b/fa3 329572563 1 2023-12-05T13:25:27.480 INFO:tasks.workunit.client.1.smithi052.stdout:7/824: dwrite d7/d4e/db4/f100 [0,4194304] 0 2023-12-05T13:25:27.483 INFO:tasks.workunit.client.1.smithi052.stdout:8/801: rename d0/d4d/c75 to d0/d28/d2b/dcf/de6/c109 0 2023-12-05T13:25:27.485 INFO:tasks.workunit.client.1.smithi052.stdout:7/825: rmdir d7/d4e/d45/d5a/d63/d95/dba 39 2023-12-05T13:25:27.487 INFO:tasks.workunit.client.1.smithi052.stdout:7/826: creat d7/d4e/d45/d5a/dfe/f115 x:0 0 0 2023-12-05T13:25:27.488 INFO:tasks.workunit.client.1.smithi052.stdout:8/802: dread d0/dae/f103 [0,4194304] 0 2023-12-05T13:25:27.490 INFO:tasks.workunit.client.1.smithi052.stdout:8/803: symlink d0/de/d27/d43/l10a 0 2023-12-05T13:25:27.490 INFO:tasks.workunit.client.1.smithi052.stdout:8/804: stat d0/de/d27/c33 0 2023-12-05T13:25:27.490 INFO:tasks.workunit.client.1.smithi052.stdout:8/805: fdatasync d0/de/d12/d29/db3/dc5/ff4 0 2023-12-05T13:25:27.507 INFO:tasks.workunit.client.1.smithi052.stdout:8/806: dwrite d0/d28/d2b/f31 [0,4194304] 0 2023-12-05T13:25:27.507 INFO:tasks.workunit.client.1.smithi052.stdout:8/807: fdatasync d0/d28/d2b/d53/fbb 0 2023-12-05T13:25:27.520 INFO:tasks.workunit.client.1.smithi052.stdout:8/808: dwrite d0/de/d12/d29/db3/dc5/f107 [0,4194304] 0 2023-12-05T13:25:27.521 INFO:tasks.workunit.client.1.smithi052.stdout:8/809: truncate d0/d28/f108 334542 0 2023-12-05T13:25:27.521 INFO:tasks.workunit.client.1.smithi052.stdout:8/810: chown d0/de/d86/c101 12 1 2023-12-05T13:25:27.521 INFO:tasks.workunit.client.1.smithi052.stdout:8/811: chown d0/f5 163818 1 2023-12-05T13:25:27.521 INFO:tasks.workunit.client.1.smithi052.stdout:8/812: write d0/de/d27/f4e [7219317,31711] 0 2023-12-05T13:25:27.524 INFO:tasks.workunit.client.1.smithi052.stdout:8/813: stat d0/d28/f87 0 2023-12-05T13:25:27.530 INFO:tasks.workunit.client.1.smithi052.stdout:8/814: creat d0/de/d12/d29/db3/f10b x:0 0 0 2023-12-05T13:25:27.530 INFO:tasks.workunit.client.1.smithi052.stdout:8/815: getdents d0/d28/d2b/dcf 0 2023-12-05T13:25:27.530 INFO:tasks.workunit.client.1.smithi052.stdout:8/816: write d0/d28/f7c [1661750,588] 0 2023-12-05T13:25:27.547 INFO:tasks.workunit.client.1.smithi052.stdout:8/817: dwrite d0/de/d12/d29/db3/dc5/ff4 [0,4194304] 0 2023-12-05T13:25:27.548 INFO:tasks.workunit.client.1.smithi052.stdout:7/827: rename d7/d4e/d12/d3f/d75 to d7/d4e/d12/d3f/d46/d4d/d116 0 2023-12-05T13:25:27.550 INFO:tasks.workunit.client.1.smithi052.stdout:8/818: creat d0/d28/f10c x:0 0 0 2023-12-05T13:25:27.550 INFO:tasks.workunit.client.1.smithi052.stdout:7/828: dread d7/d4e/d12/d3f/d46/f4a [0,4194304] 0 2023-12-05T13:25:27.551 INFO:tasks.workunit.client.1.smithi052.stdout:8/819: mknod d0/d51/c10d 0 2023-12-05T13:25:27.551 INFO:tasks.workunit.client.1.smithi052.stdout:7/829: write d7/d4e/d12/d3f/d46/f4a [369000,108064] 0 2023-12-05T13:25:27.551 INFO:tasks.workunit.client.1.smithi052.stdout:7/830: dread - d7/d4e/d86/fd4 zero size 2023-12-05T13:25:27.553 INFO:tasks.workunit.client.1.smithi052.stdout:7/831: getdents d7/d4e/d45/d5a/d63/d95/dba 0 2023-12-05T13:25:27.556 INFO:tasks.workunit.client.1.smithi052.stdout:7/832: dread d7/d4e/d12/d3f/d46/dab/df6/f10c [0,4194304] 0 2023-12-05T13:25:27.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/833: write d7/d4e/f36 [2956887,105199] 0 2023-12-05T13:25:27.558 INFO:tasks.workunit.client.1.smithi052.stdout:7/834: chown d7/d4e/d45 163153748 1 2023-12-05T13:25:27.558 INFO:tasks.workunit.client.1.smithi052.stdout:6/578: creat d3/d5/d9/d21/fc8 x:0 0 0 2023-12-05T13:25:27.564 INFO:tasks.workunit.client.1.smithi052.stdout:8/820: dwrite d0/f5 [4194304,4194304] 0 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/579: stat d3/d5/d9/d21/d48/d4d/d81/ca6 0 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:7/835: creat d7/d4e/db4/f117 x:0 0 0 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:6/580: chown d3/d4/d6/d26 24 1 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:5/534: creat d5/faf x:0 0 0 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/764: rmdir de/d2b/d64 39 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:4/765: fsync fa 0 2023-12-05T13:25:27.569 INFO:tasks.workunit.client.1.smithi052.stdout:1/801: creat d5/d7/d35/d37/f100 x:0 0 0 2023-12-05T13:25:27.577 INFO:tasks.workunit.client.1.smithi052.stdout:8/821: creat d0/d4d/f10e x:0 0 0 2023-12-05T13:25:27.582 INFO:tasks.workunit.client.1.smithi052.stdout:1/802: dwrite d5/d7/d35/d37/d43/f90 [0,4194304] 0 2023-12-05T13:25:27.583 INFO:tasks.workunit.client.1.smithi052.stdout:4/766: creat de/d30/dac/dbb/ffe x:0 0 0 2023-12-05T13:25:27.584 INFO:tasks.workunit.client.1.smithi052.stdout:5/535: creat d5/df/d11/d73/d77/fb0 x:0 0 0 2023-12-05T13:25:27.584 INFO:tasks.workunit.client.1.smithi052.stdout:8/822: creat d0/de/d12/f10f x:0 0 0 2023-12-05T13:25:27.587 INFO:tasks.workunit.client.1.smithi052.stdout:0/722: unlink d0/db/d1b/d29/f91 0 2023-12-05T13:25:27.587 INFO:tasks.workunit.client.1.smithi052.stdout:0/723: fdatasync d0/db/d14/f4f 0 2023-12-05T13:25:27.589 INFO:tasks.workunit.client.1.smithi052.stdout:7/836: dwrite d7/d4e/db4/f100 [4194304,4194304] 0 2023-12-05T13:25:27.590 INFO:tasks.workunit.client.1.smithi052.stdout:5/536: link d5/df/d11/d73/d8b/f9b d5/df/d4e/da8/fb1 0 2023-12-05T13:25:27.591 INFO:tasks.workunit.client.1.smithi052.stdout:5/537: write d5/d46/d76/fa9 [574511,114500] 0 2023-12-05T13:25:27.591 INFO:tasks.workunit.client.1.smithi052.stdout:6/581: creat d3/d4/fc9 x:0 0 0 2023-12-05T13:25:27.591 INFO:tasks.workunit.client.1.smithi052.stdout:6/582: dread - d3/d5/d9/d21/d48/d4d/d81/d82/fa2 zero size 2023-12-05T13:25:27.592 INFO:tasks.workunit.client.1.smithi052.stdout:8/823: stat d0/d28/d39/l40 0 2023-12-05T13:25:27.592 INFO:tasks.workunit.client.1.smithi052.stdout:8/824: write d0/d28/d2b/fdb [869113,12970] 0 2023-12-05T13:25:27.592 INFO:tasks.workunit.client.1.smithi052.stdout:8/825: chown d0/d28/d2b/d53/d56 242 1 2023-12-05T13:25:27.593 INFO:tasks.workunit.client.1.smithi052.stdout:1/803: dread d5/d7/d35/f3d [0,4194304] 0 2023-12-05T13:25:27.593 INFO:tasks.workunit.client.1.smithi052.stdout:4/767: read de/d30/f8a [1975803,124677] 0 2023-12-05T13:25:27.593 INFO:tasks.workunit.client.1.smithi052.stdout:4/768: getdents de/d30/d68/df8 0 2023-12-05T13:25:27.594 INFO:tasks.workunit.client.1.smithi052.stdout:7/837: mkdir d7/dce/d10f/d118 0 2023-12-05T13:25:27.595 INFO:tasks.workunit.client.1.smithi052.stdout:5/538: mknod d5/df/d11/d66/cb2 0 2023-12-05T13:25:27.595 INFO:tasks.workunit.client.1.smithi052.stdout:5/539: fdatasync d5/d15/d21/d4a/d6e/f99 0 2023-12-05T13:25:27.596 INFO:tasks.workunit.client.1.smithi052.stdout:6/583: creat d3/d4/df/d27/fca x:0 0 0 2023-12-05T13:25:27.596 INFO:tasks.workunit.client.1.smithi052.stdout:6/584: readlink d3/d5/d9/d21/d48/d4d/d66/d91/la8 0 2023-12-05T13:25:27.598 INFO:tasks.workunit.client.1.smithi052.stdout:8/826: creat d0/d28/d2b/dcf/de6/f110 x:0 0 0 2023-12-05T13:25:27.599 INFO:tasks.workunit.client.1.smithi052.stdout:1/804: creat d5/d7/d35/d2f/d3e/d62/f101 x:0 0 0 2023-12-05T13:25:27.603 INFO:tasks.workunit.client.1.smithi052.stdout:7/838: truncate d7/d4e/d45/d5a/d63/f6d 57146 0 2023-12-05T13:25:27.603 INFO:tasks.workunit.client.1.smithi052.stdout:7/839: fdatasync d7/d4e/d12/d3f/fe5 0 2023-12-05T13:25:27.603 INFO:tasks.workunit.client.1.smithi052.stdout:7/840: dread - d7/d4e/d45/d5a/f84 zero size 2023-12-05T13:25:27.603 INFO:tasks.workunit.client.1.smithi052.stdout:6/585: rmdir d3/d4/df 39 2023-12-05T13:25:27.606 INFO:tasks.workunit.client.1.smithi052.stdout:8/827: write d0/d28/fc2 [709143,23901] 0 2023-12-05T13:25:27.611 INFO:tasks.workunit.client.1.smithi052.stdout:7/841: dread d7/d4e/d12/d7d/fea [0,4194304] 0 2023-12-05T13:25:27.612 INFO:tasks.workunit.client.1.smithi052.stdout:4/769: mknod de/d30/d73/dbe/d24/ddd/cff 0 2023-12-05T13:25:27.612 INFO:tasks.workunit.client.1.smithi052.stdout:6/586: creat d3/d4/df/fcb x:0 0 0 2023-12-05T13:25:27.612 INFO:tasks.workunit.client.1.smithi052.stdout:4/770: dread - de/d29/d51/da3/d6d/fcc zero size 2023-12-05T13:25:27.612 INFO:tasks.workunit.client.1.smithi052.stdout:4/771: truncate de/d30/d73/f9a 4701501 0 2023-12-05T13:25:27.612 INFO:tasks.workunit.client.1.smithi052.stdout:8/828: rename d0/d28/d39/d3a to d0/d28/d2b/d53/d56/d111 0 2023-12-05T13:25:27.612 INFO:tasks.workunit.client.1.smithi052.stdout:8/829: chown d0/dae/f103 53516857 1 2023-12-05T13:25:27.613 INFO:tasks.workunit.client.1.smithi052.stdout:4/772: write de/d30/d73/dbe/d24/f4e [4349310,20413] 0 2023-12-05T13:25:27.613 INFO:tasks.workunit.client.1.smithi052.stdout:4/773: chown de/d30/d68/f50 1149497 1 2023-12-05T13:25:27.613 INFO:tasks.workunit.client.1.smithi052.stdout:5/540: dwrite d5/d15/d21/d4a/d6e/f99 [0,4194304] 0 2023-12-05T13:25:27.614 INFO:tasks.workunit.client.1.smithi052.stdout:5/541: chown d5/d15/d21/d25/f6d 1440463 1 2023-12-05T13:25:27.615 INFO:tasks.workunit.client.1.smithi052.stdout:7/842: creat d7/d4e/d12/d3f/d46/dab/f119 x:0 0 0 2023-12-05T13:25:27.616 INFO:tasks.workunit.client.1.smithi052.stdout:6/587: symlink d3/d5/d9/d21/dc4/lcc 0 2023-12-05T13:25:27.618 INFO:tasks.workunit.client.1.smithi052.stdout:4/774: link de/d30/d68/d5c/faf de/d30/dac/dbb/f100 0 2023-12-05T13:25:27.618 INFO:tasks.workunit.client.1.smithi052.stdout:8/830: dread d0/d28/d39/fe1 [0,4194304] 0 2023-12-05T13:25:27.619 INFO:tasks.workunit.client.1.smithi052.stdout:4/775: write de/f18 [3415227,121271] 0 2023-12-05T13:25:27.619 INFO:tasks.workunit.client.1.smithi052.stdout:4/776: stat de 0 2023-12-05T13:25:27.620 INFO:tasks.workunit.client.1.smithi052.stdout:5/542: stat d5/df/d11/l3e 0 2023-12-05T13:25:27.620 INFO:tasks.workunit.client.1.smithi052.stdout:5/543: dread - d5/d15/d21/fa5 zero size 2023-12-05T13:25:27.621 INFO:tasks.workunit.client.1.smithi052.stdout:7/843: symlink d7/d2e/l11a 0 2023-12-05T13:25:27.624 INFO:tasks.workunit.client.1.smithi052.stdout:6/588: creat d3/d4/d6/d26/fcd x:0 0 0 2023-12-05T13:25:27.625 INFO:tasks.workunit.client.1.smithi052.stdout:8/831: symlink d0/d28/d2b/d53/d56/d111/d9f/l112 0 2023-12-05T13:25:27.625 INFO:tasks.workunit.client.1.smithi052.stdout:8/832: getdents d0/d28/d2b/dcf 0 2023-12-05T13:25:27.625 INFO:tasks.workunit.client.1.smithi052.stdout:8/833: dread - d0/d62/ffd zero size 2023-12-05T13:25:27.627 INFO:tasks.workunit.client.1.smithi052.stdout:4/777: creat de/d2b/d80/f101 x:0 0 0 2023-12-05T13:25:27.627 INFO:tasks.workunit.client.1.smithi052.stdout:4/778: readlink de/d30/d68/d5c/dcb/lf5 0 2023-12-05T13:25:27.627 INFO:tasks.workunit.client.1.smithi052.stdout:2/762: sync 2023-12-05T13:25:27.627 INFO:tasks.workunit.client.1.smithi052.stdout:3/797: sync 2023-12-05T13:25:27.627 INFO:tasks.workunit.client.1.smithi052.stdout:3/798: chown da/d25/d33/d49/f7e 87864828 1 2023-12-05T13:25:27.628 INFO:tasks.workunit.client.1.smithi052.stdout:3/799: readlink da/dd/d3d/le2 0 2023-12-05T13:25:27.628 INFO:tasks.workunit.client.1.smithi052.stdout:3/800: chown da/d25/d33/d49/c64 521504054 1 2023-12-05T13:25:27.629 INFO:tasks.workunit.client.1.smithi052.stdout:6/589: mkdir d3/d5/dce 0 2023-12-05T13:25:27.630 INFO:tasks.workunit.client.1.smithi052.stdout:6/590: write d3/f19 [3781370,74889] 0 2023-12-05T13:25:27.631 INFO:tasks.workunit.client.1.smithi052.stdout:8/834: creat d0/d28/d2b/d53/d56/d111/d8f/f113 x:0 0 0 2023-12-05T13:25:27.631 INFO:tasks.workunit.client.1.smithi052.stdout:8/835: fdatasync d0/fa 0 2023-12-05T13:25:27.632 INFO:tasks.workunit.client.1.smithi052.stdout:4/779: mkdir de/d30/d73/dbe/d24/ddd/d102 0 2023-12-05T13:25:27.637 INFO:tasks.workunit.client.1.smithi052.stdout:6/591: unlink d3/d5/f34 0 2023-12-05T13:25:27.637 INFO:tasks.workunit.client.1.smithi052.stdout:6/592: chown d3/d5/d9/d44 23 1 2023-12-05T13:25:27.637 INFO:tasks.workunit.client.1.smithi052.stdout:6/593: write d3/f3d [4652827,22680] 0 2023-12-05T13:25:27.637 INFO:tasks.workunit.client.1.smithi052.stdout:6/594: write d3/d5/d9/d52/f54 [2847212,97761] 0 2023-12-05T13:25:27.641 INFO:tasks.workunit.client.1.smithi052.stdout:8/836: unlink d0/d28/f8c 0 2023-12-05T13:25:27.644 INFO:tasks.workunit.client.1.smithi052.stdout:8/837: mkdir d0/d28/d114 0 2023-12-05T13:25:27.647 INFO:tasks.workunit.client.1.smithi052.stdout:3/801: dread da/f23 [0,4194304] 0 2023-12-05T13:25:27.647 INFO:tasks.workunit.client.1.smithi052.stdout:3/802: fsync da/d25/d33/d43/d5b/f67 0 2023-12-05T13:25:27.647 INFO:tasks.workunit.client.1.smithi052.stdout:4/780: dread de/d29/d51/d76/dc4/fc7 [0,4194304] 0 2023-12-05T13:25:27.648 INFO:tasks.workunit.client.1.smithi052.stdout:4/781: write de/d2b/d64/fe1 [153300,44568] 0 2023-12-05T13:25:27.649 INFO:tasks.workunit.client.1.smithi052.stdout:8/838: mknod d0/d28/d2b/d53/d56/d111/d8f/c115 0 2023-12-05T13:25:27.649 INFO:tasks.workunit.client.1.smithi052.stdout:8/839: fsync d0/de/d98/fba 0 2023-12-05T13:25:27.649 INFO:tasks.workunit.client.1.smithi052.stdout:0/724: write d0/db/d52/d7f/d8f/f99 [1046297,53849] 0 2023-12-05T13:25:27.650 INFO:tasks.workunit.client.1.smithi052.stdout:9/683: sync 2023-12-05T13:25:27.650 INFO:tasks.workunit.client.1.smithi052.stdout:0/725: write d0/db/d52/d7f/d8f/f99 [671752,9522] 0 2023-12-05T13:25:27.650 INFO:tasks.workunit.client.1.smithi052.stdout:3/803: mkdir da/d2e/d40/d109 0 2023-12-05T13:25:27.652 INFO:tasks.workunit.client.1.smithi052.stdout:2/763: dwrite d2/d13/d37/d5c/d80/db4/fd4 [0,4194304] 0 2023-12-05T13:25:27.654 INFO:tasks.workunit.client.1.smithi052.stdout:8/840: creat d0/de/d86/f116 x:0 0 0 2023-12-05T13:25:27.655 INFO:tasks.workunit.client.1.smithi052.stdout:0/726: rename d0/db/d1b/c6b to d0/db/d20/d9c/cf0 0 2023-12-05T13:25:27.655 INFO:tasks.workunit.client.1.smithi052.stdout:9/684: symlink d3/d92/da8/le8 0 2023-12-05T13:25:27.656 INFO:tasks.workunit.client.1.smithi052.stdout:0/727: write d0/db/d33/f70 [1585180,38705] 0 2023-12-05T13:25:27.656 INFO:tasks.workunit.client.1.smithi052.stdout:3/804: creat da/d27/dec/f10a x:0 0 0 2023-12-05T13:25:27.656 INFO:tasks.workunit.client.1.smithi052.stdout:3/805: chown da/d7a/lb8 7413 1 2023-12-05T13:25:27.659 INFO:tasks.workunit.client.1.smithi052.stdout:6/595: fsync d3/d4/df/fcb 0 2023-12-05T13:25:27.660 INFO:tasks.workunit.client.1.smithi052.stdout:2/764: link d2/d13/d37/d8b/fb9 d2/d4/d3f/d9d/fe1 0 2023-12-05T13:25:27.661 INFO:tasks.workunit.client.1.smithi052.stdout:8/841: mknod d0/de/d27/d43/d44/db9/c117 0 2023-12-05T13:25:27.661 INFO:tasks.workunit.client.1.smithi052.stdout:9/685: chown d3/d1e/d37/d4f/l74 2428 1 2023-12-05T13:25:27.666 INFO:tasks.workunit.client.1.smithi052.stdout:4/782: dwrite de/d30/d68/d5c/dcb/ffa [0,4194304] 0 2023-12-05T13:25:27.666 INFO:tasks.workunit.client.1.smithi052.stdout:4/783: write de/d2b/d64/fd3 [886512,73669] 0 2023-12-05T13:25:27.666 INFO:tasks.workunit.client.1.smithi052.stdout:4/784: write de/d2b/d64/d69/f9e [4210846,70584] 0 2023-12-05T13:25:27.666 INFO:tasks.workunit.client.1.smithi052.stdout:4/785: readlink de/d29/l40 0 2023-12-05T13:25:27.667 INFO:tasks.workunit.client.1.smithi052.stdout:3/806: mkdir da/d25/d33/d51/d10b 0 2023-12-05T13:25:27.668 INFO:tasks.workunit.client.1.smithi052.stdout:9/686: dread d3/d11/f48 [0,4194304] 0 2023-12-05T13:25:27.671 INFO:tasks.workunit.client.1.smithi052.stdout:6/596: mkdir d3/d5/d9/d21/d48/dcf 0 2023-12-05T13:25:27.671 INFO:tasks.workunit.client.1.smithi052.stdout:0/728: mkdir d0/db/d52/df1 0 2023-12-05T13:25:27.671 INFO:tasks.workunit.client.1.smithi052.stdout:6/597: chown d3/d4/d6/d26/c28 7 1 2023-12-05T13:25:27.671 INFO:tasks.workunit.client.1.smithi052.stdout:0/729: readlink d0/db/l18 0 2023-12-05T13:25:27.676 INFO:tasks.workunit.client.1.smithi052.stdout:2/765: dread d2/d13/d37/d5c/f74 [8388608,4194304] 0 2023-12-05T13:25:27.676 INFO:tasks.workunit.client.1.smithi052.stdout:3/807: creat da/d2e/d40/d109/f10c x:0 0 0 2023-12-05T13:25:27.678 INFO:tasks.workunit.client.1.smithi052.stdout:9/687: rmdir d3/d92/de1 0 2023-12-05T13:25:27.678 INFO:tasks.workunit.client.1.smithi052.stdout:9/688: truncate d3/d1e/d37/d4f/f54 5073076 0 2023-12-05T13:25:27.678 INFO:tasks.workunit.client.1.smithi052.stdout:9/689: write d3/d5e/d9e/fb5 [618633,122589] 0 2023-12-05T13:25:27.679 INFO:tasks.workunit.client.1.smithi052.stdout:0/730: mknod d0/db/d1b/d29/db0/cf2 0 2023-12-05T13:25:27.679 INFO:tasks.workunit.client.1.smithi052.stdout:0/731: fdatasync d0/dcb/f67 0 2023-12-05T13:25:27.681 INFO:tasks.workunit.client.1.smithi052.stdout:2/766: mkdir d2/d13/d37/d5c/d80/dc4/de2 0 2023-12-05T13:25:27.682 INFO:tasks.workunit.client.1.smithi052.stdout:0/732: write d0/db/d52/f7d [8727603,72232] 0 2023-12-05T13:25:27.684 INFO:tasks.workunit.client.1.smithi052.stdout:3/808: mknod da/d25/dcd/c10d 0 2023-12-05T13:25:27.684 INFO:tasks.workunit.client.1.smithi052.stdout:9/690: stat d3/d11/d19/d83/lb9 0 2023-12-05T13:25:27.684 INFO:tasks.workunit.client.1.smithi052.stdout:9/691: fdatasync d3/d11/d19/d83/fb7 0 2023-12-05T13:25:27.684 INFO:tasks.workunit.client.1.smithi052.stdout:3/809: write da/dd/d3d/f76 [845709,4008] 0 2023-12-05T13:25:27.686 INFO:tasks.workunit.client.1.smithi052.stdout:8/842: dwrite d0/f95 [0,4194304] 0 2023-12-05T13:25:27.690 INFO:tasks.workunit.client.1.smithi052.stdout:0/733: unlink d0/f6 0 2023-12-05T13:25:27.690 INFO:tasks.workunit.client.1.smithi052.stdout:0/734: write d0/db/d52/d7f/f98 [4411445,52176] 0 2023-12-05T13:25:27.691 INFO:tasks.workunit.client.1.smithi052.stdout:4/786: dwrite de/d30/d73/f9a [0,4194304] 0 2023-12-05T13:25:27.692 INFO:tasks.workunit.client.1.smithi052.stdout:0/735: write d0/db/d20/fbd [1369271,62029] 0 2023-12-05T13:25:27.694 INFO:tasks.workunit.client.1.smithi052.stdout:8/843: creat d0/d28/d39/f118 x:0 0 0 2023-12-05T13:25:27.695 INFO:tasks.workunit.client.1.smithi052.stdout:8/844: write d0/de/f2f [4075336,51340] 0 2023-12-05T13:25:27.697 INFO:tasks.workunit.client.1.smithi052.stdout:4/787: creat de/d30/d73/dbe/d24/f103 x:0 0 0 2023-12-05T13:25:27.697 INFO:tasks.workunit.client.1.smithi052.stdout:4/788: chown de/d29/d51/da3/c9d 42945 1 2023-12-05T13:25:27.698 INFO:tasks.workunit.client.1.smithi052.stdout:9/692: dread d3/d11/d19/f2e [0,4194304] 0 2023-12-05T13:25:27.698 INFO:tasks.workunit.client.1.smithi052.stdout:9/693: write d3/d5e/d9e/fe3 [542512,108794] 0 2023-12-05T13:25:27.699 INFO:tasks.workunit.client.1.smithi052.stdout:0/736: creat d0/db/d1b/d7a/d8b/ff3 x:0 0 0 2023-12-05T13:25:27.706 INFO:tasks.workunit.client.1.smithi052.stdout:4/789: dread de/f14 [0,4194304] 0 2023-12-05T13:25:27.707 INFO:tasks.workunit.client.1.smithi052.stdout:8/845: rename d0/de/d27/d43/d44/l7d to d0/d28/d2b/d53/d56/d111/d4f/db5/dc0/l119 0 2023-12-05T13:25:27.708 INFO:tasks.workunit.client.1.smithi052.stdout:9/694: truncate d3/d5e/fdd 2407842 0 2023-12-05T13:25:27.709 INFO:tasks.workunit.client.1.smithi052.stdout:6/598: dwrite d3/d5/d9/d21/d48/d4d/d81/d82/fa2 [0,4194304] 0 2023-12-05T13:25:27.710 INFO:tasks.workunit.client.1.smithi052.stdout:6/599: read d3/d4/df/d24/f4f [1871699,28534] 0 2023-12-05T13:25:27.711 INFO:tasks.workunit.client.1.smithi052.stdout:2/767: dwrite d2/f2f [4194304,4194304] 0 2023-12-05T13:25:27.711 INFO:tasks.workunit.client.1.smithi052.stdout:4/790: rename de/d30/d68/d5c/dcb/ffd to de/d30/d73/dbe/d24/ddd/d102/f104 0 2023-12-05T13:25:27.712 INFO:tasks.workunit.client.1.smithi052.stdout:4/791: readlink de/d30/d68/d5c/db8/lf9 0 2023-12-05T13:25:27.712 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:27 smithi029 ceph-mon[112128]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2023-12-05T13:25:27.712 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:27 smithi029 ceph-mon[112128]: mgrmap e24: smithi052.ocazcp(active, since 4s) 2023-12-05T13:25:27.713 INFO:tasks.workunit.client.1.smithi052.stdout:9/695: mkdir d3/d1e/d41/d57/de9 0 2023-12-05T13:25:27.717 INFO:tasks.workunit.client.1.smithi052.stdout:0/737: mknod d0/cf4 0 2023-12-05T13:25:27.719 INFO:tasks.workunit.client.1.smithi052.stdout:8/846: link d0/d28/d2b/d53/d56/d111/d8f/lfa d0/d28/db0/l11a 0 2023-12-05T13:25:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:27 smithi052 ceph-mon[121072]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2023-12-05T13:25:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:27 smithi052 ceph-mon[121072]: mgrmap e24: smithi052.ocazcp(active, since 4s) 2023-12-05T13:25:27.724 INFO:tasks.workunit.client.1.smithi052.stdout:2/768: symlink d2/d13/d37/d5c/d80/dc4/de2/le3 0 2023-12-05T13:25:27.725 INFO:tasks.workunit.client.1.smithi052.stdout:4/792: creat de/d2b/d80/f105 x:0 0 0 2023-12-05T13:25:27.727 INFO:tasks.workunit.client.1.smithi052.stdout:9/696: link d3/d2a/f59 d3/d1e/d62/fea 0 2023-12-05T13:25:27.727 INFO:tasks.workunit.client.1.smithi052.stdout:9/697: dread - d3/d1e/d41/d86/fa1 zero size 2023-12-05T13:25:27.727 INFO:tasks.workunit.client.1.smithi052.stdout:8/847: dread d0/de/d27/f92 [0,4194304] 0 2023-12-05T13:25:27.727 INFO:tasks.workunit.client.1.smithi052.stdout:8/848: write d0/de/d98/d9c/f106 [770031,84801] 0 2023-12-05T13:25:27.728 INFO:tasks.workunit.client.1.smithi052.stdout:0/738: link d0/db/d20/d50/dae/cc7 d0/db/d20/d9c/cf5 0 2023-12-05T13:25:27.728 INFO:tasks.workunit.client.1.smithi052.stdout:0/739: dread - d0/db/d14/fd1 zero size 2023-12-05T13:25:27.729 INFO:tasks.workunit.client.1.smithi052.stdout:6/600: mknod d3/d4/d36/cd0 0 2023-12-05T13:25:27.729 INFO:tasks.workunit.client.1.smithi052.stdout:6/601: chown d3/d4/c18 0 1 2023-12-05T13:25:27.729 INFO:tasks.workunit.client.1.smithi052.stdout:6/602: chown d3/d5 2208264 1 2023-12-05T13:25:27.732 INFO:tasks.workunit.client.1.smithi052.stdout:6/603: link d3/d5/d9/d21/d48/d4d/d66/d74/l8c d3/d4/d6/d26/d6d/ld1 0 2023-12-05T13:25:27.733 INFO:tasks.workunit.client.1.smithi052.stdout:8/849: mknod d0/d28/c11b 0 2023-12-05T13:25:27.738 INFO:tasks.workunit.client.1.smithi052.stdout:6/604: unlink d3/d5/d58/f9f 0 2023-12-05T13:25:27.738 INFO:tasks.workunit.client.1.smithi052.stdout:0/740: dread d0/db/d20/f5a [0,4194304] 0 2023-12-05T13:25:27.738 INFO:tasks.workunit.client.1.smithi052.stdout:0/741: write d0/db/d52/d7f/fce [4992506,129361] 0 2023-12-05T13:25:27.738 INFO:tasks.workunit.client.1.smithi052.stdout:8/850: mknod d0/de/d12/d29/db3/dc5/c11c 0 2023-12-05T13:25:27.738 INFO:tasks.workunit.client.1.smithi052.stdout:6/605: unlink d3/d4/d36/d6f/l8d 0 2023-12-05T13:25:27.739 INFO:tasks.workunit.client.1.smithi052.stdout:9/698: dwrite d3/d1e/d41/d57/fb3 [0,4194304] 0 2023-12-05T13:25:27.740 INFO:tasks.workunit.client.1.smithi052.stdout:9/699: write d3/d1e/d37/d4f/f7d [338626,62378] 0 2023-12-05T13:25:27.740 INFO:tasks.workunit.client.1.smithi052.stdout:0/742: link d0/db/d1b/d29/db0/l78 d0/db/d1b/d7a/lf6 0 2023-12-05T13:25:27.740 INFO:tasks.workunit.client.1.smithi052.stdout:0/743: chown d0/db/d2e/d53/d80 693927 1 2023-12-05T13:25:27.749 INFO:tasks.workunit.client.1.smithi052.stdout:9/700: creat d3/d31/feb x:0 0 0 2023-12-05T13:25:27.750 INFO:tasks.workunit.client.1.smithi052.stdout:0/744: mknod d0/db/d1b/d29/dba/cf7 0 2023-12-05T13:25:27.750 INFO:tasks.workunit.client.1.smithi052.stdout:0/745: fdatasync d0/db/d20/fbd 0 2023-12-05T13:25:27.752 INFO:tasks.workunit.client.1.smithi052.stdout:6/606: unlink d3/d4/d36/c3b 0 2023-12-05T13:25:27.754 INFO:tasks.workunit.client.1.smithi052.stdout:8/851: dwrite d0/de/f35 [0,4194304] 0 2023-12-05T13:25:27.754 INFO:tasks.workunit.client.1.smithi052.stdout:8/852: readlink d0/de/d12/d29/db3/dc5/ld9 0 2023-12-05T13:25:27.754 INFO:tasks.workunit.client.1.smithi052.stdout:8/853: fdatasync d0/dae/f103 0 2023-12-05T13:25:27.754 INFO:tasks.workunit.client.1.smithi052.stdout:8/854: dread - d0/de/d27/d43/d44/db9/fbd zero size 2023-12-05T13:25:27.754 INFO:tasks.workunit.client.1.smithi052.stdout:8/855: write d0/d28/d2b/d53/d56/d111/d9f/f9a [823342,23680] 0 2023-12-05T13:25:27.754 INFO:tasks.workunit.client.1.smithi052.stdout:9/701: creat d3/d1e/d37/fec x:0 0 0 2023-12-05T13:25:27.756 INFO:tasks.workunit.client.1.smithi052.stdout:0/746: mknod d0/db/d52/d7f/d8f/cf8 0 2023-12-05T13:25:27.758 INFO:tasks.workunit.client.1.smithi052.stdout:6/607: creat d3/d5/d9/d21/d48/d4d/d66/d74/fd2 x:0 0 0 2023-12-05T13:25:27.760 INFO:tasks.workunit.client.1.smithi052.stdout:8/856: unlink d0/dae/cd0 0 2023-12-05T13:25:27.761 INFO:tasks.workunit.client.1.smithi052.stdout:9/702: creat d3/d5e/da7/daf/dbe/fed x:0 0 0 2023-12-05T13:25:27.762 INFO:tasks.workunit.client.1.smithi052.stdout:6/608: symlink d3/d5/ld3 0 2023-12-05T13:25:27.764 INFO:tasks.workunit.client.1.smithi052.stdout:9/703: symlink d3/d11/lee 0 2023-12-05T13:25:27.766 INFO:tasks.workunit.client.1.smithi052.stdout:6/609: unlink d3/d4/d6/f7 0 2023-12-05T13:25:27.767 INFO:tasks.workunit.client.1.smithi052.stdout:8/857: mknod d0/d28/c11d 0 2023-12-05T13:25:27.768 INFO:tasks.workunit.client.1.smithi052.stdout:6/610: mknod d3/d5/d9/d21/d48/d4d/d66/cd4 0 2023-12-05T13:25:27.768 INFO:tasks.workunit.client.1.smithi052.stdout:6/611: stat d3/d5/c65 0 2023-12-05T13:25:27.771 INFO:tasks.workunit.client.1.smithi052.stdout:9/704: dread d3/d11/f42 [0,4194304] 0 2023-12-05T13:25:27.771 INFO:tasks.workunit.client.1.smithi052.stdout:6/612: rmdir d3/d5/dce 0 2023-12-05T13:25:27.772 INFO:tasks.workunit.client.1.smithi052.stdout:8/858: truncate d0/f95 2756927 0 2023-12-05T13:25:27.772 INFO:tasks.workunit.client.1.smithi052.stdout:8/859: chown d0/d4d/f10e 744576 1 2023-12-05T13:25:27.772 INFO:tasks.workunit.client.1.smithi052.stdout:8/860: rename d0 to d0/d28/d2b/dcf/de6/d11e 22 2023-12-05T13:25:27.773 INFO:tasks.workunit.client.1.smithi052.stdout:9/705: getdents d3/d5e 0 2023-12-05T13:25:27.773 INFO:tasks.workunit.client.1.smithi052.stdout:9/706: fsync d3/d1e/d37/d4f/f52 0 2023-12-05T13:25:27.774 INFO:tasks.workunit.client.1.smithi052.stdout:6/613: creat d3/d5/fd5 x:0 0 0 2023-12-05T13:25:27.775 INFO:tasks.workunit.client.1.smithi052.stdout:9/707: dread d3/d5e/d9e/fb5 [0,4194304] 0 2023-12-05T13:25:27.775 INFO:tasks.workunit.client.1.smithi052.stdout:8/861: symlink d0/d28/d2b/dcf/l11f 0 2023-12-05T13:25:27.777 INFO:tasks.workunit.client.1.smithi052.stdout:6/614: creat d3/d5/d9/d21/d48/d4d/d66/d74/fd6 x:0 0 0 2023-12-05T13:25:27.777 INFO:tasks.workunit.client.1.smithi052.stdout:6/615: write d3/d5/d9/d21/d48/d5b/fc1 [1041708,124651] 0 2023-12-05T13:25:27.778 INFO:tasks.workunit.client.1.smithi052.stdout:9/708: mkdir d3/d5e/da7/daf/def 0 2023-12-05T13:25:27.779 INFO:tasks.workunit.client.1.smithi052.stdout:8/862: truncate d0/d28/d2b/d53/fbb 526243 0 2023-12-05T13:25:27.780 INFO:tasks.workunit.client.1.smithi052.stdout:6/616: mknod d3/d5/d9/d21/d48/d4d/d81/cd7 0 2023-12-05T13:25:27.781 INFO:tasks.workunit.client.1.smithi052.stdout:8/863: creat d0/d4d/f120 x:0 0 0 2023-12-05T13:25:27.782 INFO:tasks.workunit.client.1.smithi052.stdout:8/864: getdents d0/de/d86 0 2023-12-05T13:25:27.784 INFO:tasks.workunit.client.1.smithi052.stdout:8/865: creat d0/d28/d2b/d53/d56/d111/d8f/f121 x:0 0 0 2023-12-05T13:25:27.788 INFO:tasks.workunit.client.1.smithi052.stdout:8/866: symlink d0/d62/l122 0 2023-12-05T13:25:27.788 INFO:tasks.workunit.client.1.smithi052.stdout:8/867: fdatasync d0/dae/fb1 0 2023-12-05T13:25:27.788 INFO:tasks.workunit.client.1.smithi052.stdout:8/868: fdatasync d0/dae/f103 0 2023-12-05T13:25:27.788 INFO:tasks.workunit.client.1.smithi052.stdout:8/869: dread - d0/de/d12/d29/db3/dc5/fff zero size 2023-12-05T13:25:27.789 INFO:tasks.workunit.client.1.smithi052.stdout:8/870: unlink d0/d51/c10d 0 2023-12-05T13:25:27.791 INFO:tasks.workunit.client.1.smithi052.stdout:8/871: mknod d0/dae/c123 0 2023-12-05T13:25:27.794 INFO:tasks.workunit.client.1.smithi052.stdout:9/709: dwrite d3/d2a/f4e [0,4194304] 0 2023-12-05T13:25:27.795 INFO:tasks.workunit.client.1.smithi052.stdout:9/710: creat d3/d1e/d62/dbd/ff0 x:0 0 0 2023-12-05T13:25:27.800 INFO:tasks.workunit.client.1.smithi052.stdout:9/711: creat d3/d5e/d9e/dd4/ff1 x:0 0 0 2023-12-05T13:25:27.800 INFO:tasks.workunit.client.1.smithi052.stdout:9/712: write d3/d5e/f76 [3178400,84845] 0 2023-12-05T13:25:27.801 INFO:tasks.workunit.client.1.smithi052.stdout:9/713: chown d3/d31/c4b 2312743 1 2023-12-05T13:25:27.802 INFO:tasks.workunit.client.1.smithi052.stdout:9/714: write d3/d1e/d41/d57/fde [3540285,41765] 0 2023-12-05T13:25:27.803 INFO:tasks.workunit.client.1.smithi052.stdout:9/715: symlink d3/d11/lf2 0 2023-12-05T13:25:27.803 INFO:tasks.workunit.client.1.smithi052.stdout:9/716: readlink d3/le 0 2023-12-05T13:25:27.805 INFO:tasks.workunit.client.1.smithi052.stdout:9/717: symlink d3/d1e/d41/lf3 0 2023-12-05T13:25:27.806 INFO:tasks.workunit.client.1.smithi052.stdout:9/718: creat d3/d1e/d37/ff4 x:0 0 0 2023-12-05T13:25:27.808 INFO:tasks.workunit.client.1.smithi052.stdout:9/719: link d3/d11/d3e/f4c d3/d2a/ff5 0 2023-12-05T13:25:27.814 INFO:tasks.workunit.client.1.smithi052.stdout:1/805: sync 2023-12-05T13:25:27.816 INFO:tasks.workunit.client.1.smithi052.stdout:1/806: symlink d5/d26/d41/l102 0 2023-12-05T13:25:27.816 INFO:tasks.workunit.client.1.smithi052.stdout:1/807: readlink d5/d26/d41/l8a 0 2023-12-05T13:25:27.817 INFO:tasks.workunit.client.1.smithi052.stdout:1/808: write d5/daa/d17/d3c/fb4 [2432529,26635] 0 2023-12-05T13:25:27.827 INFO:tasks.workunit.client.1.smithi052.stdout:1/809: dread d5/d7/d35/d2f/d3e/f58 [0,4194304] 0 2023-12-05T13:25:27.829 INFO:tasks.workunit.client.1.smithi052.stdout:1/810: write d5/daa/d79/faf [781355,35749] 0 2023-12-05T13:25:27.829 INFO:tasks.workunit.client.1.smithi052.stdout:1/811: stat d5/d26/d41/deb 0 2023-12-05T13:25:27.831 INFO:tasks.workunit.client.1.smithi052.stdout:1/812: truncate d5/daa/f55 469964 0 2023-12-05T13:25:27.833 INFO:tasks.workunit.client.1.smithi052.stdout:1/813: rename d5/d26/ldc to d5/d7/d35/d2f/d3e/d62/l103 0 2023-12-05T13:25:27.834 INFO:tasks.workunit.client.1.smithi052.stdout:9/720: dwrite d3/f26 [4194304,4194304] 0 2023-12-05T13:25:27.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/814: creat d5/d26/f104 x:0 0 0 2023-12-05T13:25:27.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/815: dread - d5/d26/de5/fee zero size 2023-12-05T13:25:27.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/816: write d5/daa/d17/d3c/f80 [580107,113286] 0 2023-12-05T13:25:27.836 INFO:tasks.workunit.client.1.smithi052.stdout:9/721: dread d3/d11/f33 [0,4194304] 0 2023-12-05T13:25:27.837 INFO:tasks.workunit.client.1.smithi052.stdout:1/817: creat d5/d26/dbf/f105 x:0 0 0 2023-12-05T13:25:27.838 INFO:tasks.workunit.client.1.smithi052.stdout:9/722: getdents d3/d5e/d9e 0 2023-12-05T13:25:27.838 INFO:tasks.workunit.client.1.smithi052.stdout:9/723: dread - d3/d1e/d37/fec zero size 2023-12-05T13:25:27.839 INFO:tasks.workunit.client.1.smithi052.stdout:9/724: write d3/d31/f45 [3761839,112457] 0 2023-12-05T13:25:27.839 INFO:tasks.workunit.client.1.smithi052.stdout:9/725: dread - d3/d11/d96/fac zero size 2023-12-05T13:25:27.840 INFO:tasks.workunit.client.1.smithi052.stdout:1/818: mkdir d5/daa/da4/d106 0 2023-12-05T13:25:27.840 INFO:tasks.workunit.client.1.smithi052.stdout:5/544: sync 2023-12-05T13:25:27.840 INFO:tasks.workunit.client.1.smithi052.stdout:7/844: sync 2023-12-05T13:25:27.841 INFO:tasks.workunit.client.1.smithi052.stdout:3/810: sync 2023-12-05T13:25:27.841 INFO:tasks.workunit.client.1.smithi052.stdout:3/811: chown da/d25/d33/d89/dae/cc0 383 1 2023-12-05T13:25:27.841 INFO:tasks.workunit.client.1.smithi052.stdout:3/812: chown da/d25/d33/d43/d5b/da6/de7 178590856 1 2023-12-05T13:25:27.841 INFO:tasks.workunit.client.1.smithi052.stdout:3/813: write da/d25/f6f [947143,63909] 0 2023-12-05T13:25:27.841 INFO:tasks.workunit.client.1.smithi052.stdout:9/726: link d3/d5e/l8e d3/lf6 0 2023-12-05T13:25:27.845 INFO:tasks.workunit.client.1.smithi052.stdout:1/819: creat d5/d26/d75/d7a/dad/f107 x:0 0 0 2023-12-05T13:25:27.852 INFO:tasks.workunit.client.1.smithi052.stdout:3/814: dread da/d25/d33/d49/fd5 [0,4194304] 0 2023-12-05T13:25:27.853 INFO:tasks.workunit.client.1.smithi052.stdout:1/820: rename d5/d26/da3/fb9 to d5/d7/df1/f108 0 2023-12-05T13:25:27.853 INFO:tasks.workunit.client.1.smithi052.stdout:3/815: chown da/d48/ld9 466595 1 2023-12-05T13:25:27.853 INFO:tasks.workunit.client.1.smithi052.stdout:7/845: dread d7/d4e/d12/d3f/d46/f47 [4194304,4194304] 0 2023-12-05T13:25:27.853 INFO:tasks.workunit.client.1.smithi052.stdout:5/545: dread d5/d15/d21/d4a/d6e/f99 [0,4194304] 0 2023-12-05T13:25:27.853 INFO:tasks.workunit.client.1.smithi052.stdout:3/816: write da/d25/d33/d89/dae/faf [900267,64863] 0 2023-12-05T13:25:27.862 INFO:tasks.workunit.client.1.smithi052.stdout:9/727: dwrite d3/d5e/d9e/fbf [4194304,4194304] 0 2023-12-05T13:25:27.868 INFO:tasks.workunit.client.1.smithi052.stdout:5/546: dread d5/f79 [0,4194304] 0 2023-12-05T13:25:27.868 INFO:tasks.workunit.client.1.smithi052.stdout:5/547: write d5/df/d4b/f95 [7774,99614] 0 2023-12-05T13:25:27.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/728: dread d3/d1e/d37/d4f/f52 [0,4194304] 0 2023-12-05T13:25:27.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/729: write d3/d1e/d37/d4f/fa0 [474624,52741] 0 2023-12-05T13:25:27.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/730: chown d3/d1e/d41/lf3 55785493 1 2023-12-05T13:25:27.869 INFO:tasks.workunit.client.1.smithi052.stdout:5/548: creat d5/df/d4e/da4/fb3 x:0 0 0 2023-12-05T13:25:27.870 INFO:tasks.workunit.client.1.smithi052.stdout:1/821: dread d5/d7/d35/d37/d5a/d73/f84 [0,4194304] 0 2023-12-05T13:25:27.870 INFO:tasks.workunit.client.1.smithi052.stdout:9/731: creat d3/d5e/ff7 x:0 0 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:1/822: write d5/d7/d35/d37/d5a/d73/d76/fc1 [652516,47092] 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:3/817: write da/fe [354914,42499] 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/846: dwrite d7/d4e/f36 [0,4194304] 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/847: readlink d7/d4e/d86/l90 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:7/848: truncate d7/d4e/d45/d5a/dfe/f115 81365 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:5/549: dread d5/df/d4e/d65/f72 [0,4194304] 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:9/732: symlink d3/d2a/d5c/lf8 0 2023-12-05T13:25:27.871 INFO:tasks.workunit.client.1.smithi052.stdout:1/823: truncate d5/d7/d35/d37/d43/f90 3906311 0 2023-12-05T13:25:27.873 INFO:tasks.workunit.client.1.smithi052.stdout:3/818: symlink da/d25/d33/d51/d10b/l10e 0 2023-12-05T13:25:27.880 INFO:tasks.workunit.client.1.smithi052.stdout:7/849: dread d7/d31/f3e [0,4194304] 0 2023-12-05T13:25:27.881 INFO:tasks.workunit.client.1.smithi052.stdout:7/850: write d7/d4e/d12/d3f/d46/f4a [842513,111033] 0 2023-12-05T13:25:27.882 INFO:tasks.workunit.client.1.smithi052.stdout:5/550: getdents d5/df/d11/d73/d8b 0 2023-12-05T13:25:27.882 INFO:tasks.workunit.client.1.smithi052.stdout:5/551: dread - d5/df/d8d/f8e zero size 2023-12-05T13:25:27.883 INFO:tasks.workunit.client.1.smithi052.stdout:9/733: creat d3/d92/da8/ff9 x:0 0 0 2023-12-05T13:25:27.884 INFO:tasks.workunit.client.1.smithi052.stdout:1/824: mknod d5/d26/d41/dfe/c109 0 2023-12-05T13:25:27.884 INFO:tasks.workunit.client.1.smithi052.stdout:1/825: dread - d5/d7/de/d74/fb6 zero size 2023-12-05T13:25:27.884 INFO:tasks.workunit.client.1.smithi052.stdout:1/826: chown d5/d7/d35/d2f/d3e/d62/d85/fab 855498 1 2023-12-05T13:25:27.886 INFO:tasks.workunit.client.1.smithi052.stdout:7/851: mkdir d7/dce/d11b 0 2023-12-05T13:25:27.888 INFO:tasks.workunit.client.1.smithi052.stdout:7/852: write d7/d4e/d12/d3f/f7f [4070229,36818] 0 2023-12-05T13:25:27.888 INFO:tasks.workunit.client.1.smithi052.stdout:7/853: fdatasync d7/d4e/d45/d5a/d63/d95/fbd 0 2023-12-05T13:25:27.888 INFO:tasks.workunit.client.1.smithi052.stdout:5/552: rename d5/d15/c1d to d5/d15/cb4 0 2023-12-05T13:25:27.889 INFO:tasks.workunit.client.1.smithi052.stdout:1/827: unlink d5/d7/d35/d37/d5a/d73/c86 0 2023-12-05T13:25:27.889 INFO:tasks.workunit.client.1.smithi052.stdout:0/747: sync 2023-12-05T13:25:27.889 INFO:tasks.workunit.client.1.smithi052.stdout:2/769: sync 2023-12-05T13:25:27.890 INFO:tasks.workunit.client.1.smithi052.stdout:4/793: sync 2023-12-05T13:25:27.890 INFO:tasks.workunit.client.1.smithi052.stdout:0/748: readlink d0/db/d1b/d29/dba/lc5 0 2023-12-05T13:25:27.891 INFO:tasks.workunit.client.1.smithi052.stdout:7/854: creat d7/d4e/d12/d3f/d46/dab/f11c x:0 0 0 2023-12-05T13:25:27.892 INFO:tasks.workunit.client.1.smithi052.stdout:5/553: creat d5/d15/d21/d4a/d6e/d91/fb5 x:0 0 0 2023-12-05T13:25:27.892 INFO:tasks.workunit.client.1.smithi052.stdout:1/828: mkdir d5/d26/dbf/dfd/d10a 0 2023-12-05T13:25:27.893 INFO:tasks.workunit.client.1.smithi052.stdout:1/829: chown d5/daa/d17/f39 38802 1 2023-12-05T13:25:27.893 INFO:tasks.workunit.client.1.smithi052.stdout:2/770: mknod d2/d13/d37/d5c/da9/ce4 0 2023-12-05T13:25:27.895 INFO:tasks.workunit.client.1.smithi052.stdout:0/749: rename d0/db/d2e/d53/d80 to d0/db/d2e/d53/df9 0 2023-12-05T13:25:27.895 INFO:tasks.workunit.client.1.smithi052.stdout:4/794: getdents de/d29/d51/da3/d6d/df2 0 2023-12-05T13:25:27.896 INFO:tasks.workunit.client.1.smithi052.stdout:7/855: mknod d7/dce/c11d 0 2023-12-05T13:25:27.898 INFO:tasks.workunit.client.1.smithi052.stdout:2/771: truncate d2/d13/d37/d8b/fcf 347304 0 2023-12-05T13:25:27.898 INFO:tasks.workunit.client.1.smithi052.stdout:2/772: readlink d2/d13/d1e/d6a/d7f/d84/d3a/l44 0 2023-12-05T13:25:27.898 INFO:tasks.workunit.client.1.smithi052.stdout:7/856: dread d7/d4e/d45/d5a/d16/fd9 [0,4194304] 0 2023-12-05T13:25:27.899 INFO:tasks.workunit.client.1.smithi052.stdout:4/795: creat de/d30/d68/d5c/db8/f106 x:0 0 0 2023-12-05T13:25:27.901 INFO:tasks.workunit.client.1.smithi052.stdout:7/857: unlink d7/d4e/d45/d5a/d16/fd9 0 2023-12-05T13:25:27.901 INFO:tasks.workunit.client.1.smithi052.stdout:7/858: chown d7/d4e/d12/d3f/d46/dab/df6/f109 403 1 2023-12-05T13:25:27.902 INFO:tasks.workunit.client.1.smithi052.stdout:4/796: truncate de/d30/d94/fdb 506316 0 2023-12-05T13:25:27.902 INFO:tasks.workunit.client.1.smithi052.stdout:4/797: chown de/d30/d68/d5c/ff7 30262 1 2023-12-05T13:25:27.905 INFO:tasks.workunit.client.1.smithi052.stdout:0/750: read d0/db/d1b/d51/d55/f7c [1523508,13769] 0 2023-12-05T13:25:27.906 INFO:tasks.workunit.client.1.smithi052.stdout:4/798: symlink de/d29/l107 0 2023-12-05T13:25:27.906 INFO:tasks.workunit.client.1.smithi052.stdout:4/799: fdatasync de/d30/d73/f9a 0 2023-12-05T13:25:27.907 INFO:tasks.workunit.client.1.smithi052.stdout:5/554: dread d5/df/d11/d73/f93 [0,4194304] 0 2023-12-05T13:25:27.907 INFO:tasks.workunit.client.1.smithi052.stdout:5/555: dread - d5/faf zero size 2023-12-05T13:25:27.907 INFO:tasks.workunit.client.1.smithi052.stdout:7/859: rename d7/d4e/d45/d98 to d7/dce/d10f/d11e 0 2023-12-05T13:25:27.909 INFO:tasks.workunit.client.1.smithi052.stdout:7/860: read d7/d4e/f5c [8287805,60371] 0 2023-12-05T13:25:27.910 INFO:tasks.workunit.client.1.smithi052.stdout:5/556: link d5/d46/d76/c7e d5/df/d4b/cb6 0 2023-12-05T13:25:27.911 INFO:tasks.workunit.client.1.smithi052.stdout:4/800: rename de/d2b/d64/cb1 to de/d29/c108 0 2023-12-05T13:25:27.911 INFO:tasks.workunit.client.1.smithi052.stdout:0/751: link d0/db/d14/d9b/fc8 d0/db/d2e/d7e/dcc/dee/ffa 0 2023-12-05T13:25:27.911 INFO:tasks.workunit.client.1.smithi052.stdout:0/752: chown d0/db/d2e/d53/cab 3649 1 2023-12-05T13:25:27.912 INFO:tasks.workunit.client.1.smithi052.stdout:7/861: mkdir d7/d4e/d12/d3f/d46/d4d/d11f 0 2023-12-05T13:25:27.912 INFO:tasks.workunit.client.1.smithi052.stdout:7/862: write d7/d4e/d45/d5a/fe0 [1488888,7846] 0 2023-12-05T13:25:27.914 INFO:tasks.workunit.client.1.smithi052.stdout:4/801: write de/d29/d51/fb6 [1615082,16984] 0 2023-12-05T13:25:27.915 INFO:tasks.workunit.client.1.smithi052.stdout:4/802: chown de/fde 223854841 1 2023-12-05T13:25:27.915 INFO:tasks.workunit.client.1.smithi052.stdout:5/557: getdents d5/df/d11/d66 0 2023-12-05T13:25:27.915 INFO:tasks.workunit.client.1.smithi052.stdout:7/863: mkdir d7/d4e/d12/d3f/d46/d4d/d116/d120 0 2023-12-05T13:25:27.915 INFO:tasks.workunit.client.1.smithi052.stdout:9/734: dwrite d3/d2a/d5c/f71 [0,4194304] 0 2023-12-05T13:25:27.916 INFO:tasks.workunit.client.1.smithi052.stdout:4/803: mknod de/d30/d73/dbe/d24/ddd/c109 0 2023-12-05T13:25:27.916 INFO:tasks.workunit.client.1.smithi052.stdout:4/804: fsync de/d2b/ff0 0 2023-12-05T13:25:27.916 INFO:tasks.workunit.client.1.smithi052.stdout:5/558: creat d5/d46/d76/d8f/fb7 x:0 0 0 2023-12-05T13:25:27.918 INFO:tasks.workunit.client.1.smithi052.stdout:7/864: mkdir d7/dce/d10f/d11e/d121 0 2023-12-05T13:25:27.919 INFO:tasks.workunit.client.1.smithi052.stdout:7/865: fsync d7/d4e/d12/d3f/d46/f5f 0 2023-12-05T13:25:27.919 INFO:tasks.workunit.client.1.smithi052.stdout:2/773: dwrite d2/d13/d1e/d6a/d7f/d84/d6e/fca [0,4194304] 0 2023-12-05T13:25:27.919 INFO:tasks.workunit.client.1.smithi052.stdout:7/866: chown d7/d4e/d45/d5a/d63 368 1 2023-12-05T13:25:27.919 INFO:tasks.workunit.client.1.smithi052.stdout:1/830: dwrite d5/d7/d35/d37/d5a/d73/d7e/f6b [0,4194304] 0 2023-12-05T13:25:27.920 INFO:tasks.workunit.client.1.smithi052.stdout:2/774: write d2/d13/d48/f91 [4126585,11436] 0 2023-12-05T13:25:27.920 INFO:tasks.workunit.client.1.smithi052.stdout:2/775: stat d2/d13/d45/f4a 0 2023-12-05T13:25:27.920 INFO:tasks.workunit.client.1.smithi052.stdout:9/735: truncate d3/d11/d19/f27 5385788 0 2023-12-05T13:25:27.925 INFO:tasks.workunit.client.1.smithi052.stdout:4/805: rename de/d30/l31 to de/d30/dac/dbb/l10a 0 2023-12-05T13:25:27.925 INFO:tasks.workunit.client.1.smithi052.stdout:5/559: dread d5/df/d4b/d74/f7c [0,4194304] 0 2023-12-05T13:25:27.926 INFO:tasks.workunit.client.1.smithi052.stdout:5/560: write d5/d15/d21/d4a/d6e/f99 [212925,73170] 0 2023-12-05T13:25:27.926 INFO:tasks.workunit.client.1.smithi052.stdout:4/806: read de/d29/d51/f57 [2484847,72574] 0 2023-12-05T13:25:27.928 INFO:tasks.workunit.client.1.smithi052.stdout:1/831: link d5/d7/d35/d37/fbe d5/daa/f10b 0 2023-12-05T13:25:27.928 INFO:tasks.workunit.client.1.smithi052.stdout:1/832: write d5/d26/d75/fc4 [649963,112635] 0 2023-12-05T13:25:27.930 INFO:tasks.workunit.client.1.smithi052.stdout:1/833: read d5/d7/d35/d2f/d9b/fc9 [3864370,80060] 0 2023-12-05T13:25:27.932 INFO:tasks.workunit.client.1.smithi052.stdout:2/776: rmdir d2/d13/d45 39 2023-12-05T13:25:27.939 INFO:tasks.workunit.client.1.smithi052.stdout:7/867: rename d7/d4e/d12/caf to d7/d4e/d45/d5a/d63/d95/c122 0 2023-12-05T13:25:27.942 INFO:tasks.workunit.client.1.smithi052.stdout:5/561: dread d5/df/d11/f26 [0,4194304] 0 2023-12-05T13:25:27.944 INFO:tasks.workunit.client.1.smithi052.stdout:9/736: rename d3/d2a/d8f/fc1 to d3/d5e/da7/daf/dbe/ffa 0 2023-12-05T13:25:27.947 INFO:tasks.workunit.client.1.smithi052.stdout:5/562: rmdir d5/df/d11/d73/d77 39 2023-12-05T13:25:27.947 INFO:tasks.workunit.client.1.smithi052.stdout:5/563: dread - d5/df/d11/d73/d77/fb0 zero size 2023-12-05T13:25:27.947 INFO:tasks.workunit.client.1.smithi052.stdout:4/807: dwrite de/d2b/d80/f101 [0,4194304] 0 2023-12-05T13:25:27.953 INFO:tasks.workunit.client.1.smithi052.stdout:7/868: dread d7/d4e/f5c [4194304,4194304] 0 2023-12-05T13:25:27.958 INFO:tasks.workunit.client.1.smithi052.stdout:1/834: dwrite d5/d26/f66 [0,4194304] 0 2023-12-05T13:25:27.958 INFO:tasks.workunit.client.1.smithi052.stdout:7/869: mknod d7/d4e/d45/d50/c123 0 2023-12-05T13:25:27.959 INFO:tasks.workunit.client.1.smithi052.stdout:5/564: dread d5/d15/d21/d25/f6d [0,4194304] 0 2023-12-05T13:25:27.961 INFO:tasks.workunit.client.1.smithi052.stdout:1/835: creat d5/d7/de/d74/d99/dc6/f10c x:0 0 0 2023-12-05T13:25:27.961 INFO:tasks.workunit.client.1.smithi052.stdout:6/617: sync 2023-12-05T13:25:27.961 INFO:tasks.workunit.client.1.smithi052.stdout:8/872: sync 2023-12-05T13:25:27.963 INFO:tasks.workunit.client.1.smithi052.stdout:9/737: dread d3/d11/d3e/f6e [0,4194304] 0 2023-12-05T13:25:27.963 INFO:tasks.workunit.client.1.smithi052.stdout:9/738: getdents d3/d5e/d9e 0 2023-12-05T13:25:27.963 INFO:tasks.workunit.client.1.smithi052.stdout:7/870: mkdir d7/d4e/d45/d79/d91/d101/d124 0 2023-12-05T13:25:27.965 INFO:tasks.workunit.client.1.smithi052.stdout:5/565: creat d5/df/d4e/d5b/fb8 x:0 0 0 2023-12-05T13:25:27.965 INFO:tasks.workunit.client.1.smithi052.stdout:5/566: truncate d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c 895793 0 2023-12-05T13:25:27.969 INFO:tasks.workunit.client.1.smithi052.stdout:2/777: dwrite d2/d13/d1e/f71 [0,4194304] 0 2023-12-05T13:25:27.969 INFO:tasks.workunit.client.1.smithi052.stdout:2/778: write d2/d13/d1e/fab [896497,75308] 0 2023-12-05T13:25:27.970 INFO:tasks.workunit.client.1.smithi052.stdout:2/779: write d2/d4/f23 [2177204,123745] 0 2023-12-05T13:25:27.972 INFO:tasks.workunit.client.1.smithi052.stdout:8/873: rmdir d0/de/d12/dc1 39 2023-12-05T13:25:27.972 INFO:tasks.workunit.client.1.smithi052.stdout:6/618: symlink d3/d5/d9/d44/dab/ld8 0 2023-12-05T13:25:27.972 INFO:tasks.workunit.client.1.smithi052.stdout:6/619: readlink d3/d5/d9/d44/dab/ld8 0 2023-12-05T13:25:27.974 INFO:tasks.workunit.client.1.smithi052.stdout:7/871: unlink d7/d4e/d45/d5a/d16/f33 0 2023-12-05T13:25:27.975 INFO:tasks.workunit.client.1.smithi052.stdout:4/808: dwrite de/d30/d68/d5c/de2/ff4 [0,4194304] 0 2023-12-05T13:25:27.975 INFO:tasks.workunit.client.1.smithi052.stdout:5/567: fsync d5/df/d11/f2b 0 2023-12-05T13:25:27.977 INFO:tasks.workunit.client.1.smithi052.stdout:5/568: write d5/df/d11/d73/d77/f78 [1727574,125944] 0 2023-12-05T13:25:27.980 INFO:tasks.workunit.client.1.smithi052.stdout:9/739: dwrite d3/d2a/f3c [0,4194304] 0 2023-12-05T13:25:27.980 INFO:tasks.workunit.client.1.smithi052.stdout:1/836: dwrite d5/f64 [0,4194304] 0 2023-12-05T13:25:27.981 INFO:tasks.workunit.client.1.smithi052.stdout:9/740: write d3/d11/d3e/f4c [756808,121389] 0 2023-12-05T13:25:27.982 INFO:tasks.workunit.client.1.smithi052.stdout:2/780: dread d2/f2f [4194304,4194304] 0 2023-12-05T13:25:27.982 INFO:tasks.workunit.client.1.smithi052.stdout:1/837: write d5/d26/da3/fd0 [998443,11803] 0 2023-12-05T13:25:27.982 INFO:tasks.workunit.client.1.smithi052.stdout:1/838: read - d5/daa/d2a/fce zero size 2023-12-05T13:25:27.983 INFO:tasks.workunit.client.1.smithi052.stdout:1/839: fdatasync d5/f64 0 2023-12-05T13:25:27.983 INFO:tasks.workunit.client.1.smithi052.stdout:1/840: fdatasync d5/d26/f66 0 2023-12-05T13:25:27.986 INFO:tasks.workunit.client.1.smithi052.stdout:8/874: link d0/d4d/f10e d0/d28/db0/f124 0 2023-12-05T13:25:27.986 INFO:tasks.workunit.client.1.smithi052.stdout:6/620: symlink d3/d5/d9/d21/d48/d4d/d66/d91/ld9 0 2023-12-05T13:25:27.986 INFO:tasks.workunit.client.1.smithi052.stdout:7/872: creat d7/d4e/d12/d3f/d46/d4d/f125 x:0 0 0 2023-12-05T13:25:27.986 INFO:tasks.workunit.client.1.smithi052.stdout:5/569: creat d5/d46/d76/d8f/fb9 x:0 0 0 2023-12-05T13:25:27.986 INFO:tasks.workunit.client.1.smithi052.stdout:5/570: stat d5/d15/d21/d4a/d6e/d91/da6/d5c/f53 0 2023-12-05T13:25:27.991 INFO:tasks.workunit.client.1.smithi052.stdout:4/809: dwrite de/d2b/d80/f105 [0,4194304] 0 2023-12-05T13:25:28.061 INFO:tasks.workunit.client.1.smithi052.stdout:9/741: mknod d3/d92/cfb 0 2023-12-05T13:25:28.061 INFO:tasks.workunit.client.1.smithi052.stdout:9/742: write d3/d11/d19/f27 [5442203,92767] 0 2023-12-05T13:25:28.135 INFO:tasks.workunit.client.1.smithi052.stdout:1/841: mkdir d5/daa/d10d 0 2023-12-05T13:25:28.136 INFO:tasks.workunit.client.1.smithi052.stdout:8/875: stat d0/c1 0 2023-12-05T13:25:28.136 INFO:tasks.workunit.client.1.smithi052.stdout:8/876: read - d0/de/d27/d43/d44/db9/fbd zero size 2023-12-05T13:25:28.136 INFO:tasks.workunit.client.1.smithi052.stdout:8/877: dread - d0/de/d12/f10f zero size 2023-12-05T13:25:28.136 INFO:tasks.workunit.client.1.smithi052.stdout:6/621: chown d3/d4/df/d24/f75 4 1 2023-12-05T13:25:28.137 INFO:tasks.workunit.client.1.smithi052.stdout:7/873: creat d7/dce/f126 x:0 0 0 2023-12-05T13:25:28.137 INFO:tasks.workunit.client.1.smithi052.stdout:7/874: readlink d7/d4e/d12/d3f/d46/l9e 0 2023-12-05T13:25:28.139 INFO:tasks.workunit.client.1.smithi052.stdout:5/571: symlink d5/df/d4e/da4/lba 0 2023-12-05T13:25:28.141 INFO:tasks.workunit.client.1.smithi052.stdout:3/819: sync 2023-12-05T13:25:28.142 INFO:tasks.workunit.client.1.smithi052.stdout:4/810: creat de/d30/d68/f10b x:0 0 0 2023-12-05T13:25:28.142 INFO:tasks.workunit.client.1.smithi052.stdout:4/811: write de/d29/d51/da3/f82 [614041,105292] 0 2023-12-05T13:25:28.142 INFO:tasks.workunit.client.1.smithi052.stdout:9/743: truncate d3/d1e/f36 3959607 0 2023-12-05T13:25:28.142 INFO:tasks.workunit.client.1.smithi052.stdout:9/744: chown d3/d11/d3e/f51 172101 1 2023-12-05T13:25:28.147 INFO:tasks.workunit.client.1.smithi052.stdout:1/842: unlink d5/daa/d2a/l57 0 2023-12-05T13:25:28.147 INFO:tasks.workunit.client.1.smithi052.stdout:1/843: dread - d5/daa/d17/d9a/fff zero size 2023-12-05T13:25:28.148 INFO:tasks.workunit.client.1.smithi052.stdout:8/878: mkdir d0/de/d27/d43/d44/db9/d125 0 2023-12-05T13:25:28.149 INFO:tasks.workunit.client.1.smithi052.stdout:7/875: rmdir d7/d4e/d12/d3f/d46/d4d/d116 39 2023-12-05T13:25:28.150 INFO:tasks.workunit.client.1.smithi052.stdout:5/572: creat d5/d15/d21/d4a/d6e/d91/da6/fbb x:0 0 0 2023-12-05T13:25:28.150 INFO:tasks.workunit.client.1.smithi052.stdout:5/573: truncate d5/df/d11/f52 1400008 0 2023-12-05T13:25:28.151 INFO:tasks.workunit.client.1.smithi052.stdout:5/574: dread - d5/df/d8d/f8e zero size 2023-12-05T13:25:28.151 INFO:tasks.workunit.client.1.smithi052.stdout:5/575: write d5/d15/d21/f2e [839881,125435] 0 2023-12-05T13:25:28.151 INFO:tasks.workunit.client.1.smithi052.stdout:5/576: truncate d5/df/fa0 84712 0 2023-12-05T13:25:28.152 INFO:tasks.workunit.client.1.smithi052.stdout:3/820: symlink da/d25/d33/d49/dbd/dfd/l10f 0 2023-12-05T13:25:28.156 INFO:tasks.workunit.client.1.smithi052.stdout:9/745: creat d3/d1e/d41/d57/de9/ffc x:0 0 0 2023-12-05T13:25:28.156 INFO:tasks.workunit.client.1.smithi052.stdout:0/753: sync 2023-12-05T13:25:28.156 INFO:tasks.workunit.client.1.smithi052.stdout:8/879: rmdir d0/d28/d2b/de4 39 2023-12-05T13:25:28.161 INFO:tasks.workunit.client.1.smithi052.stdout:6/622: dread d3/d5/d9/f2f [0,4194304] 0 2023-12-05T13:25:28.161 INFO:tasks.workunit.client.1.smithi052.stdout:7/876: creat d7/dce/d10f/d11e/f127 x:0 0 0 2023-12-05T13:25:28.165 INFO:tasks.workunit.client.1.smithi052.stdout:5/577: mknod d5/df/d4e/d65/cbc 0 2023-12-05T13:25:28.165 INFO:tasks.workunit.client.1.smithi052.stdout:5/578: getdents d5/d15/d21/d4a/d6e/d91/da6/d88/da7 0 2023-12-05T13:25:28.165 INFO:tasks.workunit.client.1.smithi052.stdout:5/579: chown d5/df/d11 83 1 2023-12-05T13:25:28.166 INFO:tasks.workunit.client.1.smithi052.stdout:8/880: dread d0/de/d27/d43/d63/f8b [4194304,4194304] 0 2023-12-05T13:25:28.167 INFO:tasks.workunit.client.1.smithi052.stdout:9/746: creat d3/d92/ffd x:0 0 0 2023-12-05T13:25:28.167 INFO:tasks.workunit.client.1.smithi052.stdout:7/877: write d7/d4e/d45/d5a/f87 [1409985,79591] 0 2023-12-05T13:25:28.169 INFO:tasks.workunit.client.1.smithi052.stdout:9/747: write d3/d92/fa6 [72309,72553] 0 2023-12-05T13:25:28.173 INFO:tasks.workunit.client.1.smithi052.stdout:7/878: mknod d7/d4e/d45/d50/c128 0 2023-12-05T13:25:28.173 INFO:tasks.workunit.client.1.smithi052.stdout:9/748: dread d3/d1e/d37/d4f/f52 [0,4194304] 0 2023-12-05T13:25:28.174 INFO:tasks.workunit.client.1.smithi052.stdout:0/754: mknod d0/db/d1b/d29/cfb 0 2023-12-05T13:25:28.174 INFO:tasks.workunit.client.1.smithi052.stdout:0/755: chown d0/db/d2e/d53/c5b 0 1 2023-12-05T13:25:28.177 INFO:tasks.workunit.client.1.smithi052.stdout:1/844: dwrite d5/d26/ff4 [0,4194304] 0 2023-12-05T13:25:28.177 INFO:tasks.workunit.client.1.smithi052.stdout:7/879: getdents d7/d4e/d45/d5a 0 2023-12-05T13:25:28.179 INFO:tasks.workunit.client.1.smithi052.stdout:6/623: mkdir d3/d4/dda 0 2023-12-05T13:25:28.179 INFO:tasks.workunit.client.1.smithi052.stdout:8/881: dread d0/de/d12/d29/db3/dc5/f107 [0,4194304] 0 2023-12-05T13:25:28.180 INFO:tasks.workunit.client.1.smithi052.stdout:9/749: getdents d3/d5e/da7/daf 0 2023-12-05T13:25:28.183 INFO:tasks.workunit.client.1.smithi052.stdout:7/880: creat d7/d4e/d45/d50/f129 x:0 0 0 2023-12-05T13:25:28.183 INFO:tasks.workunit.client.1.smithi052.stdout:7/881: chown d7/f73 0 1 2023-12-05T13:25:28.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/624: rmdir d3/d5/d9/d21/d48/d4d/d81/dc2 0 2023-12-05T13:25:28.185 INFO:tasks.workunit.client.1.smithi052.stdout:3/821: dwrite da/d25/d33/d49/fb0 [0,4194304] 0 2023-12-05T13:25:28.185 INFO:tasks.workunit.client.1.smithi052.stdout:1/845: dread d5/daa/d17/f88 [0,4194304] 0 2023-12-05T13:25:28.186 INFO:tasks.workunit.client.1.smithi052.stdout:2/781: dwrite d2/d13/d1e/f7d [0,4194304] 0 2023-12-05T13:25:28.187 INFO:tasks.workunit.client.1.smithi052.stdout:7/882: dread d7/d4e/d45/d5a/d16/dae/fe6 [0,4194304] 0 2023-12-05T13:25:28.187 INFO:tasks.workunit.client.1.smithi052.stdout:8/882: creat d0/de/d12/d29/db3/dc5/f126 x:0 0 0 2023-12-05T13:25:28.187 INFO:tasks.workunit.client.1.smithi052.stdout:1/846: dread d5/d7/d35/d37/d5a/d73/d76/fe6 [0,4194304] 0 2023-12-05T13:25:28.187 INFO:tasks.workunit.client.1.smithi052.stdout:1/847: fsync d5/d26/d41/f5f 0 2023-12-05T13:25:28.187 INFO:tasks.workunit.client.1.smithi052.stdout:2/782: write d2/d13/d37/d5c/f9c [1596207,91450] 0 2023-12-05T13:25:28.187 INFO:tasks.workunit.client.1.smithi052.stdout:2/783: chown d2/d13/d37/d5c/f74 1609 1 2023-12-05T13:25:28.188 INFO:tasks.workunit.client.1.smithi052.stdout:9/750: creat d3/d5e/da7/daf/ffe x:0 0 0 2023-12-05T13:25:28.188 INFO:tasks.workunit.client.1.smithi052.stdout:5/580: dwrite d5/d15/f31 [0,4194304] 0 2023-12-05T13:25:28.190 INFO:tasks.workunit.client.1.smithi052.stdout:6/625: truncate d3/d4/df/d27/f56 149778 0 2023-12-05T13:25:28.190 INFO:tasks.workunit.client.1.smithi052.stdout:9/751: dread d3/f6a [0,4194304] 0 2023-12-05T13:25:28.192 INFO:tasks.workunit.client.1.smithi052.stdout:0/756: dread d0/f11 [0,4194304] 0 2023-12-05T13:25:28.193 INFO:tasks.workunit.client.1.smithi052.stdout:3/822: rename da/d25/d33/d43/d5b/da6/de7 to da/d25/dcd/dc6/d110 0 2023-12-05T13:25:28.195 INFO:tasks.workunit.client.1.smithi052.stdout:0/757: dread d0/db/d2e/f47 [0,4194304] 0 2023-12-05T13:25:28.195 INFO:tasks.workunit.client.1.smithi052.stdout:0/758: chown d0/db/d2e/d53/cab 896002042 1 2023-12-05T13:25:28.196 INFO:tasks.workunit.client.1.smithi052.stdout:7/883: mknod d7/d4e/d45/d5a/dfe/c12a 0 2023-12-05T13:25:28.197 INFO:tasks.workunit.client.1.smithi052.stdout:3/823: dread da/d25/d33/d49/dbd/d74/fea [0,4194304] 0 2023-12-05T13:25:28.197 INFO:tasks.workunit.client.1.smithi052.stdout:3/824: write da/d27/dec/f10a [817688,58545] 0 2023-12-05T13:25:28.197 INFO:tasks.workunit.client.1.smithi052.stdout:3/825: write da/d25/d33/d89/dae/dcf/ff3 [29783,62318] 0 2023-12-05T13:25:28.197 INFO:tasks.workunit.client.1.smithi052.stdout:3/826: write da/f101 [735619,100254] 0 2023-12-05T13:25:28.197 INFO:tasks.workunit.client.1.smithi052.stdout:3/827: dread - da/d2e/d40/fd8 zero size 2023-12-05T13:25:28.198 INFO:tasks.workunit.client.1.smithi052.stdout:3/828: chown da/d25/d33/d49/dbd/dfd/l10f 567711 1 2023-12-05T13:25:28.198 INFO:tasks.workunit.client.1.smithi052.stdout:8/883: mkdir d0/de/d12/d29/db3/d127 0 2023-12-05T13:25:28.198 INFO:tasks.workunit.client.1.smithi052.stdout:1/848: mknod d5/d7/d35/d37/d5a/d73/d7e/d4f/c10e 0 2023-12-05T13:25:28.198 INFO:tasks.workunit.client.1.smithi052.stdout:1/849: getdents d5/d7/de/d74/d99/dcc 0 2023-12-05T13:25:28.201 INFO:tasks.workunit.client.1.smithi052.stdout:2/784: symlink d2/d4/d63/d6d/le5 0 2023-12-05T13:25:28.201 INFO:tasks.workunit.client.1.smithi052.stdout:2/785: chown d2/d13/d1e/f71 54146 1 2023-12-05T13:25:28.204 INFO:tasks.workunit.client.1.smithi052.stdout:9/752: mknod d3/d11/d19/de2/cff 0 2023-12-05T13:25:28.206 INFO:tasks.workunit.client.1.smithi052.stdout:0/759: mknod d0/db/d2e/d7e/cfc 0 2023-12-05T13:25:28.206 INFO:tasks.workunit.client.1.smithi052.stdout:0/760: chown d0/db/d52/d7f/d8f/cf8 209587 1 2023-12-05T13:25:28.206 INFO:tasks.workunit.client.1.smithi052.stdout:0/761: readlink d0/db/d14/d9b/la4 0 2023-12-05T13:25:28.207 INFO:tasks.workunit.client.1.smithi052.stdout:0/762: read d0/f11 [1225491,45309] 0 2023-12-05T13:25:28.207 INFO:tasks.workunit.client.1.smithi052.stdout:0/763: fsync d0/db/d65/fc9 0 2023-12-05T13:25:28.208 INFO:tasks.workunit.client.1.smithi052.stdout:7/884: creat d7/d4e/d45/d5a/d66/f12b x:0 0 0 2023-12-05T13:25:28.209 INFO:tasks.workunit.client.1.smithi052.stdout:3/829: rmdir da/dd/d3d 39 2023-12-05T13:25:28.213 INFO:tasks.workunit.client.1.smithi052.stdout:8/884: rename d0/c8 to d0/de/d12/d29/db3/d127/c128 0 2023-12-05T13:25:28.214 INFO:tasks.workunit.client.1.smithi052.stdout:5/581: dwrite d5/df/d4e/d5b/fb8 [0,4194304] 0 2023-12-05T13:25:28.216 INFO:tasks.workunit.client.1.smithi052.stdout:1/850: mknod d5/d7/d35/d37/d5a/dd4/c10f 0 2023-12-05T13:25:28.217 INFO:tasks.workunit.client.1.smithi052.stdout:9/753: creat d3/d1e/d41/d57/f100 x:0 0 0 2023-12-05T13:25:28.220 INFO:tasks.workunit.client.1.smithi052.stdout:3/830: link da/d48/ld9 da/d25/d33/d89/l111 0 2023-12-05T13:25:28.220 INFO:tasks.workunit.client.1.smithi052.stdout:3/831: fdatasync da/dd/d3d/f76 0 2023-12-05T13:25:28.220 INFO:tasks.workunit.client.1.smithi052.stdout:3/832: fdatasync da/d25/d33/d49/fa7 0 2023-12-05T13:25:28.220 INFO:tasks.workunit.client.1.smithi052.stdout:3/833: chown l2 94 1 2023-12-05T13:25:28.223 INFO:tasks.workunit.client.1.smithi052.stdout:8/885: mknod d0/de/d12/d29/db3/dc5/c129 0 2023-12-05T13:25:28.223 INFO:tasks.workunit.client.1.smithi052.stdout:8/886: chown d0/de/l23 2 1 2023-12-05T13:25:28.224 INFO:tasks.workunit.client.1.smithi052.stdout:9/754: mknod d3/d1e/d62/dbd/c101 0 2023-12-05T13:25:28.226 INFO:tasks.workunit.client.1.smithi052.stdout:6/626: dwrite d3/d5/d58/f84 [0,4194304] 0 2023-12-05T13:25:28.227 INFO:tasks.workunit.client.1.smithi052.stdout:2/786: dwrite d2/d13/d1e/fde [0,4194304] 0 2023-12-05T13:25:28.227 INFO:tasks.workunit.client.1.smithi052.stdout:9/755: mknod d3/d5e/da7/c102 0 2023-12-05T13:25:28.228 INFO:tasks.workunit.client.1.smithi052.stdout:8/887: symlink d0/l12a 0 2023-12-05T13:25:28.228 INFO:tasks.workunit.client.1.smithi052.stdout:8/888: fsync d0/d28/d2b/d53/d56/d111/d8f/fb2 0 2023-12-05T13:25:28.228 INFO:tasks.workunit.client.1.smithi052.stdout:8/889: fdatasync d0/d28/d2b/d53/d56/d111/f47 0 2023-12-05T13:25:28.237 INFO:tasks.workunit.client.1.smithi052.stdout:0/764: dwrite d0/db/d1b/f37 [0,4194304] 0 2023-12-05T13:25:28.240 INFO:tasks.workunit.client.1.smithi052.stdout:7/885: dwrite d7/d4e/f5c [0,4194304] 0 2023-12-05T13:25:28.240 INFO:tasks.workunit.client.1.smithi052.stdout:2/787: mkdir d2/d13/d1e/dae/dc3/dd0/de6 0 2023-12-05T13:25:28.241 INFO:tasks.workunit.client.1.smithi052.stdout:9/756: creat d3/d2a/d5c/f103 x:0 0 0 2023-12-05T13:25:28.242 INFO:tasks.workunit.client.1.smithi052.stdout:8/890: link d0/d4d/cdd d0/de/d12/d29/d81/c12b 0 2023-12-05T13:25:28.243 INFO:tasks.workunit.client.1.smithi052.stdout:0/765: creat d0/db/d1b/d51/d55/d66/dcf/ffd x:0 0 0 2023-12-05T13:25:28.246 INFO:tasks.workunit.client.1.smithi052.stdout:1/851: dwrite d5/d26/da3/dcd/def/ffa [0,4194304] 0 2023-12-05T13:25:28.246 INFO:tasks.workunit.client.1.smithi052.stdout:7/886: mkdir d7/d31/d56/d60/d72/d12c 0 2023-12-05T13:25:28.246 INFO:tasks.workunit.client.1.smithi052.stdout:7/887: chown d7/d4e/d45/d5a/d16/l70 25 1 2023-12-05T13:25:28.246 INFO:tasks.workunit.client.1.smithi052.stdout:5/582: dwrite d5/df/d11/f52 [0,4194304] 0 2023-12-05T13:25:28.247 INFO:tasks.workunit.client.1.smithi052.stdout:2/788: unlink d2/d4/l1d 0 2023-12-05T13:25:28.248 INFO:tasks.workunit.client.1.smithi052.stdout:8/891: creat d0/de5/f12c x:0 0 0 2023-12-05T13:25:28.248 INFO:tasks.workunit.client.1.smithi052.stdout:8/892: read - d0/d4d/f120 zero size 2023-12-05T13:25:28.255 INFO:tasks.workunit.client.1.smithi052.stdout:1/852: dread d5/d26/da3/dcd/def/ffa [0,4194304] 0 2023-12-05T13:25:28.256 INFO:tasks.workunit.client.1.smithi052.stdout:7/888: truncate d7/d4e/d45/f51 1870115 0 2023-12-05T13:25:28.257 INFO:tasks.workunit.client.1.smithi052.stdout:2/789: dread d2/d4/d3f/d9d/fe1 [0,4194304] 0 2023-12-05T13:25:28.258 INFO:tasks.workunit.client.1.smithi052.stdout:2/790: truncate d2/d13/d48/f5e 4697161 0 2023-12-05T13:25:28.258 INFO:tasks.workunit.client.1.smithi052.stdout:5/583: rename d5/df/d4b/d74/f7c to d5/d15/d21/d25/fbd 0 2023-12-05T13:25:28.258 INFO:tasks.workunit.client.1.smithi052.stdout:6/627: dwrite d3/d4/df/d27/f56 [0,4194304] 0 2023-12-05T13:25:28.260 INFO:tasks.workunit.client.1.smithi052.stdout:2/791: read d2/da4/f79 [2740504,108739] 0 2023-12-05T13:25:28.262 INFO:tasks.workunit.client.1.smithi052.stdout:1/853: symlink d5/d7/d35/d2f/d3e/d62/l110 0 2023-12-05T13:25:28.263 INFO:tasks.workunit.client.1.smithi052.stdout:1/854: write d5/daa/d17/d3c/f80 [149485,57764] 0 2023-12-05T13:25:28.267 INFO:tasks.workunit.client.1.smithi052.stdout:6/628: creat d3/d5/d9/d21/d48/d4d/d81/fdb x:0 0 0 2023-12-05T13:25:28.267 INFO:tasks.workunit.client.1.smithi052.stdout:9/757: dwrite d3/d1e/d41/d86/fa1 [0,4194304] 0 2023-12-05T13:25:28.269 INFO:tasks.workunit.client.1.smithi052.stdout:5/584: rename d5/df/d4e/d5b/l92 to d5/df/d11/lbe 0 2023-12-05T13:25:28.273 INFO:tasks.workunit.client.1.smithi052.stdout:6/629: symlink d3/d5/d9/d52/ldc 0 2023-12-05T13:25:28.274 INFO:tasks.workunit.client.1.smithi052.stdout:0/766: dwrite d0/db/d52/d7f/f89 [4194304,4194304] 0 2023-12-05T13:25:28.274 INFO:tasks.workunit.client.1.smithi052.stdout:0/767: fdatasync d0/db/d52/d7f/f9f 0 2023-12-05T13:25:28.275 INFO:tasks.workunit.client.1.smithi052.stdout:9/758: creat d3/d1e/d41/f104 x:0 0 0 2023-12-05T13:25:28.277 INFO:tasks.workunit.client.1.smithi052.stdout:6/630: rename d3/f16 to d3/d5/d9/fdd 0 2023-12-05T13:25:28.278 INFO:tasks.workunit.client.1.smithi052.stdout:6/631: read - d3/d5/d9/d44/dab/fb1 zero size 2023-12-05T13:25:28.281 INFO:tasks.workunit.client.1.smithi052.stdout:2/792: dwrite d2/d13/d1e/d6a/d7f/d84/f9b [0,4194304] 0 2023-12-05T13:25:28.283 INFO:tasks.workunit.client.1.smithi052.stdout:0/768: link d0/db/d14/d9b/lbe d0/db/d1b/d29/lfe 0 2023-12-05T13:25:28.283 INFO:tasks.workunit.client.1.smithi052.stdout:0/769: stat d0/db/d1b/d51/d55/f5f 0 2023-12-05T13:25:28.284 INFO:tasks.workunit.client.1.smithi052.stdout:1/855: dwrite d5/d7/de/d74/d99/dc6/fd9 [0,4194304] 0 2023-12-05T13:25:28.285 INFO:tasks.workunit.client.1.smithi052.stdout:9/759: link d3/d11/d19/f53 d3/d2a/d8f/f105 0 2023-12-05T13:25:28.285 INFO:tasks.workunit.client.1.smithi052.stdout:9/760: chown d3/d11/l28 3709502 1 2023-12-05T13:25:28.285 INFO:tasks.workunit.client.1.smithi052.stdout:9/761: write d3/d2a/fca [530413,17034] 0 2023-12-05T13:25:28.287 INFO:tasks.workunit.client.1.smithi052.stdout:1/856: write d5/daa/da4/fa5 [1837313,52904] 0 2023-12-05T13:25:28.287 INFO:tasks.workunit.client.1.smithi052.stdout:1/857: fsync d5/d7/d35/d37/d5a/d73/f84 0 2023-12-05T13:25:28.287 INFO:tasks.workunit.client.1.smithi052.stdout:4/812: sync 2023-12-05T13:25:28.292 INFO:tasks.workunit.client.1.smithi052.stdout:5/585: dwrite d5/d15/d21/d4a/d6e/d91/da6/d5c/f53 [0,4194304] 0 2023-12-05T13:25:28.292 INFO:tasks.workunit.client.1.smithi052.stdout:5/586: write d5/d15/d21/fa5 [562815,69533] 0 2023-12-05T13:25:28.292 INFO:tasks.workunit.client.1.smithi052.stdout:9/762: mkdir d3/d5e/da7/d106 0 2023-12-05T13:25:28.292 INFO:tasks.workunit.client.1.smithi052.stdout:9/763: truncate d3/d5e/f64 1554418 0 2023-12-05T13:25:28.292 INFO:tasks.workunit.client.1.smithi052.stdout:9/764: read d3/d11/f48 [2071669,54054] 0 2023-12-05T13:25:28.297 INFO:tasks.workunit.client.1.smithi052.stdout:6/632: truncate d3/d4/d36/f76 447042 0 2023-12-05T13:25:28.298 INFO:tasks.workunit.client.1.smithi052.stdout:1/858: unlink d5/daa/f55 0 2023-12-05T13:25:28.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/813: symlink de/d29/d51/da3/l10c 0 2023-12-05T13:25:28.299 INFO:tasks.workunit.client.1.smithi052.stdout:4/814: dread - de/d30/dac/dbb/feb zero size 2023-12-05T13:25:28.302 INFO:tasks.workunit.client.1.smithi052.stdout:5/587: mkdir d5/df/d4e/d5b/dbf 0 2023-12-05T13:25:28.302 INFO:tasks.workunit.client.1.smithi052.stdout:0/770: dwrite d0/f11 [0,4194304] 0 2023-12-05T13:25:28.302 INFO:tasks.workunit.client.1.smithi052.stdout:0/771: chown d0/dcb/f45 1162402 1 2023-12-05T13:25:28.305 INFO:tasks.workunit.client.1.smithi052.stdout:9/765: creat d3/d1e/d41/d57/f107 x:0 0 0 2023-12-05T13:25:28.306 INFO:tasks.workunit.client.1.smithi052.stdout:6/633: dread d3/d4/d36/d6f/f85 [0,4194304] 0 2023-12-05T13:25:28.313 INFO:tasks.workunit.client.1.smithi052.stdout:0/772: mkdir d0/db/d2e/d7e/da6/dea/dff 0 2023-12-05T13:25:28.317 INFO:tasks.workunit.client.1.smithi052.stdout:9/766: getdents d3/d2a/d5c 0 2023-12-05T13:25:28.322 INFO:tasks.workunit.client.1.smithi052.stdout:9/767: mknod d3/c108 0 2023-12-05T13:25:28.322 INFO:tasks.workunit.client.1.smithi052.stdout:9/768: chown d3/d5e 243817 1 2023-12-05T13:25:28.323 INFO:tasks.workunit.client.1.smithi052.stdout:9/769: symlink d3/d5e/d9e/l109 0 2023-12-05T13:25:28.324 INFO:tasks.workunit.client.1.smithi052.stdout:6/634: dwrite d3/d4/df/d27/f47 [0,4194304] 0 2023-12-05T13:25:28.326 INFO:tasks.workunit.client.1.smithi052.stdout:9/770: rename d3/d31/l8d to d3/d5e/d9e/dce/l10a 0 2023-12-05T13:25:28.326 INFO:tasks.workunit.client.1.smithi052.stdout:9/771: write d3/d1e/d62/dbd/ff0 [419252,2184] 0 2023-12-05T13:25:28.328 INFO:tasks.workunit.client.1.smithi052.stdout:1/859: dwrite d5/d7/d35/d37/d43/f78 [0,4194304] 0 2023-12-05T13:25:28.328 INFO:tasks.workunit.client.1.smithi052.stdout:1/860: write d5/d7/d35/d2f/d3e/d62/fb8 [211889,92676] 0 2023-12-05T13:25:28.330 INFO:tasks.workunit.client.1.smithi052.stdout:9/772: unlink d3/d2a/d8f/f105 0 2023-12-05T13:25:28.330 INFO:tasks.workunit.client.1.smithi052.stdout:9/773: readlink d3/d11/d3e/lb0 0 2023-12-05T13:25:28.332 INFO:tasks.workunit.client.1.smithi052.stdout:1/861: creat d5/d7/de/d74/d99/dcc/f111 x:0 0 0 2023-12-05T13:25:28.332 INFO:tasks.workunit.client.1.smithi052.stdout:1/862: chown d5/d26/d41 67 1 2023-12-05T13:25:28.332 INFO:tasks.workunit.client.1.smithi052.stdout:1/863: dread - d5/d7/d35/d37/d5a/d73/fca zero size 2023-12-05T13:25:28.333 INFO:tasks.workunit.client.1.smithi052.stdout:0/773: dwrite d0/db/d14/d9b/fc8 [0,4194304] 0 2023-12-05T13:25:28.334 INFO:tasks.workunit.client.1.smithi052.stdout:6/635: mkdir d3/d4/d36/dde 0 2023-12-05T13:25:28.335 INFO:tasks.workunit.client.1.smithi052.stdout:9/774: mknod d3/d1e/d62/dbd/dc9/c10b 0 2023-12-05T13:25:28.337 INFO:tasks.workunit.client.1.smithi052.stdout:1/864: truncate d5/daa/d17/d3c/fb4 2474666 0 2023-12-05T13:25:28.337 INFO:tasks.workunit.client.1.smithi052.stdout:1/865: readlink d5/d26/l33 0 2023-12-05T13:25:28.343 INFO:tasks.workunit.client.1.smithi052.stdout:3/834: sync 2023-12-05T13:25:28.344 INFO:tasks.workunit.client.1.smithi052.stdout:0/774: mkdir d0/db/d33/d100 0 2023-12-05T13:25:28.346 INFO:tasks.workunit.client.1.smithi052.stdout:6/636: rename d3/d5/d9/d21/d48/d4d/d66/d74 to d3/d5/d58/ddf 0 2023-12-05T13:25:28.346 INFO:tasks.workunit.client.1.smithi052.stdout:6/637: fdatasync d3/d4/df/d24/f8a 0 2023-12-05T13:25:28.349 INFO:tasks.workunit.client.1.smithi052.stdout:9/775: symlink d3/d11/d3e/l10c 0 2023-12-05T13:25:28.350 INFO:tasks.workunit.client.1.smithi052.stdout:1/866: link d5/d7/de/d18/l1d d5/d7/d35/d37/d43/l112 0 2023-12-05T13:25:28.354 INFO:tasks.workunit.client.1.smithi052.stdout:3/835: symlink da/d25/dcd/dc6/l112 0 2023-12-05T13:25:28.354 INFO:tasks.workunit.client.1.smithi052.stdout:0/775: rmdir d0/db/d1b/d51/d55/d66/dcf 39 2023-12-05T13:25:28.354 INFO:tasks.workunit.client.1.smithi052.stdout:0/776: truncate d0/db/d33/f72 1480275 0 2023-12-05T13:25:28.355 INFO:tasks.workunit.client.1.smithi052.stdout:1/867: unlink d5/daa/l7b 0 2023-12-05T13:25:28.357 INFO:tasks.workunit.client.1.smithi052.stdout:9/776: dread d3/d2a/d8f/f9a [0,4194304] 0 2023-12-05T13:25:28.357 INFO:tasks.workunit.client.1.smithi052.stdout:3/836: creat da/d25/d33/d49/dbd/d74/f113 x:0 0 0 2023-12-05T13:25:28.357 INFO:tasks.workunit.client.1.smithi052.stdout:3/837: chown da/d25/dcd/dc6/fa8 350 1 2023-12-05T13:25:28.357 INFO:tasks.workunit.client.1.smithi052.stdout:9/777: fsync d3/d5e/f64 0 2023-12-05T13:25:28.357 INFO:tasks.workunit.client.1.smithi052.stdout:3/838: chown da/d25/d33/d89/fb1 1672949 1 2023-12-05T13:25:28.358 INFO:tasks.workunit.client.1.smithi052.stdout:0/777: creat d0/db/d65/f101 x:0 0 0 2023-12-05T13:25:28.359 INFO:tasks.workunit.client.1.smithi052.stdout:3/839: rmdir da/d7a 39 2023-12-05T13:25:28.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/778: getdents d0/db/d2e/d7e/dcc 0 2023-12-05T13:25:28.364 INFO:tasks.workunit.client.1.smithi052.stdout:9/778: dread d3/d1e/d62/dbd/ff0 [0,4194304] 0 2023-12-05T13:25:28.369 INFO:tasks.workunit.client.1.smithi052.stdout:8/893: sync 2023-12-05T13:25:28.376 INFO:tasks.workunit.client.1.smithi052.stdout:9/779: creat d3/d11/d96/f10d x:0 0 0 2023-12-05T13:25:28.377 INFO:tasks.workunit.client.1.smithi052.stdout:8/894: dread d0/de/d27/d43/d44/f49 [0,4194304] 0 2023-12-05T13:25:28.377 INFO:tasks.workunit.client.1.smithi052.stdout:8/895: truncate d0/de/d12/dc1/fe0 101062 0 2023-12-05T13:25:28.382 INFO:tasks.workunit.client.1.smithi052.stdout:0/779: dwrite d0/db/d1b/f37 [0,4194304] 0 2023-12-05T13:25:28.384 INFO:tasks.workunit.client.1.smithi052.stdout:1/868: dwrite d5/daa/da4/fa5 [0,4194304] 0 2023-12-05T13:25:28.385 INFO:tasks.workunit.client.1.smithi052.stdout:3/840: dwrite da/d25/f3a [0,4194304] 0 2023-12-05T13:25:28.386 INFO:tasks.workunit.client.1.smithi052.stdout:0/780: unlink d0/db/d1b/d51/d55/l84 0 2023-12-05T13:25:28.386 INFO:tasks.workunit.client.1.smithi052.stdout:0/781: dread - d0/db/d1b/d7a/f93 zero size 2023-12-05T13:25:28.388 INFO:tasks.workunit.client.1.smithi052.stdout:1/869: mknod d5/d7/de/d74/d99/dc6/c113 0 2023-12-05T13:25:28.389 INFO:tasks.workunit.client.1.smithi052.stdout:3/841: stat l8 0 2023-12-05T13:25:28.391 INFO:tasks.workunit.client.1.smithi052.stdout:3/842: symlink da/d25/d33/d89/dae/dcf/dfb/l114 0 2023-12-05T13:25:28.392 INFO:tasks.workunit.client.1.smithi052.stdout:3/843: mkdir da/dd/d3d/d103/d115 0 2023-12-05T13:25:28.416 INFO:tasks.workunit.client.1.smithi052.stdout:9/780: dwrite d3/d11/f48 [4194304,4194304] 0 2023-12-05T13:25:28.417 INFO:tasks.workunit.client.1.smithi052.stdout:8/896: dwrite d0/de/d27/f57 [0,4194304] 0 2023-12-05T13:25:28.419 INFO:tasks.workunit.client.1.smithi052.stdout:0/782: dwrite d0/db/d52/d7f/f9f [0,4194304] 0 2023-12-05T13:25:28.419 INFO:tasks.workunit.client.1.smithi052.stdout:0/783: truncate d0/db/d2e/f47 946080 0 2023-12-05T13:25:28.419 INFO:tasks.workunit.client.1.smithi052.stdout:0/784: chown d0/db/d2e/l34 16128813 1 2023-12-05T13:25:28.424 INFO:tasks.workunit.client.1.smithi052.stdout:0/785: getdents d0/db/d1b/d7a 0 2023-12-05T13:25:28.426 INFO:tasks.workunit.client.1.smithi052.stdout:0/786: getdents d0/db/d2e/d7e/da6 0 2023-12-05T13:25:28.426 INFO:tasks.workunit.client.1.smithi052.stdout:9/781: truncate d3/d11/f48 3701562 0 2023-12-05T13:25:28.427 INFO:tasks.workunit.client.1.smithi052.stdout:8/897: dread d0/dae/fb1 [0,4194304] 0 2023-12-05T13:25:28.429 INFO:tasks.workunit.client.1.smithi052.stdout:0/787: link d0/db/d52/l58 d0/db/d1b/d51/d55/d66/dcd/l102 0 2023-12-05T13:25:28.429 INFO:tasks.workunit.client.1.smithi052.stdout:0/788: write d0/db/d1b/d7a/f93 [1012296,61174] 0 2023-12-05T13:25:28.430 INFO:tasks.workunit.client.1.smithi052.stdout:0/789: mkdir d0/db/d52/d7f/d103 0 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:2/793: sync 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:7/889: sync 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:7/890: readlink d7/d4e/d12/d3f/d46/d4d/lf8 0 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:2/794: fdatasync d2/d13/d1e/d6a/d7f/d84/f9b 0 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:2/795: chown d2/d13/d1e/d6a/d7f/d84/d6e/l72 2126 1 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:7/891: getdents d7/d4e/d45/d5a/d63/d95/dba 0 2023-12-05T13:25:28.431 INFO:tasks.workunit.client.1.smithi052.stdout:9/782: write d3/f2c [1217601,88209] 0 2023-12-05T13:25:28.433 INFO:tasks.workunit.client.1.smithi052.stdout:2/796: unlink d2/d13/d37/d5c/f9c 0 2023-12-05T13:25:28.434 INFO:tasks.workunit.client.1.smithi052.stdout:7/892: mkdir d7/d4e/d45/d79/d91/d101/d124/d12d 0 2023-12-05T13:25:28.434 INFO:tasks.workunit.client.1.smithi052.stdout:2/797: write d2/d4/d3f/d9d/fe1 [1373997,51061] 0 2023-12-05T13:25:28.434 INFO:tasks.workunit.client.1.smithi052.stdout:2/798: write d2/d13/d48/f67 [1178833,73028] 0 2023-12-05T13:25:28.434 INFO:tasks.workunit.client.1.smithi052.stdout:2/799: write d2/d13/d37/d5c/d80/dc4/fdb [636728,68262] 0 2023-12-05T13:25:28.436 INFO:tasks.workunit.client.1.smithi052.stdout:9/783: rmdir d3/d5e 39 2023-12-05T13:25:28.436 INFO:tasks.workunit.client.1.smithi052.stdout:9/784: truncate d3/d1e/d37/d4f/f65 905369 0 2023-12-05T13:25:28.440 INFO:tasks.workunit.client.1.smithi052.stdout:2/800: creat d2/d13/d48/dd3/d62/ddd/fe7 x:0 0 0 2023-12-05T13:25:28.442 INFO:tasks.workunit.client.1.smithi052.stdout:7/893: dread d7/d31/d56/d60/f69 [0,4194304] 0 2023-12-05T13:25:28.444 INFO:tasks.workunit.client.1.smithi052.stdout:7/894: mknod d7/d31/d56/d60/d72/d12c/c12e 0 2023-12-05T13:25:28.445 INFO:tasks.workunit.client.1.smithi052.stdout:7/895: mkdir d7/d4e/d45/d5a/d63/d95/dba/d12f 0 2023-12-05T13:25:28.446 INFO:tasks.workunit.client.1.smithi052.stdout:7/896: mkdir d7/dd5/d130 0 2023-12-05T13:25:28.447 INFO:tasks.workunit.client.1.smithi052.stdout:7/897: write d7/d4e/d45/d5a/d66/f8c [662101,80089] 0 2023-12-05T13:25:28.449 INFO:tasks.workunit.client.1.smithi052.stdout:9/785: dwrite d3/d2a/fca [0,4194304] 0 2023-12-05T13:25:28.451 INFO:tasks.workunit.client.1.smithi052.stdout:2/801: dread d2/d13/d48/f5e [0,4194304] 0 2023-12-05T13:25:28.451 INFO:tasks.workunit.client.1.smithi052.stdout:2/802: chown d2/d4/d63/d6d/l8d 215195754 1 2023-12-05T13:25:28.452 INFO:tasks.workunit.client.1.smithi052.stdout:2/803: symlink d2/d4/d63/d6d/dcb/le8 0 2023-12-05T13:25:28.456 INFO:tasks.workunit.client.1.smithi052.stdout:7/898: dread d7/d4e/f5c [0,4194304] 0 2023-12-05T13:25:28.469 INFO:tasks.workunit.client.1.smithi052.stdout:2/804: dwrite d2/d4/d3f/d9d/fa2 [0,4194304] 0 2023-12-05T13:25:28.472 INFO:tasks.workunit.client.1.smithi052.stdout:2/805: creat d2/d13/d37/d5c/d80/fe9 x:0 0 0 2023-12-05T13:25:28.473 INFO:tasks.workunit.client.1.smithi052.stdout:2/806: mkdir d2/d13/d37/d5c/d80/db4/dea 0 2023-12-05T13:25:28.479 INFO:tasks.workunit.client.1.smithi052.stdout:9/786: dwrite d3/d2a/fca [4194304,4194304] 0 2023-12-05T13:25:28.479 INFO:tasks.workunit.client.1.smithi052.stdout:9/787: fsync d3/d11/d3e/f51 0 2023-12-05T13:25:28.480 INFO:tasks.workunit.client.1.smithi052.stdout:9/788: readlink d3/l40 0 2023-12-05T13:25:28.480 INFO:tasks.workunit.client.1.smithi052.stdout:7/899: dwrite d7/d4e/d45/d93/fbe [0,4194304] 0 2023-12-05T13:25:28.480 INFO:tasks.workunit.client.1.smithi052.stdout:7/900: fsync d7/d4e/d12/d3f/f7f 0 2023-12-05T13:25:28.483 INFO:tasks.workunit.client.1.smithi052.stdout:7/901: dread d7/d4e/d12/d3f/d46/ffb [0,4194304] 0 2023-12-05T13:25:28.488 INFO:tasks.workunit.client.1.smithi052.stdout:9/789: dread d3/d1e/d41/d57/fb3 [0,4194304] 0 2023-12-05T13:25:28.489 INFO:tasks.workunit.client.1.smithi052.stdout:9/790: rename d3/d1e/d37/cd8 to d3/d2a/d5c/c10e 0 2023-12-05T13:25:28.489 INFO:tasks.workunit.client.1.smithi052.stdout:7/902: dread d7/f27 [0,4194304] 0 2023-12-05T13:25:28.491 INFO:tasks.workunit.client.1.smithi052.stdout:7/903: rename d7/d4e/d86/ffc to d7/dd5/f131 0 2023-12-05T13:25:28.495 INFO:tasks.workunit.client.1.smithi052.stdout:7/904: mknod d7/d4e/d12/d3f/d46/d4d/d116/c132 0 2023-12-05T13:25:28.495 INFO:tasks.workunit.client.1.smithi052.stdout:2/807: dwrite d2/d13/d1e/d6a/faf [0,4194304] 0 2023-12-05T13:25:28.495 INFO:tasks.workunit.client.1.smithi052.stdout:2/808: fdatasync d2/d13/d1e/d6a/d7f/d84/f55 0 2023-12-05T13:25:28.497 INFO:tasks.workunit.client.1.smithi052.stdout:7/905: creat d7/d2e/d104/f133 x:0 0 0 2023-12-05T13:25:28.497 INFO:tasks.workunit.client.1.smithi052.stdout:2/809: write d2/da4/f60 [2228886,39921] 0 2023-12-05T13:25:28.497 INFO:tasks.workunit.client.1.smithi052.stdout:2/810: write d2/d13/d1e/dae/fb7 [4959608,36992] 0 2023-12-05T13:25:28.497 INFO:tasks.workunit.client.1.smithi052.stdout:2/811: readlink d2/d13/d1e/d6a/d7f/d84/d6e/l72 0 2023-12-05T13:25:28.499 INFO:tasks.workunit.client.1.smithi052.stdout:7/906: link d7/d4e/d12/d3f/f6e d7/d4e/d45/f134 0 2023-12-05T13:25:28.504 INFO:tasks.workunit.client.1.smithi052.stdout:2/812: write d2/d13/d48/dd3/f66 [7343028,76430] 0 2023-12-05T13:25:28.505 INFO:tasks.workunit.client.1.smithi052.stdout:7/907: symlink d7/dce/d11b/l135 0 2023-12-05T13:25:28.505 INFO:tasks.workunit.client.1.smithi052.stdout:7/908: chown d7/d4e/d45/d5a/d66/fb8 14253 1 2023-12-05T13:25:28.507 INFO:tasks.workunit.client.1.smithi052.stdout:2/813: rename d2/d13/d37/d5c/d80/db4/dea to d2/d13/d48/dd3/d62/deb 0 2023-12-05T13:25:28.507 INFO:tasks.workunit.client.1.smithi052.stdout:9/791: dwrite d3/d11/d3e/f9b [0,4194304] 0 2023-12-05T13:25:28.510 INFO:tasks.workunit.client.1.smithi052.stdout:7/909: creat d7/d4e/d45/d5a/f136 x:0 0 0 2023-12-05T13:25:28.512 INFO:tasks.workunit.client.1.smithi052.stdout:2/814: symlink d2/d13/d7c/lec 0 2023-12-05T13:25:28.518 INFO:tasks.workunit.client.1.smithi052.stdout:9/792: creat d3/d5e/da7/daf/dbe/f10f x:0 0 0 2023-12-05T13:25:28.518 INFO:tasks.workunit.client.1.smithi052.stdout:9/793: chown d3/d5e/da7/fda 4026 1 2023-12-05T13:25:28.519 INFO:tasks.workunit.client.1.smithi052.stdout:9/794: symlink d3/d1e/d62/l110 0 2023-12-05T13:25:28.520 INFO:tasks.workunit.client.1.smithi052.stdout:9/795: symlink d3/d11/d19/de2/l111 0 2023-12-05T13:25:28.520 INFO:tasks.workunit.client.1.smithi052.stdout:9/796: stat d3/d5e/d9e/dd4/ff1 0 2023-12-05T13:25:28.522 INFO:tasks.workunit.client.1.smithi052.stdout:9/797: read d3/f2c [430142,111731] 0 2023-12-05T13:25:28.522 INFO:tasks.workunit.client.1.smithi052.stdout:9/798: readlink d3/d11/l47 0 2023-12-05T13:25:28.522 INFO:tasks.workunit.client.1.smithi052.stdout:9/799: stat d3/d92/da8/le8 0 2023-12-05T13:25:28.522 INFO:tasks.workunit.client.1.smithi052.stdout:9/800: stat d3/l1c 0 2023-12-05T13:25:28.522 INFO:tasks.workunit.client.1.smithi052.stdout:9/801: fsync d3/d2a/f59 0 2023-12-05T13:25:28.525 INFO:tasks.workunit.client.1.smithi052.stdout:9/802: unlink d3/d5e/fd1 0 2023-12-05T13:25:28.525 INFO:tasks.workunit.client.1.smithi052.stdout:9/803: stat d3/d5e/da7/daf/dbe 0 2023-12-05T13:25:28.527 INFO:tasks.workunit.client.1.smithi052.stdout:9/804: creat d3/d11/f112 x:0 0 0 2023-12-05T13:25:28.528 INFO:tasks.workunit.client.1.smithi052.stdout:9/805: getdents d3/d92 0 2023-12-05T13:25:28.529 INFO:tasks.workunit.client.1.smithi052.stdout:9/806: fsync d3/d5e/fdd 0 2023-12-05T13:25:28.531 INFO:tasks.workunit.client.1.smithi052.stdout:9/807: mkdir d3/d1e/d37/d4f/d113 0 2023-12-05T13:25:28.531 INFO:tasks.workunit.client.1.smithi052.stdout:9/808: write d3/d1e/d41/d57/f100 [241672,112779] 0 2023-12-05T13:25:28.531 INFO:tasks.workunit.client.1.smithi052.stdout:7/910: dwrite d7/d4e/d12/d3f/d46/d4d/f125 [0,4194304] 0 2023-12-05T13:25:28.531 INFO:tasks.workunit.client.1.smithi052.stdout:2/815: dwrite d2/d13/d37/d5c/fb6 [4194304,4194304] 0 2023-12-05T13:25:28.534 INFO:tasks.workunit.client.1.smithi052.stdout:9/809: rmdir d3/d1e/d62/dbd 39 2023-12-05T13:25:28.537 INFO:tasks.workunit.client.1.smithi052.stdout:7/911: mknod d7/d4e/d12/d3f/c137 0 2023-12-05T13:25:28.539 INFO:tasks.workunit.client.1.smithi052.stdout:4/815: sync 2023-12-05T13:25:28.539 INFO:tasks.workunit.client.1.smithi052.stdout:5/588: sync 2023-12-05T13:25:28.542 INFO:tasks.workunit.client.1.smithi052.stdout:9/810: creat d3/d5e/da7/d106/f114 x:0 0 0 2023-12-05T13:25:28.544 INFO:tasks.workunit.client.1.smithi052.stdout:7/912: mknod d7/d4e/d45/d5a/d16/c138 0 2023-12-05T13:25:28.544 INFO:tasks.workunit.client.1.smithi052.stdout:7/913: chown d7/d4e/d12/d3f/d46/d4d/d116/ca4 385085589 1 2023-12-05T13:25:28.545 INFO:tasks.workunit.client.1.smithi052.stdout:7/914: write d7/d4e/d12/d3f/d46/d4d/d116/fe4 [2564570,120615] 0 2023-12-05T13:25:28.546 INFO:tasks.workunit.client.1.smithi052.stdout:4/816: rename de/d29/d51/d76/d8f to de/d30/dd1/d10d 0 2023-12-05T13:25:28.548 INFO:tasks.workunit.client.1.smithi052.stdout:5/589: creat d5/d15/d21/d4a/d6e/d91/da6/fc0 x:0 0 0 2023-12-05T13:25:28.549 INFO:tasks.workunit.client.1.smithi052.stdout:8/898: sync 2023-12-05T13:25:28.549 INFO:tasks.workunit.client.1.smithi052.stdout:3/844: sync 2023-12-05T13:25:28.549 INFO:tasks.workunit.client.1.smithi052.stdout:6/638: sync 2023-12-05T13:25:28.553 INFO:tasks.workunit.client.1.smithi052.stdout:1/870: sync 2023-12-05T13:25:28.557 INFO:tasks.workunit.client.1.smithi052.stdout:7/915: rename d7/d4e/d12/d3f/d46 to d7/d4e/d86/d139 0 2023-12-05T13:25:28.562 INFO:tasks.workunit.client.1.smithi052.stdout:4/817: symlink de/d30/d73/d85/l10e 0 2023-12-05T13:25:28.562 INFO:tasks.workunit.client.1.smithi052.stdout:5/590: mkdir d5/d15/d21/d4a/d6e/d91/da6/d88/dc1 0 2023-12-05T13:25:28.563 INFO:tasks.workunit.client.1.smithi052.stdout:3/845: rmdir da/d25/d33/d89 39 2023-12-05T13:25:28.565 INFO:tasks.workunit.client.1.smithi052.stdout:6/639: mknod d3/ce0 0 2023-12-05T13:25:28.565 INFO:tasks.workunit.client.1.smithi052.stdout:9/811: dwrite d3/d5e/da7/daf/dbe/fed [0,4194304] 0 2023-12-05T13:25:28.568 INFO:tasks.workunit.client.1.smithi052.stdout:8/899: creat d0/d28/d2b/d53/d56/d111/d4f/f12d x:0 0 0 2023-12-05T13:25:28.569 INFO:tasks.workunit.client.1.smithi052.stdout:8/900: write d0/de/d27/f4e [6725244,114522] 0 2023-12-05T13:25:28.570 INFO:tasks.workunit.client.1.smithi052.stdout:1/871: rmdir d5/d7/d35/d37/d43 39 2023-12-05T13:25:28.578 INFO:tasks.workunit.client.1.smithi052.stdout:7/916: mknod d7/d4e/c13a 0 2023-12-05T13:25:28.581 INFO:tasks.workunit.client.1.smithi052.stdout:5/591: creat d5/d46/d76/fc2 x:0 0 0 2023-12-05T13:25:28.584 INFO:tasks.workunit.client.1.smithi052.stdout:9/812: chown d3/d31/c98 737942 1 2023-12-05T13:25:28.584 INFO:tasks.workunit.client.1.smithi052.stdout:3/846: dwrite da/d25/d33/d49/dbd/d74/f113 [0,4194304] 0 2023-12-05T13:25:28.587 INFO:tasks.workunit.client.1.smithi052.stdout:8/901: creat d0/d28/d2b/d53/d56/d111/d4f/f12e x:0 0 0 2023-12-05T13:25:28.588 INFO:tasks.workunit.client.1.smithi052.stdout:7/917: creat d7/d4e/d45/d79/d91/d101/d124/d12d/f13b x:0 0 0 2023-12-05T13:25:28.592 INFO:tasks.workunit.client.1.smithi052.stdout:7/918: symlink d7/d4e/l13c 0 2023-12-05T13:25:28.592 INFO:tasks.workunit.client.1.smithi052.stdout:9/813: dread d3/d11/d3e/f6e [0,4194304] 0 2023-12-05T13:25:28.595 INFO:tasks.workunit.client.1.smithi052.stdout:3/847: dread da/d2e/f85 [0,4194304] 0 2023-12-05T13:25:28.595 INFO:tasks.workunit.client.1.smithi052.stdout:6/640: dwrite d3/d5/d9/d21/d48/d4d/d81/fdb [0,4194304] 0 2023-12-05T13:25:28.595 INFO:tasks.workunit.client.1.smithi052.stdout:7/919: rename d7/d31/d56/fe7 to d7/d4e/d45/d50/db7/f13d 0 2023-12-05T13:25:28.595 INFO:tasks.workunit.client.1.smithi052.stdout:9/814: dread - d3/d5e/ff7 zero size 2023-12-05T13:25:28.595 INFO:tasks.workunit.client.1.smithi052.stdout:5/592: write d5/f9 [6854699,79623] 0 2023-12-05T13:25:28.599 INFO:tasks.workunit.client.1.smithi052.stdout:7/920: rename d7/d4e/d86/d139/d4d/d116/ca1 to d7/c13e 0 2023-12-05T13:25:28.599 INFO:tasks.workunit.client.1.smithi052.stdout:1/872: dwrite d5/d7/d35/d2f/f7f [0,4194304] 0 2023-12-05T13:25:28.600 INFO:tasks.workunit.client.1.smithi052.stdout:9/815: truncate d3/d2a/ff5 880331 0 2023-12-05T13:25:28.600 INFO:tasks.workunit.client.1.smithi052.stdout:1/873: write d5/d7/d35/d37/d43/fe8 [837052,11224] 0 2023-12-05T13:25:28.600 INFO:tasks.workunit.client.1.smithi052.stdout:1/874: chown d5/d26/de5/fee 1 1 2023-12-05T13:25:28.600 INFO:tasks.workunit.client.1.smithi052.stdout:9/816: write d3/d5e/d9e/fe3 [245433,100103] 0 2023-12-05T13:25:28.605 INFO:tasks.workunit.client.1.smithi052.stdout:5/593: creat d5/df/d11/d73/d77/fc3 x:0 0 0 2023-12-05T13:25:28.605 INFO:tasks.workunit.client.1.smithi052.stdout:5/594: fsync d5/d15/d21/d4a/d6e/d91/da6/f50 0 2023-12-05T13:25:28.605 INFO:tasks.workunit.client.1.smithi052.stdout:6/641: rename d3/d4/df/fcb to d3/d5/d9/d21/d48/d5b/fe1 0 2023-12-05T13:25:28.605 INFO:tasks.workunit.client.1.smithi052.stdout:6/642: fdatasync d3/d4/df/f43 0 2023-12-05T13:25:28.608 INFO:tasks.workunit.client.1.smithi052.stdout:0/790: sync 2023-12-05T13:25:28.609 INFO:tasks.workunit.client.1.smithi052.stdout:8/902: dwrite d0/de/d27/d43/da2/fe8 [0,4194304] 0 2023-12-05T13:25:28.609 INFO:tasks.workunit.client.1.smithi052.stdout:8/903: truncate d0/de/d12/d29/db3/dc5/f126 36839 0 2023-12-05T13:25:28.610 INFO:tasks.workunit.client.1.smithi052.stdout:1/875: mkdir d5/daa/da4/d106/d114 0 2023-12-05T13:25:28.612 INFO:tasks.workunit.client.1.smithi052.stdout:9/817: dread - d3/d92/ffd zero size 2023-12-05T13:25:28.612 INFO:tasks.workunit.client.1.smithi052.stdout:9/818: chown d3/d92/fa6 107948 1 2023-12-05T13:25:28.612 INFO:tasks.workunit.client.1.smithi052.stdout:5/595: getdents d5/df/d4b 0 2023-12-05T13:25:28.614 INFO:tasks.workunit.client.1.smithi052.stdout:0/791: mknod d0/db/d2e/d53/c104 0 2023-12-05T13:25:28.615 INFO:tasks.workunit.client.1.smithi052.stdout:3/848: dwrite da/fe [0,4194304] 0 2023-12-05T13:25:28.615 INFO:tasks.workunit.client.1.smithi052.stdout:3/849: stat da/d25/dcd/dc6/lc7 0 2023-12-05T13:25:28.616 INFO:tasks.workunit.client.1.smithi052.stdout:7/921: dwrite d7/d4e/d12/f43 [0,4194304] 0 2023-12-05T13:25:28.620 INFO:tasks.workunit.client.1.smithi052.stdout:7/922: symlink d7/dd5/d130/l13f 0 2023-12-05T13:25:28.620 INFO:tasks.workunit.client.1.smithi052.stdout:7/923: fsync d7/d4e/d12/d3f/f80 0 2023-12-05T13:25:28.622 INFO:tasks.workunit.client.1.smithi052.stdout:9/819: rmdir d3/d1e/d41 39 2023-12-05T13:25:28.627 INFO:tasks.workunit.client.1.smithi052.stdout:7/924: truncate d7/d4e/d45/d5a/d63/d95/dba/fc3 416612 0 2023-12-05T13:25:28.629 INFO:tasks.workunit.client.1.smithi052.stdout:9/820: mknod d3/d31/c115 0 2023-12-05T13:25:28.630 INFO:tasks.workunit.client.1.smithi052.stdout:1/876: dwrite d5/d7/de/d74/fb2 [0,4194304] 0 2023-12-05T13:25:28.632 INFO:tasks.workunit.client.1.smithi052.stdout:9/821: getdents d3/d5e 0 2023-12-05T13:25:28.634 INFO:tasks.workunit.client.1.smithi052.stdout:8/904: dwrite d0/d28/d2b/d53/fa5 [0,4194304] 0 2023-12-05T13:25:28.634 INFO:tasks.workunit.client.1.smithi052.stdout:8/905: stat d0/d28/d2b/d53/d56/d111/d9f 0 2023-12-05T13:25:28.637 INFO:tasks.workunit.client.1.smithi052.stdout:1/877: creat d5/d7/d35/d37/d5a/f115 x:0 0 0 2023-12-05T13:25:28.644 INFO:tasks.workunit.client.1.smithi052.stdout:0/792: dwrite d0/db/d14/f40 [0,4194304] 0 2023-12-05T13:25:28.646 INFO:tasks.workunit.client.1.smithi052.stdout:7/925: dwrite d7/d4e/d45/f134 [4194304,4194304] 0 2023-12-05T13:25:28.646 INFO:tasks.workunit.client.1.smithi052.stdout:0/793: creat d0/db/d2e/d7e/da6/f105 x:0 0 0 2023-12-05T13:25:28.647 INFO:tasks.workunit.client.1.smithi052.stdout:0/794: dread - d0/db/d1b/d51/fe6 zero size 2023-12-05T13:25:28.647 INFO:tasks.workunit.client.1.smithi052.stdout:0/795: readlink d0/db/d1b/d29/db0/lef 0 2023-12-05T13:25:28.647 INFO:tasks.workunit.client.1.smithi052.stdout:0/796: mknod d0/db/d52/c106 0 2023-12-05T13:25:28.650 INFO:tasks.workunit.client.1.smithi052.stdout:0/797: rmdir d0/db/d20 39 2023-12-05T13:25:28.656 INFO:tasks.workunit.client.1.smithi052.stdout:0/798: mkdir d0/db/d2e/d7e/dcc/dee/d107 0 2023-12-05T13:25:28.657 INFO:tasks.workunit.client.1.smithi052.stdout:7/926: dread d7/f73 [0,4194304] 0 2023-12-05T13:25:28.657 INFO:tasks.workunit.client.1.smithi052.stdout:7/927: fdatasync d7/d4e/d12/d3f/f80 0 2023-12-05T13:25:28.659 INFO:tasks.workunit.client.1.smithi052.stdout:1/878: write d5/d7/d35/d2f/d3e/d62/f97 [2504464,20143] 0 2023-12-05T13:25:28.659 INFO:tasks.workunit.client.1.smithi052.stdout:1/879: readlink d5/daa/d2a/l2b 0 2023-12-05T13:25:28.659 INFO:tasks.workunit.client.1.smithi052.stdout:8/906: dwrite d0/de/d27/f92 [0,4194304] 0 2023-12-05T13:25:28.662 INFO:tasks.workunit.client.1.smithi052.stdout:1/880: mknod d5/d26/d41/c116 0 2023-12-05T13:25:28.662 INFO:tasks.workunit.client.1.smithi052.stdout:8/907: mkdir d0/d28/d2b/d53/d56/d111/d4f/d12f 0 2023-12-05T13:25:28.663 INFO:tasks.workunit.client.1.smithi052.stdout:8/908: dread - d0/d28/d2b/dcf/de6/f110 zero size 2023-12-05T13:25:28.664 INFO:tasks.workunit.client.1.smithi052.stdout:1/881: truncate d5/d7/f13 2811138 0 2023-12-05T13:25:28.664 INFO:tasks.workunit.client.1.smithi052.stdout:1/882: readlink d5/daa/d2a/l2b 0 2023-12-05T13:25:28.665 INFO:tasks.workunit.client.1.smithi052.stdout:8/909: mkdir d0/dae/d130 0 2023-12-05T13:25:28.666 INFO:tasks.workunit.client.1.smithi052.stdout:9/822: dwrite d3/d2a/d5c/f8c [0,4194304] 0 2023-12-05T13:25:28.666 INFO:tasks.workunit.client.1.smithi052.stdout:7/928: dread d7/d4e/d45/d5a/dfe/f115 [0,4194304] 0 2023-12-05T13:25:28.666 INFO:tasks.workunit.client.1.smithi052.stdout:0/799: dread d0/db/d20/d50/f92 [0,4194304] 0 2023-12-05T13:25:28.670 INFO:tasks.workunit.client.1.smithi052.stdout:9/823: creat d3/d1e/d41/d57/de9/f116 x:0 0 0 2023-12-05T13:25:28.672 INFO:tasks.workunit.client.1.smithi052.stdout:8/910: dread d0/de/d12/d29/dcb/fe9 [0,4194304] 0 2023-12-05T13:25:28.673 INFO:tasks.workunit.client.1.smithi052.stdout:8/911: chown d0/de/d27/d43/d44 13763 1 2023-12-05T13:25:28.676 INFO:tasks.workunit.client.1.smithi052.stdout:8/912: mknod d0/de/d98/d9c/c131 0 2023-12-05T13:25:28.682 INFO:tasks.workunit.client.1.smithi052.stdout:2/816: sync 2023-12-05T13:25:28.682 INFO:tasks.workunit.client.1.smithi052.stdout:4/818: sync 2023-12-05T13:25:28.682 INFO:tasks.workunit.client.1.smithi052.stdout:4/819: dread - de/d30/d68/d5c/db8/fe6 zero size 2023-12-05T13:25:28.685 INFO:tasks.workunit.client.1.smithi052.stdout:2/817: write d2/d13/d37/d5c/d80/db4/fd4 [4183489,68999] 0 2023-12-05T13:25:28.686 INFO:tasks.workunit.client.1.smithi052.stdout:2/818: chown d2/d13/d37/d8b/fb9 0 1 2023-12-05T13:25:28.686 INFO:tasks.workunit.client.1.smithi052.stdout:8/913: dread d0/d28/db0/fbe [0,4194304] 0 2023-12-05T13:25:28.688 INFO:tasks.workunit.client.1.smithi052.stdout:8/914: write d0/dae/fb1 [2891741,102609] 0 2023-12-05T13:25:28.688 INFO:tasks.workunit.client.1.smithi052.stdout:8/915: fdatasync d0/de/d27/f92 0 2023-12-05T13:25:28.688 INFO:tasks.workunit.client.1.smithi052.stdout:8/916: write d0/d28/d2b/dcf/de6/f110 [675495,66253] 0 2023-12-05T13:25:28.689 INFO:tasks.workunit.client.1.smithi052.stdout:7/929: dwrite d7/d31/d56/d60/d72/fe3 [0,4194304] 0 2023-12-05T13:25:28.689 INFO:tasks.workunit.client.1.smithi052.stdout:2/819: link d2/d13/d1e/d6a/fba d2/d13/d48/dd3/d62/ddd/fed 0 2023-12-05T13:25:28.690 INFO:tasks.workunit.client.1.smithi052.stdout:9/824: write d3/d11/d19/f27 [4823809,15892] 0 2023-12-05T13:25:28.691 INFO:tasks.workunit.client.1.smithi052.stdout:1/883: dwrite d5/daa/d69/f82 [0,4194304] 0 2023-12-05T13:25:28.691 INFO:tasks.workunit.client.1.smithi052.stdout:7/930: write d7/d4e/d12/d3f/f6e [4699575,24720] 0 2023-12-05T13:25:28.692 INFO:tasks.workunit.client.1.smithi052.stdout:7/931: dread - d7/feb zero size 2023-12-05T13:25:28.692 INFO:tasks.workunit.client.1.smithi052.stdout:2/820: mknod d2/d13/d1e/d6a/d7f/cee 0 2023-12-05T13:25:28.692 INFO:tasks.workunit.client.1.smithi052.stdout:2/821: chown d2/d13/d48/c73 85928266 1 2023-12-05T13:25:28.692 INFO:tasks.workunit.client.1.smithi052.stdout:2/822: dread - d2/d13/d37/d5c/d80/fe9 zero size 2023-12-05T13:25:28.692 INFO:tasks.workunit.client.1.smithi052.stdout:7/932: read d7/d4e/d12/d3f/fe5 [3475346,4529] 0 2023-12-05T13:25:28.694 INFO:tasks.workunit.client.1.smithi052.stdout:1/884: link d5/d7/d35/d2f/d3e/d62/f97 d5/daa/d17/d3c/f117 0 2023-12-05T13:25:28.694 INFO:tasks.workunit.client.1.smithi052.stdout:2/823: write d2/d13/d1e/d6a/d7f/d84/f4f [4585750,10641] 0 2023-12-05T13:25:28.695 INFO:tasks.workunit.client.1.smithi052.stdout:7/933: mkdir d7/d4e/d45/d79/df9/d140 0 2023-12-05T13:25:28.697 INFO:tasks.workunit.client.1.smithi052.stdout:1/885: unlink d5/daa/d79/faf 0 2023-12-05T13:25:28.699 INFO:tasks.workunit.client.1.smithi052.stdout:9/825: read d3/d2a/f39 [5116,30595] 0 2023-12-05T13:25:28.699 INFO:tasks.workunit.client.1.smithi052.stdout:2/824: mknod d2/d13/d37/d5c/da9/cef 0 2023-12-05T13:25:28.702 INFO:tasks.workunit.client.1.smithi052.stdout:1/886: rename d5/daa/d10d to d5/d7/d35/d37/d43/dbc/d118 0 2023-12-05T13:25:28.704 INFO:tasks.workunit.client.1.smithi052.stdout:0/800: dwrite d0/f82 [0,4194304] 0 2023-12-05T13:25:28.704 INFO:tasks.workunit.client.1.smithi052.stdout:0/801: write d0/db/d14/f59 [1462142,772] 0 2023-12-05T13:25:28.705 INFO:tasks.workunit.client.1.smithi052.stdout:2/825: creat d2/d13/d1e/dae/dc3/ff0 x:0 0 0 2023-12-05T13:25:28.706 INFO:tasks.workunit.client.1.smithi052.stdout:1/887: symlink d5/d7/de/d74/d98/l119 0 2023-12-05T13:25:28.706 INFO:tasks.workunit.client.1.smithi052.stdout:0/802: dread d0/dcb/f67 [0,4194304] 0 2023-12-05T13:25:28.709 INFO:tasks.workunit.client.1.smithi052.stdout:4/820: dwrite de/d29/d51/da3/fc9 [0,4194304] 0 2023-12-05T13:25:28.709 INFO:tasks.workunit.client.1.smithi052.stdout:8/917: dwrite d0/d28/d2b/d53/d56/d111/d8f/f121 [0,4194304] 0 2023-12-05T13:25:28.711 INFO:tasks.workunit.client.1.smithi052.stdout:1/888: rename d5/d7/d35/d2f/d3e/d62/d85/c89 to d5/d26/c11a 0 2023-12-05T13:25:28.718 INFO:tasks.workunit.client.1.smithi052.stdout:2/826: dread d2/d13/d1e/d6a/d7f/f81 [0,4194304] 0 2023-12-05T13:25:28.720 INFO:tasks.workunit.client.1.smithi052.stdout:4/821: dread de/d30/d68/d5c/dcb/ffa [0,4194304] 0 2023-12-05T13:25:28.720 INFO:tasks.workunit.client.1.smithi052.stdout:8/918: creat d0/dae/d130/f132 x:0 0 0 2023-12-05T13:25:28.720 INFO:tasks.workunit.client.1.smithi052.stdout:0/803: dread d0/db/d1b/d51/d55/d66/f86 [0,4194304] 0 2023-12-05T13:25:28.722 INFO:tasks.workunit.client.1.smithi052.stdout:9/826: dwrite d3/f6a [0,4194304] 0 2023-12-05T13:25:28.723 INFO:tasks.workunit.client.1.smithi052.stdout:2/827: rmdir d2/d13/d7c 39 2023-12-05T13:25:28.725 INFO:tasks.workunit.client.1.smithi052.stdout:8/919: mkdir d0/d28/db0/d133 0 2023-12-05T13:25:28.727 INFO:tasks.workunit.client.1.smithi052.stdout:0/804: read d0/db/d20/d50/f5d [148867,87535] 0 2023-12-05T13:25:28.728 INFO:tasks.workunit.client.1.smithi052.stdout:8/920: link d0/d28/d2b/d53/d56/d111/d8f/f121 d0/de/d27/d43/d44/f134 0 2023-12-05T13:25:28.728 INFO:tasks.workunit.client.1.smithi052.stdout:8/921: stat d0/d28/d2b/dcf/de6 0 2023-12-05T13:25:28.730 INFO:tasks.workunit.client.1.smithi052.stdout:7/934: dwrite d7/dce/d10f/d11e/f102 [0,4194304] 0 2023-12-05T13:25:28.730 INFO:tasks.workunit.client.1.smithi052.stdout:0/805: mknod d0/db/d2e/d53/df9/c108 0 2023-12-05T13:25:28.730 INFO:tasks.workunit.client.1.smithi052.stdout:0/806: read - d0/db/d52/fb1 zero size 2023-12-05T13:25:28.739 INFO:tasks.workunit.client.1.smithi052.stdout:2/828: dread d2/d13/d48/f91 [0,4194304] 0 2023-12-05T13:25:28.743 INFO:tasks.workunit.client.1.smithi052.stdout:7/935: creat d7/d4e/d45/d5a/d16/f141 x:0 0 0 2023-12-05T13:25:28.743 INFO:tasks.workunit.client.1.smithi052.stdout:7/936: fsync d7/d4e/d12/fd0 0 2023-12-05T13:25:28.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/829: symlink d2/d13/d37/lf1 0 2023-12-05T13:25:28.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/830: chown d2/d13/d37/d5c/da9 11533806 1 2023-12-05T13:25:28.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/831: stat d2/d13/d37/d5c/d80/dc4/de2/le3 0 2023-12-05T13:25:28.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/832: chown d2 5 1 2023-12-05T13:25:28.746 INFO:tasks.workunit.client.1.smithi052.stdout:2/833: write d2/d13/d1e/d6a/d7f/d84/d6e/f7a [1624975,43302] 0 2023-12-05T13:25:28.747 INFO:tasks.workunit.client.1.smithi052.stdout:1/889: dwrite d5/daa/f72 [0,4194304] 0 2023-12-05T13:25:28.747 INFO:tasks.workunit.client.1.smithi052.stdout:1/890: stat d5/d7/de/d74/d99/dc6 0 2023-12-05T13:25:28.747 INFO:tasks.workunit.client.1.smithi052.stdout:7/937: mknod d7/dce/d10f/d11e/d121/c142 0 2023-12-05T13:25:28.747 INFO:tasks.workunit.client.1.smithi052.stdout:7/938: stat d7/d4e/d45/d93/ca0 0 2023-12-05T13:25:28.747 INFO:tasks.workunit.client.1.smithi052.stdout:8/922: dwrite d0/d62/ff7 [0,4194304] 0 2023-12-05T13:25:28.748 INFO:tasks.workunit.client.1.smithi052.stdout:2/834: getdents d2/d13/d1e/dae/dc3 0 2023-12-05T13:25:28.751 INFO:tasks.workunit.client.1.smithi052.stdout:1/891: mknod d5/d7/d35/d37/d5a/d73/d7e/c11b 0 2023-12-05T13:25:28.751 INFO:tasks.workunit.client.1.smithi052.stdout:1/892: dread - d5/d7/d35/d37/f100 zero size 2023-12-05T13:25:28.753 INFO:tasks.workunit.client.1.smithi052.stdout:6/643: sync 2023-12-05T13:25:28.755 INFO:tasks.workunit.client.1.smithi052.stdout:4/822: dwrite de/d30/d73/f9a [0,4194304] 0 2023-12-05T13:25:28.757 INFO:tasks.workunit.client.1.smithi052.stdout:1/893: stat d5/daa/d17/d3c/cd7 0 2023-12-05T13:25:28.758 INFO:tasks.workunit.client.1.smithi052.stdout:2/835: mknod d2/d13/d48/dd3/d62/ddd/cf2 0 2023-12-05T13:25:28.758 INFO:tasks.workunit.client.1.smithi052.stdout:2/836: fsync d2/d4/d3f/d9d/fcd 0 2023-12-05T13:25:28.759 INFO:tasks.workunit.client.1.smithi052.stdout:4/823: link de/f98 de/d29/d51/da3/f10f 0 2023-12-05T13:25:28.759 INFO:tasks.workunit.client.1.smithi052.stdout:8/923: dread d0/de/d98/fba [0,4194304] 0 2023-12-05T13:25:28.761 INFO:tasks.workunit.client.1.smithi052.stdout:4/824: symlink de/d30/d73/dbe/l110 0 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:5/596: sync 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:8/924: unlink d0/l4 0 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:9/827: dwrite d3/d92/da8/fe6 [0,4194304] 0 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:4/825: fsync de/d30/d73/dbe/d24/f8c 0 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:4/826: read - de/d30/d68/fe8 zero size 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:8/925: dread d0/d62/f7e [0,4194304] 0 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:4/827: write de/d29/d51/da3/d6d/f8e [217369,94190] 0 2023-12-05T13:25:28.768 INFO:tasks.workunit.client.1.smithi052.stdout:7/939: dwrite d7/d4e/d45/d5a/d63/d95/dba/fc3 [0,4194304] 0 2023-12-05T13:25:28.769 INFO:tasks.workunit.client.1.smithi052.stdout:6/644: dread d3/d4/df/f43 [0,4194304] 0 2023-12-05T13:25:28.770 INFO:tasks.workunit.client.1.smithi052.stdout:5/597: rename d5/df/d4b/d74 to d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4 0 2023-12-05T13:25:28.774 INFO:tasks.workunit.client.1.smithi052.stdout:3/850: sync 2023-12-05T13:25:28.774 INFO:tasks.workunit.client.1.smithi052.stdout:3/851: chown da/d25/d33/d43/d5b/f67 85177 1 2023-12-05T13:25:28.775 INFO:tasks.workunit.client.1.smithi052.stdout:9/828: truncate d3/d5e/f64 705194 0 2023-12-05T13:25:28.777 INFO:tasks.workunit.client.1.smithi052.stdout:1/894: dwrite d5/daa/da4/fa5 [4194304,4194304] 0 2023-12-05T13:25:28.783 INFO:tasks.workunit.client.1.smithi052.stdout:8/926: creat d0/d28/d2b/d53/d56/d111/d4f/f135 x:0 0 0 2023-12-05T13:25:28.783 INFO:tasks.workunit.client.1.smithi052.stdout:4/828: creat de/d91/f111 x:0 0 0 2023-12-05T13:25:28.783 INFO:tasks.workunit.client.1.smithi052.stdout:7/940: truncate d7/d4e/d12/fd0 977594 0 2023-12-05T13:25:28.783 INFO:tasks.workunit.client.1.smithi052.stdout:8/927: write d0/de/d27/f57 [4520381,105294] 0 2023-12-05T13:25:28.783 INFO:tasks.workunit.client.1.smithi052.stdout:6/645: rmdir d3/d5/d9/d21/d48/d4d/d81 39 2023-12-05T13:25:28.783 INFO:tasks.workunit.client.1.smithi052.stdout:6/646: chown d3/d5/d9/d21/d48/d4d/d81/cd7 155 1 2023-12-05T13:25:28.784 INFO:tasks.workunit.client.1.smithi052.stdout:6/647: read d3/d4/df/d27/f31 [3395565,118967] 0 2023-12-05T13:25:28.784 INFO:tasks.workunit.client.1.smithi052.stdout:5/598: rename d5/d46/faa to d5/d7f/fc5 0 2023-12-05T13:25:28.787 INFO:tasks.workunit.client.1.smithi052.stdout:3/852: creat da/d25/d33/d43/d5b/f116 x:0 0 0 2023-12-05T13:25:28.787 INFO:tasks.workunit.client.1.smithi052.stdout:3/853: chown da/d2e/d40/d6d/cbb 32 1 2023-12-05T13:25:28.789 INFO:tasks.workunit.client.1.smithi052.stdout:9/829: creat d3/d2a/f117 x:0 0 0 2023-12-05T13:25:28.790 INFO:tasks.workunit.client.1.smithi052.stdout:2/837: dwrite d2/d13/d7c/fb5 [0,4194304] 0 2023-12-05T13:25:28.790 INFO:tasks.workunit.client.1.smithi052.stdout:2/838: chown d2/d13/d37/d5c/d80 107971 1 2023-12-05T13:25:28.795 INFO:tasks.workunit.client.1.smithi052.stdout:4/829: dread de/d2b/d80/f101 [0,4194304] 0 2023-12-05T13:25:28.795 INFO:tasks.workunit.client.1.smithi052.stdout:8/928: rmdir d0/de/d98/d9c 39 2023-12-05T13:25:28.796 INFO:tasks.workunit.client.1.smithi052.stdout:6/648: stat d3/d4/c18 0 2023-12-05T13:25:28.796 INFO:tasks.workunit.client.1.smithi052.stdout:7/941: dread d7/d4e/d45/fbb [0,4194304] 0 2023-12-05T13:25:28.796 INFO:tasks.workunit.client.1.smithi052.stdout:7/942: chown d7/d4e/d86/d139/d4d/d116 24543 1 2023-12-05T13:25:28.798 INFO:tasks.workunit.client.1.smithi052.stdout:1/895: rename d5/daa/d17/c19 to d5/d26/d75/c11c 0 2023-12-05T13:25:28.800 INFO:tasks.workunit.client.1.smithi052.stdout:5/599: mknod d5/d15/d21/d4a/cc6 0 2023-12-05T13:25:28.805 INFO:tasks.workunit.client.1.smithi052.stdout:2/839: creat d2/d13/d37/db2/ff3 x:0 0 0 2023-12-05T13:25:28.805 INFO:tasks.workunit.client.1.smithi052.stdout:2/840: fsync d2/d13/fa1 0 2023-12-05T13:25:28.805 INFO:tasks.workunit.client.1.smithi052.stdout:4/830: creat de/d30/d94/f112 x:0 0 0 2023-12-05T13:25:28.805 INFO:tasks.workunit.client.1.smithi052.stdout:4/831: stat de/d2b/d80/cee 0 2023-12-05T13:25:28.805 INFO:tasks.workunit.client.1.smithi052.stdout:7/943: dread d7/d31/f3e [0,4194304] 0 2023-12-05T13:25:28.806 INFO:tasks.workunit.client.1.smithi052.stdout:8/929: symlink d0/de/d27/d43/d44/db9/l136 0 2023-12-05T13:25:28.809 INFO:tasks.workunit.client.1.smithi052.stdout:3/854: dwrite da/d7a/fd1 [0,4194304] 0 2023-12-05T13:25:28.809 INFO:tasks.workunit.client.1.smithi052.stdout:3/855: read - da/d25/d33/d43/d5b/d94/ffa zero size 2023-12-05T13:25:28.811 INFO:tasks.workunit.client.1.smithi052.stdout:5/600: creat d5/d15/d21/d4a/fc7 x:0 0 0 2023-12-05T13:25:28.811 INFO:tasks.workunit.client.1.smithi052.stdout:2/841: write d2/d13/d1e/f57 [3655353,23746] 0 2023-12-05T13:25:28.811 INFO:tasks.workunit.client.1.smithi052.stdout:5/601: truncate d5/faf 729572 0 2023-12-05T13:25:28.813 INFO:tasks.workunit.client.1.smithi052.stdout:4/832: symlink de/d29/l113 0 2023-12-05T13:25:28.813 INFO:tasks.workunit.client.1.smithi052.stdout:4/833: readlink de/d30/l36 0 2023-12-05T13:25:28.814 INFO:tasks.workunit.client.1.smithi052.stdout:8/930: link d0/d28/d39/f118 d0/de/d12/d29/db3/dc5/f137 0 2023-12-05T13:25:28.817 INFO:tasks.workunit.client.1.smithi052.stdout:6/649: mknod d3/d4/d6/d26/ce2 0 2023-12-05T13:25:28.820 INFO:tasks.workunit.client.1.smithi052.stdout:1/896: dwrite d5/d26/d75/fc4 [0,4194304] 0 2023-12-05T13:25:28.821 INFO:tasks.workunit.client.1.smithi052.stdout:1/897: chown d5/d7/d35/d37/d5a/d73/d7e/f6b 0 1 2023-12-05T13:25:28.821 INFO:tasks.workunit.client.1.smithi052.stdout:3/856: symlink da/d27/dec/l117 0 2023-12-05T13:25:28.822 INFO:tasks.workunit.client.1.smithi052.stdout:5/602: rmdir d5/df/d4e/d65 39 2023-12-05T13:25:28.823 INFO:tasks.workunit.client.1.smithi052.stdout:7/944: dwrite d7/d4e/d86/fd4 [0,4194304] 0 2023-12-05T13:25:28.824 INFO:tasks.workunit.client.1.smithi052.stdout:7/945: chown d7/d4e/f36 19617 1 2023-12-05T13:25:28.824 INFO:tasks.workunit.client.1.smithi052.stdout:7/946: read - d7/d4e/d45/d5a/d66/f12b zero size 2023-12-05T13:25:28.825 INFO:tasks.workunit.client.1.smithi052.stdout:2/842: creat d2/d13/ff4 x:0 0 0 2023-12-05T13:25:28.827 INFO:tasks.workunit.client.1.smithi052.stdout:4/834: truncate de/d30/d73/dbe/d24/f8c 1047875 0 2023-12-05T13:25:28.827 INFO:tasks.workunit.client.1.smithi052.stdout:4/835: write de/f4b [1753567,88467] 0 2023-12-05T13:25:28.828 INFO:tasks.workunit.client.1.smithi052.stdout:4/836: read fa [6024096,57948] 0 2023-12-05T13:25:28.830 INFO:tasks.workunit.client.1.smithi052.stdout:6/650: truncate d3/d4/df/d24/f75 320932 0 2023-12-05T13:25:28.830 INFO:tasks.workunit.client.1.smithi052.stdout:8/931: dwrite d0/de/d27/d43/d44/f134 [0,4194304] 0 2023-12-05T13:25:28.832 INFO:tasks.workunit.client.1.smithi052.stdout:7/947: dread d7/d4e/d12/d3f/f80 [0,4194304] 0 2023-12-05T13:25:28.832 INFO:tasks.workunit.client.1.smithi052.stdout:7/948: dread - d7/d4e/d45/d50/db7/f13d zero size 2023-12-05T13:25:28.832 INFO:tasks.workunit.client.1.smithi052.stdout:3/857: dread da/d25/d33/d49/dbd/d74/f113 [0,4194304] 0 2023-12-05T13:25:28.834 INFO:tasks.workunit.client.1.smithi052.stdout:1/898: rename d5/d26/l31 to d5/daa/l11d 0 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:2/843: dread d2/d4/f23 [0,4194304] 0 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/899: getdents d5/daa/d17/d9a/dfc 0 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:5/603: truncate d5/f87 3604619 0 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/900: read - d5/d26/d75/d7a/dad/f107 zero size 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:5/604: fdatasync d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c 0 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:1/901: chown d5/f2c 637209183 1 2023-12-05T13:25:28.835 INFO:tasks.workunit.client.1.smithi052.stdout:2/844: read d2/d13/d48/f91 [2710430,62154] 0 2023-12-05T13:25:28.837 INFO:tasks.workunit.client.1.smithi052.stdout:4/837: dread de/d29/d51/da3/f10f [0,4194304] 0 2023-12-05T13:25:28.842 INFO:tasks.workunit.client.1.smithi052.stdout:6/651: symlink d3/d4/d36/dde/le3 0 2023-12-05T13:25:28.846 INFO:tasks.workunit.client.1.smithi052.stdout:8/932: unlink d0/d28/d2b/d53/d56/d111/d4f/cf0 0 2023-12-05T13:25:28.847 INFO:tasks.workunit.client.1.smithi052.stdout:7/949: mknod d7/d4e/d86/d139/d4d/d116/c143 0 2023-12-05T13:25:28.847 INFO:tasks.workunit.client.1.smithi052.stdout:7/950: chown d7/d4e/d86/d139/d4d/f125 0 1 2023-12-05T13:25:28.847 INFO:tasks.workunit.client.1.smithi052.stdout:7/951: truncate d7/dce/f126 117921 0 2023-12-05T13:25:28.849 INFO:tasks.workunit.client.1.smithi052.stdout:3/858: mkdir da/d25/d33/d89/dae/dcf/dfb/d118 0 2023-12-05T13:25:28.851 INFO:tasks.workunit.client.1.smithi052.stdout:1/902: link d5/daa/d79/la2 d5/d26/d41/dbd/dea/l11e 0 2023-12-05T13:25:28.851 INFO:tasks.workunit.client.1.smithi052.stdout:4/838: dwrite de/d30/f8a [4194304,4194304] 0 2023-12-05T13:25:28.853 INFO:tasks.workunit.client.1.smithi052.stdout:5/605: mknod d5/df/d4e/d5b/dbf/cc8 0 2023-12-05T13:25:28.853 INFO:tasks.workunit.client.1.smithi052.stdout:5/606: write d5/f14 [4473366,30734] 0 2023-12-05T13:25:28.853 INFO:tasks.workunit.client.1.smithi052.stdout:2/845: mkdir d2/d13/d1e/d6a/d7f/d84/df5 0 2023-12-05T13:25:28.854 INFO:tasks.workunit.client.1.smithi052.stdout:6/652: creat d3/d4/d6/d26/d8e/fe4 x:0 0 0 2023-12-05T13:25:28.855 INFO:tasks.workunit.client.1.smithi052.stdout:8/933: mkdir d0/d28/d2b/d138 0 2023-12-05T13:25:28.856 INFO:tasks.workunit.client.1.smithi052.stdout:0/807: sync 2023-12-05T13:25:28.856 INFO:tasks.workunit.client.1.smithi052.stdout:7/952: symlink d7/d4e/d45/d5a/d63/d95/dba/l144 0 2023-12-05T13:25:28.858 INFO:tasks.workunit.client.1.smithi052.stdout:3/859: truncate da/d25/d33/d89/fbf 3955041 0 2023-12-05T13:25:28.859 INFO:tasks.workunit.client.1.smithi052.stdout:1/903: symlink d5/daa/d17/d9a/l11f 0 2023-12-05T13:25:28.861 INFO:tasks.workunit.client.1.smithi052.stdout:4/839: creat de/d30/d94/f114 x:0 0 0 2023-12-05T13:25:28.862 INFO:tasks.workunit.client.1.smithi052.stdout:5/607: symlink d5/df/d4e/da8/lc9 0 2023-12-05T13:25:28.864 INFO:tasks.workunit.client.1.smithi052.stdout:2/846: symlink d2/d13/d48/dd3/d62/da7/lf6 0 2023-12-05T13:25:28.864 INFO:tasks.workunit.client.1.smithi052.stdout:2/847: write d2/d13/d37/d5c/d80/fe9 [672192,48817] 0 2023-12-05T13:25:28.864 INFO:tasks.workunit.client.1.smithi052.stdout:6/653: symlink d3/d5/d9/d21/d48/d4d/d66/d91/le5 0 2023-12-05T13:25:28.866 INFO:tasks.workunit.client.1.smithi052.stdout:8/934: creat d0/d51/f139 x:0 0 0 2023-12-05T13:25:28.866 INFO:tasks.workunit.client.1.smithi052.stdout:8/935: chown d0/de/cd2 26737 1 2023-12-05T13:25:28.866 INFO:tasks.workunit.client.1.smithi052.stdout:8/936: chown d0/d28/db0/f124 8031412 1 2023-12-05T13:25:28.867 INFO:tasks.workunit.client.1.smithi052.stdout:1/904: dread d5/d26/ff4 [0,4194304] 0 2023-12-05T13:25:28.867 INFO:tasks.workunit.client.1.smithi052.stdout:1/905: chown d5/d7/d35/d37/d5a/d73/d76/fe6 107084 1 2023-12-05T13:25:28.873 INFO:tasks.workunit.client.1.smithi052.stdout:0/808: link d0/db/d1b/d29/dba/lc5 d0/db/d1b/d51/d55/d66/l109 0 2023-12-05T13:25:28.873 INFO:tasks.workunit.client.1.smithi052.stdout:0/809: write d0/db/d1b/d29/db0/fa0 [918009,28481] 0 2023-12-05T13:25:28.875 INFO:tasks.workunit.client.1.smithi052.stdout:7/953: creat d7/d4e/d45/d79/d91/d101/f145 x:0 0 0 2023-12-05T13:25:28.875 INFO:tasks.workunit.client.1.smithi052.stdout:7/954: chown d7/d4e/d45/d5a/d63/d95/dba/fc3 239313 1 2023-12-05T13:25:28.875 INFO:tasks.workunit.client.1.smithi052.stdout:7/955: chown d7/dce/f126 101 1 2023-12-05T13:25:28.875 INFO:tasks.workunit.client.1.smithi052.stdout:7/956: chown d7/d4e/d86/d139 732635 1 2023-12-05T13:25:28.877 INFO:tasks.workunit.client.1.smithi052.stdout:3/860: creat da/d25/d33/d49/f119 x:0 0 0 2023-12-05T13:25:28.879 INFO:tasks.workunit.client.1.smithi052.stdout:4/840: creat de/d91/f115 x:0 0 0 2023-12-05T13:25:28.879 INFO:tasks.workunit.client.1.smithi052.stdout:4/841: readlink de/d30/lfb 0 2023-12-05T13:25:28.879 INFO:tasks.workunit.client.1.smithi052.stdout:4/842: dread - de/d30/d73/dbe/d24/ddd/d102/f104 zero size 2023-12-05T13:25:28.879 INFO:tasks.workunit.client.1.smithi052.stdout:3/861: write da/d25/d33/d49/fc2 [95192,129399] 0 2023-12-05T13:25:28.879 INFO:tasks.workunit.client.1.smithi052.stdout:4/843: truncate de/d2b/d64/d69/fd2 842778 0 2023-12-05T13:25:28.879 INFO:tasks.workunit.client.1.smithi052.stdout:3/862: fsync da/dd/fe5 0 2023-12-05T13:25:28.882 INFO:tasks.workunit.client.1.smithi052.stdout:5/608: unlink d5/l8 0 2023-12-05T13:25:28.882 INFO:tasks.workunit.client.1.smithi052.stdout:5/609: chown d5/df/d11/lbe 0 1 2023-12-05T13:25:28.882 INFO:tasks.workunit.client.1.smithi052.stdout:6/654: dwrite d3/d4/df/d24/f75 [0,4194304] 0 2023-12-05T13:25:28.883 INFO:tasks.workunit.client.1.smithi052.stdout:7/957: dread d7/d4e/d12/f43 [0,4194304] 0 2023-12-05T13:25:28.883 INFO:tasks.workunit.client.1.smithi052.stdout:0/810: dread d0/f1a [0,4194304] 0 2023-12-05T13:25:28.884 INFO:tasks.workunit.client.1.smithi052.stdout:2/848: mkdir d2/d13/d1e/d6a/df7 0 2023-12-05T13:25:28.885 INFO:tasks.workunit.client.1.smithi052.stdout:1/906: rename d5/d7/d35/c4e to d5/d26/d75/d7a/c120 0 2023-12-05T13:25:28.890 INFO:tasks.workunit.client.1.smithi052.stdout:4/844: symlink de/d30/d68/d5c/l116 0 2023-12-05T13:25:28.890 INFO:tasks.workunit.client.1.smithi052.stdout:4/845: fdatasync de/d30/d68/d5c/db8/f106 0 2023-12-05T13:25:28.892 INFO:tasks.workunit.client.1.smithi052.stdout:3/863: stat da/d25/c58 0 2023-12-05T13:25:28.892 INFO:tasks.workunit.client.1.smithi052.stdout:5/610: getdents d5/d15/d21/d4a/d6e/d91/da6/d5c/dab 0 2023-12-05T13:25:28.892 INFO:tasks.workunit.client.1.smithi052.stdout:5/611: fdatasync d5/df/d4e/d5b/fb8 0 2023-12-05T13:25:28.892 INFO:tasks.workunit.client.1.smithi052.stdout:5/612: dread - d5/df/d11/d66/f94 zero size 2023-12-05T13:25:28.892 INFO:tasks.workunit.client.1.smithi052.stdout:5/613: chown d5/df/d4e/d5b/dbf 25 1 2023-12-05T13:25:28.894 INFO:tasks.workunit.client.1.smithi052.stdout:7/958: unlink d7/d4e/d86/d139/d4d/c71 0 2023-12-05T13:25:28.896 INFO:tasks.workunit.client.1.smithi052.stdout:2/849: link d2/d13/d37/d5c/f74 d2/d13/ff8 0 2023-12-05T13:25:28.896 INFO:tasks.workunit.client.1.smithi052.stdout:9/830: sync 2023-12-05T13:25:28.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/811: dwrite d0/db/d14/f4f [0,4194304] 0 2023-12-05T13:25:28.898 INFO:tasks.workunit.client.1.smithi052.stdout:0/812: chown d0/db/d1b/d7a/lf6 103377 1 2023-12-05T13:25:28.899 INFO:tasks.workunit.client.1.smithi052.stdout:1/907: rename d5/daa/fd2 to d5/d7/d35/d2f/f121 0 2023-12-05T13:25:28.900 INFO:tasks.workunit.client.1.smithi052.stdout:4/846: mkdir de/d29/d51/d76/dc4/dcf/d117 0 2023-12-05T13:25:28.901 INFO:tasks.workunit.client.1.smithi052.stdout:5/614: mknod d5/df/d11/d73/d77/cca 0 2023-12-05T13:25:28.904 INFO:tasks.workunit.client.1.smithi052.stdout:7/959: creat d7/d4e/d86/d139/d4d/f146 x:0 0 0 2023-12-05T13:25:28.904 INFO:tasks.workunit.client.1.smithi052.stdout:7/960: write d7/d4e/d45/d79/d91/d101/f145 [219223,130560] 0 2023-12-05T13:25:28.904 INFO:tasks.workunit.client.1.smithi052.stdout:7/961: fdatasync d7/d4e/f1a 0 2023-12-05T13:25:28.904 INFO:tasks.workunit.client.1.smithi052.stdout:7/962: chown d7/d31/d56/d60/f76 276333 1 2023-12-05T13:25:28.905 INFO:tasks.workunit.client.1.smithi052.stdout:9/831: mkdir d3/d11/d118 0 2023-12-05T13:25:28.905 INFO:tasks.workunit.client.1.smithi052.stdout:9/832: dread - d3/d5e/d9e/fc2 zero size 2023-12-05T13:25:28.908 INFO:tasks.workunit.client.1.smithi052.stdout:1/908: symlink d5/d26/d41/l122 0 2023-12-05T13:25:28.912 INFO:tasks.workunit.client.1.smithi052.stdout:0/813: rename d0/db/d2e/d53/cab to d0/db/c10a 0 2023-12-05T13:25:28.914 INFO:tasks.workunit.client.1.smithi052.stdout:4/847: symlink de/d30/d73/dbe/d24/ddd/de4/l118 0 2023-12-05T13:25:28.914 INFO:tasks.workunit.client.1.smithi052.stdout:4/848: truncate f4 5266329 0 2023-12-05T13:25:28.915 INFO:tasks.workunit.client.1.smithi052.stdout:0/814: write d0/db/d1b/f37 [405068,124561] 0 2023-12-05T13:25:28.915 INFO:tasks.workunit.client.1.smithi052.stdout:0/815: dread - d0/db/d20/fa5 zero size 2023-12-05T13:25:28.915 INFO:tasks.workunit.client.1.smithi052.stdout:0/816: fdatasync d0/db/d52/d7f/d8f/f99 0 2023-12-05T13:25:28.917 INFO:tasks.workunit.client.1.smithi052.stdout:5/615: mkdir d5/d15/d21/d4a/d6e/d91/da6/dcb 0 2023-12-05T13:25:28.919 INFO:tasks.workunit.client.1.smithi052.stdout:2/850: dwrite d2/d13/d37/d5c/d80/dc4/fdb [0,4194304] 0 2023-12-05T13:25:28.919 INFO:tasks.workunit.client.1.smithi052.stdout:1/909: dread d5/daa/d17/d3c/f117 [0,4194304] 0 2023-12-05T13:25:28.919 INFO:tasks.workunit.client.1.smithi052.stdout:1/910: dread - d5/daa/f10b zero size 2023-12-05T13:25:28.924 INFO:tasks.workunit.client.1.smithi052.stdout:7/963: dwrite d7/d4e/db4/ff7 [0,4194304] 0 2023-12-05T13:25:28.924 INFO:tasks.workunit.client.1.smithi052.stdout:9/833: rename d3/d11/d19/d83 to d3/d92/da8/d119 0 2023-12-05T13:25:28.931 INFO:tasks.workunit.client.1.smithi052.stdout:0/817: truncate d0/db/d14/f2f 1448201 0 2023-12-05T13:25:28.933 INFO:tasks.workunit.client.1.smithi052.stdout:2/851: symlink d2/d4/d63/d6d/lf9 0 2023-12-05T13:25:28.936 INFO:tasks.workunit.client.1.smithi052.stdout:4/849: dwrite de/d30/dac/dbb/ffe [0,4194304] 0 2023-12-05T13:25:28.936 INFO:tasks.workunit.client.1.smithi052.stdout:4/850: fdatasync de/d30/d68/d5c/db8/fe6 0 2023-12-05T13:25:28.941 INFO:tasks.workunit.client.1.smithi052.stdout:2/852: dread d2/d13/f26 [0,4194304] 0 2023-12-05T13:25:28.942 INFO:tasks.workunit.client.1.smithi052.stdout:2/853: write d2/f9f [323450,13860] 0 2023-12-05T13:25:28.943 INFO:tasks.workunit.client.1.smithi052.stdout:7/964: symlink d7/dce/d11b/l147 0 2023-12-05T13:25:28.946 INFO:tasks.workunit.client.1.smithi052.stdout:5/616: rename d5/c97 to d5/d15/d21/d4a/d6e/d91/da6/dcb/ccc 0 2023-12-05T13:25:28.948 INFO:tasks.workunit.client.1.smithi052.stdout:9/834: truncate d3/d1e/d62/dbd/ff0 212323 0 2023-12-05T13:25:28.950 INFO:tasks.workunit.client.1.smithi052.stdout:0/818: creat d0/db/d20/d9c/f10b x:0 0 0 2023-12-05T13:25:28.951 INFO:tasks.workunit.client.1.smithi052.stdout:0/819: write d0/db/d2e/f46 [84414,69678] 0 2023-12-05T13:25:28.953 INFO:tasks.workunit.client.1.smithi052.stdout:4/851: creat de/d30/dd1/f119 x:0 0 0 2023-12-05T13:25:28.954 INFO:tasks.workunit.client.1.smithi052.stdout:2/854: rmdir d2/d13/d1e/d6a/d7f/d84 39 2023-12-05T13:25:28.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/852: dread de/d29/f5d [4194304,4194304] 0 2023-12-05T13:25:28.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/853: read de/f33 [141082,88535] 0 2023-12-05T13:25:28.956 INFO:tasks.workunit.client.1.smithi052.stdout:7/965: mkdir d7/dce/d148 0 2023-12-05T13:25:28.956 INFO:tasks.workunit.client.1.smithi052.stdout:7/966: fdatasync d7/d4e/d45/d5a/d16/f7c 0 2023-12-05T13:25:28.957 INFO:tasks.workunit.client.1.smithi052.stdout:7/967: truncate d7/d4e/d12/d3f/f7f 4272450 0 2023-12-05T13:25:28.957 INFO:tasks.workunit.client.1.smithi052.stdout:4/854: write de/d30/d73/dbe/f21 [3775926,57763] 0 2023-12-05T13:25:28.957 INFO:tasks.workunit.client.1.smithi052.stdout:4/855: chown de/d29/cb7 861067 1 2023-12-05T13:25:28.957 INFO:tasks.workunit.client.1.smithi052.stdout:4/856: write de/d30/d73/dbe/d24/f103 [238978,73847] 0 2023-12-05T13:25:28.957 INFO:tasks.workunit.client.1.smithi052.stdout:4/857: read - de/d30/dd1/f119 zero size 2023-12-05T13:25:28.959 INFO:tasks.workunit.client.1.smithi052.stdout:1/911: rename d5/d26/d41/lde to d5/d7/de/l123 0 2023-12-05T13:25:28.959 INFO:tasks.workunit.client.1.smithi052.stdout:1/912: fsync d5/d7/d35/d2f/d3e/d62/f101 0 2023-12-05T13:25:28.962 INFO:tasks.workunit.client.1.smithi052.stdout:2/855: creat d2/d13/d37/db2/ffa x:0 0 0 2023-12-05T13:25:28.962 INFO:tasks.workunit.client.1.smithi052.stdout:2/856: write d2/d13/d37/d61/f6c [4185436,52957] 0 2023-12-05T13:25:28.964 INFO:tasks.workunit.client.1.smithi052.stdout:7/968: creat d7/d4e/d12/d7d/dc7/f149 x:0 0 0 2023-12-05T13:25:28.964 INFO:tasks.workunit.client.1.smithi052.stdout:7/969: dread - d7/d4e/d45/d79/d91/fb2 zero size 2023-12-05T13:25:28.965 INFO:tasks.workunit.client.1.smithi052.stdout:4/858: creat de/d2b/f11a x:0 0 0 2023-12-05T13:25:28.968 INFO:tasks.workunit.client.1.smithi052.stdout:1/913: mkdir d5/d7/df1/d124 0 2023-12-05T13:25:28.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/859: write de/f87 [3004651,42829] 0 2023-12-05T13:25:28.968 INFO:tasks.workunit.client.1.smithi052.stdout:4/860: stat de/f18 0 2023-12-05T13:25:28.970 INFO:tasks.workunit.client.1.smithi052.stdout:5/617: rename d5/d15/d21/d4a/d6e/d91/da6/fc0 to d5/d15/d21/d4a/d6e/d91/da6/d88/da7/fcd 0 2023-12-05T13:25:28.970 INFO:tasks.workunit.client.1.smithi052.stdout:8/937: sync 2023-12-05T13:25:28.970 INFO:tasks.workunit.client.1.smithi052.stdout:2/857: link d2/d4/d3f/lbe d2/d13/d1e/d6a/df7/lfb 0 2023-12-05T13:25:28.980 INFO:tasks.workunit.client.1.smithi052.stdout:9/835: rename d3/d2a/d8f to d3/d1e/d41/d57/d11a 0 2023-12-05T13:25:28.980 INFO:tasks.workunit.client.1.smithi052.stdout:9/836: stat d3/d11/d3e 0 2023-12-05T13:25:28.984 INFO:tasks.workunit.client.1.smithi052.stdout:5/618: symlink d5/df/d8d/lce 0 2023-12-05T13:25:28.985 INFO:tasks.workunit.client.1.smithi052.stdout:1/914: dwrite d5/d26/de5/fee [0,4194304] 0 2023-12-05T13:25:28.985 INFO:tasks.workunit.client.1.smithi052.stdout:1/915: dread - d5/d7/de/d74/d99/dcc/f111 zero size 2023-12-05T13:25:28.986 INFO:tasks.workunit.client.1.smithi052.stdout:2/858: link d2/d13/d37/lce d2/d13/d37/d61/lfc 0 2023-12-05T13:25:28.988 INFO:tasks.workunit.client.1.smithi052.stdout:8/938: dwrite d0/d28/d2b/d53/d56/d111/d8f/fb2 [0,4194304] 0 2023-12-05T13:25:28.988 INFO:tasks.workunit.client.1.smithi052.stdout:7/970: rename d7/d31/d56/d60/d72/d12c to d7/d4e/db4/d14a 0 2023-12-05T13:25:28.990 INFO:tasks.workunit.client.1.smithi052.stdout:9/837: creat d3/d2a/d5c/f11b x:0 0 0 2023-12-05T13:25:28.991 INFO:tasks.workunit.client.1.smithi052.stdout:5/619: readlink d5/df/d11/l1c 0 2023-12-05T13:25:28.992 INFO:tasks.workunit.client.1.smithi052.stdout:4/861: dwrite de/d29/d51/fb6 [0,4194304] 0 2023-12-05T13:25:28.992 INFO:tasks.workunit.client.1.smithi052.stdout:4/862: chown de/d29/d51/da3/d6d/c86 410904466 1 2023-12-05T13:25:28.994 INFO:tasks.workunit.client.1.smithi052.stdout:1/916: truncate d5/d7/d35/d37/d5a/d73/d76/fe6 1731433 0 2023-12-05T13:25:28.996 INFO:tasks.workunit.client.1.smithi052.stdout:1/917: write d5/d7/d35/d37/d5a/d73/f84 [4120523,13199] 0 2023-12-05T13:25:28.996 INFO:tasks.workunit.client.1.smithi052.stdout:1/918: stat d5/d7/d35/d2f/d3e/d62/f101 0 2023-12-05T13:25:28.996 INFO:tasks.workunit.client.1.smithi052.stdout:8/939: unlink d0/d28/d2b/d53/d56/d111/d4f/f135 0 2023-12-05T13:25:28.997 INFO:tasks.workunit.client.1.smithi052.stdout:8/940: chown d0/de/d27/f4e 83997 1 2023-12-05T13:25:28.997 INFO:tasks.workunit.client.1.smithi052.stdout:7/971: creat d7/d31/f14b x:0 0 0 2023-12-05T13:25:28.997 INFO:tasks.workunit.client.1.smithi052.stdout:7/972: readlink d7/d4e/d45/d5a/d63/la8 0 2023-12-05T13:25:28.998 INFO:tasks.workunit.client.1.smithi052.stdout:9/838: symlink d3/d1e/d37/d4f/d113/l11c 0 2023-12-05T13:25:28.999 INFO:tasks.workunit.client.1.smithi052.stdout:4/863: dread de/d2b/d80/f101 [0,4194304] 0 2023-12-05T13:25:28.999 INFO:tasks.workunit.client.1.smithi052.stdout:2/859: dread d2/d4/f89 [0,4194304] 0 2023-12-05T13:25:29.002 INFO:tasks.workunit.client.1.smithi052.stdout:1/919: rename d5/d7/d35/d37/d5a/d73/d7e/d4f to d5/daa/da4/d125 0 2023-12-05T13:25:29.002 INFO:tasks.workunit.client.1.smithi052.stdout:1/920: truncate d5/daa/d79/ff8 375471 0 2023-12-05T13:25:29.004 INFO:tasks.workunit.client.1.smithi052.stdout:8/941: unlink d0/d62/ff7 0 2023-12-05T13:25:29.004 INFO:tasks.workunit.client.1.smithi052.stdout:8/942: dread - d0/d28/d2b/d53/d56/fec zero size 2023-12-05T13:25:29.006 INFO:tasks.workunit.client.1.smithi052.stdout:7/973: link d7/d4e/d86/d139/dab/df6/f10c d7/d4e/d12/d3f/f14c 0 2023-12-05T13:25:29.006 INFO:tasks.workunit.client.1.smithi052.stdout:2/860: dread d2/d13/d48/dd3/d62/da7/fad [0,4194304] 0 2023-12-05T13:25:29.010 INFO:tasks.workunit.client.1.smithi052.stdout:5/620: creat d5/df/d11/d73/d8b/fcf x:0 0 0 2023-12-05T13:25:29.015 INFO:tasks.workunit.client.1.smithi052.stdout:7/974: dread d7/d4e/d45/d5a/d16/dae/fda [0,4194304] 0 2023-12-05T13:25:29.016 INFO:tasks.workunit.client.1.smithi052.stdout:5/621: read d5/d15/d21/f75 [139349,25653] 0 2023-12-05T13:25:29.017 INFO:tasks.workunit.client.1.smithi052.stdout:4/864: mknod de/d29/d51/da3/d6d/df2/c11b 0 2023-12-05T13:25:29.017 INFO:tasks.workunit.client.1.smithi052.stdout:8/943: creat d0/d28/db0/f13a x:0 0 0 2023-12-05T13:25:29.017 INFO:tasks.workunit.client.1.smithi052.stdout:9/839: mkdir d3/d5e/da7/daf/def/d11d 0 2023-12-05T13:25:29.017 INFO:tasks.workunit.client.1.smithi052.stdout:6/655: sync 2023-12-05T13:25:29.019 INFO:tasks.workunit.client.1.smithi052.stdout:4/865: creat de/d91/f11c x:0 0 0 2023-12-05T13:25:29.019 INFO:tasks.workunit.client.1.smithi052.stdout:8/944: creat d0/d28/f13b x:0 0 0 2023-12-05T13:25:29.020 INFO:tasks.workunit.client.1.smithi052.stdout:2/861: mkdir d2/d13/d48/dd3/dfd 0 2023-12-05T13:25:29.020 INFO:tasks.workunit.client.1.smithi052.stdout:9/840: fdatasync d3/f2c 0 2023-12-05T13:25:29.020 INFO:tasks.workunit.client.1.smithi052.stdout:6/656: mknod d3/ce6 0 2023-12-05T13:25:29.021 INFO:tasks.workunit.client.1.smithi052.stdout:4/866: mknod de/d30/d73/c11d 0 2023-12-05T13:25:29.022 INFO:tasks.workunit.client.1.smithi052.stdout:1/921: dwrite d5/d7/d35/d2f/d3e/f54 [4194304,4194304] 0 2023-12-05T13:25:29.023 INFO:tasks.workunit.client.1.smithi052.stdout:8/945: rename d0/de/d27/d43/c6f to d0/de/d27/d43/d44/db9/d125/c13c 0 2023-12-05T13:25:29.025 INFO:tasks.workunit.client.1.smithi052.stdout:1/922: dread d5/d7/de/d74/f77 [0,4194304] 0 2023-12-05T13:25:29.029 INFO:tasks.workunit.client.1.smithi052.stdout:9/841: rename d3/d11/d19/de2 to d3/d2a/d11e 0 2023-12-05T13:25:29.029 INFO:tasks.workunit.client.1.smithi052.stdout:2/862: dread d2/d13/d37/d5c/fb6 [0,4194304] 0 2023-12-05T13:25:29.029 INFO:tasks.workunit.client.1.smithi052.stdout:2/863: dread - d2/d13/d1e/fc2 zero size 2023-12-05T13:25:29.030 INFO:tasks.workunit.client.1.smithi052.stdout:8/946: rmdir d0/de/d86 39 2023-12-05T13:25:29.034 INFO:tasks.workunit.client.1.smithi052.stdout:1/923: symlink d5/d7/d35/d37/d5a/d73/d76/de7/l126 0 2023-12-05T13:25:29.035 INFO:tasks.workunit.client.1.smithi052.stdout:9/842: readlink d3/l7a 0 2023-12-05T13:25:29.037 INFO:tasks.workunit.client.1.smithi052.stdout:8/947: unlink d0/de/d12/d29/d81/c12b 0 2023-12-05T13:25:29.040 INFO:tasks.workunit.client.1.smithi052.stdout:4/867: write f4 [5637,8763] 0 2023-12-05T13:25:29.040 INFO:tasks.workunit.client.1.smithi052.stdout:4/868: stat de/d29/d51/f57 0 2023-12-05T13:25:29.042 INFO:tasks.workunit.client.1.smithi052.stdout:9/843: creat d3/d1e/d41/d86/f11f x:0 0 0 2023-12-05T13:25:29.043 INFO:tasks.workunit.client.1.smithi052.stdout:8/948: rmdir d0/de/d12/d29/dcb 39 2023-12-05T13:25:29.046 INFO:tasks.workunit.client.1.smithi052.stdout:5/622: dwrite d5/d15/d21/f75 [0,4194304] 0 2023-12-05T13:25:29.046 INFO:tasks.workunit.client.1.smithi052.stdout:9/844: unlink d3/d11/lee 0 2023-12-05T13:25:29.047 INFO:tasks.workunit.client.1.smithi052.stdout:9/845: write d3/d11/f21 [2868222,30569] 0 2023-12-05T13:25:29.047 INFO:tasks.workunit.client.1.smithi052.stdout:9/846: fsync d3/d11/d3e/f51 0 2023-12-05T13:25:29.047 INFO:tasks.workunit.client.1.smithi052.stdout:8/949: creat d0/d28/d39/f13d x:0 0 0 2023-12-05T13:25:29.048 INFO:tasks.workunit.client.1.smithi052.stdout:8/950: write d0/de/d27/d43/d63/f9d [1751637,33347] 0 2023-12-05T13:25:29.052 INFO:tasks.workunit.client.1.smithi052.stdout:6/657: dwrite d3/d5/d9/d21/d48/d5b/f7b [0,4194304] 0 2023-12-05T13:25:29.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/864: dwrite d2/d4/d3f/f92 [0,4194304] 0 2023-12-05T13:25:29.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/865: dread - d2/d13/fa1 zero size 2023-12-05T13:25:29.053 INFO:tasks.workunit.client.1.smithi052.stdout:2/866: chown d2/d4/d3f/f97 7565395 1 2023-12-05T13:25:29.054 INFO:tasks.workunit.client.1.smithi052.stdout:2/867: write d2/d13/d37/d5c/d80/db4/fd4 [4340476,27386] 0 2023-12-05T13:25:29.054 INFO:tasks.workunit.client.1.smithi052.stdout:5/623: chown d5/df/d11/l3e 696027159 1 2023-12-05T13:25:29.054 INFO:tasks.workunit.client.1.smithi052.stdout:5/624: truncate d5/d15/d21/d4a/d6e/d91/da6/f5a 1139975 0 2023-12-05T13:25:29.054 INFO:tasks.workunit.client.1.smithi052.stdout:7/975: dwrite d7/d4e/d45/d5a/fcd [0,4194304] 0 2023-12-05T13:25:29.057 INFO:tasks.workunit.client.1.smithi052.stdout:1/924: dwrite d5/d26/de5/fee [0,4194304] 0 2023-12-05T13:25:29.058 INFO:tasks.workunit.client.1.smithi052.stdout:9/847: creat d3/d1e/d37/d4f/d113/f120 x:0 0 0 2023-12-05T13:25:29.058 INFO:tasks.workunit.client.1.smithi052.stdout:9/848: chown d3/d92/da8/lc6 0 1 2023-12-05T13:25:29.060 INFO:tasks.workunit.client.1.smithi052.stdout:1/925: write d5/d7/d35/d2f/d3e/d62/f97 [2615227,8272] 0 2023-12-05T13:25:29.060 INFO:tasks.workunit.client.1.smithi052.stdout:3/864: sync 2023-12-05T13:25:29.060 INFO:tasks.workunit.client.1.smithi052.stdout:0/820: sync 2023-12-05T13:25:29.060 INFO:tasks.workunit.client.1.smithi052.stdout:0/821: write d0/db/d20/d50/dae/fd4 [861430,68899] 0 2023-12-05T13:25:29.061 INFO:tasks.workunit.client.1.smithi052.stdout:1/926: dread d5/daa/d2a/f9e [0,4194304] 0 2023-12-05T13:25:29.063 INFO:tasks.workunit.client.1.smithi052.stdout:4/869: dwrite de/d29/d51/da3/fe5 [0,4194304] 0 2023-12-05T13:25:29.065 INFO:tasks.workunit.client.1.smithi052.stdout:2/868: symlink d2/d13/d1e/d6a/d7f/d84/df5/lfe 0 2023-12-05T13:25:29.065 INFO:tasks.workunit.client.1.smithi052.stdout:5/625: dread - d5/df/d11/d66/fad zero size 2023-12-05T13:25:29.066 INFO:tasks.workunit.client.1.smithi052.stdout:5/626: fsync d5/faf 0 2023-12-05T13:25:29.069 INFO:tasks.workunit.client.1.smithi052.stdout:7/976: creat d7/d4e/d45/d50/f14d x:0 0 0 2023-12-05T13:25:29.071 INFO:tasks.workunit.client.1.smithi052.stdout:9/849: mkdir d3/d1e/d121 0 2023-12-05T13:25:29.072 INFO:tasks.workunit.client.1.smithi052.stdout:3/865: truncate da/dd/d3d/fdf 581511 0 2023-12-05T13:25:29.074 INFO:tasks.workunit.client.1.smithi052.stdout:0/822: creat d0/db/d20/f10c x:0 0 0 2023-12-05T13:25:29.074 INFO:tasks.workunit.client.1.smithi052.stdout:0/823: dread - d0/db/d1b/fd6 zero size 2023-12-05T13:25:29.074 INFO:tasks.workunit.client.1.smithi052.stdout:6/658: dwrite d3/d4/d36/f8b [0,4194304] 0 2023-12-05T13:25:29.075 INFO:tasks.workunit.client.1.smithi052.stdout:1/927: symlink d5/d26/d75/d7a/dad/l127 0 2023-12-05T13:25:29.077 INFO:tasks.workunit.client.1.smithi052.stdout:4/870: link de/d29/d51/da3/d6d/c72 de/d29/d51/da3/c11e 0 2023-12-05T13:25:29.084 INFO:tasks.workunit.client.1.smithi052.stdout:7/977: dwrite d7/d4e/f61 [4194304,4194304] 0 2023-12-05T13:25:29.087 INFO:tasks.workunit.client.1.smithi052.stdout:5/627: truncate d5/d15/d21/d4a/f5f 3038047 0 2023-12-05T13:25:29.089 INFO:tasks.workunit.client.1.smithi052.stdout:9/850: symlink d3/d1e/d62/dbd/l122 0 2023-12-05T13:25:29.090 INFO:tasks.workunit.client.1.smithi052.stdout:3/866: creat da/d27/dec/f11a x:0 0 0 2023-12-05T13:25:29.090 INFO:tasks.workunit.client.1.smithi052.stdout:3/867: chown da/d7a/fd1 42730 1 2023-12-05T13:25:29.090 INFO:tasks.workunit.client.1.smithi052.stdout:3/868: fsync da/d25/d33/d89/dae/dcf/ffe 0 2023-12-05T13:25:29.090 INFO:tasks.workunit.client.1.smithi052.stdout:3/869: chown da/d25/d33/lcb 234511013 1 2023-12-05T13:25:29.090 INFO:tasks.workunit.client.1.smithi052.stdout:3/870: fsync da/d25/d33/d89/f91 0 2023-12-05T13:25:29.092 INFO:tasks.workunit.client.1.smithi052.stdout:0/824: link d0/db/d20/d9c/cf0 d0/db/d33/d100/c10d 0 2023-12-05T13:25:29.094 INFO:tasks.workunit.client.1.smithi052.stdout:6/659: stat d3/l99 0 2023-12-05T13:25:29.098 INFO:tasks.workunit.client.1.smithi052.stdout:1/928: symlink d5/d26/d41/dbd/dea/l128 0 2023-12-05T13:25:29.098 INFO:tasks.workunit.client.1.smithi052.stdout:9/851: dread d3/d1e/f23 [0,4194304] 0 2023-12-05T13:25:29.098 INFO:tasks.workunit.client.1.smithi052.stdout:4/871: mknod de/d29/d51/d76/c11f 0 2023-12-05T13:25:29.101 INFO:tasks.workunit.client.1.smithi052.stdout:3/871: dread da/dd/d3d/dda/fef [0,4194304] 0 2023-12-05T13:25:29.102 INFO:tasks.workunit.client.1.smithi052.stdout:5/628: mknod d5/d46/cd0 0 2023-12-05T13:25:29.102 INFO:tasks.workunit.client.1.smithi052.stdout:5/629: write d5/d15/d21/d25/fbd [4462567,109569] 0 2023-12-05T13:25:29.102 INFO:tasks.workunit.client.1.smithi052.stdout:0/825: truncate d0/db/f96 9188279 0 2023-12-05T13:25:29.102 INFO:tasks.workunit.client.1.smithi052.stdout:0/826: fsync d0/db/d20/fa5 0 2023-12-05T13:25:29.102 INFO:tasks.workunit.client.1.smithi052.stdout:0/827: write d0/db/d1b/d7a/d8b/ff3 [341449,73306] 0 2023-12-05T13:25:29.103 INFO:tasks.workunit.client.1.smithi052.stdout:6/660: mkdir d3/d4/d6/de7 0 2023-12-05T13:25:29.103 INFO:tasks.workunit.client.1.smithi052.stdout:9/852: mkdir d3/d1e/d62/dbd/d123 0 2023-12-05T13:25:29.105 INFO:tasks.workunit.client.1.smithi052.stdout:4/872: creat de/d30/d73/dbe/d24/f120 x:0 0 0 2023-12-05T13:25:29.105 INFO:tasks.workunit.client.1.smithi052.stdout:1/929: write d5/daa/d79/fcb [1230121,118190] 0 2023-12-05T13:25:29.106 INFO:tasks.workunit.client.1.smithi052.stdout:3/872: rename da/d7a to da/d25/d33/d89/dae/dcf/dfb/d11b 0 2023-12-05T13:25:29.106 INFO:tasks.workunit.client.1.smithi052.stdout:3/873: chown da/ccc 223655862 1 2023-12-05T13:25:29.107 INFO:tasks.workunit.client.1.smithi052.stdout:0/828: creat d0/db/d2e/d7e/dcc/dee/d107/f10e x:0 0 0 2023-12-05T13:25:29.109 INFO:tasks.workunit.client.1.smithi052.stdout:6/661: link d3/d4/d6/d26/d6d/ld1 d3/d5/d58/le8 0 2023-12-05T13:25:29.109 INFO:tasks.workunit.client.1.smithi052.stdout:7/978: dwrite d7/d4e/f28 [0,4194304] 0 2023-12-05T13:25:29.109 INFO:tasks.workunit.client.1.smithi052.stdout:9/853: creat d3/d2a/f124 x:0 0 0 2023-12-05T13:25:29.109 INFO:tasks.workunit.client.1.smithi052.stdout:9/854: dread - d3/d11/f112 zero size 2023-12-05T13:25:29.109 INFO:tasks.workunit.client.1.smithi052.stdout:9/855: fdatasync d3/d1e/d37/d4f/d113/f120 0 2023-12-05T13:25:29.112 INFO:tasks.workunit.client.1.smithi052.stdout:4/873: getdents de/d30/d73/d85 0 2023-12-05T13:25:29.112 INFO:tasks.workunit.client.1.smithi052.stdout:4/874: read - de/d30/d94/f114 zero size 2023-12-05T13:25:29.114 INFO:tasks.workunit.client.1.smithi052.stdout:5/630: write d5/d15/d21/d4a/f5f [2955276,3938] 0 2023-12-05T13:25:29.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/874: creat da/d2e/d107/f11c x:0 0 0 2023-12-05T13:25:29.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/875: readlink da/d25/l52 0 2023-12-05T13:25:29.117 INFO:tasks.workunit.client.1.smithi052.stdout:3/876: chown da/dd/d3d/lc3 45377394 1 2023-12-05T13:25:29.119 INFO:tasks.workunit.client.1.smithi052.stdout:0/829: mknod d0/db/d1b/d29/db0/c10f 0 2023-12-05T13:25:29.124 INFO:tasks.workunit.client.1.smithi052.stdout:7/979: symlink d7/dce/d10f/l14e 0 2023-12-05T13:25:29.124 INFO:tasks.workunit.client.1.smithi052.stdout:1/930: dwrite d5/d7/d35/d2f/f4d [0,4194304] 0 2023-12-05T13:25:29.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/980: write d7/d4e/d86/d139/fef [634244,42440] 0 2023-12-05T13:25:29.125 INFO:tasks.workunit.client.1.smithi052.stdout:7/981: chown d7/d4e/d45/d5a/d63/cdc 1821026982 1 2023-12-05T13:25:29.127 INFO:tasks.workunit.client.1.smithi052.stdout:6/662: dwrite d3/d5/d9/d21/d48/d4d/d81/fbf [0,4194304] 0 2023-12-05T13:25:29.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/875: mknod de/d30/c121 0 2023-12-05T13:25:29.129 INFO:tasks.workunit.client.1.smithi052.stdout:4/876: chown de/d29/d51/d76/dc4/dcf/d117 1 1 2023-12-05T13:25:29.132 INFO:tasks.workunit.client.1.smithi052.stdout:3/877: mkdir da/dd/d3d/d103/d115/d11d 0 2023-12-05T13:25:29.134 INFO:tasks.workunit.client.1.smithi052.stdout:0/830: mknod d0/db/d1b/d51/d55/d66/c110 0 2023-12-05T13:25:29.134 INFO:tasks.workunit.client.1.smithi052.stdout:0/831: stat d0/db/d1b/d29/c6c 0 2023-12-05T13:25:29.134 INFO:tasks.workunit.client.1.smithi052.stdout:0/832: write d0/db/d14/fd1 [49708,118391] 0 2023-12-05T13:25:29.134 INFO:tasks.workunit.client.1.smithi052.stdout:0/833: chown d0/db/d14/d9b 1613 1 2023-12-05T13:25:29.135 INFO:tasks.workunit.client.1.smithi052.stdout:7/982: dread d7/d2e/fa9 [0,4194304] 0 2023-12-05T13:25:29.136 INFO:tasks.workunit.client.1.smithi052.stdout:7/983: stat d7/d4e/d45 0 2023-12-05T13:25:29.140 INFO:tasks.workunit.client.1.smithi052.stdout:9/856: rename d3/d5e/da7/daf/ld6 to d3/d1e/d121/l125 0 2023-12-05T13:25:29.142 INFO:tasks.workunit.client.1.smithi052.stdout:7/984: dread d7/d4e/d86/d139/d4d/f125 [0,4194304] 0 2023-12-05T13:25:29.143 INFO:tasks.workunit.client.1.smithi052.stdout:7/985: read d7/d4e/d86/d139/f5f [105863,56583] 0 2023-12-05T13:25:29.143 INFO:tasks.workunit.client.1.smithi052.stdout:7/986: write d7/d4e/db4/ff7 [5060275,17572] 0 2023-12-05T13:25:29.143 INFO:tasks.workunit.client.1.smithi052.stdout:7/987: chown d7/d4e/d86/l110 70419 1 2023-12-05T13:25:29.146 INFO:tasks.workunit.client.1.smithi052.stdout:0/834: creat d0/db/d14/d9b/f111 x:0 0 0 2023-12-05T13:25:29.146 INFO:tasks.workunit.client.1.smithi052.stdout:0/835: write d0/db/d14/d60/f7b [4455667,31951] 0 2023-12-05T13:25:29.149 INFO:tasks.workunit.client.1.smithi052.stdout:5/631: rename d5/d15/l1e to d5/d15/d21/d4a/ld1 0 2023-12-05T13:25:29.149 INFO:tasks.workunit.client.1.smithi052.stdout:5/632: fdatasync d5/df/d11/d73/f96 0 2023-12-05T13:25:29.149 INFO:tasks.workunit.client.1.smithi052.stdout:8/951: sync 2023-12-05T13:25:29.149 INFO:tasks.workunit.client.1.smithi052.stdout:4/877: dwrite de/f98 [0,4194304] 0 2023-12-05T13:25:29.150 INFO:tasks.workunit.client.1.smithi052.stdout:4/878: chown de/d29/l77 59220 1 2023-12-05T13:25:29.150 INFO:tasks.workunit.client.1.smithi052.stdout:8/952: write d0/f95 [251740,68527] 0 2023-12-05T13:25:29.150 INFO:tasks.workunit.client.1.smithi052.stdout:8/953: stat d0/de/d12/d29/d81/c93 0 2023-12-05T13:25:29.150 INFO:tasks.workunit.client.1.smithi052.stdout:8/954: chown d0/d4d/l70 496612988 1 2023-12-05T13:25:29.150 INFO:tasks.workunit.client.1.smithi052.stdout:9/857: mknod d3/d1e/d121/c126 0 2023-12-05T13:25:29.158 INFO:tasks.workunit.client.1.smithi052.stdout:7/988: mknod d7/d31/c14f 0 2023-12-05T13:25:29.158 INFO:tasks.workunit.client.1.smithi052.stdout:0/836: link d0/db/d1b/d29/db0/lec d0/db/l112 0 2023-12-05T13:25:29.162 INFO:tasks.workunit.client.1.smithi052.stdout:0/837: symlink d0/db/d52/dc4/l113 0 2023-12-05T13:25:29.162 INFO:tasks.workunit.client.1.smithi052.stdout:8/955: dread d0/de/d12/d29/db3/dc5/ff4 [0,4194304] 0 2023-12-05T13:25:29.163 INFO:tasks.workunit.client.1.smithi052.stdout:0/838: read d0/dcb/f45 [2702714,61142] 0 2023-12-05T13:25:29.163 INFO:tasks.workunit.client.1.smithi052.stdout:0/839: chown d0/db/d2e/d53/c5b 60307159 1 2023-12-05T13:25:29.163 INFO:tasks.workunit.client.1.smithi052.stdout:0/840: chown d0/db/d52/fb1 764551864 1 2023-12-05T13:25:29.163 INFO:tasks.workunit.client.1.smithi052.stdout:7/989: link d7/d4e/d45/d93/cdd d7/dce/d10f/d118/c150 0 2023-12-05T13:25:29.165 INFO:tasks.workunit.client.1.smithi052.stdout:2/869: sync 2023-12-05T13:25:29.165 INFO:tasks.workunit.client.1.smithi052.stdout:2/870: chown d2/d13/d48/dd3/d62/ddd/cf2 183937258 1 2023-12-05T13:25:29.165 INFO:tasks.workunit.client.1.smithi052.stdout:4/879: mknod de/d30/d73/dbe/d24/c122 0 2023-12-05T13:25:29.167 INFO:tasks.workunit.client.1.smithi052.stdout:0/841: creat d0/db/d2e/d7e/dcc/dee/d107/f114 x:0 0 0 2023-12-05T13:25:29.168 INFO:tasks.workunit.client.1.smithi052.stdout:7/990: rename d7/dce/d11b to d7/d31/d56/d60/d151 0 2023-12-05T13:25:29.169 INFO:tasks.workunit.client.1.smithi052.stdout:2/871: mkdir d2/d13/d1e/dff 0 2023-12-05T13:25:29.171 INFO:tasks.workunit.client.1.smithi052.stdout:4/880: link de/d30/d73/dbe/c92 de/d30/d68/df8/c123 0 2023-12-05T13:25:29.172 INFO:tasks.workunit.client.1.smithi052.stdout:4/881: write de/fb0 [329410,94306] 0 2023-12-05T13:25:29.173 INFO:tasks.workunit.client.1.smithi052.stdout:5/633: dwrite d5/df/d4e/d65/f72 [0,4194304] 0 2023-12-05T13:25:29.174 INFO:tasks.workunit.client.1.smithi052.stdout:7/991: creat d7/d4e/d86/d139/dab/f152 x:0 0 0 2023-12-05T13:25:29.175 INFO:tasks.workunit.client.1.smithi052.stdout:2/872: creat d2/d13/d1e/dff/f100 x:0 0 0 2023-12-05T13:25:29.176 INFO:tasks.workunit.client.1.smithi052.stdout:4/882: readlink de/d30/d73/dbe/d24/l2f 0 2023-12-05T13:25:29.179 INFO:tasks.workunit.client.1.smithi052.stdout:8/956: dwrite d0/de/d12/d29/db3/dc5/f107 [0,4194304] 0 2023-12-05T13:25:29.179 INFO:tasks.workunit.client.1.smithi052.stdout:0/842: mkdir d0/db/d2e/d115 0 2023-12-05T13:25:29.183 INFO:tasks.workunit.client.1.smithi052.stdout:5/634: symlink d5/df/d11/d66/d84/ld2 0 2023-12-05T13:25:29.184 INFO:tasks.workunit.client.1.smithi052.stdout:5/635: dread d5/df/fa0 [0,4194304] 0 2023-12-05T13:25:29.185 INFO:tasks.workunit.client.1.smithi052.stdout:7/992: dread d7/d4e/d12/f8b [0,4194304] 0 2023-12-05T13:25:29.185 INFO:tasks.workunit.client.1.smithi052.stdout:8/957: mkdir d0/de/d98/d13e 0 2023-12-05T13:25:29.187 INFO:tasks.workunit.client.1.smithi052.stdout:0/843: rename d0/db/d1b/d29/c4a to d0/db/d2e/d53/c116 0 2023-12-05T13:25:29.191 INFO:tasks.workunit.client.1.smithi052.stdout:5/636: mknod d5/df/d11/d66/cd3 0 2023-12-05T13:25:29.195 INFO:tasks.workunit.client.1.smithi052.stdout:8/958: symlink d0/d51/l13f 0 2023-12-05T13:25:29.197 INFO:tasks.workunit.client.1.smithi052.stdout:8/959: symlink d0/de/d12/dc1/dd3/l140 0 2023-12-05T13:25:29.200 INFO:tasks.workunit.client.1.smithi052.stdout:8/960: mknod d0/de/d12/c141 0 2023-12-05T13:25:29.200 INFO:tasks.workunit.client.1.smithi052.stdout:6/663: sync 2023-12-05T13:25:29.200 INFO:tasks.workunit.client.1.smithi052.stdout:3/878: sync 2023-12-05T13:25:29.200 INFO:tasks.workunit.client.1.smithi052.stdout:1/931: sync 2023-12-05T13:25:29.200 INFO:tasks.workunit.client.1.smithi052.stdout:3/879: write da/d25/d33/fc5 [1715457,35618] 0 2023-12-05T13:25:29.200 INFO:tasks.workunit.client.1.smithi052.stdout:2/873: dread d2/d13/d37/d5c/f74 [8388608,4194304] 0 2023-12-05T13:25:29.201 INFO:tasks.workunit.client.1.smithi052.stdout:8/961: creat d0/d28/d2b/d53/d56/f142 x:0 0 0 2023-12-05T13:25:29.201 INFO:tasks.workunit.client.1.smithi052.stdout:8/962: stat d0/de/d86/f116 0 2023-12-05T13:25:29.203 INFO:tasks.workunit.client.1.smithi052.stdout:5/637: write d5/f87 [2161783,36940] 0 2023-12-05T13:25:29.203 INFO:tasks.workunit.client.1.smithi052.stdout:5/638: chown d5/df/d11/d66/d84/ld2 3558821 1 2023-12-05T13:25:29.203 INFO:tasks.workunit.client.1.smithi052.stdout:5/639: fdatasync d5/d15/d21/f75 0 2023-12-05T13:25:29.204 INFO:tasks.workunit.client.1.smithi052.stdout:0/844: dwrite d0/db/d14/f59 [0,4194304] 0 2023-12-05T13:25:29.204 INFO:tasks.workunit.client.1.smithi052.stdout:1/932: unlink d5/daa/d17/d3c/cd7 0 2023-12-05T13:25:29.205 INFO:tasks.workunit.client.1.smithi052.stdout:6/664: mknod d3/d5/d9/d21/d48/d4d/ce9 0 2023-12-05T13:25:29.208 INFO:tasks.workunit.client.1.smithi052.stdout:2/874: mkdir d2/d13/d37/d5c/d80/d101 0 2023-12-05T13:25:29.208 INFO:tasks.workunit.client.1.smithi052.stdout:6/665: write d3/f19 [1534614,42053] 0 2023-12-05T13:25:29.210 INFO:tasks.workunit.client.1.smithi052.stdout:5/640: creat d5/d46/d76/d8f/fd4 x:0 0 0 2023-12-05T13:25:29.212 INFO:tasks.workunit.client.1.smithi052.stdout:0/845: rmdir d0/db/d20/d50 39 2023-12-05T13:25:29.214 INFO:tasks.workunit.client.1.smithi052.stdout:1/933: mkdir d5/d26/da3/dcd/def/d129 0 2023-12-05T13:25:29.215 INFO:tasks.workunit.client.1.smithi052.stdout:2/875: mknod d2/d13/d1e/dae/dc3/c102 0 2023-12-05T13:25:29.218 INFO:tasks.workunit.client.1.smithi052.stdout:6/666: getdents d3/d4/df/d27 0 2023-12-05T13:25:29.218 INFO:tasks.workunit.client.1.smithi052.stdout:6/667: chown d3/d5/d9/d21/d48/d4d/d81/cb4 33672 1 2023-12-05T13:25:29.219 INFO:tasks.workunit.client.1.smithi052.stdout:5/641: creat d5/df/d11/fd5 x:0 0 0 2023-12-05T13:25:29.221 INFO:tasks.workunit.client.1.smithi052.stdout:0/846: chown d0/c1c 2 1 2023-12-05T13:25:29.224 INFO:tasks.workunit.client.1.smithi052.stdout:8/963: dread d0/de/d12/f85 [0,4194304] 0 2023-12-05T13:25:29.224 INFO:tasks.workunit.client.1.smithi052.stdout:7/993: dwrite d7/d31/f3e [0,4194304] 0 2023-12-05T13:25:29.224 INFO:tasks.workunit.client.1.smithi052.stdout:3/880: dwrite da/d25/d33/d89/dae/dcf/dfb/d11b/fc4 [0,4194304] 0 2023-12-05T13:25:29.224 INFO:tasks.workunit.client.1.smithi052.stdout:7/994: chown d7/d4e/f1a 0 1 2023-12-05T13:25:29.226 INFO:tasks.workunit.client.1.smithi052.stdout:1/934: mknod d5/d26/d75/d7a/dad/c12a 0 2023-12-05T13:25:29.226 INFO:tasks.workunit.client.1.smithi052.stdout:2/876: link d2/d13/ff4 d2/d13/d37/d5c/d80/f103 0 2023-12-05T13:25:29.227 INFO:tasks.workunit.client.1.smithi052.stdout:1/935: readlink d5/daa/d79/l95 0 2023-12-05T13:25:29.227 INFO:tasks.workunit.client.1.smithi052.stdout:2/877: write d2/d13/d48/f9a [239894,48372] 0 2023-12-05T13:25:29.227 INFO:tasks.workunit.client.1.smithi052.stdout:5/642: mkdir d5/df/d4e/da4/dd6 0 2023-12-05T13:25:29.228 INFO:tasks.workunit.client.1.smithi052.stdout:0/847: symlink d0/db/d1b/d51/d55/d66/l117 0 2023-12-05T13:25:29.231 INFO:tasks.workunit.client.1.smithi052.stdout:8/964: mkdir d0/d28/d2b/d53/d56/d111/d4f/db5/d143 0 2023-12-05T13:25:29.232 INFO:tasks.workunit.client.1.smithi052.stdout:7/995: creat d7/d2e/d104/f153 x:0 0 0 2023-12-05T13:25:29.232 INFO:tasks.workunit.client.1.smithi052.stdout:7/996: read - d7/d31/d56/d60/d72/fe8 zero size 2023-12-05T13:25:29.236 INFO:tasks.workunit.client.1.smithi052.stdout:6/668: write d3/d5/d9/f2f [3822129,60555] 0 2023-12-05T13:25:29.238 INFO:tasks.workunit.client.1.smithi052.stdout:2/878: rename d2/d13/d48/dd3/d62/ddd/fe7 to d2/d13/d48/f104 0 2023-12-05T13:25:29.240 INFO:tasks.workunit.client.1.smithi052.stdout:5/643: write d5/df/d11/f2b [2401201,44267] 0 2023-12-05T13:25:29.241 INFO:tasks.workunit.client.1.smithi052.stdout:8/965: mkdir d0/de/d12/d29/dcb/d144 0 2023-12-05T13:25:29.243 INFO:tasks.workunit.client.1.smithi052.stdout:1/936: creat d5/d7/d35/d37/d5a/d73/d76/f12b x:0 0 0 2023-12-05T13:25:29.244 INFO:tasks.workunit.client.1.smithi052.stdout:1/937: write d5/d7/de/d74/fb2 [1457095,76208] 0 2023-12-05T13:25:29.244 INFO:tasks.workunit.client.1.smithi052.stdout:3/881: dread da/dd/f90 [0,4194304] 0 2023-12-05T13:25:29.244 INFO:tasks.workunit.client.1.smithi052.stdout:7/997: dread d7/dce/f126 [0,4194304] 0 2023-12-05T13:25:29.246 INFO:tasks.workunit.client.1.smithi052.stdout:0/848: unlink d0/db/d2e/c56 0 2023-12-05T13:25:29.246 INFO:tasks.workunit.client.1.smithi052.stdout:0/849: chown d0/db/d52/fbc 68370 1 2023-12-05T13:25:29.247 INFO:tasks.workunit.client.1.smithi052.stdout:7/998: write d7/d31/f3e [744594,76712] 0 2023-12-05T13:25:29.251 INFO:tasks.workunit.client.1.smithi052.stdout:7/999: dread d7/d4e/d45/d5a/f19 [0,4194304] 0 2023-12-05T13:25:29.254 INFO:tasks.workunit.client.1.smithi052.stdout:5/644: mkdir d5/df/d4e/da8/dd7 0 2023-12-05T13:25:29.255 INFO:tasks.workunit.client.1.smithi052.stdout:1/938: unlink d5/d26/f104 0 2023-12-05T13:25:29.255 INFO:tasks.workunit.client.1.smithi052.stdout:1/939: stat d5/daa/d17/d9a/dfc 0 2023-12-05T13:25:29.255 INFO:tasks.workunit.client.1.smithi052.stdout:5/645: fdatasync d5/d15/d21/f2e 0 2023-12-05T13:25:29.255 INFO:tasks.workunit.client.1.smithi052.stdout:1/940: chown d5/d26/c11a 0 1 2023-12-05T13:25:29.255 INFO:tasks.workunit.client.1.smithi052.stdout:9/858: sync 2023-12-05T13:25:29.256 INFO:tasks.workunit.client.1.smithi052.stdout:1/941: write d5/daa/d2a/f92 [85847,81410] 0 2023-12-05T13:25:29.257 INFO:tasks.workunit.client.1.smithi052.stdout:3/882: getdents da/d25/dcd 0 2023-12-05T13:25:29.258 INFO:tasks.workunit.client.1.smithi052.stdout:0/850: symlink d0/db/d52/d7f/l118 0 2023-12-05T13:25:29.258 INFO:tasks.workunit.client.1.smithi052.stdout:0/851: readlink d0/db/d52/d7f/d8f/lb6 0 2023-12-05T13:25:29.264 INFO:tasks.workunit.client.1.smithi052.stdout:5/646: rename d5/df/d11/d66/d84 to d5/df/d8d/dd8 0 2023-12-05T13:25:29.265 INFO:tasks.workunit.client.1.smithi052.stdout:9/859: mkdir d3/d5e/da7/daf/dbe/d127 0 2023-12-05T13:25:29.265 INFO:tasks.workunit.client.1.smithi052.stdout:3/883: write da/dd/d3d/f9c [2963625,20657] 0 2023-12-05T13:25:29.266 INFO:tasks.workunit.client.1.smithi052.stdout:5/647: dread d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c [0,4194304] 0 2023-12-05T13:25:29.266 INFO:tasks.workunit.client.1.smithi052.stdout:1/942: mkdir d5/d7/d35/d37/d5a/d73/d12c 0 2023-12-05T13:25:29.267 INFO:tasks.workunit.client.1.smithi052.stdout:2/879: dwrite d2/d13/d48/dd3/d62/da7/fc0 [0,4194304] 0 2023-12-05T13:25:29.267 INFO:tasks.workunit.client.1.smithi052.stdout:3/884: mknod da/d25/c11e 0 2023-12-05T13:25:29.267 INFO:tasks.workunit.client.1.smithi052.stdout:8/966: dwrite d0/d28/d2b/d53/d56/d111/d8f/fb2 [0,4194304] 0 2023-12-05T13:25:29.268 INFO:tasks.workunit.client.1.smithi052.stdout:8/967: write d0/d28/d2b/d53/d56/d111/f5b [9217082,54484] 0 2023-12-05T13:25:29.269 INFO:tasks.workunit.client.1.smithi052.stdout:5/648: rename d5/df/d8d/lce to d5/df/ld9 0 2023-12-05T13:25:29.270 INFO:tasks.workunit.client.1.smithi052.stdout:1/943: symlink d5/d26/l12d 0 2023-12-05T13:25:29.272 INFO:tasks.workunit.client.1.smithi052.stdout:6/669: dwrite d3/d5/d9/f2f [0,4194304] 0 2023-12-05T13:25:29.272 INFO:tasks.workunit.client.1.smithi052.stdout:2/880: dread d2/d13/d1e/f54 [4194304,4194304] 0 2023-12-05T13:25:29.272 INFO:tasks.workunit.client.1.smithi052.stdout:2/881: stat d2/d13/d1e/d6a/dda/cc9 0 2023-12-05T13:25:29.273 INFO:tasks.workunit.client.1.smithi052.stdout:5/649: rmdir d5/df/d4b 39 2023-12-05T13:25:29.274 INFO:tasks.workunit.client.1.smithi052.stdout:1/944: dread d5/d26/d41/f5f [0,4194304] 0 2023-12-05T13:25:29.275 INFO:tasks.workunit.client.1.smithi052.stdout:2/882: getdents d2/d13/d7c 0 2023-12-05T13:25:29.277 INFO:tasks.workunit.client.1.smithi052.stdout:5/650: mknod d5/df/d4e/d5b/cda 0 2023-12-05T13:25:29.277 INFO:tasks.workunit.client.1.smithi052.stdout:5/651: fdatasync d5/d15/f31 0 2023-12-05T13:25:29.277 INFO:tasks.workunit.client.1.smithi052.stdout:1/945: chown d5/d7/d35/d2f/d3e/d62/d85/c8b 36 1 2023-12-05T13:25:29.278 INFO:tasks.workunit.client.1.smithi052.stdout:5/652: readlink d5/df/d11/lbe 0 2023-12-05T13:25:29.288 INFO:tasks.workunit.client.1.smithi052.stdout:4/883: sync 2023-12-05T13:25:29.288 INFO:tasks.workunit.client.1.smithi052.stdout:4/884: fsync de/d30/dd1/f119 0 2023-12-05T13:25:29.288 INFO:tasks.workunit.client.1.smithi052.stdout:4/885: truncate de/d30/d73/dbe/d24/ddd/d102/f104 290764 0 2023-12-05T13:25:29.288 INFO:tasks.workunit.client.1.smithi052.stdout:4/886: fsync de/d29/d51/fc1 0 2023-12-05T13:25:29.291 INFO:tasks.workunit.client.1.smithi052.stdout:2/883: dwrite d2/d13/d1e/dff/f100 [0,4194304] 0 2023-12-05T13:25:29.292 INFO:tasks.workunit.client.1.smithi052.stdout:4/887: dread de/d29/f3d [0,4194304] 0 2023-12-05T13:25:29.293 INFO:tasks.workunit.client.1.smithi052.stdout:2/884: read d2/d13/d1e/d6a/faf [1573877,90438] 0 2023-12-05T13:25:29.295 INFO:tasks.workunit.client.1.smithi052.stdout:2/885: mknod d2/d4/d3f/c105 0 2023-12-05T13:25:29.296 INFO:tasks.workunit.client.1.smithi052.stdout:2/886: creat d2/d13/d37/d5c/d80/dc4/de2/f106 x:0 0 0 2023-12-05T13:25:29.296 INFO:tasks.workunit.client.1.smithi052.stdout:2/887: readlink d2/d13/d45/l93 0 2023-12-05T13:25:29.296 INFO:tasks.workunit.client.1.smithi052.stdout:2/888: readlink d2/d13/d1e/d6a/d7f/d84/lb3 0 2023-12-05T13:25:29.296 INFO:tasks.workunit.client.1.smithi052.stdout:2/889: truncate d2/d13/d37/d5c/d80/f103 603541 0 2023-12-05T13:25:29.300 INFO:tasks.workunit.client.1.smithi052.stdout:2/890: dread d2/d13/d48/dd3/d62/da7/fad [0,4194304] 0 2023-12-05T13:25:29.302 INFO:tasks.workunit.client.1.smithi052.stdout:2/891: link d2/d13/d37/d5c/d80/fe9 d2/d13/d37/d5c/d80/db4/f107 0 2023-12-05T13:25:29.302 INFO:tasks.workunit.client.1.smithi052.stdout:2/892: chown d2/d13/d1e/d6a/d7f/d84/c70 57190 1 2023-12-05T13:25:29.302 INFO:tasks.workunit.client.1.smithi052.stdout:2/893: fdatasync d2/d13/d37/d5c/d80/fe9 0 2023-12-05T13:25:29.302 INFO:tasks.workunit.client.1.smithi052.stdout:2/894: stat d2/l2e 0 2023-12-05T13:25:29.302 INFO:tasks.workunit.client.1.smithi052.stdout:2/895: truncate d2/d13/d1e/d6a/d7f/d84/d6e/f7a 4448343 0 2023-12-05T13:25:29.303 INFO:tasks.workunit.client.1.smithi052.stdout:1/946: dwrite d5/d26/d75/fc4 [0,4194304] 0 2023-12-05T13:25:29.303 INFO:tasks.workunit.client.1.smithi052.stdout:4/888: dread de/d2b/f2d [0,4194304] 0 2023-12-05T13:25:29.305 INFO:tasks.workunit.client.1.smithi052.stdout:2/896: dread d2/d13/d48/f67 [0,4194304] 0 2023-12-05T13:25:29.305 INFO:tasks.workunit.client.1.smithi052.stdout:4/889: mkdir de/d30/d73/dbe/d124 0 2023-12-05T13:25:29.306 INFO:tasks.workunit.client.1.smithi052.stdout:2/897: creat d2/d13/d48/dd3/f108 x:0 0 0 2023-12-05T13:25:29.307 INFO:tasks.workunit.client.1.smithi052.stdout:4/890: link de/d30/d73/dbe/d24/c122 de/d29/c125 0 2023-12-05T13:25:29.307 INFO:tasks.workunit.client.1.smithi052.stdout:4/891: fdatasync de/d30/d73/dbe/d24/f4e 0 2023-12-05T13:25:29.307 INFO:tasks.workunit.client.1.smithi052.stdout:4/892: chown de/d29/c108 63935 1 2023-12-05T13:25:29.308 INFO:tasks.workunit.client.1.smithi052.stdout:2/898: mknod d2/d13/d1e/d6a/df7/c109 0 2023-12-05T13:25:29.308 INFO:tasks.workunit.client.1.smithi052.stdout:4/893: mkdir de/d29/d51/d76/dc4/dcf/d126 0 2023-12-05T13:25:29.311 INFO:tasks.workunit.client.1.smithi052.stdout:1/947: dread d5/daa/d17/d3c/fe9 [0,4194304] 0 2023-12-05T13:25:29.312 INFO:tasks.workunit.client.1.smithi052.stdout:1/948: write d5/d26/d75/fc4 [1867932,86162] 0 2023-12-05T13:25:29.314 INFO:tasks.workunit.client.1.smithi052.stdout:1/949: mknod d5/d26/d75/d7a/dad/c12e 0 2023-12-05T13:25:29.319 INFO:tasks.workunit.client.1.smithi052.stdout:4/894: dread de/d30/d73/f9a [0,4194304] 0 2023-12-05T13:25:29.319 INFO:tasks.workunit.client.1.smithi052.stdout:1/950: dread d5/daa/d17/d3c/fe9 [0,4194304] 0 2023-12-05T13:25:29.320 INFO:tasks.workunit.client.1.smithi052.stdout:1/951: rmdir d5/d7/de/d18 39 2023-12-05T13:25:29.323 INFO:tasks.workunit.client.1.smithi052.stdout:2/899: dwrite d2/d13/d1e/f54 [4194304,4194304] 0 2023-12-05T13:25:29.323 INFO:tasks.workunit.client.1.smithi052.stdout:2/900: dread - d2/d13/d1e/fd7 zero size 2023-12-05T13:25:29.323 INFO:tasks.workunit.client.1.smithi052.stdout:4/895: creat de/d30/d68/d5c/de2/f127 x:0 0 0 2023-12-05T13:25:29.323 INFO:tasks.workunit.client.1.smithi052.stdout:4/896: fdatasync de/fde 0 2023-12-05T13:25:29.325 INFO:tasks.workunit.client.1.smithi052.stdout:2/901: creat d2/d13/d7c/f10a x:0 0 0 2023-12-05T13:25:29.326 INFO:tasks.workunit.client.1.smithi052.stdout:4/897: write de/f14 [555551,120623] 0 2023-12-05T13:25:29.326 INFO:tasks.workunit.client.1.smithi052.stdout:2/902: mknod d2/d4/c10b 0 2023-12-05T13:25:29.326 INFO:tasks.workunit.client.1.smithi052.stdout:2/903: chown d2/d13/d1e/d6a/fba 57 1 2023-12-05T13:25:29.326 INFO:tasks.workunit.client.1.smithi052.stdout:4/898: write de/d29/f3d [48457,107078] 0 2023-12-05T13:25:29.326 INFO:tasks.workunit.client.1.smithi052.stdout:4/899: chown de/d30/d68/fe8 3733727 1 2023-12-05T13:25:29.327 INFO:tasks.workunit.client.1.smithi052.stdout:4/900: read de/d29/d51/da3/d6d/fb5 [786761,124095] 0 2023-12-05T13:25:29.328 INFO:tasks.workunit.client.1.smithi052.stdout:2/904: creat d2/d13/d1e/d6a/d7f/d84/f10c x:0 0 0 2023-12-05T13:25:29.331 INFO:tasks.workunit.client.1.smithi052.stdout:1/952: dread d5/daa/d79/fdb [0,4194304] 0 2023-12-05T13:25:29.332 INFO:tasks.workunit.client.1.smithi052.stdout:1/953: mkdir d5/d26/d41/deb/d12f 0 2023-12-05T13:25:29.332 INFO:tasks.workunit.client.1.smithi052.stdout:1/954: chown d5/daa/d17/l22 1322 1 2023-12-05T13:25:29.333 INFO:tasks.workunit.client.1.smithi052.stdout:2/905: mknod d2/d13/d48/dd3/c10d 0 2023-12-05T13:25:29.334 INFO:tasks.workunit.client.1.smithi052.stdout:4/901: rmdir de/d30/d73 39 2023-12-05T13:25:29.335 INFO:tasks.workunit.client.1.smithi052.stdout:1/955: rmdir d5/d7/d35/d37/d5a/dd4 39 2023-12-05T13:25:29.341 INFO:tasks.workunit.client.1.smithi052.stdout:2/906: mkdir d2/d13/d1e/d6a/d7f/d84/d6e/d10e 0 2023-12-05T13:25:29.341 INFO:tasks.workunit.client.1.smithi052.stdout:2/907: chown d2/d13/d37/d5c/d80/db4/fd4 48916 1 2023-12-05T13:25:29.342 INFO:tasks.workunit.client.1.smithi052.stdout:4/902: mknod de/d30/dac/dbb/c128 0 2023-12-05T13:25:29.343 INFO:tasks.workunit.client.1.smithi052.stdout:1/956: mknod d5/d7/c130 0 2023-12-05T13:25:29.345 INFO:tasks.workunit.client.1.smithi052.stdout:2/908: creat d2/d13/d37/d5c/f10f x:0 0 0 2023-12-05T13:25:29.345 INFO:tasks.workunit.client.1.smithi052.stdout:4/903: creat de/d30/d68/d5c/db8/f129 x:0 0 0 2023-12-05T13:25:29.346 INFO:tasks.workunit.client.1.smithi052.stdout:1/957: creat d5/d26/da3/f131 x:0 0 0 2023-12-05T13:25:29.346 INFO:tasks.workunit.client.1.smithi052.stdout:1/958: truncate d5/d7/de/d74/d99/dcc/f111 786262 0 2023-12-05T13:25:29.346 INFO:tasks.workunit.client.1.smithi052.stdout:1/959: readlink d5/daa/d2a/l2b 0 2023-12-05T13:25:29.348 INFO:tasks.workunit.client.1.smithi052.stdout:2/909: mknod d2/d13/d37/db2/c110 0 2023-12-05T13:25:29.350 INFO:tasks.workunit.client.1.smithi052.stdout:1/960: unlink d5/daa/d79/l95 0 2023-12-05T13:25:29.350 INFO:tasks.workunit.client.1.smithi052.stdout:1/961: dread - d5/d7/d35/d37/f100 zero size 2023-12-05T13:25:29.350 INFO:tasks.workunit.client.1.smithi052.stdout:1/962: truncate d5/d7/d35/d2f/d3e/d62/f101 638566 0 2023-12-05T13:25:29.351 INFO:tasks.workunit.client.1.smithi052.stdout:2/910: mkdir d2/d13/d37/d5c/d80/d101/d111 0 2023-12-05T13:25:29.353 INFO:tasks.workunit.client.1.smithi052.stdout:1/963: getdents d5/d26/dbf 0 2023-12-05T13:25:29.354 INFO:tasks.workunit.client.1.smithi052.stdout:2/911: chown d2/d13/d48/dd3/f39 735133 1 2023-12-05T13:25:29.356 INFO:tasks.workunit.client.1.smithi052.stdout:1/964: symlink d5/d7/d35/d37/d5a/d73/dac/l132 0 2023-12-05T13:25:29.357 INFO:tasks.workunit.client.1.smithi052.stdout:1/965: write d5/d7/d35/d2f/d3e/d62/d85/fab [4437744,63383] 0 2023-12-05T13:25:29.357 INFO:tasks.workunit.client.1.smithi052.stdout:2/912: creat d2/d13/d1e/d6a/d7f/dc5/f112 x:0 0 0 2023-12-05T13:25:29.358 INFO:tasks.workunit.client.1.smithi052.stdout:0/852: sync 2023-12-05T13:25:29.359 INFO:tasks.workunit.client.1.smithi052.stdout:4/904: dwrite de/d2b/d64/d69/f9e [0,4194304] 0 2023-12-05T13:25:29.359 INFO:tasks.workunit.client.1.smithi052.stdout:1/966: dread d5/d26/d41/f5f [0,4194304] 0 2023-12-05T13:25:29.361 INFO:tasks.workunit.client.1.smithi052.stdout:2/913: mknod d2/d4/d3f/c113 0 2023-12-05T13:25:29.361 INFO:tasks.workunit.client.1.smithi052.stdout:2/914: fsync d2/d13/d48/dd3/d62/da7/fd6 0 2023-12-05T13:25:29.361 INFO:tasks.workunit.client.1.smithi052.stdout:2/915: write d2/d13/d37/d5c/d80/dc4/de2/f106 [114572,78255] 0 2023-12-05T13:25:29.361 INFO:tasks.workunit.client.1.smithi052.stdout:2/916: chown d2/d13/d37/d5c/da9/cef 0 1 2023-12-05T13:25:29.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/853: creat d0/db/d1b/d51/d55/d66/dcd/f119 x:0 0 0 2023-12-05T13:25:29.361 INFO:tasks.workunit.client.1.smithi052.stdout:0/854: fsync d0/db/d65/fc9 0 2023-12-05T13:25:29.364 INFO:tasks.workunit.client.1.smithi052.stdout:1/967: mkdir d5/d7/de/d74/d99/dc6/dba/d133 0 2023-12-05T13:25:29.364 INFO:tasks.workunit.client.1.smithi052.stdout:2/917: rmdir d2/d13/d37/d5c/da9 39 2023-12-05T13:25:29.364 INFO:tasks.workunit.client.1.smithi052.stdout:2/918: fsync d2/d13/d1e/d6a/d7f/f81 0 2023-12-05T13:25:29.365 INFO:tasks.workunit.client.1.smithi052.stdout:0/855: mknod d0/db/d2e/d7e/dcc/dee/c11a 0 2023-12-05T13:25:29.365 INFO:tasks.workunit.client.1.smithi052.stdout:0/856: write d0/db/d20/d50/dae/fd4 [864178,8053] 0 2023-12-05T13:25:29.365 INFO:tasks.workunit.client.1.smithi052.stdout:2/919: write d2/d13/d48/dd3/d62/da7/fc0 [537809,12668] 0 2023-12-05T13:25:29.366 INFO:tasks.workunit.client.1.smithi052.stdout:1/968: mkdir d5/d26/dbf/dfd/d134 0 2023-12-05T13:25:29.366 INFO:tasks.workunit.client.1.smithi052.stdout:1/969: write d5/d7/de/d74/d99/dcc/f111 [1701427,36331] 0 2023-12-05T13:25:29.366 INFO:tasks.workunit.client.1.smithi052.stdout:4/905: dread de/d30/d73/dbe/d24/f4e [0,4194304] 0 2023-12-05T13:25:29.367 INFO:tasks.workunit.client.1.smithi052.stdout:0/857: symlink d0/db/d2e/d7e/dcc/dee/l11b 0 2023-12-05T13:25:29.368 INFO:tasks.workunit.client.1.smithi052.stdout:2/920: symlink d2/d13/d1e/dae/l114 0 2023-12-05T13:25:29.371 INFO:tasks.workunit.client.1.smithi052.stdout:4/906: mkdir de/d2b/d12a 0 2023-12-05T13:25:29.371 INFO:tasks.workunit.client.1.smithi052.stdout:2/921: symlink d2/d13/d37/d61/l115 0 2023-12-05T13:25:29.373 INFO:tasks.workunit.client.1.smithi052.stdout:4/907: getdents de/d30/d68/d5c/db8/ddc 0 2023-12-05T13:25:29.375 INFO:tasks.workunit.client.1.smithi052.stdout:2/922: rename d2/d4/f23 to d2/d13/d1e/d6a/d7f/d84/d3a/f116 0 2023-12-05T13:25:29.376 INFO:tasks.workunit.client.1.smithi052.stdout:4/908: mknod de/d30/d68/df8/c12b 0 2023-12-05T13:25:29.378 INFO:tasks.workunit.client.1.smithi052.stdout:2/923: write d2/d13/d1e/d6a/d7f/d84/d6e/fca [1826831,102046] 0 2023-12-05T13:25:29.383 INFO:tasks.workunit.client.1.smithi052.stdout:4/909: creat de/d30/d94/ded/f12c x:0 0 0 2023-12-05T13:25:29.383 INFO:tasks.workunit.client.1.smithi052.stdout:4/910: fsync de/d30/d68/d5c/db8/f106 0 2023-12-05T13:25:29.384 INFO:tasks.workunit.client.1.smithi052.stdout:0/858: dwrite d0/db/d1b/d7a/f93 [0,4194304] 0 2023-12-05T13:25:29.390 INFO:tasks.workunit.client.1.smithi052.stdout:1/970: dwrite d5/d7/f13 [0,4194304] 0 2023-12-05T13:25:29.392 INFO:tasks.workunit.client.1.smithi052.stdout:8/968: sync 2023-12-05T13:25:29.392 INFO:tasks.workunit.client.1.smithi052.stdout:9/860: sync 2023-12-05T13:25:29.392 INFO:tasks.workunit.client.1.smithi052.stdout:3/885: sync 2023-12-05T13:25:29.394 INFO:tasks.workunit.client.1.smithi052.stdout:8/969: symlink d0/de/d12/d29/db3/d127/l145 0 2023-12-05T13:25:29.398 INFO:tasks.workunit.client.1.smithi052.stdout:3/886: rmdir da/d2e/d40/d6d/dba 39 2023-12-05T13:25:29.398 INFO:tasks.workunit.client.1.smithi052.stdout:9/861: unlink d3/d1e/d62/l8b 0 2023-12-05T13:25:29.399 INFO:tasks.workunit.client.1.smithi052.stdout:8/970: creat d0/d28/d2b/d53/d56/d111/d4f/f146 x:0 0 0 2023-12-05T13:25:29.400 INFO:tasks.workunit.client.1.smithi052.stdout:9/862: getdents d3/d1e/d41/d86 0 2023-12-05T13:25:29.403 INFO:tasks.workunit.client.1.smithi052.stdout:9/863: mknod d3/d5e/d9e/c128 0 2023-12-05T13:25:29.405 INFO:tasks.workunit.client.1.smithi052.stdout:0/859: dwrite d0/db/d20/fa5 [0,4194304] 0 2023-12-05T13:25:29.405 INFO:tasks.workunit.client.1.smithi052.stdout:0/860: chown d0/db/d1b/d51/c6f 188 1 2023-12-05T13:25:29.405 INFO:tasks.workunit.client.1.smithi052.stdout:0/861: fdatasync d0/db/d14/fd1 0 2023-12-05T13:25:29.406 INFO:tasks.workunit.client.1.smithi052.stdout:1/971: dwrite d5/d7/d35/d37/d5a/d73/d76/fe6 [0,4194304] 0 2023-12-05T13:25:29.409 INFO:tasks.workunit.client.1.smithi052.stdout:0/862: creat d0/db/d2e/d53/df9/ddf/f11c x:0 0 0 2023-12-05T13:25:29.409 INFO:tasks.workunit.client.1.smithi052.stdout:6/670: sync 2023-12-05T13:25:29.409 INFO:tasks.workunit.client.1.smithi052.stdout:5/653: sync 2023-12-05T13:25:29.409 INFO:tasks.workunit.client.1.smithi052.stdout:5/654: fsync d5/df/d11/d73/f93 0 2023-12-05T13:25:29.410 INFO:tasks.workunit.client.1.smithi052.stdout:4/911: dwrite de/d30/d73/dbe/d24/fd8 [0,4194304] 0 2023-12-05T13:25:29.415 INFO:tasks.workunit.client.1.smithi052.stdout:9/864: dread d3/fb4 [0,4194304] 0 2023-12-05T13:25:29.416 INFO:tasks.workunit.client.1.smithi052.stdout:1/972: dread d5/d7/de/d74/fb2 [0,4194304] 0 2023-12-05T13:25:29.416 INFO:tasks.workunit.client.1.smithi052.stdout:3/887: dwrite da/d25/fb5 [0,4194304] 0 2023-12-05T13:25:29.420 INFO:tasks.workunit.client.1.smithi052.stdout:6/671: mkdir d3/d5/d9/d21/d48/d4d/d66/dea 0 2023-12-05T13:25:29.421 INFO:tasks.workunit.client.1.smithi052.stdout:5/655: mknod d5/df/d4e/da8/dd7/cdb 0 2023-12-05T13:25:29.421 INFO:tasks.workunit.client.1.smithi052.stdout:4/912: getdents de/d30/d73 0 2023-12-05T13:25:29.421 INFO:tasks.workunit.client.1.smithi052.stdout:5/656: write d5/d46/d76/d8f/fb9 [268184,42144] 0 2023-12-05T13:25:29.421 INFO:tasks.workunit.client.1.smithi052.stdout:5/657: chown d5/df/d4e/d5b/cda 212 1 2023-12-05T13:25:29.421 INFO:tasks.workunit.client.1.smithi052.stdout:6/672: write d3/d4/df/d27/f47 [4233165,108531] 0 2023-12-05T13:25:29.421 INFO:tasks.workunit.client.1.smithi052.stdout:8/971: rmdir d0/d28/d2b/d53/d56/d111/d4f 39 2023-12-05T13:25:29.423 INFO:tasks.workunit.client.1.smithi052.stdout:9/865: creat d3/d1e/d37/d4f/d113/f129 x:0 0 0 2023-12-05T13:25:29.423 INFO:tasks.workunit.client.1.smithi052.stdout:9/866: dread - d3/d1e/d62/fba zero size 2023-12-05T13:25:29.423 INFO:tasks.workunit.client.1.smithi052.stdout:9/867: write d3/d1e/d41/d86/f11f [97119,17056] 0 2023-12-05T13:25:29.426 INFO:tasks.workunit.client.1.smithi052.stdout:0/863: dwrite d0/db/d1b/f37 [4194304,4194304] 0 2023-12-05T13:25:29.427 INFO:tasks.workunit.client.1.smithi052.stdout:1/973: creat d5/d7/d35/d2f/d9b/f135 x:0 0 0 2023-12-05T13:25:29.431 INFO:tasks.workunit.client.1.smithi052.stdout:0/864: write d0/db/d52/d7f/f98 [1909713,90698] 0 2023-12-05T13:25:29.431 INFO:tasks.workunit.client.1.smithi052.stdout:8/972: dread d0/f32 [4194304,4194304] 0 2023-12-05T13:25:29.431 INFO:tasks.workunit.client.1.smithi052.stdout:0/865: fsync d0/db/d14/d9b/f111 0 2023-12-05T13:25:29.432 INFO:tasks.workunit.client.1.smithi052.stdout:8/973: write d0/de/d27/d43/d44/fd8 [96115,48624] 0 2023-12-05T13:25:29.432 INFO:tasks.workunit.client.1.smithi052.stdout:3/888: truncate da/f23 433383 0 2023-12-05T13:25:29.432 INFO:tasks.workunit.client.1.smithi052.stdout:4/913: creat de/d2b/d80/f12d x:0 0 0 2023-12-05T13:25:29.441 INFO:tasks.workunit.client.1.smithi052.stdout:1/974: rename d5/d7/d35/d37/d5a/d73/d7e/cb0 to d5/d7/d35/d37/d5a/d73/dac/c136 0 2023-12-05T13:25:29.443 INFO:tasks.workunit.client.1.smithi052.stdout:0/866: creat d0/db/d2e/d7e/da6/dea/f11d x:0 0 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:8/974: creat d0/de/d27/f147 x:0 0 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:3/889: mkdir da/d2e/d40/d11f 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:3/890: chown da/d2e/ffc 63 1 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:3/891: readlink da/d48/lc1 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:3/892: fdatasync da/d25/d33/d49/dbd/d74/fea 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:3/893: fdatasync da/d25/d33/d89/dae/dcf/ff3 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:5/658: dwrite d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 [0,4194304] 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:5/659: fsync d5/d15/d21/d4a/d6e/d91/da6/d5c/f53 0 2023-12-05T13:25:29.445 INFO:tasks.workunit.client.1.smithi052.stdout:1/975: getdents d5/d26/da3/dcd 0 2023-12-05T13:25:29.446 INFO:tasks.workunit.client.1.smithi052.stdout:0/867: symlink d0/db/d14/d60/l11e 0 2023-12-05T13:25:29.446 INFO:tasks.workunit.client.1.smithi052.stdout:0/868: readlink d0/db/d52/lc6 0 2023-12-05T13:25:29.447 INFO:tasks.workunit.client.1.smithi052.stdout:8/975: creat d0/d28/db0/d133/f148 x:0 0 0 2023-12-05T13:25:29.450 INFO:tasks.workunit.client.1.smithi052.stdout:3/894: mkdir da/dd/d3d/d103/d115/d120 0 2023-12-05T13:25:29.451 INFO:tasks.workunit.client.1.smithi052.stdout:6/673: dwrite d3/d4/d36/d6f/f85 [4194304,4194304] 0 2023-12-05T13:25:29.451 INFO:tasks.workunit.client.1.smithi052.stdout:5/660: mkdir d5/d15/ddc 0 2023-12-05T13:25:29.451 INFO:tasks.workunit.client.1.smithi052.stdout:5/661: fdatasync d5/d15/d21/d4a/d6e/d91/da6/f50 0 2023-12-05T13:25:29.452 INFO:tasks.workunit.client.1.smithi052.stdout:5/662: readlink l0 0 2023-12-05T13:25:29.452 INFO:tasks.workunit.client.1.smithi052.stdout:4/914: dwrite de/d30/d68/d5c/db8/fe6 [0,4194304] 0 2023-12-05T13:25:29.453 INFO:tasks.workunit.client.1.smithi052.stdout:4/915: fsync de/f87 0 2023-12-05T13:25:29.453 INFO:tasks.workunit.client.1.smithi052.stdout:1/976: symlink d5/d26/d41/l137 0 2023-12-05T13:25:29.454 INFO:tasks.workunit.client.1.smithi052.stdout:9/868: dwrite d3/d2a/f117 [0,4194304] 0 2023-12-05T13:25:29.457 INFO:tasks.workunit.client.1.smithi052.stdout:1/977: dread d5/d7/de/d74/fb2 [0,4194304] 0 2023-12-05T13:25:29.457 INFO:tasks.workunit.client.1.smithi052.stdout:0/869: getdents d0/db/d2e/d7e/dcc/dee/d107 0 2023-12-05T13:25:29.458 INFO:tasks.workunit.client.1.smithi052.stdout:0/870: stat d0/db/d2e/d7e/da6/f105 0 2023-12-05T13:25:29.461 INFO:tasks.workunit.client.1.smithi052.stdout:3/895: rename da/d27/f3b to da/d25/dcd/dc6/f121 0 2023-12-05T13:25:29.464 INFO:tasks.workunit.client.1.smithi052.stdout:2/924: sync 2023-12-05T13:25:29.464 INFO:tasks.workunit.client.1.smithi052.stdout:2/925: write d2/d13/d1e/d6a/dda/fd8 [848547,43396] 0 2023-12-05T13:25:29.465 INFO:tasks.workunit.client.1.smithi052.stdout:6/674: rmdir d3/d5/d9/d21/d48/d4d/d66/d91 39 2023-12-05T13:25:29.466 INFO:tasks.workunit.client.1.smithi052.stdout:4/916: write de/d2b/f2d [2055689,31540] 0 2023-12-05T13:25:29.467 INFO:tasks.workunit.client.1.smithi052.stdout:8/976: dwrite d0/d28/f13b [0,4194304] 0 2023-12-05T13:25:29.475 INFO:tasks.workunit.client.1.smithi052.stdout:9/869: mkdir d3/d5e/da7/d106/d12a 0 2023-12-05T13:25:29.475 INFO:tasks.workunit.client.1.smithi052.stdout:0/871: unlink d0/db/d1b/d7a/d8b/cd8 0 2023-12-05T13:25:29.475 INFO:tasks.workunit.client.1.smithi052.stdout:0/872: write d0/db/d2e/d7e/da6/f105 [121109,3070] 0 2023-12-05T13:25:29.476 INFO:tasks.workunit.client.1.smithi052.stdout:2/926: creat d2/d13/d37/d5c/d80/dc4/de2/f117 x:0 0 0 2023-12-05T13:25:29.477 INFO:tasks.workunit.client.1.smithi052.stdout:6/675: truncate d3/d5/d9/d21/d48/d4d/d66/d91/fa4 2835093 0 2023-12-05T13:25:29.478 INFO:tasks.workunit.client.1.smithi052.stdout:4/917: symlink de/d30/d73/dbe/l12e 0 2023-12-05T13:25:29.483 INFO:tasks.workunit.client.1.smithi052.stdout:5/663: dwrite d5/d46/d76/d8f/fb7 [0,4194304] 0 2023-12-05T13:25:29.483 INFO:tasks.workunit.client.1.smithi052.stdout:8/977: creat d0/de/f149 x:0 0 0 2023-12-05T13:25:29.484 INFO:tasks.workunit.client.1.smithi052.stdout:3/896: dwrite da/d25/d33/d49/dbd/f71 [0,4194304] 0 2023-12-05T13:25:29.484 INFO:tasks.workunit.client.1.smithi052.stdout:3/897: readlink da/d25/d33/d89/l111 0 2023-12-05T13:25:29.485 INFO:tasks.workunit.client.1.smithi052.stdout:0/873: creat d0/db/d1b/d29/dba/f11f x:0 0 0 2023-12-05T13:25:29.488 INFO:tasks.workunit.client.1.smithi052.stdout:6/676: mkdir d3/d5/d9/d21/dc4/deb 0 2023-12-05T13:25:29.488 INFO:tasks.workunit.client.1.smithi052.stdout:6/677: dread - d3/d5/d58/ddf/fd2 zero size 2023-12-05T13:25:29.488 INFO:tasks.workunit.client.1.smithi052.stdout:2/927: mkdir d2/d13/d37/d5c/da9/d118 0 2023-12-05T13:25:29.489 INFO:tasks.workunit.client.1.smithi052.stdout:5/664: getdents d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4 0 2023-12-05T13:25:29.492 INFO:tasks.workunit.client.1.smithi052.stdout:8/978: rmdir d0/de/d27/d43/da2 39 2023-12-05T13:25:29.496 INFO:tasks.workunit.client.1.smithi052.stdout:9/870: dwrite d3/d1e/d41/d86/f91 [0,4194304] 0 2023-12-05T13:25:29.496 INFO:tasks.workunit.client.1.smithi052.stdout:9/871: chown d3/d11/f112 485742870 1 2023-12-05T13:25:29.504 INFO:tasks.workunit.client.1.smithi052.stdout:6/678: rmdir d3/d5/d9/d21/d48/d4d/d66 39 2023-12-05T13:25:29.504 INFO:tasks.workunit.client.1.smithi052.stdout:0/874: rename d0/db/d1b/d51/f69 to d0/db/d20/f120 0 2023-12-05T13:25:29.504 INFO:tasks.workunit.client.1.smithi052.stdout:0/875: write d0/db/d2e/d7e/dcc/dee/d107/f10e [674252,83959] 0 2023-12-05T13:25:29.505 INFO:tasks.workunit.client.1.smithi052.stdout:3/898: dwrite da/d25/d33/d49/fa7 [0,4194304] 0 2023-12-05T13:25:29.506 INFO:tasks.workunit.client.1.smithi052.stdout:5/665: dwrite d5/d15/d21/d4a/fc7 [0,4194304] 0 2023-12-05T13:25:29.506 INFO:tasks.workunit.client.1.smithi052.stdout:2/928: creat d2/d4/d3f/f119 x:0 0 0 2023-12-05T13:25:29.506 INFO:tasks.workunit.client.1.smithi052.stdout:5/666: write d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c [614598,34345] 0 2023-12-05T13:25:29.507 INFO:tasks.workunit.client.1.smithi052.stdout:8/979: creat d0/d28/d2b/d53/d56/d111/d4f/f14a x:0 0 0 2023-12-05T13:25:29.508 INFO:tasks.workunit.client.1.smithi052.stdout:9/872: mkdir d3/d5e/d9e/dd4/d12b 0 2023-12-05T13:25:29.508 INFO:tasks.workunit.client.1.smithi052.stdout:8/980: dread d0/de/d12/d29/db3/dc5/f126 [0,4194304] 0 2023-12-05T13:25:29.508 INFO:tasks.workunit.client.1.smithi052.stdout:8/981: chown d0/d28/d2b/d53/d56/d111/d4f/f12d 1720 1 2023-12-05T13:25:29.510 INFO:tasks.workunit.client.1.smithi052.stdout:6/679: creat d3/d4/fec x:0 0 0 2023-12-05T13:25:29.513 INFO:tasks.workunit.client.1.smithi052.stdout:0/876: rename d0/db/d14/f62 to d0/db/d20/d50/dae/f121 0 2023-12-05T13:25:29.515 INFO:tasks.workunit.client.1.smithi052.stdout:3/899: dread da/d25/d33/d89/dae/dcf/dfb/d11b/fa4 [0,4194304] 0 2023-12-05T13:25:29.515 INFO:tasks.workunit.client.1.smithi052.stdout:3/900: chown da/d25/d33/d43/c78 310131 1 2023-12-05T13:25:29.518 INFO:tasks.workunit.client.1.smithi052.stdout:2/929: creat d2/d13/d37/d5c/d80/db4/f11a x:0 0 0 2023-12-05T13:25:29.519 INFO:tasks.workunit.client.1.smithi052.stdout:2/930: write d2/d13/d1e/d6a/d7f/d84/d6e/f7a [2139951,26665] 0 2023-12-05T13:25:29.520 INFO:tasks.workunit.client.1.smithi052.stdout:6/680: truncate d3/d5/d9/f2f 3133725 0 2023-12-05T13:25:29.522 INFO:tasks.workunit.client.1.smithi052.stdout:6/681: dread d3/d5/d9/f3a [0,4194304] 0 2023-12-05T13:25:29.522 INFO:tasks.workunit.client.1.smithi052.stdout:6/682: fdatasync d3/fbb 0 2023-12-05T13:25:29.523 INFO:tasks.workunit.client.1.smithi052.stdout:3/901: mkdir da/d27/dec/d122 0 2023-12-05T13:25:29.524 INFO:tasks.workunit.client.1.smithi052.stdout:5/667: truncate d5/d46/d76/d8f/fb7 981086 0 2023-12-05T13:25:29.525 INFO:tasks.workunit.client.1.smithi052.stdout:5/668: write d5/d15/d21/d4a/f5f [1818351,28368] 0 2023-12-05T13:25:29.526 INFO:tasks.workunit.client.1.smithi052.stdout:2/931: getdents d2/d13/d1e/dff 0 2023-12-05T13:25:29.530 INFO:tasks.workunit.client.1.smithi052.stdout:0/877: mknod d0/db/d52/c122 0 2023-12-05T13:25:29.530 INFO:tasks.workunit.client.1.smithi052.stdout:3/902: creat da/d25/f123 x:0 0 0 2023-12-05T13:25:29.530 INFO:tasks.workunit.client.1.smithi052.stdout:9/873: mknod d3/d5e/da7/daf/c12c 0 2023-12-05T13:25:29.531 INFO:tasks.workunit.client.1.smithi052.stdout:8/982: dwrite d0/de/f1f [0,4194304] 0 2023-12-05T13:25:29.531 INFO:tasks.workunit.client.1.smithi052.stdout:5/669: creat d5/d15/d21/d25/fdd x:0 0 0 2023-12-05T13:25:29.532 INFO:tasks.workunit.client.1.smithi052.stdout:5/670: truncate d5/df/d4b/f95 491067 0 2023-12-05T13:25:29.532 INFO:tasks.workunit.client.1.smithi052.stdout:5/671: getdents d5/d15/ddc 0 2023-12-05T13:25:29.535 INFO:tasks.workunit.client.1.smithi052.stdout:2/932: rename d2/d13/d37/d5c/da9/cef to d2/d4/d3f/d9d/c11b 0 2023-12-05T13:25:29.537 INFO:tasks.workunit.client.1.smithi052.stdout:3/903: rmdir da/d25/d33/d51/d10b 39 2023-12-05T13:25:29.537 INFO:tasks.workunit.client.1.smithi052.stdout:3/904: readlink l2 0 2023-12-05T13:25:29.538 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:29 smithi029 ceph-mon[112128]: pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 17 MiB/s rd, 30 MiB/s wr, 37 op/s 2023-12-05T13:25:29.538 INFO:tasks.workunit.client.1.smithi052.stdout:9/874: unlink d3/d5e/ff7 0 2023-12-05T13:25:29.538 INFO:tasks.workunit.client.1.smithi052.stdout:9/875: write d3/d1e/d37/d4f/d113/f120 [944534,90983] 0 2023-12-05T13:25:29.538 INFO:tasks.workunit.client.1.smithi052.stdout:9/876: stat d3/d31/ca5 0 2023-12-05T13:25:29.539 INFO:tasks.workunit.client.1.smithi052.stdout:3/905: write da/dd/d3d/f63 [84784,53942] 0 2023-12-05T13:25:29.545 INFO:tasks.workunit.client.1.smithi052.stdout:5/672: creat d5/df/d4e/fde x:0 0 0 2023-12-05T13:25:29.546 INFO:tasks.workunit.client.1.smithi052.stdout:2/933: creat d2/d13/d1e/dae/dc3/f11c x:0 0 0 2023-12-05T13:25:29.546 INFO:tasks.workunit.client.1.smithi052.stdout:0/878: dwrite d0/db/d20/fa5 [0,4194304] 0 2023-12-05T13:25:29.546 INFO:tasks.workunit.client.1.smithi052.stdout:0/879: stat d0/db/d20/d50 0 2023-12-05T13:25:29.547 INFO:tasks.workunit.client.1.smithi052.stdout:5/673: write d5/d15/f31 [2295425,49954] 0 2023-12-05T13:25:29.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/877: dwrite d3/d5e/d9e/fe3 [0,4194304] 0 2023-12-05T13:25:29.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/878: chown d3/d1e/fe0 1108035621 1 2023-12-05T13:25:29.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/879: write d3/d11/fa2 [582081,65419] 0 2023-12-05T13:25:29.554 INFO:tasks.workunit.client.1.smithi052.stdout:9/880: readlink d3/d5e/l90 0 2023-12-05T13:25:29.557 INFO:tasks.workunit.client.1.smithi052.stdout:2/934: write d2/d13/d37/d5c/d80/dc4/fdb [876273,48636] 0 2023-12-05T13:25:29.558 INFO:tasks.workunit.client.1.smithi052.stdout:2/935: chown d2/d13/d1e/d6a/d7f/d84/d6e 0 1 2023-12-05T13:25:29.561 INFO:tasks.workunit.client.1.smithi052.stdout:2/936: link d2/d4/l99 d2/d4/d63/d6d/dcb/l11d 0 2023-12-05T13:25:29.563 INFO:tasks.workunit.client.1.smithi052.stdout:9/881: link d3/l40 d3/d11/d3e/l12d 0 2023-12-05T13:25:29.564 INFO:tasks.workunit.client.1.smithi052.stdout:2/937: rmdir d2/d13/d1e/dff 39 2023-12-05T13:25:29.566 INFO:tasks.workunit.client.1.smithi052.stdout:5/674: dwrite d5/d15/d21/fa5 [0,4194304] 0 2023-12-05T13:25:29.569 INFO:tasks.workunit.client.1.smithi052.stdout:9/882: creat d3/d5e/da7/f12e x:0 0 0 2023-12-05T13:25:29.570 INFO:tasks.workunit.client.1.smithi052.stdout:2/938: symlink d2/d13/d1e/d6a/d7f/d84/df5/l11e 0 2023-12-05T13:25:29.574 INFO:tasks.workunit.client.1.smithi052.stdout:5/675: symlink d5/d15/d21/d4a/d6e/d91/da6/d5c/dab/ldf 0 2023-12-05T13:25:29.576 INFO:tasks.workunit.client.1.smithi052.stdout:5/676: dread d5/d15/d21/f23 [0,4194304] 0 2023-12-05T13:25:29.578 INFO:tasks.workunit.client.1.smithi052.stdout:2/939: unlink d2/d4/d3f/lbe 0 2023-12-05T13:25:29.580 INFO:tasks.workunit.client.1.smithi052.stdout:5/677: stat d5/cb 0 2023-12-05T13:25:29.581 INFO:tasks.workunit.client.1.smithi052.stdout:5/678: truncate d5/d15/d21/d4a/d6e/f99 4828331 0 2023-12-05T13:25:29.581 INFO:tasks.workunit.client.1.smithi052.stdout:5/679: chown d5/d15/c1f 2 1 2023-12-05T13:25:29.583 INFO:tasks.workunit.client.1.smithi052.stdout:2/940: getdents d2/da4 0 2023-12-05T13:25:29.584 INFO:tasks.workunit.client.1.smithi052.stdout:9/883: rename d3/cc5 to d3/c12f 0 2023-12-05T13:25:29.585 INFO:tasks.workunit.client.1.smithi052.stdout:5/680: truncate d5/faf 374716 0 2023-12-05T13:25:29.586 INFO:tasks.workunit.client.1.smithi052.stdout:2/941: mkdir d2/d13/d37/d5c/d80/dc4/de2/d11f 0 2023-12-05T13:25:29.586 INFO:tasks.workunit.client.1.smithi052.stdout:1/978: sync 2023-12-05T13:25:29.587 INFO:tasks.workunit.client.1.smithi052.stdout:2/942: creat d2/d13/d37/d5c/d80/dc4/f120 x:0 0 0 2023-12-05T13:25:29.589 INFO:tasks.workunit.client.1.smithi052.stdout:2/943: rename d2/d13/d1e/d6a/d7f/d84/lbf to d2/d13/d48/dd3/d62/deb/l121 0 2023-12-05T13:25:29.591 INFO:tasks.workunit.client.1.smithi052.stdout:2/944: read d2/d4/d3f/f97 [3564232,56656] 0 2023-12-05T13:25:29.592 INFO:tasks.workunit.client.1.smithi052.stdout:2/945: creat d2/d4/d3f/f122 x:0 0 0 2023-12-05T13:25:29.595 INFO:tasks.workunit.client.1.smithi052.stdout:2/946: mknod d2/d13/c123 0 2023-12-05T13:25:29.596 INFO:tasks.workunit.client.1.smithi052.stdout:2/947: read d2/f9f [134989,16796] 0 2023-12-05T13:25:29.598 INFO:tasks.workunit.client.1.smithi052.stdout:2/948: creat d2/d13/d37/d5c/d80/f124 x:0 0 0 2023-12-05T13:25:29.602 INFO:tasks.workunit.client.1.smithi052.stdout:5/681: dread d5/d7f/fc5 [0,4194304] 0 2023-12-05T13:25:29.605 INFO:tasks.workunit.client.1.smithi052.stdout:5/682: symlink d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/le0 0 2023-12-05T13:25:29.605 INFO:tasks.workunit.client.1.smithi052.stdout:5/683: stat d5/f14 0 2023-12-05T13:25:29.609 INFO:tasks.workunit.client.1.smithi052.stdout:9/884: dwrite d3/d1e/d41/d86/fa1 [0,4194304] 0 2023-12-05T13:25:29.616 INFO:tasks.workunit.client.1.smithi052.stdout:1/979: dwrite d5/d26/da3/f131 [0,4194304] 0 2023-12-05T13:25:29.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/980: rename d5/d26/d41/c116 to d5/d26/d41/deb/c138 0 2023-12-05T13:25:29.618 INFO:tasks.workunit.client.1.smithi052.stdout:1/981: truncate d5/d26/dbf/f105 114214 0 2023-12-05T13:25:29.619 INFO:tasks.workunit.client.1.smithi052.stdout:2/949: dwrite d2/d13/d1e/d6a/d7f/d84/f10c [0,4194304] 0 2023-12-05T13:25:29.620 INFO:tasks.workunit.client.1.smithi052.stdout:1/982: mkdir d5/d26/d41/deb/d12f/d139 0 2023-12-05T13:25:29.623 INFO:tasks.workunit.client.1.smithi052.stdout:2/950: creat d2/d13/d1e/d6a/d7f/f125 x:0 0 0 2023-12-05T13:25:29.623 INFO:tasks.workunit.client.1.smithi052.stdout:2/951: fsync d2/d13/f22 0 2023-12-05T13:25:29.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/983: mkdir d5/d7/d35/d37/d5a/d13a 0 2023-12-05T13:25:29.625 INFO:tasks.workunit.client.1.smithi052.stdout:1/984: readlink d5/d26/l3f 0 2023-12-05T13:25:29.626 INFO:tasks.workunit.client.1.smithi052.stdout:5/684: dwrite d5/df/d11/d66/f94 [0,4194304] 0 2023-12-05T13:25:29.626 INFO:tasks.workunit.client.1.smithi052.stdout:2/952: mkdir d2/d13/d1e/d6a/d7f/d84/d6e/d126 0 2023-12-05T13:25:29.626 INFO:tasks.workunit.client.1.smithi052.stdout:9/885: dwrite d3/d1e/d41/d57/f107 [0,4194304] 0 2023-12-05T13:25:29.627 INFO:tasks.workunit.client.1.smithi052.stdout:1/985: mknod d5/d26/c13b 0 2023-12-05T13:25:29.634 INFO:tasks.workunit.client.1.smithi052.stdout:5/685: mkdir d5/d15/d21/d4a/de1 0 2023-12-05T13:25:29.641 INFO:tasks.workunit.client.1.smithi052.stdout:9/886: mknod d3/d1e/d41/d57/c130 0 2023-12-05T13:25:29.641 INFO:tasks.workunit.client.1.smithi052.stdout:9/887: chown d3/d92/da8/d119/ca9 304322087 1 2023-12-05T13:25:29.641 INFO:tasks.workunit.client.1.smithi052.stdout:9/888: chown d3/d5e/da7/daf/dbe/lc7 32 1 2023-12-05T13:25:29.641 INFO:tasks.workunit.client.1.smithi052.stdout:1/986: rename d5/daa/d79/la2 to d5/daa/d17/d3c/dc2/l13c 0 2023-12-05T13:25:29.643 INFO:tasks.workunit.client.1.smithi052.stdout:2/953: dwrite d2/d13/d1e/d6a/fba [0,4194304] 0 2023-12-05T13:25:29.643 INFO:tasks.workunit.client.1.smithi052.stdout:5/686: write d5/df/d11/f52 [2787717,102567] 0 2023-12-05T13:25:29.643 INFO:tasks.workunit.client.1.smithi052.stdout:5/687: stat d5/df/d11/l3e 0 2023-12-05T13:25:29.643 INFO:tasks.workunit.client.1.smithi052.stdout:5/688: chown d5/df/f61 4516 1 2023-12-05T13:25:29.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/987: mkdir d5/d7/de/d13d 0 2023-12-05T13:25:29.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/988: readlink d5/d7/d35/d2f/d3e/d62/l110 0 2023-12-05T13:25:29.645 INFO:tasks.workunit.client.1.smithi052.stdout:1/989: write d5/daa/d2a/fce [111661,102163] 0 2023-12-05T13:25:29.649 INFO:tasks.workunit.client.1.smithi052.stdout:4/918: sync 2023-12-05T13:25:29.649 INFO:tasks.workunit.client.1.smithi052.stdout:5/689: creat d5/df/d8d/dd8/fe2 x:0 0 0 2023-12-05T13:25:29.649 INFO:tasks.workunit.client.1.smithi052.stdout:6/683: sync 2023-12-05T13:25:29.652 INFO:tasks.workunit.client.1.smithi052.stdout:9/889: mkdir d3/d5e/da7/daf/d131 0 2023-12-05T13:25:29.652 INFO:tasks.workunit.client.1.smithi052.stdout:5/690: creat d5/d15/fe3 x:0 0 0 2023-12-05T13:25:29.652 INFO:tasks.workunit.client.1.smithi052.stdout:5/691: readlink d5/d15/d21/d4a/d6e/d91/da6/d5c/l2f 0 2023-12-05T13:25:29.652 INFO:tasks.workunit.client.1.smithi052.stdout:5/692: truncate d5/d15/d21/d4a/f89 797795 0 2023-12-05T13:25:29.657 INFO:tasks.workunit.client.1.smithi052.stdout:6/684: creat d3/d5/d9/fed x:0 0 0 2023-12-05T13:25:29.657 INFO:tasks.workunit.client.1.smithi052.stdout:6/685: write d3/d5/d9/d21/fc8 [890599,52033] 0 2023-12-05T13:25:29.657 INFO:tasks.workunit.client.1.smithi052.stdout:9/890: rmdir d3/d1e/d41/d86 39 2023-12-05T13:25:29.661 INFO:tasks.workunit.client.1.smithi052.stdout:0/880: sync 2023-12-05T13:25:29.663 INFO:tasks.workunit.client.1.smithi052.stdout:9/891: write d3/d5e/da7/daf/dbe/fed [706350,114357] 0 2023-12-05T13:25:29.663 INFO:tasks.workunit.client.1.smithi052.stdout:2/954: dwrite d2/d13/d1e/fab [0,4194304] 0 2023-12-05T13:25:29.664 INFO:tasks.workunit.client.1.smithi052.stdout:0/881: creat d0/db/d14/d60/f123 x:0 0 0 2023-12-05T13:25:29.664 INFO:tasks.workunit.client.1.smithi052.stdout:1/990: dwrite d5/d7/f12 [0,4194304] 0 2023-12-05T13:25:29.667 INFO:tasks.workunit.client.1.smithi052.stdout:2/955: getdents d2/d13/d48/dd3/d62/deb 0 2023-12-05T13:25:29.667 INFO:tasks.workunit.client.1.smithi052.stdout:2/956: write d2/d13/d37/d5c/d80/dc4/de2/f106 [1062086,88368] 0 2023-12-05T13:25:29.667 INFO:tasks.workunit.client.1.smithi052.stdout:2/957: fsync d2/d13/d1e/d6a/fba 0 2023-12-05T13:25:29.669 INFO:tasks.workunit.client.1.smithi052.stdout:8/983: sync 2023-12-05T13:25:29.669 INFO:tasks.workunit.client.1.smithi052.stdout:8/984: chown d0/de/d12/d29 765 1 2023-12-05T13:25:29.669 INFO:tasks.workunit.client.1.smithi052.stdout:3/906: sync 2023-12-05T13:25:29.671 INFO:tasks.workunit.client.1.smithi052.stdout:9/892: dread d3/d5e/fdd [0,4194304] 0 2023-12-05T13:25:29.673 INFO:tasks.workunit.client.1.smithi052.stdout:2/958: mknod d2/d13/d1e/d6a/d7f/d84/d6e/d10e/c127 0 2023-12-05T13:25:29.673 INFO:tasks.workunit.client.1.smithi052.stdout:2/959: chown d2/d13/d1e/d6a/d7f/lcc 18319155 1 2023-12-05T13:25:29.675 INFO:tasks.workunit.client.1.smithi052.stdout:8/985: unlink d0/de/d12/c73 0 2023-12-05T13:25:29.677 INFO:tasks.workunit.client.1.smithi052.stdout:3/907: rename da/l46 to da/d25/d33/d43/d5b/l124 0 2023-12-05T13:25:29.679 INFO:tasks.workunit.client.1.smithi052.stdout:0/882: dread d0/f1a [4194304,4194304] 0 2023-12-05T13:25:29.679 INFO:tasks.workunit.client.1.smithi052.stdout:4/919: dwrite de/d30/d73/dbe/d24/f120 [0,4194304] 0 2023-12-05T13:25:29.679 INFO:tasks.workunit.client.1.smithi052.stdout:9/893: mknod d3/d92/da8/d119/c132 0 2023-12-05T13:25:29.680 INFO:tasks.workunit.client.1.smithi052.stdout:2/960: symlink d2/d13/d45/l128 0 2023-12-05T13:25:29.681 INFO:tasks.workunit.client.1.smithi052.stdout:8/986: creat d0/d28/d2b/d53/d56/d111/d4f/db5/f14b x:0 0 0 2023-12-05T13:25:29.682 INFO:tasks.workunit.client.1.smithi052.stdout:3/908: dread da/dd/d3d/f76 [0,4194304] 0 2023-12-05T13:25:29.682 INFO:tasks.workunit.client.1.smithi052.stdout:5/693: truncate d5/d15/d21/d4a/f89 733257 0 2023-12-05T13:25:29.685 INFO:tasks.workunit.client.1.smithi052.stdout:3/909: dread da/d25/d33/d89/dae/dcf/ff3 [0,4194304] 0 2023-12-05T13:25:29.685 INFO:tasks.workunit.client.1.smithi052.stdout:3/910: write da/d2e/d40/d6d/ff6 [932855,16506] 0 2023-12-05T13:25:29.687 INFO:tasks.workunit.client.1.smithi052.stdout:3/911: dread da/dd/fe5 [0,4194304] 0 2023-12-05T13:25:29.687 INFO:tasks.workunit.client.1.smithi052.stdout:6/686: dwrite d3/d4/df/d27/f56 [0,4194304] 0 2023-12-05T13:25:29.687 INFO:tasks.workunit.client.1.smithi052.stdout:4/920: rename de/d30/d73/dbe/ld9 to de/d30/dac/dbb/l12f 0 2023-12-05T13:25:29.689 INFO:tasks.workunit.client.1.smithi052.stdout:9/894: mkdir d3/d11/d96/d133 0 2023-12-05T13:25:29.690 INFO:tasks.workunit.client.1.smithi052.stdout:2/961: creat d2/d13/d37/d5c/d80/dc4/de2/f129 x:0 0 0 2023-12-05T13:25:29.690 INFO:tasks.workunit.client.1.smithi052.stdout:1/991: dwrite d5/d26/d41/f5f [0,4194304] 0 2023-12-05T13:25:29.692 INFO:tasks.workunit.client.1.smithi052.stdout:8/987: creat d0/dae/f14c x:0 0 0 2023-12-05T13:25:29.696 INFO:tasks.workunit.client.1.smithi052.stdout:5/694: symlink d5/d15/d21/d4a/de1/le4 0 2023-12-05T13:25:29.696 INFO:tasks.workunit.client.1.smithi052.stdout:5/695: chown d5/df/d11/d73/d77/fc3 361 1 2023-12-05T13:25:29.698 INFO:tasks.workunit.client.1.smithi052.stdout:5/696: read d5/d15/d21/d4a/d6e/d91/da6/d5c/f4f [1845427,109000] 0 2023-12-05T13:25:29.699 INFO:tasks.workunit.client.1.smithi052.stdout:3/912: stat da/d25/d33/d43/d5b/l124 0 2023-12-05T13:25:29.699 INFO:tasks.workunit.client.1.smithi052.stdout:1/992: dread d5/d7/f4b [0,4194304] 0 2023-12-05T13:25:29.699 INFO:tasks.workunit.client.1.smithi052.stdout:3/913: chown da/dd/f55 2139189508 1 2023-12-05T13:25:29.700 INFO:tasks.workunit.client.1.smithi052.stdout:1/993: readlink d5/d7/d35/d37/d43/le0 0 2023-12-05T13:25:29.700 INFO:tasks.workunit.client.1.smithi052.stdout:3/914: readlink da/d25/d33/d89/dae/dcf/dfb/d11b/lb8 0 2023-12-05T13:25:29.700 INFO:tasks.workunit.client.1.smithi052.stdout:9/895: mknod d3/d5e/da7/daf/dbe/c134 0 2023-12-05T13:25:29.704 INFO:tasks.workunit.client.1.smithi052.stdout:6/687: dread d3/d4/df/d63/f70 [0,4194304] 0 2023-12-05T13:25:29.704 INFO:tasks.workunit.client.1.smithi052.stdout:6/688: dread - d3/d4/df/d27/fca zero size 2023-12-05T13:25:29.706 INFO:tasks.workunit.client.1.smithi052.stdout:8/988: rename d0/de/d86/f116 to d0/de/f14d 0 2023-12-05T13:25:29.706 INFO:tasks.workunit.client.1.smithi052.stdout:0/883: dwrite d0/f1a [0,4194304] 0 2023-12-05T13:25:29.707 INFO:tasks.workunit.client.1.smithi052.stdout:2/962: dread d2/d13/d37/d5c/d80/db4/fd4 [0,4194304] 0 2023-12-05T13:25:29.707 INFO:tasks.workunit.client.1.smithi052.stdout:2/963: getdents d2/d13/d1e/dff 0 2023-12-05T13:25:29.707 INFO:tasks.workunit.client.1.smithi052.stdout:2/964: readlink d2/d4/l9 0 2023-12-05T13:25:29.709 INFO:tasks.workunit.client.1.smithi052.stdout:5/697: dread d5/d15/d21/d4a/f89 [0,4194304] 0 2023-12-05T13:25:29.709 INFO:tasks.workunit.client.1.smithi052.stdout:9/896: getdents d3 0 2023-12-05T13:25:29.709 INFO:tasks.workunit.client.1.smithi052.stdout:9/897: readlink d3/d92/da8/d119/lb9 0 2023-12-05T13:25:29.709 INFO:tasks.workunit.client.1.smithi052.stdout:9/898: write d3/d1e/d37/d4f/f65 [1187100,17194] 0 2023-12-05T13:25:29.710 INFO:tasks.workunit.client.1.smithi052.stdout:9/899: read - d3/d1e/d37/fec zero size 2023-12-05T13:25:29.710 INFO:tasks.workunit.client.1.smithi052.stdout:4/921: dwrite de/d2b/f5a [0,4194304] 0 2023-12-05T13:25:29.710 INFO:tasks.workunit.client.1.smithi052.stdout:0/884: dread d0/db/d52/d7f/fce [4194304,4194304] 0 2023-12-05T13:25:29.711 INFO:tasks.workunit.client.1.smithi052.stdout:6/689: creat d3/d5/d9/d21/d48/d4d/d66/dea/fee x:0 0 0 2023-12-05T13:25:29.714 INFO:tasks.workunit.client.1.smithi052.stdout:1/994: rename d5/d7/c91 to d5/d26/da3/c13e 0 2023-12-05T13:25:29.716 INFO:tasks.workunit.client.1.smithi052.stdout:8/989: link d0/dae/f14c d0/d28/d2b/d53/d56/d111/d8f/f14e 0 2023-12-05T13:25:29.719 INFO:tasks.workunit.client.1.smithi052.stdout:2/965: mknod d2/d13/d1e/d6a/d7f/d84/d6e/d126/c12a 0 2023-12-05T13:25:29.721 INFO:tasks.workunit.client.1.smithi052.stdout:4/922: dwrite de/d2b/f5a [4194304,4194304] 0 2023-12-05T13:25:29.722 INFO:tasks.workunit.client.1.smithi052.stdout:9/900: creat d3/d1e/d62/f135 x:0 0 0 2023-12-05T13:25:29.722 INFO:tasks.workunit.client.1.smithi052.stdout:9/901: write d3/d92/ffd [595366,74331] 0 2023-12-05T13:25:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:29 smithi052 ceph-mon[121072]: pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 17 MiB/s rd, 30 MiB/s wr, 37 op/s 2023-12-05T13:25:29.724 INFO:tasks.workunit.client.1.smithi052.stdout:0/885: truncate d0/db/d52/d7f/f9f 3180425 0 2023-12-05T13:25:29.725 INFO:tasks.workunit.client.1.smithi052.stdout:6/690: creat d3/d4/dda/fef x:0 0 0 2023-12-05T13:25:29.727 INFO:tasks.workunit.client.1.smithi052.stdout:3/915: rename da/dd/d3d/dda/ddc/ff5 to da/d2e/d40/d109/f125 0 2023-12-05T13:25:29.728 INFO:tasks.workunit.client.1.smithi052.stdout:3/916: write da/d25/d33/d49/fd5 [2162023,109586] 0 2023-12-05T13:25:29.732 INFO:tasks.workunit.client.1.smithi052.stdout:2/966: creat d2/d13/d37/d8b/f12b x:0 0 0 2023-12-05T13:25:29.733 INFO:tasks.workunit.client.1.smithi052.stdout:1/995: rmdir d5/d26/da3 39 2023-12-05T13:25:29.738 INFO:tasks.workunit.client.1.smithi052.stdout:9/902: symlink d3/d11/l136 0 2023-12-05T13:25:29.739 INFO:tasks.workunit.client.1.smithi052.stdout:0/886: creat d0/db/d20/f124 x:0 0 0 2023-12-05T13:25:29.741 INFO:tasks.workunit.client.1.smithi052.stdout:6/691: truncate d3/d5/d9/d21/d48/d5b/fc3 1080076 0 2023-12-05T13:25:29.744 INFO:tasks.workunit.client.1.smithi052.stdout:8/990: rename d0/f11 to d0/de/d12/f14f 0 2023-12-05T13:25:29.744 INFO:tasks.workunit.client.1.smithi052.stdout:6/692: write d3/d5/d9/d21/d48/d5b/f7b [4037700,52812] 0 2023-12-05T13:25:29.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/967: dwrite d2/d13/d37/d5c/d80/dc4/de2/f117 [0,4194304] 0 2023-12-05T13:25:29.745 INFO:tasks.workunit.client.1.smithi052.stdout:2/968: fdatasync d2/d13/d37/d5c/d80/db4/fd4 0 2023-12-05T13:25:29.752 INFO:tasks.workunit.client.1.smithi052.stdout:3/917: mknod da/d25/d33/d89/dae/dcf/dfb/c126 0 2023-12-05T13:25:29.753 INFO:tasks.workunit.client.1.smithi052.stdout:5/698: truncate d5/df/d11/f52 1705278 0 2023-12-05T13:25:29.753 INFO:tasks.workunit.client.1.smithi052.stdout:5/699: chown d5/df/d11/fd5 2118680 1 2023-12-05T13:25:29.753 INFO:tasks.workunit.client.1.smithi052.stdout:1/996: creat d5/d7/d35/d37/d5a/d73/dac/dc7/f13f x:0 0 0 2023-12-05T13:25:29.754 INFO:tasks.workunit.client.1.smithi052.stdout:4/923: write de/d30/d73/dbe/f2a [2054244,40705] 0 2023-12-05T13:25:29.754 INFO:tasks.workunit.client.1.smithi052.stdout:9/903: creat d3/d1e/d41/d57/de9/f137 x:0 0 0 2023-12-05T13:25:29.754 INFO:tasks.workunit.client.1.smithi052.stdout:4/924: dread - de/d2b/d80/f12d zero size 2023-12-05T13:25:29.755 INFO:tasks.workunit.client.1.smithi052.stdout:3/918: write da/d25/f6f [2634454,87295] 0 2023-12-05T13:25:29.755 INFO:tasks.workunit.client.1.smithi052.stdout:3/919: stat da/d25/dcd/c10d 0 2023-12-05T13:25:29.755 INFO:tasks.workunit.client.1.smithi052.stdout:0/887: creat d0/db/d1b/d51/d55/d66/f125 x:0 0 0 2023-12-05T13:25:29.756 INFO:tasks.workunit.client.1.smithi052.stdout:8/991: dwrite d0/de/d27/f92 [0,4194304] 0 2023-12-05T13:25:29.758 INFO:tasks.workunit.client.1.smithi052.stdout:6/693: symlink d3/d4/df/d27/lf0 0 2023-12-05T13:25:29.758 INFO:tasks.workunit.client.1.smithi052.stdout:6/694: fdatasync d3/d5/d9/d21/d48/d4d/f78 0 2023-12-05T13:25:29.761 INFO:tasks.workunit.client.1.smithi052.stdout:9/904: dread d3/d1e/d37/d4f/f65 [0,4194304] 0 2023-12-05T13:25:29.764 INFO:tasks.workunit.client.1.smithi052.stdout:0/888: dread d0/fd0 [0,4194304] 0 2023-12-05T13:25:29.764 INFO:tasks.workunit.client.1.smithi052.stdout:0/889: fsync d0/db/d52/d7f/f89 0 2023-12-05T13:25:29.765 INFO:tasks.workunit.client.1.smithi052.stdout:2/969: getdents d2/d13/d1e 0 2023-12-05T13:25:29.770 INFO:tasks.workunit.client.1.smithi052.stdout:5/700: mknod d5/df/d4e/d5b/ce5 0 2023-12-05T13:25:29.772 INFO:tasks.workunit.client.1.smithi052.stdout:1/997: creat d5/d7/d35/d37/d43/dbc/f140 x:0 0 0 2023-12-05T13:25:29.772 INFO:tasks.workunit.client.1.smithi052.stdout:1/998: write d5/d7/d35/d37/d5a/d73/d76/f12b [828053,33702] 0 2023-12-05T13:25:29.773 INFO:tasks.workunit.client.1.smithi052.stdout:4/925: mknod de/d29/d51/da3/d6d/c130 0 2023-12-05T13:25:29.774 INFO:tasks.workunit.client.1.smithi052.stdout:8/992: dwrite d0/d28/db0/f13a [0,4194304] 0 2023-12-05T13:25:29.774 INFO:tasks.workunit.client.1.smithi052.stdout:3/920: symlink da/l127 0 2023-12-05T13:25:29.778 INFO:tasks.workunit.client.1.smithi052.stdout:6/695: truncate d3/d5/d9/d21/f23 3650453 0 2023-12-05T13:25:29.778 INFO:tasks.workunit.client.1.smithi052.stdout:6/696: chown d3/d5/d9/d21/d48 127692 1 2023-12-05T13:25:29.780 INFO:tasks.workunit.client.1.smithi052.stdout:9/905: rename d3/d11/c81 to d3/d5e/da7/daf/d131/c138 0 2023-12-05T13:25:29.781 INFO:tasks.workunit.client.1.smithi052.stdout:9/906: truncate d3/d5e/da7/daf/dbe/f10f 646137 0 2023-12-05T13:25:29.781 INFO:tasks.workunit.client.1.smithi052.stdout:9/907: readlink d3/d11/lf2 0 2023-12-05T13:25:29.783 INFO:tasks.workunit.client.1.smithi052.stdout:0/890: symlink d0/db/d2e/d53/df9/ddf/l126 0 2023-12-05T13:25:29.783 INFO:tasks.workunit.client.1.smithi052.stdout:0/891: write d0/db/d1b/fd6 [706385,68704] 0 2023-12-05T13:25:29.785 INFO:tasks.workunit.client.1.smithi052.stdout:1/999: symlink d5/d26/d41/dbd/l141 0 2023-12-05T13:25:29.788 INFO:tasks.workunit.client.1.smithi052.stdout:5/701: dwrite d5/d15/d21/f5e [0,4194304] 0 2023-12-05T13:25:29.799 INFO:tasks.workunit.client.1.smithi052.stdout:3/921: creat da/d25/d33/d51/f128 x:0 0 0 2023-12-05T13:25:29.799 INFO:tasks.workunit.client.1.smithi052.stdout:8/993: stat d0/d4d/la8 0 2023-12-05T13:25:29.801 INFO:tasks.workunit.client.1.smithi052.stdout:5/702: dread d5/d15/d21/fa5 [0,4194304] 0 2023-12-05T13:25:29.804 INFO:tasks.workunit.client.1.smithi052.stdout:4/926: rename de/d2b/d80/f12d to de/d30/d68/d5c/dcb/f131 0 2023-12-05T13:25:29.806 INFO:tasks.workunit.client.1.smithi052.stdout:9/908: mknod d3/d5e/da7/daf/d131/c139 0 2023-12-05T13:25:29.807 INFO:tasks.workunit.client.1.smithi052.stdout:0/892: creat d0/db/d52/df1/f127 x:0 0 0 2023-12-05T13:25:29.807 INFO:tasks.workunit.client.1.smithi052.stdout:0/893: readlink d0/db/d52/le1 0 2023-12-05T13:25:29.808 INFO:tasks.workunit.client.1.smithi052.stdout:8/994: symlink d0/de/d27/d43/d44/l150 0 2023-12-05T13:25:29.810 INFO:tasks.workunit.client.1.smithi052.stdout:5/703: getdents d5/df 0 2023-12-05T13:25:29.811 INFO:tasks.workunit.client.1.smithi052.stdout:6/697: symlink d3/d4/d36/lf1 0 2023-12-05T13:25:29.811 INFO:tasks.workunit.client.1.smithi052.stdout:6/698: chown d3/d5/c65 43 1 2023-12-05T13:25:29.812 INFO:tasks.workunit.client.1.smithi052.stdout:4/927: creat de/d2b/d64/f132 x:0 0 0 2023-12-05T13:25:29.813 INFO:tasks.workunit.client.1.smithi052.stdout:0/894: truncate d0/db/d33/f35 3131390 0 2023-12-05T13:25:29.813 INFO:tasks.workunit.client.1.smithi052.stdout:0/895: readlink d0/db/d52/lc6 0 2023-12-05T13:25:29.815 INFO:tasks.workunit.client.1.smithi052.stdout:8/995: symlink d0/de/d12/dc1/dd3/l151 0 2023-12-05T13:25:29.815 INFO:tasks.workunit.client.1.smithi052.stdout:8/996: read - d0/d28/d2b/d53/d56/f142 zero size 2023-12-05T13:25:29.816 INFO:tasks.workunit.client.1.smithi052.stdout:8/997: write d0/de/d12/f10f [917691,41768] 0 2023-12-05T13:25:29.816 INFO:tasks.workunit.client.1.smithi052.stdout:8/998: read d0/f95 [751845,65226] 0 2023-12-05T13:25:29.816 INFO:tasks.workunit.client.1.smithi052.stdout:8/999: chown d0/de/d12/dc1/dd3 106 1 2023-12-05T13:25:29.817 INFO:tasks.workunit.client.1.smithi052.stdout:5/704: unlink d5/df/d11/d73/d77/f78 0 2023-12-05T13:25:29.818 INFO:tasks.workunit.client.1.smithi052.stdout:6/699: creat d3/d4/df/d63/ff2 x:0 0 0 2023-12-05T13:25:29.819 INFO:tasks.workunit.client.1.smithi052.stdout:9/909: dwrite d3/d1e/d37/ff4 [0,4194304] 0 2023-12-05T13:25:29.820 INFO:tasks.workunit.client.1.smithi052.stdout:4/928: rename de/d30/d68/f10b to de/d29/d51/da3/d6d/df2/f133 0 2023-12-05T13:25:29.824 INFO:tasks.workunit.client.1.smithi052.stdout:5/705: rename d5/df/d4e/d5b/c80 to d5/d46/d76/d8f/ce6 0 2023-12-05T13:25:29.827 INFO:tasks.workunit.client.1.smithi052.stdout:9/910: dread d3/d5e/d9e/fe3 [0,4194304] 0 2023-12-05T13:25:29.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/911: mknod d3/d5e/d9e/c13a 0 2023-12-05T13:25:29.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/912: dread - d3/d2a/fbb zero size 2023-12-05T13:25:29.829 INFO:tasks.workunit.client.1.smithi052.stdout:9/913: chown d3/d1e/d41/f104 17 1 2023-12-05T13:25:29.830 INFO:tasks.workunit.client.1.smithi052.stdout:4/929: getdents de/d2b/d64 0 2023-12-05T13:25:29.831 INFO:tasks.workunit.client.1.smithi052.stdout:9/914: mkdir d3/d92/da8/d13b 0 2023-12-05T13:25:29.831 INFO:tasks.workunit.client.1.smithi052.stdout:9/915: readlink d3/d2a/d11e/l111 0 2023-12-05T13:25:29.832 INFO:tasks.workunit.client.1.smithi052.stdout:6/700: dwrite d3/d4/df/d24/f8a [0,4194304] 0 2023-12-05T13:25:29.832 INFO:tasks.workunit.client.1.smithi052.stdout:6/701: fdatasync d3/d4/d6/d26/fcd 0 2023-12-05T13:25:29.834 INFO:tasks.workunit.client.1.smithi052.stdout:5/706: dread d5/f79 [0,4194304] 0 2023-12-05T13:25:29.845 INFO:tasks.workunit.client.1.smithi052.stdout:4/930: rmdir de/d30/d68 39 2023-12-05T13:25:29.845 INFO:tasks.workunit.client.1.smithi052.stdout:4/931: fsync de/f14 0 2023-12-05T13:25:29.845 INFO:tasks.workunit.client.1.smithi052.stdout:5/707: truncate d5/d15/d21/fa5 412565 0 2023-12-05T13:25:29.848 INFO:tasks.workunit.client.1.smithi052.stdout:5/708: rename d5/d46/d76/d8f/fd4 to d5/df/d11/d66/fe7 0 2023-12-05T13:25:29.850 INFO:tasks.workunit.client.1.smithi052.stdout:4/932: write de/d30/dac/dbb/ffe [1244261,121877] 0 2023-12-05T13:25:29.851 INFO:tasks.workunit.client.1.smithi052.stdout:4/933: write de/f11 [1965582,45372] 0 2023-12-05T13:25:29.851 INFO:tasks.workunit.client.1.smithi052.stdout:4/934: fdatasync de/d29/d51/fc1 0 2023-12-05T13:25:29.851 INFO:tasks.workunit.client.1.smithi052.stdout:5/709: write d5/d15/d21/d4a/f5f [276101,79462] 0 2023-12-05T13:25:29.851 INFO:tasks.workunit.client.1.smithi052.stdout:5/710: truncate d5/d15/d21/f2e 1879212 0 2023-12-05T13:25:29.852 INFO:tasks.workunit.client.1.smithi052.stdout:9/916: dwrite d3/d31/f87 [0,4194304] 0 2023-12-05T13:25:29.852 INFO:tasks.workunit.client.1.smithi052.stdout:9/917: dread - d3/d92/da8/ff9 zero size 2023-12-05T13:25:29.852 INFO:tasks.workunit.client.1.smithi052.stdout:9/918: fsync d3/d1e/d41/d57/f100 0 2023-12-05T13:25:29.854 INFO:tasks.workunit.client.1.smithi052.stdout:4/935: mknod de/d2b/c134 0 2023-12-05T13:25:29.855 INFO:tasks.workunit.client.1.smithi052.stdout:4/936: read de/d30/d68/d5c/db8/fe6 [3138519,87395] 0 2023-12-05T13:25:29.856 INFO:tasks.workunit.client.1.smithi052.stdout:5/711: rename d5/d15/d21/d25/l68 to d5/d15/d21/le8 0 2023-12-05T13:25:29.858 INFO:tasks.workunit.client.1.smithi052.stdout:9/919: symlink d3/d1e/d62/l13c 0 2023-12-05T13:25:29.860 INFO:tasks.workunit.client.1.smithi052.stdout:6/702: dwrite d3/d4/df/d24/f4f [0,4194304] 0 2023-12-05T13:25:29.863 INFO:tasks.workunit.client.1.smithi052.stdout:4/937: creat de/d30/dd1/d10d/f135 x:0 0 0 2023-12-05T13:25:29.864 INFO:tasks.workunit.client.1.smithi052.stdout:5/712: creat d5/d15/d21/d4a/d6e/d91/da6/fe9 x:0 0 0 2023-12-05T13:25:29.865 INFO:tasks.workunit.client.1.smithi052.stdout:5/713: stat d5/d15/d21/f2e 0 2023-12-05T13:25:29.868 INFO:tasks.workunit.client.1.smithi052.stdout:9/920: unlink d3/d5e/d9e/dce/l10a 0 2023-12-05T13:25:29.871 INFO:tasks.workunit.client.1.smithi052.stdout:6/703: truncate d3/d5/d9/d21/d48/d4d/d81/fdb 3204221 0 2023-12-05T13:25:29.871 INFO:tasks.workunit.client.1.smithi052.stdout:6/704: chown d3/d4/d36/d6f 23017498 1 2023-12-05T13:25:29.871 INFO:tasks.workunit.client.1.smithi052.stdout:6/705: fsync d3/d4/dda/fef 0 2023-12-05T13:25:29.871 INFO:tasks.workunit.client.1.smithi052.stdout:6/706: write d3/d5/d9/d21/d48/d4d/d66/dea/fee [264080,99547] 0 2023-12-05T13:25:29.880 INFO:tasks.workunit.client.1.smithi052.stdout:2/970: sync 2023-12-05T13:25:29.882 INFO:tasks.workunit.client.1.smithi052.stdout:2/971: symlink d2/d13/d1e/l12c 0 2023-12-05T13:25:29.882 INFO:tasks.workunit.client.1.smithi052.stdout:4/938: dwrite de/d29/d51/d76/dc4/fc7 [4194304,4194304] 0 2023-12-05T13:25:29.887 INFO:tasks.workunit.client.1.smithi052.stdout:4/939: rename de/d2b/d80/cd0 to de/d30/d73/dbe/d24/ddd/d102/c136 0 2023-12-05T13:25:29.888 INFO:tasks.workunit.client.1.smithi052.stdout:9/921: dwrite d3/d11/fa2 [0,4194304] 0 2023-12-05T13:25:29.889 INFO:tasks.workunit.client.1.smithi052.stdout:4/940: creat de/d29/d51/da3/d6d/df2/f137 x:0 0 0 2023-12-05T13:25:29.889 INFO:tasks.workunit.client.1.smithi052.stdout:5/714: dwrite d5/d15/d21/fa5 [0,4194304] 0 2023-12-05T13:25:29.892 INFO:tasks.workunit.client.1.smithi052.stdout:9/922: symlink d3/d5e/da7/daf/def/d11d/l13d 0 2023-12-05T13:25:29.893 INFO:tasks.workunit.client.1.smithi052.stdout:4/941: mknod de/d30/c138 0 2023-12-05T13:25:29.895 INFO:tasks.workunit.client.1.smithi052.stdout:9/923: dread d3/d1e/d37/d4f/d113/f120 [0,4194304] 0 2023-12-05T13:25:29.895 INFO:tasks.workunit.client.1.smithi052.stdout:9/924: chown d3/d92/l9d 5952 1 2023-12-05T13:25:29.895 INFO:tasks.workunit.client.1.smithi052.stdout:9/925: fsync d3/d1e/d37/fec 0 2023-12-05T13:25:29.897 INFO:tasks.workunit.client.1.smithi052.stdout:2/972: dwrite d2/d13/d48/f5e [0,4194304] 0 2023-12-05T13:25:29.898 INFO:tasks.workunit.client.1.smithi052.stdout:4/942: unlink de/d30/d73/dbe/d24/l5b 0 2023-12-05T13:25:29.901 INFO:tasks.workunit.client.1.smithi052.stdout:9/926: symlink d3/l13e 0 2023-12-05T13:25:29.903 INFO:tasks.workunit.client.1.smithi052.stdout:2/973: truncate d2/f2f 4796042 0 2023-12-05T13:25:29.905 INFO:tasks.workunit.client.1.smithi052.stdout:4/943: creat de/d30/d73/d85/f139 x:0 0 0 2023-12-05T13:25:29.905 INFO:tasks.workunit.client.1.smithi052.stdout:4/944: stat de/d29/d51/da3/d6d/df2/c11b 0 2023-12-05T13:25:29.908 INFO:tasks.workunit.client.1.smithi052.stdout:9/927: rename d3/d1e/d41/f104 to d3/d11/d19/f13f 0 2023-12-05T13:25:29.909 INFO:tasks.workunit.client.1.smithi052.stdout:5/715: dwrite d5/d15/d21/d4a/d6e/d91/da6/f5a [0,4194304] 0 2023-12-05T13:25:29.910 INFO:tasks.workunit.client.1.smithi052.stdout:9/928: truncate d3/d1e/d41/d57/fb3 1467939 0 2023-12-05T13:25:29.912 INFO:tasks.workunit.client.1.smithi052.stdout:3/922: sync 2023-12-05T13:25:29.917 INFO:tasks.workunit.client.1.smithi052.stdout:4/945: dread de/d29/f5d [0,4194304] 0 2023-12-05T13:25:29.918 INFO:tasks.workunit.client.1.smithi052.stdout:3/923: rename da/d25/d33/d49/f7e to da/d2e/d40/d109/f129 0 2023-12-05T13:25:29.918 INFO:tasks.workunit.client.1.smithi052.stdout:3/924: fdatasync da/d25/d33/d43/f80 0 2023-12-05T13:25:29.921 INFO:tasks.workunit.client.1.smithi052.stdout:4/946: mkdir de/d29/d51/da3/d6d/d13a 0 2023-12-05T13:25:29.924 INFO:tasks.workunit.client.1.smithi052.stdout:3/925: symlink da/d25/d33/d43/l12a 0 2023-12-05T13:25:29.926 INFO:tasks.workunit.client.1.smithi052.stdout:2/974: dwrite d2/d13/d1e/dae/dc3/ff0 [0,4194304] 0 2023-12-05T13:25:29.926 INFO:tasks.workunit.client.1.smithi052.stdout:2/975: write d2/d13/d37/d5c/f10f [377799,82150] 0 2023-12-05T13:25:29.926 INFO:tasks.workunit.client.1.smithi052.stdout:3/926: mknod da/d25/d33/d43/c12b 0 2023-12-05T13:25:29.927 INFO:tasks.workunit.client.1.smithi052.stdout:9/929: dread d3/d1e/d62/fea [0,4194304] 0 2023-12-05T13:25:29.927 INFO:tasks.workunit.client.1.smithi052.stdout:4/947: dread de/d2b/fc0 [0,4194304] 0 2023-12-05T13:25:29.929 INFO:tasks.workunit.client.1.smithi052.stdout:2/976: mkdir d2/d13/d37/d12d 0 2023-12-05T13:25:29.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/977: chown d2/d13/d1e/dae/dc3/dd0/de6 4996727 1 2023-12-05T13:25:29.930 INFO:tasks.workunit.client.1.smithi052.stdout:2/978: stat d2/d13/d37/d5c/d80/dc4/f120 0 2023-12-05T13:25:29.931 INFO:tasks.workunit.client.1.smithi052.stdout:3/927: creat da/d25/d33/d49/dbd/d74/f12c x:0 0 0 2023-12-05T13:25:29.932 INFO:tasks.workunit.client.1.smithi052.stdout:9/930: mkdir d3/d92/da8/d13b/d140 0 2023-12-05T13:25:29.932 INFO:tasks.workunit.client.1.smithi052.stdout:5/716: dwrite f4 [0,4194304] 0 2023-12-05T13:25:29.933 INFO:tasks.workunit.client.1.smithi052.stdout:4/948: creat de/d29/d51/da3/f13b x:0 0 0 2023-12-05T13:25:29.934 INFO:tasks.workunit.client.1.smithi052.stdout:4/949: fdatasync de/d2b/d64/f132 0 2023-12-05T13:25:29.934 INFO:tasks.workunit.client.1.smithi052.stdout:4/950: dread - de/d91/f111 zero size 2023-12-05T13:25:29.934 INFO:tasks.workunit.client.1.smithi052.stdout:4/951: fdatasync de/d2b/f11a 0 2023-12-05T13:25:29.934 INFO:tasks.workunit.client.1.smithi052.stdout:5/717: dread d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c [0,4194304] 0 2023-12-05T13:25:29.936 INFO:tasks.workunit.client.1.smithi052.stdout:3/928: mkdir da/d2e/d40/d12d 0 2023-12-05T13:25:29.937 INFO:tasks.workunit.client.1.smithi052.stdout:9/931: dread d3/d11/d3e/f6e [0,4194304] 0 2023-12-05T13:25:29.937 INFO:tasks.workunit.client.1.smithi052.stdout:9/932: chown d3/d5e/da7/daf/dbe 11 1 2023-12-05T13:25:29.938 INFO:tasks.workunit.client.1.smithi052.stdout:2/979: dread d2/d13/d1e/f46 [0,4194304] 0 2023-12-05T13:25:29.938 INFO:tasks.workunit.client.1.smithi052.stdout:3/929: getdents da/dd 0 2023-12-05T13:25:29.939 INFO:tasks.workunit.client.1.smithi052.stdout:3/930: read da/d25/d33/d89/dae/dcf/f105 [422173,125224] 0 2023-12-05T13:25:29.940 INFO:tasks.workunit.client.1.smithi052.stdout:9/933: symlink d3/d1e/d121/l141 0 2023-12-05T13:25:29.940 INFO:tasks.workunit.client.1.smithi052.stdout:9/934: write d3/d1e/d62/dbd/ff0 [625634,3788] 0 2023-12-05T13:25:29.945 INFO:tasks.workunit.client.1.smithi052.stdout:9/935: creat d3/d92/da8/d13b/f142 x:0 0 0 2023-12-05T13:25:29.945 INFO:tasks.workunit.client.1.smithi052.stdout:4/952: dread de/d29/d51/da3/f9b [0,4194304] 0 2023-12-05T13:25:29.945 INFO:tasks.workunit.client.1.smithi052.stdout:4/953: write de/d29/d51/da3/d6d/f8e [304885,68717] 0 2023-12-05T13:25:29.946 INFO:tasks.workunit.client.1.smithi052.stdout:9/936: getdents d3/d11/d96 0 2023-12-05T13:25:29.947 INFO:tasks.workunit.client.1.smithi052.stdout:9/937: write d3/d1e/d37/d4f/f67 [1133260,61533] 0 2023-12-05T13:25:29.949 INFO:tasks.workunit.client.1.smithi052.stdout:4/954: truncate de/d2b/d64/d69/fd2 224622 0 2023-12-05T13:25:29.954 INFO:tasks.workunit.client.1.smithi052.stdout:2/980: dwrite d2/d4/d3f/d9d/fe1 [0,4194304] 0 2023-12-05T13:25:29.955 INFO:tasks.workunit.client.1.smithi052.stdout:4/955: unlink de/d2b/d64/c71 0 2023-12-05T13:25:29.956 INFO:tasks.workunit.client.1.smithi052.stdout:4/956: write de/d30/d73/dbe/f2a [1973743,106587] 0 2023-12-05T13:25:29.956 INFO:tasks.workunit.client.1.smithi052.stdout:4/957: truncate de/d30/d68/d5c/db8/f106 968784 0 2023-12-05T13:25:29.959 INFO:tasks.workunit.client.1.smithi052.stdout:2/981: unlink d2/d13/d37/d5c/d80/dc4/de2/f106 0 2023-12-05T13:25:29.961 INFO:tasks.workunit.client.1.smithi052.stdout:4/958: mknod de/d30/d68/d5c/db8/ddc/def/c13c 0 2023-12-05T13:25:29.964 INFO:tasks.workunit.client.1.smithi052.stdout:3/931: dwrite da/d25/d33/f97 [0,4194304] 0 2023-12-05T13:25:29.964 INFO:tasks.workunit.client.1.smithi052.stdout:2/982: dread d2/d13/f26 [0,4194304] 0 2023-12-05T13:25:29.964 INFO:tasks.workunit.client.1.smithi052.stdout:0/896: sync 2023-12-05T13:25:29.966 INFO:tasks.workunit.client.1.smithi052.stdout:3/932: truncate da/d25/f6f 3192978 0 2023-12-05T13:25:29.971 INFO:tasks.workunit.client.1.smithi052.stdout:0/897: mknod d0/db/d1b/d51/d55/d66/c128 0 2023-12-05T13:25:29.971 INFO:tasks.workunit.client.1.smithi052.stdout:4/959: dread de/d29/f56 [0,4194304] 0 2023-12-05T13:25:29.971 INFO:tasks.workunit.client.1.smithi052.stdout:9/938: dwrite d3/d1e/d41/d57/de9/f116 [0,4194304] 0 2023-12-05T13:25:29.972 INFO:tasks.workunit.client.1.smithi052.stdout:9/939: fdatasync d3/d1e/d37/d4f/f7d 0 2023-12-05T13:25:29.972 INFO:tasks.workunit.client.1.smithi052.stdout:9/940: chown d3/d92/ffd 2385453 1 2023-12-05T13:25:29.972 INFO:tasks.workunit.client.1.smithi052.stdout:0/898: creat d0/db/d2e/d53/df9/f129 x:0 0 0 2023-12-05T13:25:29.973 INFO:tasks.workunit.client.1.smithi052.stdout:2/983: dread d2/d4/d3f/d9d/fa2 [0,4194304] 0 2023-12-05T13:25:29.973 INFO:tasks.workunit.client.1.smithi052.stdout:2/984: stat d2/d13/d1e/fd7 0 2023-12-05T13:25:29.975 INFO:tasks.workunit.client.1.smithi052.stdout:4/960: rmdir de/d29/d51/da3/d6d/d13a 0 2023-12-05T13:25:29.975 INFO:tasks.workunit.client.1.smithi052.stdout:4/961: chown de/d30/dac/dbb/l12f 1333097 1 2023-12-05T13:25:29.975 INFO:tasks.workunit.client.1.smithi052.stdout:4/962: dread - de/d91/f115 zero size 2023-12-05T13:25:29.976 INFO:tasks.workunit.client.1.smithi052.stdout:4/963: dread - de/d2b/d64/f132 zero size 2023-12-05T13:25:29.977 INFO:tasks.workunit.client.1.smithi052.stdout:3/933: dread da/d25/d33/d89/dae/dcf/dfb/d11b/fc4 [0,4194304] 0 2023-12-05T13:25:29.977 INFO:tasks.workunit.client.1.smithi052.stdout:3/934: chown da/f23 37 1 2023-12-05T13:25:29.977 INFO:tasks.workunit.client.1.smithi052.stdout:3/935: fdatasync da/d25/d33/d43/d5b/f67 0 2023-12-05T13:25:29.978 INFO:tasks.workunit.client.1.smithi052.stdout:2/985: mknod d2/d13/d1e/d6a/d7f/d84/df5/c12e 0 2023-12-05T13:25:29.978 INFO:tasks.workunit.client.1.smithi052.stdout:2/986: dread - d2/d13/d37/d61/fb8 zero size 2023-12-05T13:25:29.980 INFO:tasks.workunit.client.1.smithi052.stdout:4/964: creat de/d30/dd1/d10d/f13d x:0 0 0 2023-12-05T13:25:29.983 INFO:tasks.workunit.client.1.smithi052.stdout:9/941: unlink d3/d11/d19/l35 0 2023-12-05T13:25:29.985 INFO:tasks.workunit.client.1.smithi052.stdout:3/936: creat da/d25/d33/d89/dae/dcf/dfb/f12e x:0 0 0 2023-12-05T13:25:29.985 INFO:tasks.workunit.client.1.smithi052.stdout:3/937: write da/d25/ff8 [996889,122525] 0 2023-12-05T13:25:29.986 INFO:tasks.workunit.client.1.smithi052.stdout:0/899: dwrite d0/db/d14/f40 [4194304,4194304] 0 2023-12-05T13:25:29.988 INFO:tasks.workunit.client.1.smithi052.stdout:2/987: rename d2/d13/d37/d5c/d80/dc4/de2/d11f to d2/d4/d3f/d12f 0 2023-12-05T13:25:29.988 INFO:tasks.workunit.client.1.smithi052.stdout:2/988: readlink d2/d13/d37/d5c/d80/laa 0 2023-12-05T13:25:29.990 INFO:tasks.workunit.client.1.smithi052.stdout:4/965: link de/d30/dd1/f119 de/d30/d68/d5c/db8/ddc/def/f13e 0 2023-12-05T13:25:29.991 INFO:tasks.workunit.client.1.smithi052.stdout:9/942: mkdir d3/d5e/d9e/dd4/d143 0 2023-12-05T13:25:29.992 INFO:tasks.workunit.client.1.smithi052.stdout:9/943: dread d3/d92/da8/d119/fb7 [0,4194304] 0 2023-12-05T13:25:29.992 INFO:tasks.workunit.client.1.smithi052.stdout:3/938: symlink da/d2e/d40/l12f 0 2023-12-05T13:25:30.002 INFO:tasks.workunit.client.1.smithi052.stdout:0/900: creat d0/db/d1b/d29/dba/f12a x:0 0 0 2023-12-05T13:25:30.004 INFO:tasks.workunit.client.1.smithi052.stdout:2/989: mkdir d2/d13/d37/d5c/d80/dc4/d130 0 2023-12-05T13:25:30.006 INFO:tasks.workunit.client.1.smithi052.stdout:4/966: link de/d30/d68/d5c/dcb/lf5 de/d30/d68/d5c/dcb/l13f 0 2023-12-05T13:25:30.006 INFO:tasks.workunit.client.1.smithi052.stdout:4/967: stat de/d29/d51/da3/c84 0 2023-12-05T13:25:30.006 INFO:tasks.workunit.client.1.smithi052.stdout:4/968: readlink de/d2b/d64/lb4 0 2023-12-05T13:25:30.007 INFO:tasks.workunit.client.1.smithi052.stdout:9/944: creat d3/d11/d19/f144 x:0 0 0 2023-12-05T13:25:30.008 INFO:tasks.workunit.client.1.smithi052.stdout:3/939: getdents da/d2e/d40/d6d 0 2023-12-05T13:25:30.010 INFO:tasks.workunit.client.1.smithi052.stdout:2/990: creat d2/d13/d1e/f131 x:0 0 0 2023-12-05T13:25:30.011 INFO:tasks.workunit.client.1.smithi052.stdout:4/969: rmdir de/d2b/d80 39 2023-12-05T13:25:30.016 INFO:tasks.workunit.client.1.smithi052.stdout:3/940: symlink da/d2e/d107/l130 0 2023-12-05T13:25:30.016 INFO:tasks.workunit.client.1.smithi052.stdout:9/945: rename d3/d1e/d37/d4f/d113 to d3/d5e/d9e/dd4/d145 0 2023-12-05T13:25:30.016 INFO:tasks.workunit.client.1.smithi052.stdout:9/946: chown d3/c12f 62259 1 2023-12-05T13:25:30.017 INFO:tasks.workunit.client.1.smithi052.stdout:5/718: sync 2023-12-05T13:25:30.017 INFO:tasks.workunit.client.1.smithi052.stdout:6/707: sync 2023-12-05T13:25:30.017 INFO:tasks.workunit.client.1.smithi052.stdout:5/719: chown d5/df/ld9 95 1 2023-12-05T13:25:30.017 INFO:tasks.workunit.client.1.smithi052.stdout:5/720: chown d5/d15/d21/d4a/ld1 584 1 2023-12-05T13:25:30.018 INFO:tasks.workunit.client.1.smithi052.stdout:5/721: fsync d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 0 2023-12-05T13:25:30.018 INFO:tasks.workunit.client.1.smithi052.stdout:5/722: fsync d5/df/d11/d66/f94 0 2023-12-05T13:25:30.018 INFO:tasks.workunit.client.1.smithi052.stdout:5/723: chown d5/df/d11/d73/d77/fa1 80782 1 2023-12-05T13:25:30.020 INFO:tasks.workunit.client.1.smithi052.stdout:0/901: dwrite d0/db/f96 [0,4194304] 0 2023-12-05T13:25:30.020 INFO:tasks.workunit.client.1.smithi052.stdout:0/902: read - d0/db/d20/d9c/f10b zero size 2023-12-05T13:25:30.020 INFO:tasks.workunit.client.1.smithi052.stdout:3/941: mkdir da/d25/d33/d89/dae/dcf/d131 0 2023-12-05T13:25:30.020 INFO:tasks.workunit.client.1.smithi052.stdout:3/942: write da/d25/f6f [3371711,1788] 0 2023-12-05T13:25:30.020 INFO:tasks.workunit.client.1.smithi052.stdout:3/943: read - da/d25/d33/d49/f119 zero size 2023-12-05T13:25:30.021 INFO:tasks.workunit.client.1.smithi052.stdout:0/903: mknod d0/db/d2e/d115/c12b 0 2023-12-05T13:25:30.022 INFO:tasks.workunit.client.1.smithi052.stdout:0/904: write d0/db/d2e/d7e/da6/dea/f11d [116044,10752] 0 2023-12-05T13:25:30.025 INFO:tasks.workunit.client.1.smithi052.stdout:4/970: dread de/d29/d51/da3/fe5 [0,4194304] 0 2023-12-05T13:25:30.026 INFO:tasks.workunit.client.1.smithi052.stdout:3/944: mknod da/d25/d33/d43/d5b/c132 0 2023-12-05T13:25:30.028 INFO:tasks.workunit.client.1.smithi052.stdout:0/905: symlink d0/db/d2e/d7e/da6/l12c 0 2023-12-05T13:25:30.030 INFO:tasks.workunit.client.1.smithi052.stdout:2/991: dwrite d2/d4/d3f/d9d/fa2 [0,4194304] 0 2023-12-05T13:25:30.030 INFO:tasks.workunit.client.1.smithi052.stdout:3/945: creat da/d25/d33/f133 x:0 0 0 2023-12-05T13:25:30.030 INFO:tasks.workunit.client.1.smithi052.stdout:3/946: readlink da/dd/d3d/le2 0 2023-12-05T13:25:30.032 INFO:tasks.workunit.client.1.smithi052.stdout:0/906: write d0/db/f96 [2471199,61133] 0 2023-12-05T13:25:30.032 INFO:tasks.workunit.client.1.smithi052.stdout:2/992: mkdir d2/d13/d1e/d6a/d7f/d84/d132 0 2023-12-05T13:25:30.032 INFO:tasks.workunit.client.1.smithi052.stdout:2/993: chown d2/d13/d37/d5c/f8c 1376626683 1 2023-12-05T13:25:30.032 INFO:tasks.workunit.client.1.smithi052.stdout:2/994: chown d2/d13/d37/l77 11115 1 2023-12-05T13:25:30.033 INFO:tasks.workunit.client.1.smithi052.stdout:9/947: dread d3/d11/d19/f53 [0,4194304] 0 2023-12-05T13:25:30.033 INFO:tasks.workunit.client.1.smithi052.stdout:9/948: chown d3/d11/d3e/l10c 2886 1 2023-12-05T13:25:30.033 INFO:tasks.workunit.client.1.smithi052.stdout:3/947: mknod da/d48/c134 0 2023-12-05T13:25:30.033 INFO:tasks.workunit.client.1.smithi052.stdout:3/948: stat da/d2e/d107/f11c 0 2023-12-05T13:25:30.033 INFO:tasks.workunit.client.1.smithi052.stdout:3/949: write da/d2e/ffc [107605,92565] 0 2023-12-05T13:25:30.033 INFO:tasks.workunit.client.1.smithi052.stdout:3/950: write da/d25/d33/d51/f128 [998770,47612] 0 2023-12-05T13:25:30.034 INFO:tasks.workunit.client.1.smithi052.stdout:0/907: mkdir d0/db/d20/d9c/d12d 0 2023-12-05T13:25:30.035 INFO:tasks.workunit.client.1.smithi052.stdout:0/908: write d0/db/d1b/d51/d55/d66/dcf/ffd [617194,122817] 0 2023-12-05T13:25:30.035 INFO:tasks.workunit.client.1.smithi052.stdout:0/909: chown d0/dcb/f67 2891 1 2023-12-05T13:25:30.035 INFO:tasks.workunit.client.1.smithi052.stdout:2/995: mkdir d2/d13/d45/d133 0 2023-12-05T13:25:30.035 INFO:tasks.workunit.client.1.smithi052.stdout:6/708: dwrite d3/d4/d6/d26/fcd [0,4194304] 0 2023-12-05T13:25:30.036 INFO:tasks.workunit.client.1.smithi052.stdout:9/949: symlink d3/d5e/da7/daf/d131/l146 0 2023-12-05T13:25:30.037 INFO:tasks.workunit.client.1.smithi052.stdout:3/951: mkdir da/d25/d33/d49/dbd/d135 0 2023-12-05T13:25:30.040 INFO:tasks.workunit.client.1.smithi052.stdout:2/996: creat d2/d4/d3f/d12f/f134 x:0 0 0 2023-12-05T13:25:30.041 INFO:tasks.workunit.client.1.smithi052.stdout:5/724: dwrite d5/d15/d21/f5e [4194304,4194304] 0 2023-12-05T13:25:30.041 INFO:tasks.workunit.client.1.smithi052.stdout:2/997: write d2/d4/d3f/d9d/fe1 [1907102,51914] 0 2023-12-05T13:25:30.041 INFO:tasks.workunit.client.1.smithi052.stdout:6/709: rename d3/d5/d58/ddf/fd2 to d3/d4/df/d24/ff3 0 2023-12-05T13:25:30.044 INFO:tasks.workunit.client.1.smithi052.stdout:9/950: mkdir d3/d5e/d147 0 2023-12-05T13:25:30.045 INFO:tasks.workunit.client.1.smithi052.stdout:9/951: chown d3/d11/fcc 56 1 2023-12-05T13:25:30.045 INFO:tasks.workunit.client.1.smithi052.stdout:9/952: write d3/d2a/d5c/f11b [747453,38425] 0 2023-12-05T13:25:30.045 INFO:tasks.workunit.client.1.smithi052.stdout:9/953: stat d3/d5e/fdd 0 2023-12-05T13:25:30.045 INFO:tasks.workunit.client.1.smithi052.stdout:3/952: creat da/d25/d33/d43/d5b/d96/f136 x:0 0 0 2023-12-05T13:25:30.047 INFO:tasks.workunit.client.1.smithi052.stdout:5/725: mkdir d5/df/d4e/da8/dd7/dea 0 2023-12-05T13:25:30.050 INFO:tasks.workunit.client.1.smithi052.stdout:2/998: rmdir d2/d4/d63 39 2023-12-05T13:25:30.051 INFO:tasks.workunit.client.1.smithi052.stdout:3/953: dread da/d2e/f7f [4194304,4194304] 0 2023-12-05T13:25:30.051 INFO:tasks.workunit.client.1.smithi052.stdout:3/954: write da/fde [1357817,50466] 0 2023-12-05T13:25:30.055 INFO:tasks.workunit.client.1.smithi052.stdout:3/955: rmdir da/dd/d3d/d103/d115/d120 0 2023-12-05T13:25:30.056 INFO:tasks.workunit.client.1.smithi052.stdout:4/971: dwrite de/d2b/d64/d69/fd2 [0,4194304] 0 2023-12-05T13:25:30.056 INFO:tasks.workunit.client.1.smithi052.stdout:4/972: stat de/d30/d73/c78 0 2023-12-05T13:25:30.056 INFO:tasks.workunit.client.1.smithi052.stdout:4/973: dread - de/d30/d73/d85/f139 zero size 2023-12-05T13:25:30.057 INFO:tasks.workunit.client.1.smithi052.stdout:3/956: unlink da/d2e/d40/d6d/cbb 0 2023-12-05T13:25:30.060 INFO:tasks.workunit.client.1.smithi052.stdout:2/999: write d2/d13/d1e/f27 [4512986,36153] 0 2023-12-05T13:25:30.062 INFO:tasks.workunit.client.1.smithi052.stdout:0/910: dwrite d0/db/d52/d7f/fd2 [0,4194304] 0 2023-12-05T13:25:30.065 INFO:tasks.workunit.client.1.smithi052.stdout:6/710: dwrite d3/d5/d9/d21/d48/d4d/f78 [0,4194304] 0 2023-12-05T13:25:30.066 INFO:tasks.workunit.client.1.smithi052.stdout:9/954: dwrite d3/d1e/d37/d4f/f65 [0,4194304] 0 2023-12-05T13:25:30.071 INFO:tasks.workunit.client.1.smithi052.stdout:9/955: symlink d3/d5e/da7/d106/d12a/l148 0 2023-12-05T13:25:30.082 INFO:tasks.workunit.client.1.smithi052.stdout:5/726: dwrite d5/d15/d21/d4a/d6e/d91/da6/d88/da7/fcd [0,4194304] 0 2023-12-05T13:25:30.082 INFO:tasks.workunit.client.1.smithi052.stdout:5/727: chown d5/d15/f31 954092 1 2023-12-05T13:25:30.082 INFO:tasks.workunit.client.1.smithi052.stdout:5/728: fsync d5/df/d11/f2b 0 2023-12-05T13:25:30.084 INFO:tasks.workunit.client.1.smithi052.stdout:0/911: dread d0/db/d2e/f46 [0,4194304] 0 2023-12-05T13:25:30.085 INFO:tasks.workunit.client.1.smithi052.stdout:5/729: creat d5/d15/feb x:0 0 0 2023-12-05T13:25:30.085 INFO:tasks.workunit.client.1.smithi052.stdout:5/730: fdatasync d5/d7f/fc5 0 2023-12-05T13:25:30.086 INFO:tasks.workunit.client.1.smithi052.stdout:5/731: write d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 [172272,96022] 0 2023-12-05T13:25:30.088 INFO:tasks.workunit.client.1.smithi052.stdout:0/912: symlink d0/db/d20/l12e 0 2023-12-05T13:25:30.088 INFO:tasks.workunit.client.1.smithi052.stdout:9/956: dread d3/d31/f87 [0,4194304] 0 2023-12-05T13:25:30.089 INFO:tasks.workunit.client.1.smithi052.stdout:5/732: getdents d5/df/d11/d73 0 2023-12-05T13:25:30.090 INFO:tasks.workunit.client.1.smithi052.stdout:9/957: write d3/d1e/d41/d86/f91 [1175666,101727] 0 2023-12-05T13:25:30.091 INFO:tasks.workunit.client.1.smithi052.stdout:0/913: truncate d0/db/d20/d50/f92 214539 0 2023-12-05T13:25:30.095 INFO:tasks.workunit.client.1.smithi052.stdout:6/711: dwrite d3/d5/d9/d21/d48/d4d/d66/dea/fee [0,4194304] 0 2023-12-05T13:25:30.095 INFO:tasks.workunit.client.1.smithi052.stdout:9/958: dread d3/d31/f87 [0,4194304] 0 2023-12-05T13:25:30.096 INFO:tasks.workunit.client.1.smithi052.stdout:4/974: dwrite de/d2b/d64/fd3 [0,4194304] 0 2023-12-05T13:25:30.096 INFO:tasks.workunit.client.1.smithi052.stdout:9/959: dread - d3/d11/d96/fac zero size 2023-12-05T13:25:30.096 INFO:tasks.workunit.client.1.smithi052.stdout:4/975: truncate de/d30/d73/fec 846625 0 2023-12-05T13:25:30.096 INFO:tasks.workunit.client.1.smithi052.stdout:9/960: readlink d3/d11/l28 0 2023-12-05T13:25:30.096 INFO:tasks.workunit.client.1.smithi052.stdout:9/961: read - d3/d1e/d41/d57/f82 zero size 2023-12-05T13:25:30.102 INFO:tasks.workunit.client.1.smithi052.stdout:6/712: rename d3/d4/d36 to d3/d5/d58/df4 0 2023-12-05T13:25:30.106 INFO:tasks.workunit.client.1.smithi052.stdout:4/976: dread de/f11 [0,4194304] 0 2023-12-05T13:25:30.106 INFO:tasks.workunit.client.1.smithi052.stdout:4/977: readlink de/d29/l40 0 2023-12-05T13:25:30.106 INFO:tasks.workunit.client.1.smithi052.stdout:4/978: write de/d29/d51/da3/f13b [168661,105454] 0 2023-12-05T13:25:30.106 INFO:tasks.workunit.client.1.smithi052.stdout:5/733: dread d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 [0,4194304] 0 2023-12-05T13:25:30.106 INFO:tasks.workunit.client.1.smithi052.stdout:6/713: unlink d3/d5/d9/d21/d48/d4d/d81/d82/cbc 0 2023-12-05T13:25:30.108 INFO:tasks.workunit.client.1.smithi052.stdout:4/979: unlink de/d29/f56 0 2023-12-05T13:25:30.110 INFO:tasks.workunit.client.1.smithi052.stdout:5/734: symlink d5/df/d4e/da8/lec 0 2023-12-05T13:25:30.110 INFO:tasks.workunit.client.1.smithi052.stdout:5/735: chown d5/df/d4e/d5b 13115 1 2023-12-05T13:25:30.110 INFO:tasks.workunit.client.1.smithi052.stdout:5/736: dread - d5/d15/d21/d4a/d6e/d91/fb5 zero size 2023-12-05T13:25:30.110 INFO:tasks.workunit.client.1.smithi052.stdout:9/962: dwrite d3/d11/d3e/f51 [0,4194304] 0 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:5/737: write d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c [354278,29262] 0 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:5/738: readlink d5/d15/d21/d4a/d6e/d91/da6/l6b 0 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:5/739: chown d5/df/d4e/d5b/dbf 28994461 1 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:9/963: write d3/d2a/f117 [2829953,77331] 0 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:9/964: chown d3/d11/d118 4881 1 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:9/965: write d3/d5e/da7/fda [5162812,127945] 0 2023-12-05T13:25:30.111 INFO:tasks.workunit.client.1.smithi052.stdout:6/714: mkdir d3/d5/d9/d21/d48/d4d/d81/df5 0 2023-12-05T13:25:30.113 INFO:tasks.workunit.client.1.smithi052.stdout:4/980: rmdir de/d30/dd1 39 2023-12-05T13:25:30.117 INFO:tasks.workunit.client.1.smithi052.stdout:9/966: mkdir d3/d92/da8/d13b/d149 0 2023-12-05T13:25:30.119 INFO:tasks.workunit.client.1.smithi052.stdout:9/967: write d3/d5e/da7/daf/dbe/ffa [1949125,81722] 0 2023-12-05T13:25:30.119 INFO:tasks.workunit.client.1.smithi052.stdout:9/968: chown d3/d5e/da7/daf/def/d11d 65 1 2023-12-05T13:25:30.119 INFO:tasks.workunit.client.1.smithi052.stdout:9/969: chown d3/d11/d3e/l10c 793936 1 2023-12-05T13:25:30.119 INFO:tasks.workunit.client.1.smithi052.stdout:9/970: write d3/d92/da8/ff9 [72370,62503] 0 2023-12-05T13:25:30.124 INFO:tasks.workunit.client.1.smithi052.stdout:6/715: rename d3/d5/d9/d21/d48/d4d/d66/d91/lc0 to d3/d5/d9/d21/d5f/lf6 0 2023-12-05T13:25:30.127 INFO:tasks.workunit.client.1.smithi052.stdout:4/981: rename de/d29/l77 to de/l140 0 2023-12-05T13:25:30.129 INFO:tasks.workunit.client.1.smithi052.stdout:5/740: dwrite d5/df/f61 [0,4194304] 0 2023-12-05T13:25:30.129 INFO:tasks.workunit.client.1.smithi052.stdout:5/741: dread - d5/df/d11/d73/d77/fc3 zero size 2023-12-05T13:25:30.129 INFO:tasks.workunit.client.1.smithi052.stdout:5/742: dread - d5/df/d4e/fde zero size 2023-12-05T13:25:30.129 INFO:tasks.workunit.client.1.smithi052.stdout:6/716: unlink d3/d5/d9/l7a 0 2023-12-05T13:25:30.131 INFO:tasks.workunit.client.1.smithi052.stdout:9/971: rename d3/d2a/d5c/c10e to d3/d5e/d9e/dd4/d143/c14a 0 2023-12-05T13:25:30.132 INFO:tasks.workunit.client.1.smithi052.stdout:9/972: read - d3/d1e/d41/d57/f82 zero size 2023-12-05T13:25:30.137 INFO:tasks.workunit.client.1.smithi052.stdout:9/973: dread d3/d5e/da7/daf/dbe/ffa [0,4194304] 0 2023-12-05T13:25:30.141 INFO:tasks.workunit.client.1.smithi052.stdout:5/743: mknod d5/d15/d21/d4a/d6e/d91/ced 0 2023-12-05T13:25:30.144 INFO:tasks.workunit.client.1.smithi052.stdout:6/717: rmdir d3/d4/dda 39 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/982: rename de/d2b/ff0 to de/d30/d68/f141 0 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/983: chown de/d29/d51/da3 39 1 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/984: fsync de/d30/d73/dbe/d24/f8c 0 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/985: chown de/d2b/f58 1 1 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/986: write de/d2b/f5a [8967955,127471] 0 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/987: dread - de/d2b/f11a zero size 2023-12-05T13:25:30.147 INFO:tasks.workunit.client.1.smithi052.stdout:4/988: write de/d30/dd1/d10d/f135 [233207,62214] 0 2023-12-05T13:25:30.149 INFO:tasks.workunit.client.1.smithi052.stdout:9/974: rename d3/d1e/d37/l44 to d3/d5e/da7/daf/d131/l14b 0 2023-12-05T13:25:30.149 INFO:tasks.workunit.client.1.smithi052.stdout:9/975: read d3/d11/d3e/f9b [3264702,98148] 0 2023-12-05T13:25:30.153 INFO:tasks.workunit.client.1.smithi052.stdout:6/718: rename d3/d5/d9/d21/d48/d5b to d3/d4/dda/df7 0 2023-12-05T13:25:30.155 INFO:tasks.workunit.client.1.smithi052.stdout:9/976: creat d3/d11/d3e/f14c x:0 0 0 2023-12-05T13:25:30.155 INFO:tasks.workunit.client.1.smithi052.stdout:9/977: chown d3/d1e/d41/d57/l99 3365597 1 2023-12-05T13:25:30.156 INFO:tasks.workunit.client.1.smithi052.stdout:3/957: sync 2023-12-05T13:25:30.157 INFO:tasks.workunit.client.1.smithi052.stdout:3/958: dread - da/d25/d33/d49/f119 zero size 2023-12-05T13:25:30.157 INFO:tasks.workunit.client.1.smithi052.stdout:3/959: stat da/d25/d33/d43/d5b/d96/f136 0 2023-12-05T13:25:30.157 INFO:tasks.workunit.client.1.smithi052.stdout:3/960: write da/d25/d33/d89/dae/dcf/f105 [1560264,54741] 0 2023-12-05T13:25:30.161 INFO:tasks.workunit.client.1.smithi052.stdout:4/989: rename de/d30/d68/d5c/db8/f106 to de/d30/d73/dbe/d24/ddd/de4/f142 0 2023-12-05T13:25:30.163 INFO:tasks.workunit.client.1.smithi052.stdout:6/719: creat d3/d4/d6/d26/ff8 x:0 0 0 2023-12-05T13:25:30.166 INFO:tasks.workunit.client.1.smithi052.stdout:9/978: mkdir d3/d5e/d9e/dd4/d145/d14d 0 2023-12-05T13:25:30.177 INFO:tasks.workunit.client.1.smithi052.stdout:9/979: rmdir d3/d2a/d11e 39 2023-12-05T13:25:30.177 INFO:tasks.workunit.client.1.smithi052.stdout:6/720: creat d3/d4/d6/de7/ff9 x:0 0 0 2023-12-05T13:25:30.177 INFO:tasks.workunit.client.1.smithi052.stdout:3/961: dwrite da/f6e [0,4194304] 0 2023-12-05T13:25:30.177 INFO:tasks.workunit.client.1.smithi052.stdout:3/962: chown da/d25/d33/d49/dbd 64253 1 2023-12-05T13:25:30.177 INFO:tasks.workunit.client.1.smithi052.stdout:4/990: dwrite de/d2b/d80/f101 [0,4194304] 0 2023-12-05T13:25:30.179 INFO:tasks.workunit.client.1.smithi052.stdout:9/980: unlink d3/f24 0 2023-12-05T13:25:30.181 INFO:tasks.workunit.client.1.smithi052.stdout:6/721: rename d3/d4/df/d63/f70 to d3/d4/d6/d26/d6d/ffa 0 2023-12-05T13:25:30.182 INFO:tasks.workunit.client.1.smithi052.stdout:3/963: symlink da/d25/d33/d49/l137 0 2023-12-05T13:25:30.182 INFO:tasks.workunit.client.1.smithi052.stdout:3/964: write da/d25/d33/d49/fc2 [1792588,69222] 0 2023-12-05T13:25:30.183 INFO:tasks.workunit.client.1.smithi052.stdout:4/991: symlink de/d29/d51/d76/dc4/l143 0 2023-12-05T13:25:30.184 INFO:tasks.workunit.client.1.smithi052.stdout:4/992: read - de/d29/d51/da3/d6d/fcc zero size 2023-12-05T13:25:30.184 INFO:tasks.workunit.client.1.smithi052.stdout:4/993: fdatasync de/d29/d51/f6b 0 2023-12-05T13:25:30.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/722: mkdir d3/d5/d9/d21/d48/dcf/dfb 0 2023-12-05T13:25:30.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/723: stat d3/ce0 0 2023-12-05T13:25:30.186 INFO:tasks.workunit.client.1.smithi052.stdout:3/965: creat da/d48/f138 x:0 0 0 2023-12-05T13:25:30.192 INFO:tasks.workunit.client.1.smithi052.stdout:6/724: creat d3/d5/d9/d21/d48/d4d/ffc x:0 0 0 2023-12-05T13:25:30.194 INFO:tasks.workunit.client.1.smithi052.stdout:6/725: rename d3/d4/dda/df7/fe1 to d3/d5/d58/ddf/ffd 0 2023-12-05T13:25:30.194 INFO:tasks.workunit.client.1.smithi052.stdout:6/726: fdatasync d3/d5/d9/d21/d48/d4d/ffc 0 2023-12-05T13:25:30.202 INFO:tasks.workunit.client.1.smithi052.stdout:9/981: dwrite d3/d1e/d41/d57/de9/f137 [0,4194304] 0 2023-12-05T13:25:30.210 INFO:tasks.workunit.client.1.smithi052.stdout:9/982: dread d3/d92/fa6 [0,4194304] 0 2023-12-05T13:25:30.211 INFO:tasks.workunit.client.1.smithi052.stdout:9/983: creat d3/d1e/d62/dbd/f14e x:0 0 0 2023-12-05T13:25:30.211 INFO:tasks.workunit.client.1.smithi052.stdout:6/727: dwrite d3/d4/d6/f11 [0,4194304] 0 2023-12-05T13:25:30.212 INFO:tasks.workunit.client.1.smithi052.stdout:4/994: dwrite de/d29/d51/fc1 [0,4194304] 0 2023-12-05T13:25:30.212 INFO:tasks.workunit.client.1.smithi052.stdout:9/984: creat d3/d5e/d9e/dd4/d143/f14f x:0 0 0 2023-12-05T13:25:30.212 INFO:tasks.workunit.client.1.smithi052.stdout:9/985: write d3/d1e/d41/d57/f100 [1139743,124046] 0 2023-12-05T13:25:30.221 INFO:tasks.workunit.client.1.smithi052.stdout:4/995: getdents de/d30/d94/ded 0 2023-12-05T13:25:30.224 INFO:tasks.workunit.client.1.smithi052.stdout:4/996: mknod de/d2b/d64/d69/c144 0 2023-12-05T13:25:30.227 INFO:tasks.workunit.client.1.smithi052.stdout:9/986: dwrite d3/d1e/d37/f4d [0,4194304] 0 2023-12-05T13:25:30.227 INFO:tasks.workunit.client.1.smithi052.stdout:9/987: read - d3/d5e/d9e/dd4/ff1 zero size 2023-12-05T13:25:30.230 INFO:tasks.workunit.client.1.smithi052.stdout:6/728: getdents d3/d4/dda/df7 0 2023-12-05T13:25:30.230 INFO:tasks.workunit.client.1.smithi052.stdout:4/997: rename de/d30/d68/d5c/db8/ddc/def/c13c to de/d30/dac/dbb/c145 0 2023-12-05T13:25:30.232 INFO:tasks.workunit.client.1.smithi052.stdout:6/729: getdents d3/d4/d6/d26/d6d 0 2023-12-05T13:25:30.234 INFO:tasks.workunit.client.1.smithi052.stdout:6/730: getdents d3/d5/d9/d52 0 2023-12-05T13:25:30.234 INFO:tasks.workunit.client.1.smithi052.stdout:6/731: truncate d3/d5/fd5 241037 0 2023-12-05T13:25:30.238 INFO:tasks.workunit.client.1.smithi052.stdout:0/914: sync 2023-12-05T13:25:30.241 INFO:tasks.workunit.client.1.smithi052.stdout:0/915: creat d0/db/d1b/d7a/d8b/f12f x:0 0 0 2023-12-05T13:25:30.242 INFO:tasks.workunit.client.1.smithi052.stdout:6/732: dread d3/d5/d9/d21/d48/d4d/d81/fdb [0,4194304] 0 2023-12-05T13:25:30.242 INFO:tasks.workunit.client.1.smithi052.stdout:6/733: chown d3/d5/d58/le8 0 1 2023-12-05T13:25:30.243 INFO:tasks.workunit.client.1.smithi052.stdout:0/916: rename d0/db/d52/d7f/lbb to d0/db/d1b/d51/d55/d66/dcd/l130 0 2023-12-05T13:25:30.245 INFO:tasks.workunit.client.1.smithi052.stdout:0/917: read d0/db/d20/d50/dae/f121 [610,91528] 0 2023-12-05T13:25:30.247 INFO:tasks.workunit.client.1.smithi052.stdout:9/988: dwrite d3/d1e/d37/d4f/f77 [0,4194304] 0 2023-12-05T13:25:30.247 INFO:tasks.workunit.client.1.smithi052.stdout:6/734: link d3/d4/d6/f11 d3/d4/ffe 0 2023-12-05T13:25:30.247 INFO:tasks.workunit.client.1.smithi052.stdout:6/735: write d3/d5/d58/df4/f8b [4288241,3102] 0 2023-12-05T13:25:30.248 INFO:tasks.workunit.client.1.smithi052.stdout:6/736: chown d3/d4/d6/d26/d8e/fe4 520579 1 2023-12-05T13:25:30.248 INFO:tasks.workunit.client.1.smithi052.stdout:6/737: fdatasync d3/d4/df/d27/f56 0 2023-12-05T13:25:30.248 INFO:tasks.workunit.client.1.smithi052.stdout:6/738: write d3/d4/df/d24/f8a [251964,71756] 0 2023-12-05T13:25:30.249 INFO:tasks.workunit.client.1.smithi052.stdout:6/739: dread - d3/d4/df/d27/fca zero size 2023-12-05T13:25:30.251 INFO:tasks.workunit.client.1.smithi052.stdout:9/989: symlink d3/d92/da8/d119/l150 0 2023-12-05T13:25:30.251 INFO:tasks.workunit.client.1.smithi052.stdout:9/990: chown d3/d11/d3e 338063 1 2023-12-05T13:25:30.255 INFO:tasks.workunit.client.1.smithi052.stdout:4/998: dwrite de/d30/dac/dbb/f100 [0,4194304] 0 2023-12-05T13:25:30.255 INFO:tasks.workunit.client.1.smithi052.stdout:4/999: write de/d30/d73/dbe/d24/f4e [8864788,7947] 0 2023-12-05T13:25:30.255 INFO:tasks.workunit.client.1.smithi052.stdout:9/991: creat d3/d1e/f151 x:0 0 0 2023-12-05T13:25:30.256 INFO:tasks.workunit.client.1.smithi052.stdout:6/740: rename d3/d5/d58/df4/c3f to d3/d5/d58/ddf/cff 0 2023-12-05T13:25:30.256 INFO:tasks.workunit.client.1.smithi052.stdout:0/918: dread d0/db/d14/d9b/fc8 [0,4194304] 0 2023-12-05T13:25:30.256 INFO:tasks.workunit.client.1.smithi052.stdout:0/919: dread - d0/db/d65/f101 zero size 2023-12-05T13:25:30.256 INFO:tasks.workunit.client.1.smithi052.stdout:0/920: write d0/db/d52/d7f/f9f [3199387,9687] 0 2023-12-05T13:25:30.262 INFO:tasks.workunit.client.1.smithi052.stdout:9/992: symlink d3/d1e/d41/d57/l152 0 2023-12-05T13:25:30.263 INFO:tasks.workunit.client.1.smithi052.stdout:5/744: sync 2023-12-05T13:25:30.263 INFO:tasks.workunit.client.1.smithi052.stdout:0/921: mknod d0/db/d1b/d51/d55/d66/c131 0 2023-12-05T13:25:30.263 INFO:tasks.workunit.client.1.smithi052.stdout:5/745: write d5/d15/feb [546181,113142] 0 2023-12-05T13:25:30.263 INFO:tasks.workunit.client.1.smithi052.stdout:6/741: dread d3/d5/d9/d21/d48/d4d/f78 [0,4194304] 0 2023-12-05T13:25:30.264 INFO:tasks.workunit.client.1.smithi052.stdout:9/993: truncate d3/d1e/d37/d4f/f77 2134377 0 2023-12-05T13:25:30.264 INFO:tasks.workunit.client.1.smithi052.stdout:9/994: write d3/d1e/d37/d4f/f7d [2199485,64759] 0 2023-12-05T13:25:30.269 INFO:tasks.workunit.client.1.smithi052.stdout:0/922: mknod d0/db/d52/c132 0 2023-12-05T13:25:30.270 INFO:tasks.workunit.client.1.smithi052.stdout:0/923: write d0/db/d1b/d7a/f93 [1941884,75746] 0 2023-12-05T13:25:30.271 INFO:tasks.workunit.client.1.smithi052.stdout:9/995: creat d3/d2a/f153 x:0 0 0 2023-12-05T13:25:30.272 INFO:tasks.workunit.client.1.smithi052.stdout:0/924: read d0/db/d20/d50/f5d [503447,88963] 0 2023-12-05T13:25:30.278 INFO:tasks.workunit.client.1.smithi052.stdout:0/925: link d0/db/d65/fc9 d0/db/d1b/d29/db0/f133 0 2023-12-05T13:25:30.279 INFO:tasks.workunit.client.1.smithi052.stdout:0/926: truncate d0/db/d2e/d53/df9/fd7 1012880 0 2023-12-05T13:25:30.279 INFO:tasks.workunit.client.1.smithi052.stdout:0/927: creat d0/db/d1b/f134 x:0 0 0 2023-12-05T13:25:30.289 INFO:tasks.workunit.client.1.smithi052.stdout:5/746: dwrite d5/df/d8d/dd8/fe2 [0,4194304] 0 2023-12-05T13:25:30.291 INFO:tasks.workunit.client.1.smithi052.stdout:9/996: dwrite d3/f6a [0,4194304] 0 2023-12-05T13:25:30.292 INFO:tasks.workunit.client.1.smithi052.stdout:5/747: mknod d5/d15/d21/d4a/d6e/d91/da6/dcb/cee 0 2023-12-05T13:25:30.293 INFO:tasks.workunit.client.1.smithi052.stdout:6/742: dwrite d3/d4/df/d63/f71 [0,4194304] 0 2023-12-05T13:25:30.293 INFO:tasks.workunit.client.1.smithi052.stdout:9/997: write d3/d1e/d62/dbd/ff0 [220545,102150] 0 2023-12-05T13:25:30.295 INFO:tasks.workunit.client.1.smithi052.stdout:0/928: dread d0/db/d52/d7f/f9f [0,4194304] 0 2023-12-05T13:25:30.298 INFO:tasks.workunit.client.1.smithi052.stdout:5/748: mknod d5/df/d11/d73/d8b/cef 0 2023-12-05T13:25:30.304 INFO:tasks.workunit.client.1.smithi052.stdout:5/749: symlink d5/df/d4e/lf0 0 2023-12-05T13:25:30.304 INFO:tasks.workunit.client.1.smithi052.stdout:6/743: creat d3/d5/d9/d21/d48/d4d/d81/d82/f100 x:0 0 0 2023-12-05T13:25:30.304 INFO:tasks.workunit.client.1.smithi052.stdout:3/966: sync 2023-12-05T13:25:30.309 INFO:tasks.workunit.client.1.smithi052.stdout:5/750: getdents d5/d15 0 2023-12-05T13:25:30.310 INFO:tasks.workunit.client.1.smithi052.stdout:6/744: creat d3/d5/d9/d21/d48/d4d/d66/d91/f101 x:0 0 0 2023-12-05T13:25:30.314 INFO:tasks.workunit.client.1.smithi052.stdout:6/745: chown d3/d4/l45 23555833 1 2023-12-05T13:25:30.314 INFO:tasks.workunit.client.1.smithi052.stdout:5/751: mkdir d5/df/d4e/da4/dd6/df1 0 2023-12-05T13:25:30.314 INFO:tasks.workunit.client.1.smithi052.stdout:5/752: fsync d5/d15/d21/d4a/d6e/d91/da6/fe9 0 2023-12-05T13:25:30.315 INFO:tasks.workunit.client.1.smithi052.stdout:6/746: symlink d3/d4/d6/d26/l102 0 2023-12-05T13:25:30.315 INFO:tasks.workunit.client.1.smithi052.stdout:6/747: stat d3/d4/d6/d26/d8e 0 2023-12-05T13:25:30.316 INFO:tasks.workunit.client.1.smithi052.stdout:9/998: dwrite d3/d1e/d37/d4f/f65 [0,4194304] 0 2023-12-05T13:25:30.317 INFO:tasks.workunit.client.1.smithi052.stdout:5/753: creat d5/d15/d21/ff2 x:0 0 0 2023-12-05T13:25:30.318 INFO:tasks.workunit.client.1.smithi052.stdout:6/748: creat d3/d5/d9/d21/f103 x:0 0 0 2023-12-05T13:25:30.320 INFO:tasks.workunit.client.1.smithi052.stdout:3/967: dwrite da/d2e/d40/d109/f129 [0,4194304] 0 2023-12-05T13:25:30.323 INFO:tasks.workunit.client.1.smithi052.stdout:9/999: mkdir d3/d5e/da7/daf/dbe/d127/d154 0 2023-12-05T13:25:30.323 INFO:tasks.workunit.client.1.smithi052.stdout:0/929: dwrite d0/db/d2e/d7e/da6/dea/f11d [0,4194304] 0 2023-12-05T13:25:30.323 INFO:tasks.workunit.client.1.smithi052.stdout:5/754: truncate d5/f79 2019465 0 2023-12-05T13:25:30.326 INFO:tasks.workunit.client.1.smithi052.stdout:5/755: write d5/df/d11/d66/f6a [1514385,15387] 0 2023-12-05T13:25:30.327 INFO:tasks.workunit.client.1.smithi052.stdout:6/749: dread d3/d4/df/f43 [0,4194304] 0 2023-12-05T13:25:30.329 INFO:tasks.workunit.client.1.smithi052.stdout:0/930: creat d0/db/d1b/d7a/d8b/f135 x:0 0 0 2023-12-05T13:25:30.330 INFO:tasks.workunit.client.1.smithi052.stdout:5/756: symlink d5/d15/d21/d4a/d6e/lf3 0 2023-12-05T13:25:30.330 INFO:tasks.workunit.client.1.smithi052.stdout:5/757: truncate d5/d15/d21/d25/fdd 374057 0 2023-12-05T13:25:30.330 INFO:tasks.workunit.client.1.smithi052.stdout:5/758: stat d5/df/d4e/da8/dd7 0 2023-12-05T13:25:30.330 INFO:tasks.workunit.client.1.smithi052.stdout:5/759: chown d5/d15/d21/d4a 868504805 1 2023-12-05T13:25:30.332 INFO:tasks.workunit.client.1.smithi052.stdout:6/750: creat d3/d5/d9/d21/d48/f104 x:0 0 0 2023-12-05T13:25:30.340 INFO:tasks.workunit.client.1.smithi052.stdout:5/760: creat d5/d46/d76/ff4 x:0 0 0 2023-12-05T13:25:30.340 INFO:tasks.workunit.client.1.smithi052.stdout:6/751: rename d3/d5/d58/df4/cd0 to d3/d5/d9/d21/d48/d4d/d66/d91/c105 0 2023-12-05T13:25:30.340 INFO:tasks.workunit.client.1.smithi052.stdout:6/752: fsync d3/d4/dda/df7/fc1 0 2023-12-05T13:25:30.341 INFO:tasks.workunit.client.1.smithi052.stdout:6/753: truncate d3/d4/fc9 66413 0 2023-12-05T13:25:30.341 INFO:tasks.workunit.client.1.smithi052.stdout:6/754: stat d3/d4/df 0 2023-12-05T13:25:30.341 INFO:tasks.workunit.client.1.smithi052.stdout:6/755: fsync d3/d5/d9/d21/d48/d4d/d66/d91/fb5 0 2023-12-05T13:25:30.342 INFO:tasks.workunit.client.1.smithi052.stdout:3/968: dwrite da/d25/d33/d89/dae/dcf/dfb/d11b/fa3 [0,4194304] 0 2023-12-05T13:25:30.348 INFO:tasks.workunit.client.1.smithi052.stdout:0/931: dwrite d0/db/d52/fbc [0,4194304] 0 2023-12-05T13:25:30.351 INFO:tasks.workunit.client.1.smithi052.stdout:0/932: mkdir d0/db/d1b/d29/d136 0 2023-12-05T13:25:30.352 INFO:tasks.workunit.client.1.smithi052.stdout:6/756: dread d3/d4/d6/d26/fcd [0,4194304] 0 2023-12-05T13:25:30.352 INFO:tasks.workunit.client.1.smithi052.stdout:6/757: fsync d3/d4/dda/fef 0 2023-12-05T13:25:30.354 INFO:tasks.workunit.client.1.smithi052.stdout:6/758: mknod d3/d5/d9/d21/d48/d4d/d66/c106 0 2023-12-05T13:25:30.354 INFO:tasks.workunit.client.1.smithi052.stdout:3/969: dread da/d25/d33/d89/dae/dcf/dfb/d11b/fa3 [0,4194304] 0 2023-12-05T13:25:30.354 INFO:tasks.workunit.client.1.smithi052.stdout:3/970: chown da/d25/c11e 237 1 2023-12-05T13:25:30.354 INFO:tasks.workunit.client.1.smithi052.stdout:3/971: write da/d25/d33/d49/f119 [902317,47207] 0 2023-12-05T13:25:30.355 INFO:tasks.workunit.client.1.smithi052.stdout:5/761: dwrite d5/df/d8d/f8e [0,4194304] 0 2023-12-05T13:25:30.355 INFO:tasks.workunit.client.1.smithi052.stdout:5/762: write d5/faf [1089336,104733] 0 2023-12-05T13:25:30.355 INFO:tasks.workunit.client.1.smithi052.stdout:6/759: truncate d3/d4/df/d27/f31 3117797 0 2023-12-05T13:25:30.357 INFO:tasks.workunit.client.1.smithi052.stdout:5/763: write f4 [1758589,56801] 0 2023-12-05T13:25:30.357 INFO:tasks.workunit.client.1.smithi052.stdout:3/972: rename da/dd/d3d/le2 to da/d27/l139 0 2023-12-05T13:25:30.358 INFO:tasks.workunit.client.1.smithi052.stdout:3/973: stat da/dd/f30 0 2023-12-05T13:25:30.362 INFO:tasks.workunit.client.1.smithi052.stdout:5/764: mknod d5/df/cf5 0 2023-12-05T13:25:30.367 INFO:tasks.workunit.client.1.smithi052.stdout:6/760: dread d3/d5/d58/f84 [0,4194304] 0 2023-12-05T13:25:30.370 INFO:tasks.workunit.client.1.smithi052.stdout:6/761: mknod d3/c107 0 2023-12-05T13:25:30.370 INFO:tasks.workunit.client.1.smithi052.stdout:6/762: write d3/d5/d9/d21/fc8 [1461969,95161] 0 2023-12-05T13:25:30.371 INFO:tasks.workunit.client.1.smithi052.stdout:3/974: dread da/d25/d33/d89/dae/dcf/dfb/d11b/fd1 [0,4194304] 0 2023-12-05T13:25:30.374 INFO:tasks.workunit.client.1.smithi052.stdout:3/975: write da/d25/d33/d49/dbd/d74/f113 [2389408,75248] 0 2023-12-05T13:25:30.379 INFO:tasks.workunit.client.1.smithi052.stdout:0/933: dwrite d0/db/d52/d7f/fa7 [0,4194304] 0 2023-12-05T13:25:30.381 INFO:tasks.workunit.client.1.smithi052.stdout:0/934: mknod d0/db/d1b/d29/c137 0 2023-12-05T13:25:30.381 INFO:tasks.workunit.client.1.smithi052.stdout:0/935: fdatasync d0/db/d2e/d53/df9/fd7 0 2023-12-05T13:25:30.382 INFO:tasks.workunit.client.1.smithi052.stdout:0/936: creat d0/db/d1b/d51/d55/d66/dcd/f138 x:0 0 0 2023-12-05T13:25:30.383 INFO:tasks.workunit.client.1.smithi052.stdout:3/976: dread da/d25/d33/d43/d5b/f5c [0,4194304] 0 2023-12-05T13:25:30.385 INFO:tasks.workunit.client.1.smithi052.stdout:6/763: dwrite d3/d4/d6/d26/fcd [0,4194304] 0 2023-12-05T13:25:30.385 INFO:tasks.workunit.client.1.smithi052.stdout:6/764: chown d3/d5/d58/df4/f8b 4185 1 2023-12-05T13:25:30.385 INFO:tasks.workunit.client.1.smithi052.stdout:5/765: dwrite d5/df/d4e/da4/fb3 [0,4194304] 0 2023-12-05T13:25:30.385 INFO:tasks.workunit.client.1.smithi052.stdout:3/977: dread da/dd/fe5 [0,4194304] 0 2023-12-05T13:25:30.385 INFO:tasks.workunit.client.1.smithi052.stdout:3/978: fdatasync da/d25/d33/d89/dae/faf 0 2023-12-05T13:25:30.385 INFO:tasks.workunit.client.1.smithi052.stdout:6/765: read d3/d5/d9/f3a [131306,27083] 0 2023-12-05T13:25:30.388 INFO:tasks.workunit.client.1.smithi052.stdout:5/766: truncate d5/d15/d21/d4a/d6e/d91/da6/d5c/f4f 935803 0 2023-12-05T13:25:30.389 INFO:tasks.workunit.client.1.smithi052.stdout:5/767: symlink d5/d46/lf6 0 2023-12-05T13:25:30.390 INFO:tasks.workunit.client.1.smithi052.stdout:5/768: write d5/df/d11/d73/d77/fb0 [991811,19146] 0 2023-12-05T13:25:30.391 INFO:tasks.workunit.client.1.smithi052.stdout:6/766: dread d3/d5/f5a [0,4194304] 0 2023-12-05T13:25:30.406 INFO:tasks.workunit.client.1.smithi052.stdout:3/979: dwrite da/d25/d33/d43/d5b/fb3 [0,4194304] 0 2023-12-05T13:25:30.406 INFO:tasks.workunit.client.1.smithi052.stdout:0/937: dread d0/db/d52/d7f/fa7 [0,4194304] 0 2023-12-05T13:25:30.406 INFO:tasks.workunit.client.1.smithi052.stdout:0/938: fdatasync d0/db/d20/d50/dae/fd4 0 2023-12-05T13:25:30.406 INFO:tasks.workunit.client.1.smithi052.stdout:0/939: fsync d0/db/d20/f5a 0 2023-12-05T13:25:30.408 INFO:tasks.workunit.client.1.smithi052.stdout:3/980: dread da/fde [0,4194304] 0 2023-12-05T13:25:30.413 INFO:tasks.workunit.client.1.smithi052.stdout:3/981: getdents da/dd/d3d/d103 0 2023-12-05T13:25:30.413 INFO:tasks.workunit.client.1.smithi052.stdout:0/940: write d0/db/d52/d7f/f98 [151726,86543] 0 2023-12-05T13:25:30.414 INFO:tasks.workunit.client.1.smithi052.stdout:5/769: dwrite d5/df/d11/d66/f94 [0,4194304] 0 2023-12-05T13:25:30.417 INFO:tasks.workunit.client.1.smithi052.stdout:3/982: truncate da/dd/f19 2427644 0 2023-12-05T13:25:30.417 INFO:tasks.workunit.client.1.smithi052.stdout:5/770: rename d5/df/d4e/d65 to d5/d15/ddc/df7 0 2023-12-05T13:25:30.417 INFO:tasks.workunit.client.1.smithi052.stdout:5/771: fsync d5/f87 0 2023-12-05T13:25:30.418 INFO:tasks.workunit.client.1.smithi052.stdout:6/767: dwrite d3/d5/d9/d52/f54 [0,4194304] 0 2023-12-05T13:25:30.419 INFO:tasks.workunit.client.1.smithi052.stdout:0/941: dread d0/db/d52/d7f/d8f/f99 [0,4194304] 0 2023-12-05T13:25:30.420 INFO:tasks.workunit.client.1.smithi052.stdout:6/768: unlink d3/d5/d58/df4/f8b 0 2023-12-05T13:25:30.422 INFO:tasks.workunit.client.1.smithi052.stdout:0/942: truncate d0/db/d2e/d7e/dcc/dee/d107/f10e 292441 0 2023-12-05T13:25:30.423 INFO:tasks.workunit.client.1.smithi052.stdout:3/983: dread da/d27/f92 [4194304,4194304] 0 2023-12-05T13:25:30.424 INFO:tasks.workunit.client.1.smithi052.stdout:6/769: creat d3/d5/d9/d21/d48/d4d/f108 x:0 0 0 2023-12-05T13:25:30.424 INFO:tasks.workunit.client.1.smithi052.stdout:6/770: fdatasync d3/d5/d58/f97 0 2023-12-05T13:25:30.424 INFO:tasks.workunit.client.1.smithi052.stdout:5/772: dread d5/f9 [0,4194304] 0 2023-12-05T13:25:30.426 INFO:tasks.workunit.client.1.smithi052.stdout:3/984: creat da/d48/f13a x:0 0 0 2023-12-05T13:25:30.427 INFO:tasks.workunit.client.1.smithi052.stdout:3/985: mkdir da/d25/d33/d13b 0 2023-12-05T13:25:30.430 INFO:tasks.workunit.client.1.smithi052.stdout:3/986: rename da/d25/d33/d49/dbd/dfd/l10f to da/d25/d33/d49/dbd/l13c 0 2023-12-05T13:25:30.444 INFO:tasks.workunit.client.1.smithi052.stdout:6/771: dwrite d3/d4/df/fa7 [0,4194304] 0 2023-12-05T13:25:30.446 INFO:tasks.workunit.client.1.smithi052.stdout:3/987: mknod da/d27/dec/c13d 0 2023-12-05T13:25:30.446 INFO:tasks.workunit.client.1.smithi052.stdout:3/988: chown da/d25/d33/d43/c66 396478127 1 2023-12-05T13:25:30.447 INFO:tasks.workunit.client.1.smithi052.stdout:6/772: write d3/f29 [3502580,55706] 0 2023-12-05T13:25:30.450 INFO:tasks.workunit.client.1.smithi052.stdout:0/943: unlink d0/db/d2e/d7e/dcc/dee/d107/f10e 0 2023-12-05T13:25:30.450 INFO:tasks.workunit.client.1.smithi052.stdout:0/944: chown d0/db/d2e/d7e/da6 79836176 1 2023-12-05T13:25:30.450 INFO:tasks.workunit.client.1.smithi052.stdout:0/945: chown d0/dcb/f67 2998 1 2023-12-05T13:25:30.453 INFO:tasks.workunit.client.1.smithi052.stdout:6/773: rename d3/d5/d58/df4/d6f to d3/d5/d9/d21/d48/dcf/d109 0 2023-12-05T13:25:30.453 INFO:tasks.workunit.client.1.smithi052.stdout:6/774: chown d3/d5/d9/d52 295468 1 2023-12-05T13:25:30.453 INFO:tasks.workunit.client.1.smithi052.stdout:0/946: symlink d0/db/d1b/d51/d55/d66/l139 0 2023-12-05T13:25:30.454 INFO:tasks.workunit.client.1.smithi052.stdout:6/775: mknod d3/d5/d9/d21/d5f/c10a 0 2023-12-05T13:25:30.454 INFO:tasks.workunit.client.1.smithi052.stdout:6/776: fdatasync d3/f19 0 2023-12-05T13:25:30.455 INFO:tasks.workunit.client.1.smithi052.stdout:0/947: unlink d0/db/d1b/d7a/lf6 0 2023-12-05T13:25:30.455 INFO:tasks.workunit.client.1.smithi052.stdout:5/773: dwrite d5/df/d11/d66/f6a [0,4194304] 0 2023-12-05T13:25:30.455 INFO:tasks.workunit.client.1.smithi052.stdout:5/774: readlink l0 0 2023-12-05T13:25:30.455 INFO:tasks.workunit.client.1.smithi052.stdout:3/989: dread da/d2e/f85 [0,4194304] 0 2023-12-05T13:25:30.752 INFO:tasks.workunit.client.1.smithi052.stdout:6/777: creat d3/d4/d6/d26/f10b x:0 0 0 2023-12-05T13:25:30.754 INFO:tasks.workunit.client.1.smithi052.stdout:0/948: rename d0/db/d1b/d51/cc1 to d0/db/d1b/d51/d55/d66/dcf/c13a 0 2023-12-05T13:25:30.757 INFO:tasks.workunit.client.1.smithi052.stdout:5/775: symlink d5/df/lf8 0 2023-12-05T13:25:30.759 INFO:tasks.workunit.client.1.smithi052.stdout:3/990: rmdir da/dd/d3d/dda 39 2023-12-05T13:25:30.767 INFO:tasks.workunit.client.1.smithi052.stdout:0/949: dread d0/db/d14/f40 [0,4194304] 0 2023-12-05T13:25:30.774 INFO:tasks.workunit.client.1.smithi052.stdout:6/778: dwrite d3/d4/df/fa7 [0,4194304] 0 2023-12-05T13:25:30.778 INFO:tasks.workunit.client.1.smithi052.stdout:3/991: dwrite da/d25/d33/d49/dbd/d74/f113 [4194304,4194304] 0 2023-12-05T13:25:30.840 INFO:tasks.workunit.client.1.smithi052.stdout:5/776: chown d5/df/d11/f26 21875315 1 2023-12-05T13:25:30.840 INFO:tasks.workunit.client.1.smithi052.stdout:5/777: chown d5/c3b 210343897 1 2023-12-05T13:25:30.840 INFO:tasks.workunit.client.1.smithi052.stdout:5/778: fsync d5/df/d11/d66/f6a 0 2023-12-05T13:25:30.842 INFO:tasks.workunit.client.1.smithi052.stdout:0/950: rename d0/db/d33/d100/c10d to d0/db/d65/c13b 0 2023-12-05T13:25:30.842 INFO:tasks.workunit.client.1.smithi052.stdout:6/779: creat d3/d4/df/d27/f10c x:0 0 0 2023-12-05T13:25:30.844 INFO:tasks.workunit.client.1.smithi052.stdout:0/951: write d0/db/d20/f21 [7775737,4356] 0 2023-12-05T13:25:30.847 INFO:tasks.workunit.client.1.smithi052.stdout:6/780: mknod d3/d4/d6/d26/d6d/c10d 0 2023-12-05T13:25:30.848 INFO:tasks.workunit.client.1.smithi052.stdout:0/952: creat d0/db/d52/d7f/f13c x:0 0 0 2023-12-05T13:25:30.848 INFO:tasks.workunit.client.1.smithi052.stdout:0/953: write d0/db/d20/f10c [182902,53457] 0 2023-12-05T13:25:30.848 INFO:tasks.workunit.client.1.smithi052.stdout:0/954: write d0/db/d1b/d29/dba/f11f [626786,84438] 0 2023-12-05T13:25:30.851 INFO:tasks.workunit.client.1.smithi052.stdout:6/781: mkdir d3/d4/d6/d26/d10e 0 2023-12-05T13:25:30.852 INFO:tasks.workunit.client.1.smithi052.stdout:0/955: mkdir d0/db/d20/d50/dae/d13d 0 2023-12-05T13:25:30.857 INFO:tasks.workunit.client.1.smithi052.stdout:5/779: dwrite d5/d46/d76/ff4 [0,4194304] 0 2023-12-05T13:25:30.860 INFO:tasks.workunit.client.1.smithi052.stdout:6/782: dread d3/d5/d9/d21/d48/d4d/d81/fdb [0,4194304] 0 2023-12-05T13:25:30.860 INFO:tasks.workunit.client.1.smithi052.stdout:6/783: truncate d3/d4/df/d24/f75 4984045 0 2023-12-05T13:25:30.865 INFO:tasks.workunit.client.1.smithi052.stdout:0/956: rmdir d0/db/d52/d7f 39 2023-12-05T13:25:30.866 INFO:tasks.workunit.client.1.smithi052.stdout:3/992: truncate da/d25/d33/d89/dae/dcf/dfb/d11b/fa3 1645625 0 2023-12-05T13:25:30.866 INFO:tasks.workunit.client.1.smithi052.stdout:3/993: stat da/d27/dec/c13d 0 2023-12-05T13:25:30.868 INFO:tasks.workunit.client.1.smithi052.stdout:0/957: creat d0/dcb/f13e x:0 0 0 2023-12-05T13:25:30.871 INFO:tasks.workunit.client.1.smithi052.stdout:0/958: creat d0/db/d20/f13f x:0 0 0 2023-12-05T13:25:30.878 INFO:tasks.workunit.client.1.smithi052.stdout:3/994: dread da/dd/d3d/f9c [0,4194304] 0 2023-12-05T13:25:30.879 INFO:tasks.workunit.client.1.smithi052.stdout:0/959: mknod d0/db/d14/c140 0 2023-12-05T13:25:30.881 INFO:tasks.workunit.client.1.smithi052.stdout:6/784: dwrite d3/d5/d58/f84 [0,4194304] 0 2023-12-05T13:25:30.881 INFO:tasks.workunit.client.1.smithi052.stdout:5/780: dwrite d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 [0,4194304] 0 2023-12-05T13:25:30.881 INFO:tasks.workunit.client.1.smithi052.stdout:5/781: dread - d5/d15/d21/d4a/d6e/d91/fb5 zero size 2023-12-05T13:25:30.881 INFO:tasks.workunit.client.1.smithi052.stdout:3/995: creat da/d25/dcd/f13e x:0 0 0 2023-12-05T13:25:30.881 INFO:tasks.workunit.client.1.smithi052.stdout:3/996: dread - da/d2e/d40/fd8 zero size 2023-12-05T13:25:30.885 INFO:tasks.workunit.client.1.smithi052.stdout:6/785: rmdir d3/d5/d9/d21/d48/d4d 39 2023-12-05T13:25:30.886 INFO:tasks.workunit.client.1.smithi052.stdout:6/786: dread - d3/d4/df/d24/ff3 zero size 2023-12-05T13:25:30.888 INFO:tasks.workunit.client.1.smithi052.stdout:5/782: creat d5/d46/d76/d8f/ff9 x:0 0 0 2023-12-05T13:25:30.893 INFO:tasks.workunit.client.1.smithi052.stdout:0/960: dwrite d0/db/d14/fd1 [0,4194304] 0 2023-12-05T13:25:30.894 INFO:tasks.workunit.client.1.smithi052.stdout:3/997: rename da/d2e/d40/d109/f10c to da/d2e/d40/f13f 0 2023-12-05T13:25:30.894 INFO:tasks.workunit.client.1.smithi052.stdout:6/787: creat d3/d5/d9/d21/d48/f10f x:0 0 0 2023-12-05T13:25:30.894 INFO:tasks.workunit.client.1.smithi052.stdout:5/783: mknod d5/d15/ddc/df7/cfa 0 2023-12-05T13:25:30.895 INFO:tasks.workunit.client.1.smithi052.stdout:3/998: write da/d25/d33/d89/fbf [4998709,51570] 0 2023-12-05T13:25:30.896 INFO:tasks.workunit.client.1.smithi052.stdout:6/788: rmdir d3/d5/d58/df4/dde 39 2023-12-05T13:25:30.898 INFO:tasks.workunit.client.1.smithi052.stdout:6/789: truncate d3/d5/d9/f64 1528629 0 2023-12-05T13:25:30.898 INFO:tasks.workunit.client.1.smithi052.stdout:6/790: dread - d3/d5/d9/d21/d48/d4d/ffc zero size 2023-12-05T13:25:30.901 INFO:tasks.workunit.client.1.smithi052.stdout:6/791: dread d3/d5/d9/d21/d48/d4d/d66/d91/fa4 [0,4194304] 0 2023-12-05T13:25:30.904 INFO:tasks.workunit.client.1.smithi052.stdout:6/792: rename d3/d5/d58/l72 to d3/d5/d58/df4/l110 0 2023-12-05T13:25:30.907 INFO:tasks.workunit.client.1.smithi052.stdout:3/999: dread da/f6e [0,4194304] 0 2023-12-05T13:25:30.907 INFO:tasks.workunit.client.1.smithi052.stdout:6/793: mkdir d3/d4/dda/d111 0 2023-12-05T13:25:30.910 INFO:tasks.workunit.client.1.smithi052.stdout:6/794: unlink d3/d5/d9/d21/d48/d4d/d66/l90 0 2023-12-05T13:25:30.911 INFO:tasks.workunit.client.1.smithi052.stdout:6/795: write d3/d5/d9/f2e [973470,51754] 0 2023-12-05T13:25:30.912 INFO:tasks.workunit.client.1.smithi052.stdout:0/961: dwrite d0/db/d1b/d29/dba/f11f [0,4194304] 0 2023-12-05T13:25:30.914 INFO:tasks.workunit.client.1.smithi052.stdout:6/796: dread d3/d4/df/f43 [0,4194304] 0 2023-12-05T13:25:30.916 INFO:tasks.workunit.client.1.smithi052.stdout:0/962: rename d0/db/d2e/d53/df9/fd7 to d0/db/d52/d7f/d8f/f141 0 2023-12-05T13:25:30.917 INFO:tasks.workunit.client.1.smithi052.stdout:6/797: creat d3/d4/df/d27/f112 x:0 0 0 2023-12-05T13:25:30.917 INFO:tasks.workunit.client.1.smithi052.stdout:6/798: fdatasync d3/d4/df/d63/f6e 0 2023-12-05T13:25:30.918 INFO:tasks.workunit.client.1.smithi052.stdout:5/784: dread d5/fc [0,4194304] 0 2023-12-05T13:25:30.918 INFO:tasks.workunit.client.1.smithi052.stdout:0/963: truncate d0/f1a 2844233 0 2023-12-05T13:25:30.927 INFO:tasks.workunit.client.1.smithi052.stdout:6/799: rename d3/d5/d9/d44 to d3/d4/df/d63/d113 0 2023-12-05T13:25:30.927 INFO:tasks.workunit.client.1.smithi052.stdout:5/785: mknod d5/df/d11/d73/cfb 0 2023-12-05T13:25:30.927 INFO:tasks.workunit.client.1.smithi052.stdout:6/800: read d3/d5/d9/f2f [2967957,11935] 0 2023-12-05T13:25:30.928 INFO:tasks.workunit.client.1.smithi052.stdout:5/786: rmdir d5/df/d8d 39 2023-12-05T13:25:30.931 INFO:tasks.workunit.client.1.smithi052.stdout:6/801: getdents d3/d4/df/d63/d113 0 2023-12-05T13:25:30.932 INFO:tasks.workunit.client.1.smithi052.stdout:0/964: dwrite d0/db/d52/d7f/fd2 [0,4194304] 0 2023-12-05T13:25:30.932 INFO:tasks.workunit.client.1.smithi052.stdout:0/965: truncate d0/db/d1b/f27 1921411 0 2023-12-05T13:25:30.934 INFO:tasks.workunit.client.1.smithi052.stdout:6/802: dread d3/d5/d58/df4/f76 [0,4194304] 0 2023-12-05T13:25:30.934 INFO:tasks.workunit.client.1.smithi052.stdout:6/803: write d3/d5/fd5 [282409,101817] 0 2023-12-05T13:25:30.935 INFO:tasks.workunit.client.1.smithi052.stdout:0/966: mkdir d0/db/d33/d100/d142 0 2023-12-05T13:25:30.937 INFO:tasks.workunit.client.1.smithi052.stdout:0/967: write d0/db/d14/f40 [8152049,53310] 0 2023-12-05T13:25:30.937 INFO:tasks.workunit.client.1.smithi052.stdout:0/968: write d0/db/d2e/d7e/da6/dea/f11d [4732378,106869] 0 2023-12-05T13:25:30.938 INFO:tasks.workunit.client.1.smithi052.stdout:6/804: creat d3/d4/df/d63/f114 x:0 0 0 2023-12-05T13:25:30.938 INFO:tasks.workunit.client.1.smithi052.stdout:6/805: chown d3/d4/d6/d26/d6d/f7e 15 1 2023-12-05T13:25:30.941 INFO:tasks.workunit.client.1.smithi052.stdout:0/969: rename d0/db/d52/d7f/f9f to d0/db/d14/d60/f143 0 2023-12-05T13:25:30.941 INFO:tasks.workunit.client.1.smithi052.stdout:0/970: chown d0/db/d20/d9c 28 1 2023-12-05T13:25:30.941 INFO:tasks.workunit.client.1.smithi052.stdout:6/806: symlink d3/d4/dda/d111/l115 0 2023-12-05T13:25:30.942 INFO:tasks.workunit.client.1.smithi052.stdout:5/787: dwrite d5/df/f61 [4194304,4194304] 0 2023-12-05T13:25:30.942 INFO:tasks.workunit.client.1.smithi052.stdout:5/788: read - d5/df/d11/d66/fad zero size 2023-12-05T13:25:30.943 INFO:tasks.workunit.client.1.smithi052.stdout:0/971: mkdir d0/db/d33/d100/d142/d144 0 2023-12-05T13:25:30.946 INFO:tasks.workunit.client.1.smithi052.stdout:5/789: mkdir d5/df/d4e/dfc 0 2023-12-05T13:25:30.948 INFO:tasks.workunit.client.1.smithi052.stdout:6/807: dread d3/d4/d6/f25 [0,4194304] 0 2023-12-05T13:25:30.948 INFO:tasks.workunit.client.1.smithi052.stdout:5/790: mknod d5/df/d4e/da4/dd6/df1/cfd 0 2023-12-05T13:25:30.948 INFO:tasks.workunit.client.1.smithi052.stdout:5/791: truncate d5/fc 5152246 0 2023-12-05T13:25:30.952 INFO:tasks.workunit.client.1.smithi052.stdout:6/808: getdents d3/d4/d6/de7 0 2023-12-05T13:25:30.952 INFO:tasks.workunit.client.1.smithi052.stdout:6/809: truncate d3/d5/d58/fbd 1142968 0 2023-12-05T13:25:30.953 INFO:tasks.workunit.client.1.smithi052.stdout:6/810: write d3/d5/d9/d21/d48/d4d/d81/fbf [1904063,29045] 0 2023-12-05T13:25:30.953 INFO:tasks.workunit.client.1.smithi052.stdout:6/811: fdatasync d3/d4/d6/d26/d6d/ffa 0 2023-12-05T13:25:30.954 INFO:tasks.workunit.client.1.smithi052.stdout:5/792: mkdir d5/df/d11/d73/dfe 0 2023-12-05T13:25:30.956 INFO:tasks.workunit.client.1.smithi052.stdout:6/812: mknod d3/d5/d9/d21/d48/d4d/d66/c116 0 2023-12-05T13:25:30.957 INFO:tasks.workunit.client.1.smithi052.stdout:5/793: creat d5/d15/d21/fff x:0 0 0 2023-12-05T13:25:30.959 INFO:tasks.workunit.client.1.smithi052.stdout:6/813: link d3/d5/d9/d21/d48/d4d/d81/d82/fa2 d3/d5/d9/d52/f117 0 2023-12-05T13:25:30.961 INFO:tasks.workunit.client.1.smithi052.stdout:0/972: dwrite d0/db/d65/fc9 [0,4194304] 0 2023-12-05T13:25:30.963 INFO:tasks.workunit.client.1.smithi052.stdout:6/814: rename d3/d4/d6/d26/d6d/ld1 to d3/d4/df/d27/l118 0 2023-12-05T13:25:30.966 INFO:tasks.workunit.client.1.smithi052.stdout:0/973: symlink d0/db/d2e/d7e/l145 0 2023-12-05T13:25:30.966 INFO:tasks.workunit.client.1.smithi052.stdout:6/815: symlink d3/d5/d58/l119 0 2023-12-05T13:25:30.967 INFO:tasks.workunit.client.1.smithi052.stdout:0/974: truncate d0/db/d14/f4f 1249445 0 2023-12-05T13:25:30.967 INFO:tasks.workunit.client.1.smithi052.stdout:0/975: truncate d0/db/d2e/f47 1373177 0 2023-12-05T13:25:30.969 INFO:tasks.workunit.client.1.smithi052.stdout:0/976: mknod d0/db/d2e/d53/c146 0 2023-12-05T13:25:30.969 INFO:tasks.workunit.client.1.smithi052.stdout:6/816: symlink d3/d5/d58/df4/l11a 0 2023-12-05T13:25:30.975 INFO:tasks.workunit.client.1.smithi052.stdout:6/817: mkdir d3/d4/d11b 0 2023-12-05T13:25:30.975 INFO:tasks.workunit.client.1.smithi052.stdout:6/818: rename d3/d5/d9/d21 to d3/d5/d9/d21/dc4/deb/d11c 22 2023-12-05T13:25:30.977 INFO:tasks.workunit.client.1.smithi052.stdout:5/794: dwrite d5/d15/d21/d4a/d6e/f99 [0,4194304] 0 2023-12-05T13:25:30.983 INFO:tasks.workunit.client.1.smithi052.stdout:6/819: dread d3/d4/df/d63/f71 [0,4194304] 0 2023-12-05T13:25:30.983 INFO:tasks.workunit.client.1.smithi052.stdout:6/820: chown d3/d4/d6/d26/l102 547067 1 2023-12-05T13:25:30.983 INFO:tasks.workunit.client.1.smithi052.stdout:6/821: chown d3/d5/d9/d21/d48/d4d/d66/d91/ld9 11149853 1 2023-12-05T13:25:30.984 INFO:tasks.workunit.client.1.smithi052.stdout:6/822: getdents d3/d5/d9/d21/d48/d4d/d81/df5 0 2023-12-05T13:25:30.984 INFO:tasks.workunit.client.1.smithi052.stdout:6/823: fsync d3/d5/d9/d52/f117 0 2023-12-05T13:25:30.984 INFO:tasks.workunit.client.1.smithi052.stdout:5/795: write d5/df/d11/d73/f93 [1771213,118326] 0 2023-12-05T13:25:30.988 INFO:tasks.workunit.client.1.smithi052.stdout:6/824: mkdir d3/d4/df/d63/d113/d11d 0 2023-12-05T13:25:30.989 INFO:tasks.workunit.client.1.smithi052.stdout:5/796: symlink d5/d15/d21/d4a/d6e/d91/da6/l100 0 2023-12-05T13:25:30.991 INFO:tasks.workunit.client.1.smithi052.stdout:6/825: symlink d3/d5/d9/d21/d48/dcf/d109/l11e 0 2023-12-05T13:25:30.993 INFO:tasks.workunit.client.1.smithi052.stdout:6/826: mkdir d3/d5/d9/d21/d48/d4d/d81/df5/d11f 0 2023-12-05T13:25:30.994 INFO:tasks.workunit.client.1.smithi052.stdout:0/977: dwrite d0/db/d2e/f46 [0,4194304] 0 2023-12-05T13:25:30.995 INFO:tasks.workunit.client.1.smithi052.stdout:6/827: mkdir d3/d5/d9/d21/d48/d4d/d66/d91/d120 0 2023-12-05T13:25:30.995 INFO:tasks.workunit.client.1.smithi052.stdout:6/828: chown d3/d5/d58/le8 3689077 1 2023-12-05T13:25:30.996 INFO:tasks.workunit.client.1.smithi052.stdout:6/829: link d3/d4/d6/d26/d8e/c9c d3/d4/d6/de7/c121 0 2023-12-05T13:25:30.997 INFO:tasks.workunit.client.1.smithi052.stdout:6/830: mknod d3/d5/d9/d21/d48/d4d/d66/c122 0 2023-12-05T13:25:30.998 INFO:tasks.workunit.client.1.smithi052.stdout:6/831: write d3/d5/d58/ddf/f87 [303403,24369] 0 2023-12-05T13:25:30.998 INFO:tasks.workunit.client.1.smithi052.stdout:6/832: chown d3/d4/dda/df7/fc3 398623053 1 2023-12-05T13:25:31.010 INFO:tasks.workunit.client.1.smithi052.stdout:0/978: dwrite d0/f2b [0,4194304] 0 2023-12-05T13:25:31.010 INFO:tasks.workunit.client.1.smithi052.stdout:6/833: rename d3/d4/d6/d26 to d3/d5/d9/d21/d48/d4d/d81/df5/d123 0 2023-12-05T13:25:31.011 INFO:tasks.workunit.client.1.smithi052.stdout:5/797: dwrite d5/d15/d21/d4a/d6e/d91/da6/d5c/f53 [0,4194304] 0 2023-12-05T13:25:31.012 INFO:tasks.workunit.client.1.smithi052.stdout:5/798: readlink d5/d15/d21/d4a/d6e/d91/da6/d5c/dab/ldf 0 2023-12-05T13:25:31.012 INFO:tasks.workunit.client.1.smithi052.stdout:0/979: mknod d0/db/d1b/d29/c147 0 2023-12-05T13:25:31.013 INFO:tasks.workunit.client.1.smithi052.stdout:6/834: creat d3/d4/df/d63/f124 x:0 0 0 2023-12-05T13:25:31.015 INFO:tasks.workunit.client.1.smithi052.stdout:6/835: symlink d3/d4/d6/l125 0 2023-12-05T13:25:31.017 INFO:tasks.workunit.client.1.smithi052.stdout:6/836: fdatasync d3/d5/d9/d21/d48/d4d/d81/fbf 0 2023-12-05T13:25:31.020 INFO:tasks.workunit.client.1.smithi052.stdout:6/837: unlink d3/f29 0 2023-12-05T13:25:31.021 INFO:tasks.workunit.client.1.smithi052.stdout:5/799: dread d5/d15/d21/d4a/d6e/d91/da6/f5a [0,4194304] 0 2023-12-05T13:25:31.021 INFO:tasks.workunit.client.1.smithi052.stdout:6/838: symlink d3/d4/df/d63/d113/dab/l126 0 2023-12-05T13:25:31.027 INFO:tasks.workunit.client.1.smithi052.stdout:5/800: dread d5/f79 [0,4194304] 0 2023-12-05T13:25:31.027 INFO:tasks.workunit.client.1.smithi052.stdout:5/801: fsync d5/d15/d21/d4a/d6e/d91/da6/d5c/f4f 0 2023-12-05T13:25:31.027 INFO:tasks.workunit.client.1.smithi052.stdout:6/839: dread d3/d4/df/f43 [0,4194304] 0 2023-12-05T13:25:31.027 INFO:tasks.workunit.client.1.smithi052.stdout:5/802: creat d5/df/d4e/da4/dd6/f101 x:0 0 0 2023-12-05T13:25:31.027 INFO:tasks.workunit.client.1.smithi052.stdout:5/803: fsync d5/df/fa0 0 2023-12-05T13:25:31.032 INFO:tasks.workunit.client.1.smithi052.stdout:6/840: rename d3/d4/df/d24 to d3/d5/d9/d21/d48/d4d/d66/d91/d127 0 2023-12-05T13:25:31.039 INFO:tasks.workunit.client.1.smithi052.stdout:6/841: write d3/d5/d9/d21/d48/d4d/d81/fdb [2146263,45841] 0 2023-12-05T13:25:31.043 INFO:tasks.workunit.client.1.smithi052.stdout:0/980: dwrite d0/db/d20/d50/f5d [0,4194304] 0 2023-12-05T13:25:31.048 INFO:tasks.workunit.client.1.smithi052.stdout:6/842: mkdir d3/d5/d9/d21/d48/d4d/d81/d82/d128 0 2023-12-05T13:25:31.048 INFO:tasks.workunit.client.1.smithi052.stdout:6/843: fsync d3/d5/d9/f2f 0 2023-12-05T13:25:31.049 INFO:tasks.workunit.client.1.smithi052.stdout:6/844: write d3/d4/df/d27/f31 [968765,18938] 0 2023-12-05T13:25:31.049 INFO:tasks.workunit.client.1.smithi052.stdout:6/845: fdatasync d3/d5/d9/d21/d48/d4d/d66/d91/d127/ff3 0 2023-12-05T13:25:31.054 INFO:tasks.workunit.client.1.smithi052.stdout:0/981: creat d0/db/d14/d9b/f148 x:0 0 0 2023-12-05T13:25:31.055 INFO:tasks.workunit.client.1.smithi052.stdout:6/846: symlink d3/d5/d9/d21/dc4/l129 0 2023-12-05T13:25:31.059 INFO:tasks.workunit.client.1.smithi052.stdout:0/982: rename d0/db/d1b/d51/d55/d66/c128 to d0/db/d52/d7f/d8f/c149 0 2023-12-05T13:25:31.061 INFO:tasks.workunit.client.1.smithi052.stdout:6/847: rename d3/d5/d58/fbd to d3/d5/d9/d21/dc4/f12a 0 2023-12-05T13:25:31.061 INFO:tasks.workunit.client.1.smithi052.stdout:0/983: mknod d0/db/d2e/d53/c14a 0 2023-12-05T13:25:31.063 INFO:tasks.workunit.client.1.smithi052.stdout:6/848: mknod d3/d5/d9/d21/c12b 0 2023-12-05T13:25:31.064 INFO:tasks.workunit.client.1.smithi052.stdout:6/849: write d3/d5/d58/ddf/f87 [281051,34418] 0 2023-12-05T13:25:31.067 INFO:tasks.workunit.client.1.smithi052.stdout:6/850: symlink d3/d5/d9/d21/d48/d4d/d66/d91/d127/l12c 0 2023-12-05T13:25:31.067 INFO:tasks.workunit.client.1.smithi052.stdout:6/851: fdatasync d3/d5/d58/f97 0 2023-12-05T13:25:31.068 INFO:tasks.workunit.client.1.smithi052.stdout:6/852: truncate d3/d5/d9/d21/d48/d4d/d66/d91/fa4 2279859 0 2023-12-05T13:25:31.070 INFO:tasks.workunit.client.1.smithi052.stdout:6/853: unlink d3/d4/c18 0 2023-12-05T13:25:31.074 INFO:tasks.workunit.client.1.smithi052.stdout:0/984: rename d0/db/d1b to d0/db/d2e/d115/d14b 0 2023-12-05T13:25:31.079 INFO:tasks.workunit.client.1.smithi052.stdout:0/985: creat d0/db/d20/d50/dae/d13d/f14c x:0 0 0 2023-12-05T13:25:31.080 INFO:tasks.workunit.client.1.smithi052.stdout:0/986: read d0/f11 [3696145,38742] 0 2023-12-05T13:25:31.082 INFO:tasks.workunit.client.1.smithi052.stdout:0/987: symlink d0/db/d20/l14d 0 2023-12-05T13:25:31.084 INFO:tasks.workunit.client.1.smithi052.stdout:0/988: creat d0/db/d33/d100/d142/d144/f14e x:0 0 0 2023-12-05T13:25:31.084 INFO:tasks.workunit.client.1.smithi052.stdout:0/989: dread - d0/db/d20/f13f zero size 2023-12-05T13:25:31.086 INFO:tasks.workunit.client.1.smithi052.stdout:0/990: mknod d0/db/d2e/d53/c14f 0 2023-12-05T13:25:31.087 INFO:tasks.workunit.client.1.smithi052.stdout:6/854: dwrite d3/d4/df/d27/f47 [0,4194304] 0 2023-12-05T13:25:31.087 INFO:tasks.workunit.client.1.smithi052.stdout:6/855: write d3/d5/d9/d21/d48/d4d/d66/d91/fa4 [3209457,130904] 0 2023-12-05T13:25:31.096 INFO:tasks.workunit.client.1.smithi052.stdout:0/991: dread d0/f82 [0,4194304] 0 2023-12-05T13:25:31.096 INFO:tasks.workunit.client.1.smithi052.stdout:0/992: dread - d0/db/d52/d7f/fdd zero size 2023-12-05T13:25:31.101 INFO:tasks.workunit.client.1.smithi052.stdout:6/856: dwrite d3/d5/d9/d21/d48/d4d/d81/df5/d123/f10b [0,4194304] 0 2023-12-05T13:25:31.101 INFO:tasks.workunit.client.1.smithi052.stdout:6/857: readlink d3/d5/d9/d21/d48/lc6 0 2023-12-05T13:25:31.101 INFO:tasks.workunit.client.1.smithi052.stdout:6/858: dread - d3/d5/d9/d21/d48/d4d/d81/d82/f9e zero size 2023-12-05T13:25:31.101 INFO:tasks.workunit.client.1.smithi052.stdout:6/859: dread - d3/d5/d9/fed zero size 2023-12-05T13:25:31.102 INFO:tasks.workunit.client.1.smithi052.stdout:0/993: truncate d0/f2b 3000012 0 2023-12-05T13:25:31.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:30 smithi029 ceph-mon[112128]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 84 MiB/s rd, 181 MiB/s wr, 335 op/s 2023-12-05T13:25:31.124 INFO:tasks.workunit.client.1.smithi052.stdout:6/860: dwrite d3/d5/d9/fdd [0,4194304] 0 2023-12-05T13:25:31.128 INFO:tasks.workunit.client.1.smithi052.stdout:6/861: mknod d3/d5/d9/d21/c12d 0 2023-12-05T13:25:31.128 INFO:tasks.workunit.client.1.smithi052.stdout:6/862: fdatasync d3/d4/dda/df7/f7b 0 2023-12-05T13:25:31.145 INFO:tasks.workunit.client.1.smithi052.stdout:6/863: mkdir d3/d5/d9/d21/d48/d4d/d66/d91/d127/d12e 0 2023-12-05T13:25:31.147 INFO:tasks.workunit.client.1.smithi052.stdout:6/864: rmdir d3/d5/d9/d21/d48/dcf/dfb 0 2023-12-05T13:25:31.147 INFO:tasks.workunit.client.1.smithi052.stdout:6/865: write d3/d5/d9/d21/d48/d4d/d81/df5/d123/f95 [551061,86495] 0 2023-12-05T13:25:31.160 INFO:tasks.workunit.client.1.smithi052.stdout:6/866: dwrite d3/d5/d9/d21/d48/d4d/d81/d82/f100 [0,4194304] 0 2023-12-05T13:25:31.164 INFO:tasks.workunit.client.1.smithi052.stdout:6/867: creat d3/d4/df/d63/d113/d11d/f12f x:0 0 0 2023-12-05T13:25:31.176 INFO:tasks.workunit.client.1.smithi052.stdout:6/868: dwrite d3/d4/d6/f4b [0,4194304] 0 2023-12-05T13:25:31.180 INFO:tasks.workunit.client.1.smithi052.stdout:6/869: dread d3/d5/f5a [0,4194304] 0 2023-12-05T13:25:31.180 INFO:tasks.workunit.client.1.smithi052.stdout:6/870: read d3/d5/d9/d21/d48/d4d/d66/d91/fb5 [362648,22499] 0 2023-12-05T13:25:31.181 INFO:tasks.workunit.client.1.smithi052.stdout:6/871: dread d3/d5/fd5 [0,4194304] 0 2023-12-05T13:25:31.182 INFO:tasks.workunit.client.1.smithi052.stdout:6/872: creat d3/d4/df/f130 x:0 0 0 2023-12-05T13:25:31.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/873: creat d3/d5/d9/d21/d48/d4d/f131 x:0 0 0 2023-12-05T13:25:31.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/874: chown d3/d4/df/d63/d113 129682 1 2023-12-05T13:25:31.185 INFO:tasks.workunit.client.1.smithi052.stdout:6/875: stat d3/d5/d9/d21/d48/d4d/d81/df5/d11f 0 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 -- 172.21.15.29:0/3901062710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 msgr2=0x7efe440fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 --2- 172.21.15.29:0/3901062710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe440fd000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efe34004940 tx=0x7efe34009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 -- 172.21.15.29:0/3901062710 shutdown_connections 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 --2- 172.21.15.29:0/3901062710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 0x7efe440fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 --2- 172.21.15.29:0/3901062710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe440fd000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 -- 172.21.15.29:0/3901062710 >> 172.21.15.29:0/3901062710 conn(0x7efe440f82d0 msgr2=0x7efe440fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 -- 172.21.15.29:0/3901062710 shutdown_connections 2023-12-05T13:25:31.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.183+0000 7efe49a17700 1 -- 172.21.15.29:0/3901062710 wait complete. 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe49a17700 1 Processor -- start 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe49a17700 1 -- start start 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe49a17700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe4410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe49a17700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 0x7efe4410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe49a17700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4410e010 con 0x7efe440fcbf0 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe49a17700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4410e8b0 con 0x7efe440fde00 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe42ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe4410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe42ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe4410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58292/0 (socket says 172.21.15.29:58292) 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe42ffd700 1 -- 172.21.15.29:0/1772351773 learned_addr learned my addr 172.21.15.29:0/1772351773 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:31.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.184+0000 7efe427fc700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 0x7efe4410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:31.188 INFO:tasks.workunit.client.1.smithi052.stdout:6/876: link d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/fe4 d3/d4/dda/df7/f132 0 2023-12-05T13:25:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe42ffd700 1 -- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 msgr2=0x7efe4410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe42ffd700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 0x7efe4410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.189 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe42ffd700 1 -- 172.21.15.29:0/1772351773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34005040 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe427fc700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 0x7efe4410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe42ffd700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe4410d4d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe34000c00 tx=0x7efe34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe34021070 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe3401c400 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3400e070 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4410eb30 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.185+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4410f010 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.186+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 24) v1 ==== 45727+0+0 (secure 0 0 0) 0x7efe3400b760 con 0x7efe440fcbf0 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.187+0000 7efe2b7fe700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7efe2c038760 0x7efe2c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:31.190 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.187+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7efe3404d2f0 con 0x7efe440fcbf0 2023-12-05T13:25:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.187+0000 7efe427fc700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7efe2c038760 0x7efe2c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:31.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.187+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4404bb80 con 0x7efe440fcbf0 2023-12-05T13:25:31.191 INFO:tasks.workunit.client.1.smithi052.stdout:6/877: write d3/d5/d9/d21/d48/d4d/d81/fbf [1038002,55738] 0 2023-12-05T13:25:31.191 INFO:tasks.workunit.client.1.smithi052.stdout:6/878: write d3/d5/f7c [408167,46595] 0 2023-12-05T13:25:31.191 INFO:tasks.workunit.client.1.smithi052.stdout:6/879: readlink d3/d5/d9/d21/d48/d4d/d81/df5/d123/l102 0 2023-12-05T13:25:31.192 INFO:tasks.workunit.client.1.smithi052.stdout:6/880: mknod d3/d4/df/d27/c133 0 2023-12-05T13:25:31.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.187+0000 7efe427fc700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7efe2c038760 0x7efe2c03ac10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efe38009b80 tx=0x7efe3800b040 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:31.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.192+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efe3400bb00 con 0x7efe440fcbf0 2023-12-05T13:25:31.202 INFO:tasks.workunit.client.1.smithi052.stdout:6/881: dwrite d3/d5/d9/d21/d48/d4d/d81/df5/d123/f10b [0,4194304] 0 2023-12-05T13:25:31.204 INFO:tasks.workunit.client.1.smithi052.stdout:6/882: creat d3/d4/d11b/f134 x:0 0 0 2023-12-05T13:25:31.205 INFO:tasks.workunit.client.1.smithi052.stdout:6/883: write d3/d4/df/f2a [618652,107419] 0 2023-12-05T13:25:31.205 INFO:tasks.workunit.client.1.smithi052.stdout:6/884: chown d3/d5/d9/d21/d48/d4d/d81/df5/d123/d6d/f7e 3 1 2023-12-05T13:25:31.223 INFO:tasks.workunit.client.1.smithi052.stdout:6/885: dwrite d3/d4/df/d63/ff2 [0,4194304] 0 2023-12-05T13:25:31.225 INFO:tasks.workunit.client.1.smithi052.stdout:6/886: dread d3/d4/df/d27/f96 [0,4194304] 0 2023-12-05T13:25:31.229 INFO:tasks.workunit.client.1.smithi052.stdout:6/887: mknod d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/c135 0 2023-12-05T13:25:31.229 INFO:tasks.workunit.client.1.smithi052.stdout:6/888: dread - d3/d4/df/d27/f10c zero size 2023-12-05T13:25:31.229 INFO:tasks.workunit.client.1.smithi052.stdout:6/889: chown d3/d5/d9/d21/d48/d4d/d66/cd4 74704836 1 2023-12-05T13:25:31.229 INFO:tasks.workunit.client.1.smithi052.stdout:6/890: fdatasync d3/d5/d9/d21/d48/f104 0 2023-12-05T13:25:31.230 INFO:tasks.workunit.client.1.smithi052.stdout:6/891: rmdir d3/d5/d9/d21/d48/d4d/d81/df5/d123/d10e 0 2023-12-05T13:25:31.233 INFO:tasks.workunit.client.1.smithi052.stdout:5/804: sync 2023-12-05T13:25:31.233 INFO:tasks.workunit.client.1.smithi052.stdout:0/994: sync 2023-12-05T13:25:31.241 INFO:tasks.workunit.client.1.smithi052.stdout:5/805: creat d5/d15/d21/d4a/d6e/d91/da6/d5c/dab/dac/f102 x:0 0 0 2023-12-05T13:25:31.241 INFO:tasks.workunit.client.1.smithi052.stdout:5/806: stat d5/df/d11/d66/fe7 0 2023-12-05T13:25:31.242 INFO:tasks.workunit.client.1.smithi052.stdout:0/995: mknod d0/db/d2e/c150 0 2023-12-05T13:25:31.242 INFO:tasks.workunit.client.1.smithi052.stdout:6/892: dwrite d3/d5/d9/d21/d48/d4d/d81/d82/fa2 [0,4194304] 0 2023-12-05T13:25:31.245 INFO:tasks.workunit.client.1.smithi052.stdout:5/807: rename d5/d15/d21/d4a/d6e/d91/fb5 to d5/df/d4e/da8/dd7/f103 0 2023-12-05T13:25:31.251 INFO:tasks.workunit.client.1.smithi052.stdout:6/893: getdents d3/d5 0 2023-12-05T13:25:31.258 INFO:tasks.workunit.client.1.smithi052.stdout:5/808: truncate d5/df/d8d/dd8/fe2 3960202 0 2023-12-05T13:25:31.258 INFO:tasks.workunit.client.1.smithi052.stdout:6/894: mkdir d3/d5/d9/d21/d48/d4d/d81/df5/d136 0 2023-12-05T13:25:31.260 INFO:tasks.workunit.client.1.smithi052.stdout:5/809: symlink d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4/l104 0 2023-12-05T13:25:31.264 INFO:tasks.workunit.client.1.smithi052.stdout:6/895: rename d3/d4/df/d63 to d3/d5/d137 0 2023-12-05T13:25:31.266 INFO:tasks.workunit.client.1.smithi052.stdout:0/996: dwrite d0/db/d14/d9b/f148 [0,4194304] 0 2023-12-05T13:25:31.269 INFO:tasks.workunit.client.1.smithi052.stdout:5/810: rename d5/d46/d76 to d5/df/d11/d73/d77/d105 0 2023-12-05T13:25:31.272 INFO:tasks.workunit.client.1.smithi052.stdout:6/896: symlink d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/l138 0 2023-12-05T13:25:31.276 INFO:tasks.workunit.client.1.smithi052.stdout:5/811: dread d5/d15/d21/d4a/fc7 [0,4194304] 0 2023-12-05T13:25:31.276 INFO:tasks.workunit.client.1.smithi052.stdout:5/812: write d5/d15/d21/d4a/d6e/d91/da6/d5c/f4f [1613776,25493] 0 2023-12-05T13:25:31.277 INFO:tasks.workunit.client.1.smithi052.stdout:5/813: truncate d5/f14 5437488 0 2023-12-05T13:25:31.277 INFO:tasks.workunit.client.1.smithi052.stdout:5/814: chown d5/d15/d21/d4a/d6e/d91 1489 1 2023-12-05T13:25:31.277 INFO:tasks.workunit.client.1.smithi052.stdout:0/997: creat d0/db/d14/d60/f151 x:0 0 0 2023-12-05T13:25:31.277 INFO:tasks.workunit.client.1.smithi052.stdout:0/998: chown d0/db/d2e/d7e/dcc/dee/d107/f114 25 1 2023-12-05T13:25:31.277 INFO:tasks.workunit.client.1.smithi052.stdout:0/999: chown d0/db/d33/f70 638 1 2023-12-05T13:25:31.278 INFO:tasks.workunit.client.1.smithi052.stdout:6/897: symlink d3/d5/d9/d52/l139 0 2023-12-05T13:25:31.280 INFO:tasks.workunit.client.1.smithi052.stdout:6/898: write d3/d5/d58/f84 [2223743,22107] 0 2023-12-05T13:25:31.281 INFO:tasks.workunit.client.1.smithi052.stdout:5/815: rename d5/df/d11/d73/d77/cca to d5/d15/d21/d4a/de1/c106 0 2023-12-05T13:25:31.283 INFO:tasks.workunit.client.1.smithi052.stdout:6/899: creat d3/d5/d137/d113/f13a x:0 0 0 2023-12-05T13:25:31.284 INFO:tasks.workunit.client.1.smithi052.stdout:5/816: mkdir d5/d15/d21/d25/d107 0 2023-12-05T13:25:31.284 INFO:tasks.workunit.client.1.smithi052.stdout:5/817: truncate d5/d15/d21/d4a/d6e/d91/da6/fe9 227741 0 2023-12-05T13:25:31.285 INFO:tasks.workunit.client.1.smithi052.stdout:5/818: truncate d5/d15/d21/d4a/d6e/d91/da6/fbb 798975 0 2023-12-05T13:25:31.286 INFO:tasks.workunit.client.1.smithi052.stdout:6/900: symlink d3/d5/d9/d21/d48/d4d/d66/dea/l13b 0 2023-12-05T13:25:31.289 INFO:tasks.workunit.client.1.smithi052.stdout:5/819: rename d5/d7f/fc5 to d5/d15/d21/d4a/d6e/f108 0 2023-12-05T13:25:31.291 INFO:tasks.workunit.client.1.smithi052.stdout:6/901: symlink d3/d5/d9/d21/d48/dcf/l13c 0 2023-12-05T13:25:31.291 INFO:tasks.workunit.client.1.smithi052.stdout:6/902: chown d3/d5/d58/df4/dde/le3 126 1 2023-12-05T13:25:31.291 INFO:tasks.workunit.client.1.smithi052.stdout:6/903: dread - d3/d5/d137/d113/dab/fb1 zero size 2023-12-05T13:25:31.292 INFO:tasks.workunit.client.1.smithi052.stdout:5/820: truncate d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 861019 0 2023-12-05T13:25:31.297 INFO:tasks.workunit.client.1.smithi052.stdout:5/821: creat d5/df/d4e/dfc/f109 x:0 0 0 2023-12-05T13:25:31.299 INFO:tasks.workunit.client.1.smithi052.stdout:5/822: rename d5/df/d4b/f95 to d5/df/d4e/f10a 0 2023-12-05T13:25:31.299 INFO:tasks.workunit.client.1.smithi052.stdout:5/823: readlink d5/d15/l27 0 2023-12-05T13:25:31.300 INFO:tasks.workunit.client.1.smithi052.stdout:5/824: mkdir d5/df/d10b 0 2023-12-05T13:25:31.300 INFO:tasks.workunit.client.1.smithi052.stdout:5/825: stat d5/d15/f31 0 2023-12-05T13:25:31.303 INFO:tasks.workunit.client.1.smithi052.stdout:5/826: mknod d5/d15/d21/c10c 0 2023-12-05T13:25:31.304 INFO:tasks.workunit.client.1.smithi052.stdout:5/827: write d5/d15/d21/d4a/d6e/d91/da6/fe9 [1097985,55346] 0 2023-12-05T13:25:31.333 INFO:tasks.workunit.client.1.smithi052.stdout:5/828: dwrite d5/df/d11/d73/f93 [0,4194304] 0 2023-12-05T13:25:31.336 INFO:tasks.workunit.client.1.smithi052.stdout:5/829: mkdir d5/df/d4e/da4/d10d 0 2023-12-05T13:25:31.346 INFO:tasks.workunit.client.1.smithi052.stdout:6/904: dwrite d3/d5/d9/f64 [0,4194304] 0 2023-12-05T13:25:31.350 INFO:tasks.workunit.client.1.smithi052.stdout:6/905: creat d3/d5/f13d x:0 0 0 2023-12-05T13:25:31.353 INFO:tasks.workunit.client.1.smithi052.stdout:6/906: rmdir d3/d5/d9/d21 39 2023-12-05T13:25:31.355 INFO:tasks.workunit.client.1.smithi052.stdout:6/907: creat d3/d4/d6/de7/f13e x:0 0 0 2023-12-05T13:25:31.355 INFO:tasks.workunit.client.1.smithi052.stdout:6/908: chown d3/d4/ffe 7323172 1 2023-12-05T13:25:31.357 INFO:tasks.workunit.client.1.smithi052.stdout:6/909: symlink d3/d5/d9/d21/d48/d4d/d66/d91/l13f 0 2023-12-05T13:25:31.358 INFO:tasks.workunit.client.1.smithi052.stdout:6/910: unlink d3/c12 0 2023-12-05T13:25:31.360 INFO:tasks.workunit.client.1.smithi052.stdout:5/830: dwrite d5/df/d4e/da8/fb1 [0,4194304] 0 2023-12-05T13:25:31.360 INFO:tasks.workunit.client.1.smithi052.stdout:6/911: creat d3/d5/d9/d21/dc4/deb/f140 x:0 0 0 2023-12-05T13:25:31.364 INFO:tasks.workunit.client.1.smithi052.stdout:5/831: creat d5/d7f/f10e x:0 0 0 2023-12-05T13:25:31.364 INFO:tasks.workunit.client.1.smithi052.stdout:5/832: stat d5/df/d10b 0 2023-12-05T13:25:31.367 INFO:tasks.workunit.client.1.smithi052.stdout:6/912: truncate d3/d5/d9/d21/d48/d4d/d81/d82/f100 860285 0 2023-12-05T13:25:31.369 INFO:tasks.workunit.client.1.smithi052.stdout:6/913: mkdir d3/d5/d141 0 2023-12-05T13:25:31.371 INFO:tasks.workunit.client.1.smithi052.stdout:6/914: mkdir d3/d4/d6/d142 0 2023-12-05T13:25:31.373 INFO:tasks.workunit.client.1.smithi052.stdout:6/915: rmdir d3/d5/d9/d21/d48/d4d/d81/df5/d123 39 2023-12-05T13:25:31.373 INFO:tasks.workunit.client.1.smithi052.stdout:6/916: dread - d3/d4/dda/fef zero size 2023-12-05T13:25:31.377 INFO:tasks.workunit.client.1.smithi052.stdout:6/917: link d3/d5/d9/f2f d3/d4/df/d27/f143 0 2023-12-05T13:25:31.377 INFO:tasks.workunit.client.1.smithi052.stdout:5/833: dwrite d5/df/d8d/f8e [0,4194304] 0 2023-12-05T13:25:31.377 INFO:tasks.workunit.client.1.smithi052.stdout:6/918: read d3/d5/fd5 [145176,90743] 0 2023-12-05T13:25:31.379 INFO:tasks.workunit.client.1.smithi052.stdout:5/834: symlink d5/d15/ddc/df7/l10f 0 2023-12-05T13:25:31.379 INFO:tasks.workunit.client.1.smithi052.stdout:5/835: chown d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4 790 1 2023-12-05T13:25:31.379 INFO:tasks.workunit.client.1.smithi052.stdout:6/919: creat d3/d4/d6/de7/f144 x:0 0 0 2023-12-05T13:25:31.380 INFO:tasks.workunit.client.1.smithi052.stdout:5/836: creat d5/df/d4e/d5b/f110 x:0 0 0 2023-12-05T13:25:31.381 INFO:tasks.workunit.client.1.smithi052.stdout:5/837: truncate d5/df/d11/d73/d77/fa1 63225 0 2023-12-05T13:25:31.381 INFO:tasks.workunit.client.1.smithi052.stdout:5/838: write d5/df/d4e/d5b/f81 [887604,122956] 0 2023-12-05T13:25:31.381 INFO:tasks.workunit.client.1.smithi052.stdout:5/839: chown d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4/l104 2 1 2023-12-05T13:25:31.381 INFO:tasks.workunit.client.1.smithi052.stdout:6/920: creat d3/d5/d9/d21/d48/d4d/d66/dea/f145 x:0 0 0 2023-12-05T13:25:31.382 INFO:tasks.workunit.client.1.smithi052.stdout:6/921: fdatasync d3/d5/d9/d21/d48/d4d/f108 0 2023-12-05T13:25:31.382 INFO:tasks.workunit.client.1.smithi052.stdout:6/922: stat d3/d5/d58/l119 0 2023-12-05T13:25:31.382 INFO:tasks.workunit.client.1.smithi052.stdout:5/840: dread d5/df/f36 [0,4194304] 0 2023-12-05T13:25:31.382 INFO:tasks.workunit.client.1.smithi052.stdout:6/923: symlink d3/d5/d9/d21/dc4/l146 0 2023-12-05T13:25:31.384 INFO:tasks.workunit.client.1.smithi052.stdout:5/841: mknod d5/d15/d21/d4a/d6e/d91/da6/d5c/c111 0 2023-12-05T13:25:31.384 INFO:tasks.workunit.client.1.smithi052.stdout:5/842: stat d5/df/d4e/da8/dd7/dea 0 2023-12-05T13:25:31.384 INFO:tasks.workunit.client.1.smithi052.stdout:5/843: readlink d5/d15/l58 0 2023-12-05T13:25:31.384 INFO:tasks.workunit.client.1.smithi052.stdout:5/844: truncate d5/df/d4e/fde 638842 0 2023-12-05T13:25:31.391 INFO:tasks.workunit.client.1.smithi052.stdout:5/845: creat d5/df/d4e/da8/dd7/dea/f112 x:0 0 0 2023-12-05T13:25:31.392 INFO:tasks.workunit.client.1.smithi052.stdout:5/846: creat d5/d15/d21/d4a/d6e/f113 x:0 0 0 2023-12-05T13:25:31.398 INFO:tasks.workunit.client.1.smithi052.stdout:5/847: dread d5/df/d4b/f4d [0,4194304] 0 2023-12-05T13:25:31.400 INFO:tasks.workunit.client.1.smithi052.stdout:5/848: write d5/df/d11/d73/f96 [4646359,6348] 0 2023-12-05T13:25:31.400 INFO:tasks.workunit.client.1.smithi052.stdout:6/924: dwrite d3/d4/df/d27/f56 [4194304,4194304] 0 2023-12-05T13:25:31.403 INFO:tasks.workunit.client.1.smithi052.stdout:6/925: mknod d3/d4/c147 0 2023-12-05T13:25:31.406 INFO:tasks.workunit.client.1.smithi052.stdout:6/926: symlink d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/l148 0 2023-12-05T13:25:31.407 INFO:tasks.workunit.client.1.smithi052.stdout:6/927: symlink d3/d5/d9/d21/d48/d4d/d81/df5/d11f/l149 0 2023-12-05T13:25:31.411 INFO:tasks.workunit.client.1.smithi052.stdout:6/928: dread d3/d5/f5a [0,4194304] 0 2023-12-05T13:25:31.412 INFO:tasks.workunit.client.1.smithi052.stdout:6/929: getdents d3/d4/d6 0 2023-12-05T13:25:31.412 INFO:tasks.workunit.client.1.smithi052.stdout:6/930: write d3/d4/d6/de7/ff9 [118781,120813] 0 2023-12-05T13:25:31.414 INFO:tasks.workunit.client.1.smithi052.stdout:5/849: dwrite d5/d15/d21/d4a/d6e/d91/da6/fbb [0,4194304] 0 2023-12-05T13:25:31.414 INFO:tasks.workunit.client.1.smithi052.stdout:5/850: truncate d5/d15/d21/d4a/f89 1758882 0 2023-12-05T13:25:31.415 INFO:tasks.workunit.client.1.smithi052.stdout:6/931: unlink d3/d5/d9/d52/l139 0 2023-12-05T13:25:31.416 INFO:tasks.workunit.client.1.smithi052.stdout:6/932: write d3/d5/d9/d21/d48/d4d/d81/d82/fa2 [598181,51743] 0 2023-12-05T13:25:31.420 INFO:tasks.workunit.client.1.smithi052.stdout:6/933: creat d3/d5/d9/d21/d48/d4d/d81/f14a x:0 0 0 2023-12-05T13:25:31.423 INFO:tasks.workunit.client.1.smithi052.stdout:6/934: mknod d3/d5/d9/d21/d48/d4d/d81/df5/c14b 0 2023-12-05T13:25:31.423 INFO:tasks.workunit.client.1.smithi052.stdout:6/935: read - d3/d4/df/f130 zero size 2023-12-05T13:25:31.426 INFO:tasks.workunit.client.1.smithi052.stdout:6/936: rename d3/d5/d137 to d3/d14c 0 2023-12-05T13:25:31.426 INFO:tasks.workunit.client.1.smithi052.stdout:6/937: fdatasync d3/d5/d9/d21/d48/f104 0 2023-12-05T13:25:31.426 INFO:tasks.workunit.client.1.smithi052.stdout:6/938: write d3/d4/df/d27/f10c [348405,30000] 0 2023-12-05T13:25:31.429 INFO:tasks.workunit.client.1.smithi052.stdout:6/939: dread d3/d5/d9/d21/d48/d4d/d66/d91/fa4 [0,4194304] 0 2023-12-05T13:25:31.429 INFO:tasks.workunit.client.1.smithi052.stdout:6/940: fsync d3/d4/dda/df7/fc3 0 2023-12-05T13:25:31.431 INFO:tasks.workunit.client.1.smithi052.stdout:6/941: mkdir d3/d5/d9/d21/d48/d4d/d66/d91/d120/d14d 0 2023-12-05T13:25:31.431 INFO:tasks.workunit.client.1.smithi052.stdout:5/851: dwrite d5/d15/d21/d4a/d6e/d91/da6/d5c/f53 [0,4194304] 0 2023-12-05T13:25:31.431 INFO:tasks.workunit.client.1.smithi052.stdout:5/852: write d5/df/d11/d73/d77/d105/d8f/ff9 [51016,106043] 0 2023-12-05T13:25:31.431 INFO:tasks.workunit.client.1.smithi052.stdout:6/942: creat d3/d5/d9/d21/d48/d4d/d81/df5/d123/d6d/f14e x:0 0 0 2023-12-05T13:25:31.432 INFO:tasks.workunit.client.1.smithi052.stdout:5/853: creat d5/d15/d21/d4a/d6e/d91/da6/f114 x:0 0 0 2023-12-05T13:25:31.433 INFO:tasks.workunit.client.1.smithi052.stdout:5/854: creat d5/df/d11/d73/d77/d105/d8f/f115 x:0 0 0 2023-12-05T13:25:31.434 INFO:tasks.workunit.client.1.smithi052.stdout:5/855: stat d5/df/d4e/da8/dd7/cdb 0 2023-12-05T13:25:31.434 INFO:tasks.workunit.client.1.smithi052.stdout:5/856: write d5/df/d11/fd5 [72040,48701] 0 2023-12-05T13:25:31.437 INFO:tasks.workunit.client.1.smithi052.stdout:5/857: rename d5/df/d4e/da8 to d5/df/d4b/d116 0 2023-12-05T13:25:31.437 INFO:tasks.workunit.client.1.smithi052.stdout:5/858: mkdir d5/d15/d21/d4a/d6e/d91/da6/d5c/d117 0 2023-12-05T13:25:31.438 INFO:tasks.workunit.client.1.smithi052.stdout:5/859: fdatasync d5/df/d11/d73/d77/d105/d8f/fb9 0 2023-12-05T13:25:31.439 INFO:tasks.workunit.client.1.smithi052.stdout:5/860: mkdir d5/d15/d21/d25/d118 0 2023-12-05T13:25:31.439 INFO:tasks.workunit.client.1.smithi052.stdout:5/861: chown d5/df/d4b/cb6 305 1 2023-12-05T13:25:31.439 INFO:tasks.workunit.client.1.smithi052.stdout:5/862: chown d5/df/f61 109309010 1 2023-12-05T13:25:31.440 INFO:tasks.workunit.client.1.smithi052.stdout:5/863: mknod d5/df/d4b/c119 0 2023-12-05T13:25:31.442 INFO:tasks.workunit.client.1.smithi052.stdout:5/864: rmdir d5/df/d4e/da4/dd6/df1 39 2023-12-05T13:25:31.444 INFO:tasks.workunit.client.1.smithi052.stdout:6/943: dwrite d3/d5/d58/ddf/f87 [0,4194304] 0 2023-12-05T13:25:31.445 INFO:tasks.workunit.client.1.smithi052.stdout:6/944: fsync d3/d4/d6/de7/f13e 0 2023-12-05T13:25:31.457 INFO:tasks.workunit.client.1.smithi052.stdout:5/865: dwrite d5/df/d4e/d5b/f110 [0,4194304] 0 2023-12-05T13:25:31.462 INFO:tasks.workunit.client.1.smithi052.stdout:5/866: rename d5/df/d11/d73/d77/d105/d8f/fb7 to d5/df/d4e/d5b/f11a 0 2023-12-05T13:25:31.462 INFO:tasks.workunit.client.1.smithi052.stdout:5/867: mkdir d5/df/d4e/da4/dd6/df1/d11b 0 2023-12-05T13:25:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:30 smithi052 ceph-mon[121072]: pgmap v7: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 84 MiB/s rd, 181 MiB/s wr, 335 op/s 2023-12-05T13:25:31.476 INFO:tasks.workunit.client.1.smithi052.stdout:5/868: dwrite d5/d15/ddc/df7/f72 [4194304,4194304] 0 2023-12-05T13:25:31.479 INFO:tasks.workunit.client.1.smithi052.stdout:5/869: rename d5/df/d11/d73/d77/fb0 to d5/df/d4e/da4/dd6/f11c 0 2023-12-05T13:25:31.480 INFO:tasks.workunit.client.1.smithi052.stdout:5/870: write d5/f14 [3014711,30083] 0 2023-12-05T13:25:31.480 INFO:tasks.workunit.client.1.smithi052.stdout:5/871: readlink d5/df/d4b/l7d 0 2023-12-05T13:25:31.483 INFO:tasks.workunit.client.1.smithi052.stdout:5/872: rename d5/d15/cb4 to d5/df/d8d/dd8/c11d 0 2023-12-05T13:25:31.483 INFO:tasks.workunit.client.1.smithi052.stdout:5/873: dread - d5/df/d11/d73/d77/d105/fc2 zero size 2023-12-05T13:25:31.527 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.526+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe4410f400 con 0x7efe2c038760 2023-12-05T13:25:31.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.527+0000 7efe2b7fe700 1 -- 172.21.15.29:0/1772351773 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7efe4410f400 con 0x7efe2c038760 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7efe2c038760 msgr2=0x7efe2c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7efe2c038760 0x7efe2c03ac10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efe38009b80 tx=0x7efe3800b040 comp rx=0 tx=0).stop 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 msgr2=0x7efe4410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe4410d4d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe34000c00 tx=0x7efe34009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 shutdown_connections 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7efe2c038760 0x7efe2c03ac10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe440fcbf0 0x7efe4410d4d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 --2- 172.21.15.29:0/1772351773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe440fde00 0x7efe4410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 >> 172.21.15.29:0/1772351773 conn(0x7efe440f82d0 msgr2=0x7efe44101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 shutdown_connections 2023-12-05T13:25:31.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.530+0000 7efe49a17700 1 -- 172.21.15.29:0/1772351773 wait complete. 2023-12-05T13:25:31.543 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:25:31.576 INFO:tasks.workunit.client.1.smithi052.stdout:6/945: sync 2023-12-05T13:25:31.576 INFO:tasks.workunit.client.1.smithi052.stdout:5/874: sync 2023-12-05T13:25:31.576 INFO:tasks.workunit.client.1.smithi052.stdout:6/946: readlink d3/d5/d9/d21/d48/d4d/d81/df5/d11f/l149 0 2023-12-05T13:25:31.577 INFO:tasks.workunit.client.1.smithi052.stdout:5/875: creat d5/d15/d21/d4a/d6e/d91/da6/d88/da7/f11e x:0 0 0 2023-12-05T13:25:31.600 INFO:tasks.workunit.client.1.smithi052.stdout:6/947: dwrite d3/d5/f7c [0,4194304] 0 2023-12-05T13:25:31.603 INFO:tasks.workunit.client.1.smithi052.stdout:6/948: unlink d3/d5/d9/d21/d48/d4d/d66/d91/d127/cb6 0 2023-12-05T13:25:31.603 INFO:tasks.workunit.client.1.smithi052.stdout:6/949: rename d3/d5/d9/d21/d48/d4d/d81/df5 to d3/d5/d9/d21/d48/d4d/d81/df5/d136/d14f 22 2023-12-05T13:25:31.603 INFO:tasks.workunit.client.1.smithi052.stdout:6/950: creat d3/d4/d6/de7/f150 x:0 0 0 2023-12-05T13:25:31.605 INFO:tasks.workunit.client.1.smithi052.stdout:5/876: dwrite d5/df/d11/f52 [0,4194304] 0 2023-12-05T13:25:31.605 INFO:tasks.workunit.client.1.smithi052.stdout:6/951: link d3/d4/df/f9b d3/d5/d9/d21/d48/d4d/d81/df5/d123/d6d/f151 0 2023-12-05T13:25:31.605 INFO:tasks.workunit.client.1.smithi052.stdout:6/952: readlink d3/d14c/d113/dab/ld8 0 2023-12-05T13:25:31.607 INFO:tasks.workunit.client.1.smithi052.stdout:5/877: getdents d5/df/d11 0 2023-12-05T13:25:31.609 INFO:tasks.workunit.client.1.smithi052.stdout:5/878: symlink d5/df/d4e/da4/l11f 0 2023-12-05T13:25:31.611 INFO:tasks.workunit.client.1.smithi052.stdout:5/879: mknod d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4/c120 0 2023-12-05T13:25:31.613 INFO:tasks.workunit.client.1.smithi052.stdout:5/880: symlink d5/d15/l121 0 2023-12-05T13:25:31.613 INFO:tasks.workunit.client.1.smithi052.stdout:5/881: stat d5/d15/ddc 0 2023-12-05T13:25:31.614 INFO:tasks.workunit.client.1.smithi052.stdout:5/882: mkdir d5/df/d11/d73/d77/d105/d8f/d122 0 2023-12-05T13:25:31.615 INFO:tasks.workunit.client.1.smithi052.stdout:5/883: unlink d5/df/d4e/d5b/f11a 0 2023-12-05T13:25:31.616 INFO:tasks.workunit.client.1.smithi052.stdout:5/884: mkdir d5/df/d11/d73/d8b/d123 0 2023-12-05T13:25:31.616 INFO:tasks.workunit.client.1.smithi052.stdout:5/885: rmdir d5/df/d11/d73/d77/d105 39 2023-12-05T13:25:31.616 INFO:tasks.workunit.client.1.smithi052.stdout:5/886: stat d5/d15/d21/d4a/d6e/d91/da6/d5c/c111 0 2023-12-05T13:25:31.617 INFO:tasks.workunit.client.1.smithi052.stdout:5/887: mkdir d5/df/d4b/d124 0 2023-12-05T13:25:31.617 INFO:tasks.workunit.client.1.smithi052.stdout:5/888: chown d5/df/d4b/cb6 219 1 2023-12-05T13:25:31.617 INFO:tasks.workunit.client.1.smithi052.stdout:5/889: stat d5/d15/d21/d4a/d6e/d91/da6/d5c/f49 0 2023-12-05T13:25:31.617 INFO:tasks.workunit.client.1.smithi052.stdout:5/890: stat d5/d15/d21/d4a/d6e/d91/da6/d5c/d117 0 2023-12-05T13:25:31.618 INFO:tasks.workunit.client.1.smithi052.stdout:6/953: dwrite d3/d4/ffe [0,4194304] 0 2023-12-05T13:25:31.618 INFO:tasks.workunit.client.1.smithi052.stdout:6/954: fsync d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/f9d 0 2023-12-05T13:25:31.618 INFO:tasks.workunit.client.1.smithi052.stdout:6/955: write d3/d4/d6/f4b [4550748,15834] 0 2023-12-05T13:25:31.619 INFO:tasks.workunit.client.1.smithi052.stdout:6/956: creat d3/d14c/d113/f152 x:0 0 0 2023-12-05T13:25:31.619 INFO:tasks.workunit.client.1.smithi052.stdout:6/957: truncate d3/d5/d9/d21/d48/d4d/f108 718123 0 2023-12-05T13:25:31.620 INFO:tasks.workunit.client.1.smithi052.stdout:6/958: fsync d3/d5/d9/d21/d48/d4d/d81/f14a 0 2023-12-05T13:25:31.630 INFO:tasks.workunit.client.1.smithi052.stdout:5/891: dwrite d5/df/d4e/fde [0,4194304] 0 2023-12-05T13:25:31.631 INFO:tasks.workunit.client.1.smithi052.stdout:6/959: truncate d3/d4/d6/f4b 4073204 0 2023-12-05T13:25:31.631 INFO:tasks.workunit.client.1.smithi052.stdout:6/960: write d3/d4/dda/df7/f132 [310070,35175] 0 2023-12-05T13:25:31.634 INFO:tasks.workunit.client.1.smithi052.stdout:6/961: mkdir d3/d5/d58/d153 0 2023-12-05T13:25:31.634 INFO:tasks.workunit.client.1.smithi052.stdout:6/962: chown d3/l99 3047465 1 2023-12-05T13:25:31.640 INFO:tasks.workunit.client.1.smithi052.stdout:5/892: dread d5/d15/d21/d4a/d6e/f99 [0,4194304] 0 2023-12-05T13:25:31.642 INFO:tasks.workunit.client.1.smithi052.stdout:5/893: symlink d5/d15/d21/d4a/de1/l125 0 2023-12-05T13:25:31.642 INFO:tasks.workunit.client.1.smithi052.stdout:5/894: readlink d5/d15/d21/l56 0 2023-12-05T13:25:31.645 INFO:tasks.workunit.client.1.smithi052.stdout:5/895: creat d5/df/d11/d73/d77/f126 x:0 0 0 2023-12-05T13:25:31.646 INFO:tasks.workunit.client.1.smithi052.stdout:5/896: write d5/d15/ddc/df7/f72 [106368,86393] 0 2023-12-05T13:25:31.646 INFO:tasks.workunit.client.1.smithi052.stdout:5/897: mknod d5/df/d11/d73/d8b/d123/c127 0 2023-12-05T13:25:31.647 INFO:tasks.workunit.client.1.smithi052.stdout:5/898: creat d5/df/d8d/dd8/f128 x:0 0 0 2023-12-05T13:25:31.654 INFO:tasks.workunit.client.1.smithi052.stdout:6/963: dwrite d3/d14c/d113/f13a [0,4194304] 0 2023-12-05T13:25:31.655 INFO:tasks.workunit.client.1.smithi052.stdout:5/899: dread d5/d15/d21/fa5 [0,4194304] 0 2023-12-05T13:25:31.656 INFO:tasks.workunit.client.1.smithi052.stdout:6/964: mkdir d3/d4/df/d27/d154 0 2023-12-05T13:25:31.658 INFO:tasks.workunit.client.1.smithi052.stdout:6/965: link d3/d5/d9/d21/d48/d4d/d66/d91/le5 d3/d4/dda/d111/l155 0 2023-12-05T13:25:31.658 INFO:tasks.workunit.client.1.smithi052.stdout:6/966: chown d3/d4/dda/df7/fc1 1 1 2023-12-05T13:25:31.660 INFO:tasks.workunit.client.1.smithi052.stdout:6/967: creat d3/d5/d58/f156 x:0 0 0 2023-12-05T13:25:31.660 INFO:tasks.workunit.client.1.smithi052.stdout:6/968: chown d3/d5/d9/d21/d48/dcf/d109/f85 676 1 2023-12-05T13:25:31.662 INFO:tasks.workunit.client.1.smithi052.stdout:6/969: write d3/d5/d9/f2f [245764,25666] 0 2023-12-05T13:25:31.663 INFO:tasks.workunit.client.1.smithi052.stdout:5/900: dread d5/df/d4e/d5b/fb8 [0,4194304] 0 2023-12-05T13:25:31.663 INFO:tasks.workunit.client.1.smithi052.stdout:5/901: chown d5/df/d11/lbe 293 1 2023-12-05T13:25:31.663 INFO:tasks.workunit.client.1.smithi052.stdout:6/970: unlink d3/d5/d9/d21/d48/d4d/d66/d91/f101 0 2023-12-05T13:25:31.665 INFO:tasks.workunit.client.1.smithi052.stdout:5/902: symlink d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4/l129 0 2023-12-05T13:25:31.665 INFO:tasks.workunit.client.1.smithi052.stdout:5/903: fdatasync d5/d15/d21/d4a/d6e/d91/da6/d5c/f53 0 2023-12-05T13:25:31.665 INFO:tasks.workunit.client.1.smithi052.stdout:5/904: chown d5/df/d4e/lf0 1808 1 2023-12-05T13:25:31.665 INFO:tasks.workunit.client.1.smithi052.stdout:6/971: stat d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/cb0 0 2023-12-05T13:25:31.666 INFO:tasks.workunit.client.1.smithi052.stdout:5/905: creat d5/d15/d21/d4a/d6e/d91/da6/d88/f12a x:0 0 0 2023-12-05T13:25:31.666 INFO:tasks.workunit.client.1.smithi052.stdout:5/906: readlink d5/d15/d21/d4a/de1/l125 0 2023-12-05T13:25:31.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.666+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/2711834596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 msgr2=0x7f5e040fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.666+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/2711834596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e040fd150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5df4004940 tx=0x7f5df4009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:31.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.666+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/2711834596 shutdown_connections 2023-12-05T13:25:31.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.666+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/2711834596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e040fd150 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.666+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/2711834596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e040fbaf0 0x7f5e040fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.666+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/2711834596 >> 172.21.15.29:0/2711834596 conn(0x7f5e040f7190 msgr2=0x7f5e040f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:31.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.667+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/2711834596 shutdown_connections 2023-12-05T13:25:31.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.667+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/2711834596 wait complete. 2023-12-05T13:25:31.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.667+0000 7f5e0bfaf700 1 Processor -- start 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.667+0000 7f5e0bfaf700 1 -- start start 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0bfaf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e040fbaf0 0x7f5e04065a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0bfaf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e0406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0bfaf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040660b0 con 0x7f5e040fcd00 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0bfaf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040661f0 con 0x7f5e040fbaf0 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0954a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e0406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0954a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e0406e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58304/0 (socket says 172.21.15.29:58304) 2023-12-05T13:25:31.670 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0954a700 1 -- 172.21.15.29:0/3073831421 learned_addr learned my addr 172.21.15.29:0/3073831421 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0954a700 1 -- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e040fbaf0 msgr2=0x7f5e04065a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0954a700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e040fbaf0 0x7f5e04065a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.668+0000 7f5e0954a700 1 -- 172.21.15.29:0/3073831421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4005040 con 0x7f5e040fcd00 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.669+0000 7f5e0954a700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e0406e8c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000c00 tx=0x7f5df4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.669+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df400e030 con 0x7f5e040fcd00 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.669+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5df401c400 con 0x7f5e040fcd00 2023-12-05T13:25:31.671 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.669+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0406ee60 con 0x7f5e040fcd00 2023-12-05T13:25:31.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.669+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5df400b650 con 0x7f5e040fcd00 2023-12-05T13:25:31.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.669+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0406f3a0 con 0x7f5e040fcd00 2023-12-05T13:25:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.671+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 24) v1 ==== 45727+0+0 (secure 0 0 0) 0x7f5df400b7b0 con 0x7f5e040fcd00 2023-12-05T13:25:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.671+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0404bb80 con 0x7f5e040fcd00 2023-12-05T13:25:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.671+0000 7f5dfa7fc700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f5df0038760 0x7f5df003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.671+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5df404dc10 con 0x7f5e040fcd00 2023-12-05T13:25:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.671+0000 7f5e09d4b700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f5df0038760 0x7f5df003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:31.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.672+0000 7f5e09d4b700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f5df0038760 0x7f5df003ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e040657f0 tx=0x7f5e0000b040 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:31.676 INFO:tasks.workunit.client.1.smithi052.stdout:6/972: dwrite d3/d4/fc9 [0,4194304] 0 2023-12-05T13:25:31.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.676+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5df4011730 con 0x7f5e040fcd00 2023-12-05T13:25:31.680 INFO:tasks.workunit.client.1.smithi052.stdout:6/973: getdents d3/d5/d9/d21/d48/d4d/d81/df5/d123 0 2023-12-05T13:25:31.680 INFO:tasks.workunit.client.1.smithi052.stdout:6/974: truncate d3/d5/d9/d21/d48/d4d/d81/df5/d123/d8e/f9d 103357 0 2023-12-05T13:25:31.680 INFO:tasks.workunit.client.1.smithi052.stdout:6/975: fsync d3/d14c/d113/f152 0 2023-12-05T13:25:31.680 INFO:tasks.workunit.client.1.smithi052.stdout:6/976: write d3/fbb [97886,60091] 0 2023-12-05T13:25:31.680 INFO:tasks.workunit.client.1.smithi052.stdout:6/977: stat d3/d5/d9/d21/d48/f10f 0 2023-12-05T13:25:31.683 INFO:tasks.workunit.client.1.smithi052.stdout:6/978: mkdir d3/d5/d9/d21/d48/d4d/d81/d82/d157 0 2023-12-05T13:25:31.685 INFO:tasks.workunit.client.1.smithi052.stdout:6/979: mkdir d3/d4/d6/d158 0 2023-12-05T13:25:31.687 INFO:tasks.workunit.client.1.smithi052.stdout:6/980: mknod d3/d5/d9/d21/d48/d4d/d81/df5/c159 0 2023-12-05T13:25:31.688 INFO:tasks.workunit.client.1.smithi052.stdout:6/981: creat d3/d5/d9/d21/d48/d4d/d81/d82/d157/f15a x:0 0 0 2023-12-05T13:25:31.691 INFO:tasks.workunit.client.1.smithi052.stdout:6/982: dread d3/fbb [0,4194304] 0 2023-12-05T13:25:31.698 INFO:tasks.workunit.client.1.smithi052.stdout:6/983: dread d3/d5/f7c [0,4194304] 0 2023-12-05T13:25:31.726 INFO:tasks.workunit.client.1.smithi052.stdout:6/984: dwrite d3/d4/df/d27/fca [0,4194304] 0 2023-12-05T13:25:31.726 INFO:tasks.workunit.client.1.smithi052.stdout:6/985: fdatasync d3/d4/df/d27/f31 0 2023-12-05T13:25:31.726 INFO:tasks.workunit.client.1.smithi052.stdout:6/986: fsync d3/d5/d9/d21/d48/d4d/d66/dea/f145 0 2023-12-05T13:25:31.726 INFO:tasks.workunit.client.1.smithi052.stdout:6/987: fdatasync d3/d4/fec 0 2023-12-05T13:25:31.728 INFO:tasks.workunit.client.1.smithi052.stdout:6/988: truncate d3/d5/d9/d21/d48/dcf/d109/f85 2502523 0 2023-12-05T13:25:31.728 INFO:tasks.workunit.client.1.smithi052.stdout:6/989: fsync d3/d4/dda/df7/f132 0 2023-12-05T13:25:31.729 INFO:tasks.workunit.client.1.smithi052.stdout:6/990: mknod d3/d5/d9/d21/d48/d4d/d66/d91/d127/d12e/c15b 0 2023-12-05T13:25:31.730 INFO:tasks.workunit.client.1.smithi052.stdout:6/991: mknod d3/d5/d9/d21/d48/d4d/d81/d82/d157/c15c 0 2023-12-05T13:25:31.730 INFO:tasks.workunit.client.1.smithi052.stdout:6/992: write d3/d5/d9/d21/f103 [616720,42179] 0 2023-12-05T13:25:31.730 INFO:tasks.workunit.client.1.smithi052.stdout:6/993: write d3/d5/d9/d21/d48/d4d/f108 [1397529,125034] 0 2023-12-05T13:25:31.752 INFO:tasks.workunit.client.1.smithi052.stdout:6/994: dwrite d3/d5/d9/d21/d48/d4d/d81/fdb [0,4194304] 0 2023-12-05T13:25:31.752 INFO:tasks.workunit.client.1.smithi052.stdout:6/995: write d3/d4/d6/de7/f13e [808904,28732] 0 2023-12-05T13:25:31.755 INFO:tasks.workunit.client.1.smithi052.stdout:6/996: mknod d3/d5/d9/d21/d48/d4d/c15d 0 2023-12-05T13:25:31.756 INFO:tasks.workunit.client.1.smithi052.stdout:6/997: write d3/d5/d9/f2f [37893,42624] 0 2023-12-05T13:25:31.757 INFO:tasks.workunit.client.1.smithi052.stdout:5/907: sync 2023-12-05T13:25:31.758 INFO:tasks.workunit.client.1.smithi052.stdout:6/998: dread d3/d5/d9/d21/d48/d4d/d66/d91/fb5 [0,4194304] 0 2023-12-05T13:25:31.758 INFO:tasks.workunit.client.1.smithi052.stdout:6/999: truncate d3/d5/d9/d21/dc4/f12a 742719 0 2023-12-05T13:25:31.771 INFO:tasks.workunit.client.1.smithi052.stdout:5/908: dwrite d5/df/d11/d73/d77/fc3 [0,4194304] 0 2023-12-05T13:25:31.773 INFO:tasks.workunit.client.1.smithi052.stdout:5/909: mkdir d5/df/d4e/d5b/dbf/d12b 0 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/910: creat d5/df/d11/d73/dfe/f12c x:0 0 0 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/911: chown d5/df/d4e/da4/dd6/df1 924451 1 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/912: readlink d5/df/d4e/da4/l11f 0 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/913: dread d5/d15/d21/d4a/d6e/d91/da6/d5c/f6c [0,4194304] 0 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/914: fdatasync d5/d15/d21/d4a/d6e/f113 0 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/915: stat d5/d15/ddc/df7/l10f 0 2023-12-05T13:25:31.777 INFO:tasks.workunit.client.1.smithi052.stdout:5/916: mknod d5/df/d4b/d116/dd7/dea/c12d 0 2023-12-05T13:25:31.778 INFO:tasks.workunit.client.1.smithi052.stdout:5/917: write d5/df/d11/d73/d77/d105/d8f/f115 [901395,29774] 0 2023-12-05T13:25:31.778 INFO:tasks.workunit.client.1.smithi052.stdout:5/918: creat d5/d7f/f12e x:0 0 0 2023-12-05T13:25:31.778 INFO:tasks.workunit.client.1.smithi052.stdout:5/919: chown d5/d15/d21/f2e 3185 1 2023-12-05T13:25:31.779 INFO:tasks.workunit.client.1.smithi052.stdout:5/920: write f4 [4623570,79864] 0 2023-12-05T13:25:31.780 INFO:tasks.workunit.client.1.smithi052.stdout:5/921: unlink d5/df/d11/c9d 0 2023-12-05T13:25:31.802 INFO:tasks.workunit.client.1.smithi052.stdout:5/922: dwrite d5/d15/d21/f75 [0,4194304] 0 2023-12-05T13:25:31.804 INFO:tasks.workunit.client.1.smithi052.stdout:5/923: symlink d5/d15/d21/d4a/l12f 0 2023-12-05T13:25:31.804 INFO:tasks.workunit.client.1.smithi052.stdout:5/924: readlink d5/d15/d21/d4a/d6e/d91/da6/d5c/l83 0 2023-12-05T13:25:31.804 INFO:tasks.workunit.client.1.smithi052.stdout:5/925: getdents d5/d15/ddc 0 2023-12-05T13:25:31.805 INFO:tasks.workunit.client.1.smithi052.stdout:5/926: read d5/df/d11/d66/f6a [964528,15828] 0 2023-12-05T13:25:31.805 INFO:tasks.workunit.client.1.smithi052.stdout:5/927: chown d5/d15/d21/d4a/d6e/d91/da6/d88/dc1/dc4/l129 11587569 1 2023-12-05T13:25:31.817 INFO:tasks.workunit.client.1.smithi052.stdout:5/928: dwrite d5/d15/d21/f2e [0,4194304] 0 2023-12-05T13:25:31.829 INFO:tasks.workunit.client.1.smithi052.stdout:5/929: dwrite d5/df/d4e/d5b/f82 [0,4194304] 0 2023-12-05T13:25:31.844 INFO:tasks.workunit.client.1.smithi052.stdout:5/930: dwrite d5/df/f61 [0,4194304] 0 2023-12-05T13:25:31.845 INFO:tasks.workunit.client.1.smithi052.stdout:5/931: mknod d5/df/d4e/da4/dd6/df1/d11b/c130 0 2023-12-05T13:25:31.846 INFO:tasks.workunit.client.1.smithi052.stdout:5/932: mkdir d5/d15/d21/d4a/d6e/d91/da6/d88/da7/d131 0 2023-12-05T13:25:31.849 INFO:tasks.workunit.client.1.smithi052.stdout:5/933: symlink d5/df/l132 0 2023-12-05T13:25:31.849 INFO:tasks.workunit.client.1.smithi052.stdout:5/934: fdatasync d5/df/d4b/d116/dd7/f103 0 2023-12-05T13:25:31.866 INFO:tasks.workunit.client.1.smithi052.stdout:5/935: dwrite d5/d15/d21/f5e [4194304,4194304] 0 2023-12-05T13:25:31.867 INFO:tasks.workunit.client.1.smithi052.stdout:5/936: mknod d5/df/d11/d73/d77/d105/d8f/d122/c133 0 2023-12-05T13:25:31.869 INFO:tasks.workunit.client.1.smithi052.stdout:5/937: dread d5/df/d11/f2b [0,4194304] 0 2023-12-05T13:25:31.871 INFO:tasks.workunit.client.1.smithi052.stdout:5/938: unlink d5/f14 0 2023-12-05T13:25:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.929+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e04101650 con 0x7f5df0038760 2023-12-05T13:25:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.930+0000 7f5dfa7fc700 1 -- 172.21.15.29:0/3073831421 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f5e04101650 con 0x7f5df0038760 2023-12-05T13:25:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f5df0038760 msgr2=0x7f5df003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f5df0038760 0x7f5df003ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e040657f0 tx=0x7f5e0000b040 comp rx=0 tx=0).stop 2023-12-05T13:25:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 msgr2=0x7f5e0406e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e0406e8c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000c00 tx=0x7f5df4009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 shutdown_connections 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f5df0038760 0x7f5df003ac10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e040fbaf0 0x7f5e04065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 --2- 172.21.15.29:0/3073831421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e040fcd00 0x7f5e0406e8c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 >> 172.21.15.29:0/3073831421 conn(0x7f5e040f7190 msgr2=0x7f5e040fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 shutdown_connections 2023-12-05T13:25:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:31.933+0000 7f5e0bfaf700 1 -- 172.21.15.29:0/3073831421 wait complete. 2023-12-05T13:25:32.025 INFO:tasks.workunit.client.1.smithi052.stdout:5/939: sync 2023-12-05T13:25:32.026 INFO:tasks.workunit.client.1.smithi052.stdout:5/940: symlink d5/df/d11/d73/d77/l134 0 2023-12-05T13:25:32.027 INFO:tasks.workunit.client.1.smithi052.stdout:5/941: mknod d5/df/d11/d73/d77/d105/c135 0 2023-12-05T13:25:32.028 INFO:tasks.workunit.client.1.smithi052.stdout:5/942: write d5/f9 [4636457,57571] 0 2023-12-05T13:25:32.029 INFO:tasks.workunit.client.1.smithi052.stdout:5/943: getdents d5/d15/d21/d4a/d6e/d91/da6/d5c/dab 0 2023-12-05T13:25:32.030 INFO:tasks.workunit.client.1.smithi052.stdout:5/944: mknod d5/d7f/c136 0 2023-12-05T13:25:32.031 INFO:tasks.workunit.client.1.smithi052.stdout:5/945: rename d5/d15/d21/c35 to d5/d15/d21/d4a/c137 0 2023-12-05T13:25:32.032 INFO:tasks.workunit.client.1.smithi052.stdout:5/946: creat d5/d15/d21/d4a/d6e/d91/da6/d88/da7/d131/f138 x:0 0 0 2023-12-05T13:25:32.033 INFO:tasks.workunit.client.1.smithi052.stdout:5/947: mkdir d5/d15/d21/d4a/d6e/d139 0 2023-12-05T13:25:32.039 INFO:tasks.workunit.client.1.smithi052.stdout:5/948: dread f4 [0,4194304] 0 2023-12-05T13:25:32.039 INFO:tasks.workunit.client.1.smithi052.stdout:5/949: truncate d5/df/d11/d73/d77/fa1 807223 0 2023-12-05T13:25:32.040 INFO:tasks.workunit.client.1.smithi052.stdout:5/950: dread d5/d15/d21/d4a/f89 [0,4194304] 0 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.051+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/1532017937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fcd00 msgr2=0x7fe7ec0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.051+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/1532017937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fcd00 0x7fe7ec0fd150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc004940 tx=0x7fe7dc009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.051+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/1532017937 shutdown_connections 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.051+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/1532017937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fcd00 0x7fe7ec0fd150 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.051+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/1532017937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.051+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/1532017937 >> 172.21.15.29:0/1532017937 conn(0x7fe7ec0f7190 msgr2=0x7fe7ec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.052+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/1532017937 shutdown_connections 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.052+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/1532017937 wait complete. 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.052+0000 7fe7f3a9e700 1 Processor -- start 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.052+0000 7fe7f3a9e700 1 -- start start 2023-12-05T13:25:32.055 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f3a9e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec10c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f3a9e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7ec0fcd00 0x7fe7ec10c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f3a9e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec10cfb0 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f3a9e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec10d850 con 0x7fe7ec0fcd00 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f183a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec10c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f183a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec10c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58322/0 (socket says 172.21.15.29:58322) 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f183a700 1 -- 172.21.15.29:0/2622612596 learned_addr learned my addr 172.21.15.29:0/2622612596 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f1039700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7ec0fcd00 0x7fe7ec10c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f183a700 1 -- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7ec0fcd00 msgr2=0x7fe7ec10c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f183a700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7ec0fcd00 0x7fe7ec10c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.056 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.053+0000 7fe7f183a700 1 -- 172.21.15.29:0/2622612596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc005040 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.054+0000 7fe7f183a700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec10c470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800eac0 tx=0x7fe7e8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.054+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e800a980 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.054+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7e800d070 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.054+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ec10dad0 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.055+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e8010da0 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.057 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.055+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ec10e010 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.056+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ec04bb80 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.057+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7fe7e8010600 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.057+0000 7fe7e27fc700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fe7d806ae40 0x7fe7d806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.057+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe7e80896b0 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.058+0000 7fe7f1039700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fe7d806ae40 0x7fe7d806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.058+0000 7fe7f1039700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fe7d806ae40 0x7fe7d806d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00b3b0 tx=0x7fe7dc009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:32.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.063+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe7e8057550 con 0x7fe7ec0fbaf0 2023-12-05T13:25:32.134 INFO:tasks.workunit.client.1.smithi052.stdout:5/951: sync 2023-12-05T13:25:32.136 INFO:tasks.workunit.client.1.smithi052.stdout:5/952: rename d5/d15/l121 to d5/df/d11/d73/d77/d105/d8f/l13a 0 2023-12-05T13:25:32.136 INFO:tasks.workunit.client.1.smithi052.stdout:5/953: getdents d5/df/d4b 0 2023-12-05T13:25:32.137 INFO:tasks.workunit.client.1.smithi052.stdout:5/954: fdatasync d5/d7f/f12e 0 2023-12-05T13:25:32.137 INFO:tasks.workunit.client.1.smithi052.stdout:5/955: symlink d5/df/d4e/da4/d10d/l13b 0 2023-12-05T13:25:32.137 INFO:tasks.workunit.client.1.smithi052.stdout:5/956: chown d5/df/d4b/d116/lec 0 1 2023-12-05T13:25:32.154 INFO:tasks.workunit.client.1.smithi052.stdout:5/957: dwrite f4 [0,4194304] 0 2023-12-05T13:25:32.157 INFO:tasks.workunit.client.1.smithi052.stdout:5/958: dread d5/df/d4e/da4/dd6/f11c [0,4194304] 0 2023-12-05T13:25:32.157 INFO:tasks.workunit.client.1.smithi052.stdout:5/959: chown d5/df/d4e/d5b/fb8 5948958 1 2023-12-05T13:25:32.169 INFO:tasks.workunit.client.1.smithi052.stdout:5/960: dwrite d5/df/d4e/d5b/fb8 [0,4194304] 0 2023-12-05T13:25:32.175 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:31 smithi052 ceph-mon[121072]: Standby manager daemon smithi029.eekhlu started 2023-12-05T13:25:32.175 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:31 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/crt"}]: dispatch 2023-12-05T13:25:32.176 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:31 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:25:32.176 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:31 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/key"}]: dispatch 2023-12-05T13:25:32.176 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:31 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:25:32.176 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:31 smithi052 ceph-mon[121072]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:32.182 INFO:tasks.workunit.client.1.smithi052.stdout:5/961: dwrite d5/d15/d21/d4a/d6e/d91/da6/fe9 [0,4194304] 0 2023-12-05T13:25:32.182 INFO:tasks.workunit.client.1.smithi052.stdout:5/962: write d5/df/d4e/f10a [1297603,74079] 0 2023-12-05T13:25:32.184 INFO:tasks.workunit.client.1.smithi052.stdout:5/963: truncate d5/d15/d21/d25/f6d 1697986 0 2023-12-05T13:25:32.186 INFO:tasks.workunit.client.1.smithi052.stdout:5/964: dread d5/df/d11/d73/d77/d105/fa9 [0,4194304] 0 2023-12-05T13:25:32.186 INFO:tasks.workunit.client.1.smithi052.stdout:5/965: dread - d5/df/d4e/da4/dd6/f101 zero size 2023-12-05T13:25:32.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/966: truncate d5/f7b 228828 0 2023-12-05T13:25:32.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/967: chown d5/df/d11/f2b 6733950 1 2023-12-05T13:25:32.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/968: fsync d5/d15/fe3 0 2023-12-05T13:25:32.187 INFO:tasks.workunit.client.1.smithi052.stdout:5/969: mknod d5/d15/c13c 0 2023-12-05T13:25:32.188 INFO:tasks.workunit.client.1.smithi052.stdout:5/970: read d5/f79 [1976427,90861] 0 2023-12-05T13:25:32.189 INFO:tasks.workunit.client.1.smithi052.stdout:5/971: dread d5/df/d11/d73/d77/d105/fa9 [0,4194304] 0 2023-12-05T13:25:32.190 INFO:tasks.workunit.client.1.smithi052.stdout:5/972: read d5/df/d4e/d5b/f110 [790197,36099] 0 2023-12-05T13:25:32.190 INFO:tasks.workunit.client.1.smithi052.stdout:5/973: readlink d5/d15/ddc/df7/lae 0 2023-12-05T13:25:32.191 INFO:tasks.workunit.client.1.smithi052.stdout:5/974: link d5/df/d11/d73/d77/d105/fa9 d5/d15/f13d 0 2023-12-05T13:25:32.192 INFO:tasks.workunit.client.1.smithi052.stdout:5/975: getdents d5/d7f 0 2023-12-05T13:25:32.194 INFO:tasks.workunit.client.1.smithi052.stdout:5/976: unlink d5/df/lf8 0 2023-12-05T13:25:32.197 INFO:tasks.workunit.client.1.smithi052.stdout:5/977: dread d5/df/d4e/da4/dd6/f11c [0,4194304] 0 2023-12-05T13:25:32.197 INFO:tasks.workunit.client.1.smithi052.stdout:5/978: chown d5/df/d4e/d5b/cda 257002516 1 2023-12-05T13:25:32.198 INFO:tasks.workunit.client.1.smithi052.stdout:5/979: write d5/d15/d21/d4a/d6e/d91/da6/f50 [321456,57627] 0 2023-12-05T13:25:32.198 INFO:tasks.workunit.client.1.smithi052.stdout:5/980: fdatasync d5/d15/fe3 0 2023-12-05T13:25:32.199 INFO:tasks.workunit.client.1.smithi052.stdout:5/981: symlink d5/d46/l13e 0 2023-12-05T13:25:32.207 INFO:tasks.workunit.client.1.smithi052.stdout:5/982: dread d5/d15/d21/f2e [0,4194304] 0 2023-12-05T13:25:32.208 INFO:tasks.workunit.client.1.smithi052.stdout:5/983: creat d5/df/d11/d66/f13f x:0 0 0 2023-12-05T13:25:32.221 INFO:tasks.workunit.client.1.smithi052.stdout:5/984: dwrite d5/d15/f13d [0,4194304] 0 2023-12-05T13:25:32.223 INFO:tasks.workunit.client.1.smithi052.stdout:5/985: dread d5/df/d4b/f4d [0,4194304] 0 2023-12-05T13:25:32.223 INFO:tasks.workunit.client.1.smithi052.stdout:5/986: chown d5/df/l132 1798627589 1 2023-12-05T13:25:32.225 INFO:tasks.workunit.client.1.smithi052.stdout:5/987: dread d5/df/d11/d73/d77/d105/d8f/f115 [0,4194304] 0 2023-12-05T13:25:32.235 INFO:tasks.workunit.client.1.smithi052.stdout:5/988: dread d5/f9 [4194304,4194304] 0 2023-12-05T13:25:32.236 INFO:tasks.workunit.client.1.smithi052.stdout:5/989: creat d5/df/d11/d73/d8b/d123/f140 x:0 0 0 2023-12-05T13:25:32.258 INFO:tasks.workunit.client.1.smithi052.stdout:5/990: dwrite d5/df/d11/d73/d77/d105/fa9 [4194304,4194304] 0 2023-12-05T13:25:32.258 INFO:tasks.workunit.client.1.smithi052.stdout:5/991: write d5/df/d11/d73/d77/d105/d8f/ff9 [1026381,21412] 0 2023-12-05T13:25:32.258 INFO:tasks.workunit.client.1.smithi052.stdout:5/992: chown d5/df/d4e/d5b/dbf/d12b 562373 1 2023-12-05T13:25:32.259 INFO:tasks.workunit.client.1.smithi052.stdout:5/993: dread - d5/df/d11/d73/d77/f126 zero size 2023-12-05T13:25:32.259 INFO:tasks.workunit.client.1.smithi052.stdout:5/994: getdents d5/d15/ddc/df7 0 2023-12-05T13:25:32.259 INFO:tasks.workunit.client.1.smithi052.stdout:5/995: write d5/df/d11/d73/d77/d105/d8f/ff9 [1795769,52632] 0 2023-12-05T13:25:32.259 INFO:tasks.workunit.client.1.smithi052.stdout:5/996: write d5/d15/f13d [2389491,25528] 0 2023-12-05T13:25:32.259 INFO:tasks.workunit.client.1.smithi052.stdout:5/997: write d5/d15/d21/d25/fbd [2499742,116938] 0 2023-12-05T13:25:32.266 INFO:tasks.workunit.client.1.smithi052.stdout:5/998: mkdir d5/d46/d141 0 2023-12-05T13:25:32.268 INFO:tasks.workunit.client.1.smithi052.stdout:5/999: creat d5/df/d4e/da4/dd6/df1/f142 x:0 0 0 2023-12-05T13:25:32.272 INFO:tasks.workunit.client.1.smithi052.stderr:+ rm -rf -- ./tmp.BCBXe5ys8a 2023-12-05T13:25:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.321+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7ec10dc60 con 0x7fe7d806ae40 2023-12-05T13:25:32.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.333+0000 7fe7e27fc700 1 -- 172.21.15.29:0/2622612596 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fe7ec10dc60 con 0x7fe7d806ae40 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (5m) 2m ago 6m 26.4M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (6m) 2m ago 6m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (6m) 15s ago 6m 7490k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (5m) 2m ago 6m 86.6M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (2m) 2m ago 2m 18.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (2m) 2m ago 2m 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (2m) 15s ago 2m 16.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (2m) 15s ago 2m 16.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (7m) 2m ago 7m 495M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (18s) 15s ago 5m 48.5M - 19.0.0-13-ge6605fb8 104f332cd0a9 33d25b025398 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (7m) 2m ago 7m 76.2M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:25:32.335 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (5m) 15s ago 5m 53.3M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (6m) 2m ago 6m 18.2M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 15s ago 5m 17.9M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (5m) 2m ago 5m 56.2M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (4m) 2m ago 4m 59.1M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (4m) 2m ago 4m 53.6M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (4m) 15s ago 4m 434M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (4m) 15s ago 4m 350M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (3m) 15s ago 3m 444M 5324M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:25:32.336 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (5m) 2m ago 6m 48.7M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fe7d806ae40 msgr2=0x7fe7d806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fe7d806ae40 0x7fe7d806d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00b3b0 tx=0x7fe7dc009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 msgr2=0x7fe7ec10c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec10c470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800eac0 tx=0x7fe7e8004470 comp rx=0 tx=0).stop 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 shutdown_connections 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fe7d806ae40 0x7fe7d806d2f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7ec0fbaf0 0x7fe7ec10c470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 --2- 172.21.15.29:0/2622612596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7ec0fcd00 0x7fe7ec10c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.339 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.337+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 >> 172.21.15.29:0/2622612596 conn(0x7fe7ec0f7190 msgr2=0x7fe7ec0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:32.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.338+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 shutdown_connections 2023-12-05T13:25:32.340 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.338+0000 7fe7f3a9e700 1 -- 172.21.15.29:0/2622612596 wait complete. 2023-12-05T13:25:32.358 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:31 smithi029 ceph-mon[112128]: Standby manager daemon smithi029.eekhlu started 2023-12-05T13:25:32.358 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:31 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/crt"}]: dispatch 2023-12-05T13:25:32.358 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:31 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:25:32.359 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:31 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/key"}]: dispatch 2023-12-05T13:25:32.359 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:31 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.29:0/128509160' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:25:32.359 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:31 smithi029 ceph-mon[112128]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:32.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 -- 172.21.15.29:0/2067968251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fbaf0 msgr2=0x7f01ac0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.510 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 --2- 172.21.15.29:0/2067968251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fbaf0 0x7f01ac0fbf00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f01a8004940 tx=0x7f01a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 -- 172.21.15.29:0/2067968251 shutdown_connections 2023-12-05T13:25:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 --2- 172.21.15.29:0/2067968251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01ac0fcd00 0x7f01ac0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 --2- 172.21.15.29:0/2067968251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fbaf0 0x7f01ac0fbf00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 -- 172.21.15.29:0/2067968251 >> 172.21.15.29:0/2067968251 conn(0x7f01ac0f7190 msgr2=0x7f01ac0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.508+0000 7f01b3c36700 1 -- 172.21.15.29:0/2067968251 shutdown_connections 2023-12-05T13:25:32.511 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.509+0000 7f01b3c36700 1 -- 172.21.15.29:0/2067968251 wait complete. 2023-12-05T13:25:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.509+0000 7f01b3c36700 1 Processor -- start 2023-12-05T13:25:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.509+0000 7f01b3c36700 1 -- start start 2023-12-05T13:25:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b3c36700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01ac0fbaf0 0x7f01ac10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b3c36700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 0x7f01ac10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.512 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b3c36700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac10e0c0 con 0x7f01ac0fcd00 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b3c36700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac10e960 con 0x7f01ac0fbaf0 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 0x7f01ac10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b19d2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01ac0fbaf0 0x7f01ac10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 0x7f01ac10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58336/0 (socket says 172.21.15.29:58336) 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 -- 172.21.15.29:0/160510874 learned_addr learned my addr 172.21.15.29:0/160510874 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 -- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01ac0fbaf0 msgr2=0x7f01ac10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01ac0fbaf0 0x7f01ac10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 -- 172.21.15.29:0/160510874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8005040 con 0x7f01ac0fcd00 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01b11d1700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 0x7f01ac10dac0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c8c0 tx=0x7f019c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.510+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019c0106f0 con 0x7f01ac0fcd00 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.511+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac10ec40 con 0x7f01ac0fcd00 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.511+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f019c010d00 con 0x7f01ac0fcd00 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.511+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019c012e90 con 0x7f01ac0fcd00 2023-12-05T13:25:32.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.511+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac10f180 con 0x7f01ac0fcd00 2023-12-05T13:25:32.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.512+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac04bb80 con 0x7f01ac0fcd00 2023-12-05T13:25:32.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.513+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f019c010850 con 0x7f01ac0fcd00 2023-12-05T13:25:32.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.514+0000 7f01a27fc700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f019806ae90 0x7f019806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.514+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f019c0897a0 con 0x7f01ac0fcd00 2023-12-05T13:25:32.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.514+0000 7f01b19d2700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f019806ae90 0x7f019806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.515+0000 7f01b19d2700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f019806ae90 0x7f019806d340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b7d0 tx=0x7f01a8009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:32.521 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.520+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f019c057610 con 0x7f01ac0fcd00 2023-12-05T13:25:32.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.855+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f01ac104490 con 0x7f01ac0fcd00 2023-12-05T13:25:32.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.856+0000 7f01a27fc700 1 -- 172.21.15.29:0/160510874 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f019c0571a0 con 0x7f01ac0fcd00 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:25:32.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:25:32.859 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:25:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.859+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f019806ae90 msgr2=0x7f019806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.859+0000 7f01b3c36700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f019806ae90 0x7f019806d340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b7d0 tx=0x7f01a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 msgr2=0x7f01ac10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 0x7f01ac10dac0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c8c0 tx=0x7f019c0044c0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 shutdown_connections 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f019806ae90 0x7f019806d340 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01ac0fbaf0 0x7f01ac10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 --2- 172.21.15.29:0/160510874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01ac0fcd00 0x7f01ac10dac0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 >> 172.21.15.29:0/160510874 conn(0x7f01ac0f7190 msgr2=0x7f01ac065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 shutdown_connections 2023-12-05T13:25:32.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.860+0000 7f01b3c36700 1 -- 172.21.15.29:0/160510874 wait complete. 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 -- 172.21.15.29:0/2265511966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 msgr2=0x7fcf281044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/2265511966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 0x7fcf281044a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c004940 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 -- 172.21.15.29:0/2265511966 shutdown_connections 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/2265511966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 0x7fcf281044a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/2265511966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf28101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 -- 172.21.15.29:0/2265511966 >> 172.21.15.29:0/2265511966 conn(0x7fcf280f71b0 msgr2=0x7fcf280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 -- 172.21.15.29:0/2265511966 shutdown_connections 2023-12-05T13:25:32.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.992+0000 7fcf2d52c700 1 -- 172.21.15.29:0/2265511966 wait complete. 2023-12-05T13:25:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.993+0000 7fcf2d52c700 1 Processor -- start 2023-12-05T13:25:32.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.993+0000 7fcf2d52c700 1 -- start start 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf2d52c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf2810f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf2d52c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 0x7fcf2810fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf2d52c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28110350 con 0x7fcf281020c0 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf2d52c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28110bf0 con 0x7fcf28066940 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf2810f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf2810f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:39604/0 (socket says 172.21.15.29:39604) 2023-12-05T13:25:32.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 -- 172.21.15.29:0/3114022974 learned_addr learned my addr 172.21.15.29:0/3114022974 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 -- 172.21.15.29:0/3114022974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 msgr2=0x7fcf2810fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 0x7fcf2810fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 -- 172.21.15.29:0/3114022974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c005040 con 0x7fcf28066940 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.994+0000 7fcf26ffd700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf2810f810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800eb40 tx=0x7fcf1800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.995+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf18007cc0 con 0x7fcf28066940 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.995+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf1800f040 con 0x7fcf28066940 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.995+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf18009570 con 0x7fcf28066940 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.995+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf28110e70 con 0x7fcf28066940 2023-12-05T13:25:32.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.995+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf281113b0 con 0x7fcf28066940 2023-12-05T13:25:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.996+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf281096f0 con 0x7fcf28066940 2023-12-05T13:25:32.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.997+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7fcf180096d0 con 0x7fcf28066940 2023-12-05T13:25:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.998+0000 7fcf0f7fe700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1006ae40 0x7fcf1006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:25:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.998+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcf18089430 con 0x7fcf28066940 2023-12-05T13:25:32.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.998+0000 7fcf267fc700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1006ae40 0x7fcf1006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:25:33.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:32.999+0000 7fcf267fc700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1006ae40 0x7fcf1006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009fd0 tx=0x7fcf1c009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:25:33.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.006+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcf1804ece0 con 0x7fcf28066940 2023-12-05T13:25:33.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.296+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf28111690 con 0x7fcf1006ae40 2023-12-05T13:25:33.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.299+0000 7fcf0f7fe700 1 -- 172.21.15.29:0/3114022974 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcf28111690 con 0x7fcf1006ae40 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "1/2 daemons upgraded", 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "", 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:25:33.301 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:25:33.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.303+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1006ae40 msgr2=0x7fcf1006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.303+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1006ae40 0x7fcf1006d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009fd0 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.303+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 msgr2=0x7fcf2810f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.303+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf2810f810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800eb40 tx=0x7fcf1800b040 comp rx=0 tx=0).stop 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.303+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 shutdown_connections 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.304+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1006ae40 0x7fcf1006d2f0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009fd0 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.304+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf28066940 0x7fcf2810f810 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800eb40 tx=0x7fcf1800b040 comp rx=0 tx=0).stop 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.304+0000 7fcf2d52c700 1 --2- 172.21.15.29:0/3114022974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf281020c0 0x7fcf2810fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:25:33.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.304+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 >> 172.21.15.29:0/3114022974 conn(0x7fcf280f71b0 msgr2=0x7fcf280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:25:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.304+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 shutdown_connections 2023-12-05T13:25:33.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:25:33.304+0000 7fcf2d52c700 1 -- 172.21.15.29:0/3114022974 wait complete. 2023-12-05T13:25:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: mgrmap e25: smithi052.ocazcp(active, since 9s), standbys: smithi029.eekhlu 2023-12-05T13:25:33.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:25:33.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:33.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 141 MiB/s wr, 260 op/s 2023-12-05T13:25:33.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:33.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:33.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:32 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/160510874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: mgrmap e25: smithi052.ocazcp(active, since 9s), standbys: smithi029.eekhlu 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: pgmap v8: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 141 MiB/s wr, 260 op/s 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:33.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:32 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/160510874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:25:34.684 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:34 smithi052 ceph-mon[121072]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:34.685 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:34 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:34.685 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:34 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:34.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:34 smithi029 ceph-mon[112128]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:25:34.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:34 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:34 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:35.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:35 smithi029 ceph-mon[112128]: pgmap v9: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 99 MiB/s rd, 198 MiB/s wr, 359 op/s 2023-12-05T13:25:35.894 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:35 smithi052 ceph-mon[121072]: pgmap v9: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 99 MiB/s rd, 198 MiB/s wr, 359 op/s 2023-12-05T13:25:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi052 to 2594M 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:37 smithi029 ceph-mon[112128]: pgmap v10: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 90 MiB/s rd, 182 MiB/s wr, 329 op/s 2023-12-05T13:25:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:25:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi052 to 2594M 2023-12-05T13:25:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:25:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:37 smithi052 ceph-mon[121072]: pgmap v10: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 90 MiB/s rd, 182 MiB/s wr, 329 op/s 2023-12-05T13:25:38.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:38 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:38 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:39 smithi029 ceph-mon[112128]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 90 MiB/s rd, 182 MiB/s wr, 344 op/s 2023-12-05T13:25:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:39 smithi052 ceph-mon[121072]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 90 MiB/s rd, 182 MiB/s wr, 344 op/s 2023-12-05T13:25:41.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:40 smithi029 ceph-mon[112128]: pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 83 MiB/s rd, 170 MiB/s wr, 384 op/s 2023-12-05T13:25:41.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:40 smithi052 ceph-mon[121072]: pgmap v12: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 83 MiB/s rd, 170 MiB/s wr, 384 op/s 2023-12-05T13:25:42.189 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-05T13:25:42.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-05T13:25:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:43 smithi052 ceph-mon[121072]: pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 41 MiB/s rd, 77 MiB/s wr, 205 op/s 2023-12-05T13:25:43.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:43 smithi029 ceph-mon[112128]: pgmap v13: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 41 MiB/s rd, 77 MiB/s wr, 205 op/s 2023-12-05T13:25:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:45 smithi052 ceph-mon[121072]: pgmap v14: 65 pgs: 65 active+clean; 495 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 41 MiB/s rd, 77 MiB/s wr, 264 op/s 2023-12-05T13:25:45.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:45 smithi029 ceph-mon[112128]: pgmap v14: 65 pgs: 65 active+clean; 495 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 41 MiB/s rd, 77 MiB/s wr, 264 op/s 2023-12-05T13:25:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:47 smithi052 ceph-mon[121072]: pgmap v15: 65 pgs: 65 active+clean; 495 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 130 op/s 2023-12-05T13:25:47.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:47 smithi029 ceph-mon[112128]: pgmap v15: 65 pgs: 65 active+clean; 495 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 130 op/s 2023-12-05T13:25:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:49 smithi052 ceph-mon[121072]: pgmap v16: 65 pgs: 65 active+clean; 471 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-12-05T13:25:49.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:49 smithi029 ceph-mon[112128]: pgmap v16: 65 pgs: 65 active+clean; 471 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-12-05T13:25:51.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:50 smithi029 ceph-mon[112128]: pgmap v17: 65 pgs: 65 active+clean; 382 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 1.7 MiB/s wr, 244 op/s 2023-12-05T13:25:51.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:50 smithi052 ceph-mon[121072]: pgmap v17: 65 pgs: 65 active+clean; 382 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 1.7 MiB/s wr, 244 op/s 2023-12-05T13:25:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:53 smithi052 ceph-mon[121072]: pgmap v18: 65 pgs: 65 active+clean; 382 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 188 op/s 2023-12-05T13:25:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:53 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:53.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:53 smithi029 ceph-mon[112128]: pgmap v18: 65 pgs: 65 active+clean; 382 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 188 op/s 2023-12-05T13:25:53.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:53 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:25:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:55 smithi052 ceph-mon[121072]: pgmap v19: 65 pgs: 65 active+clean; 395 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 206 op/s 2023-12-05T13:25:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:55 smithi029 ceph-mon[112128]: pgmap v19: 65 pgs: 65 active+clean; 395 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 206 op/s 2023-12-05T13:25:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:57 smithi052 ceph-mon[121072]: pgmap v20: 65 pgs: 65 active+clean; 395 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 146 op/s 2023-12-05T13:25:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:57 smithi029 ceph-mon[112128]: pgmap v20: 65 pgs: 65 active+clean; 395 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 146 op/s 2023-12-05T13:25:59.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:25:59 smithi052 ceph-mon[121072]: pgmap v21: 65 pgs: 65 active+clean; 394 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 194 op/s 2023-12-05T13:25:59.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:25:59 smithi029 ceph-mon[112128]: pgmap v21: 65 pgs: 65 active+clean; 394 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 194 op/s 2023-12-05T13:26:01.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:00 smithi029 ceph-mon[112128]: pgmap v22: 65 pgs: 65 active+clean; 376 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 15 KiB/s rd, 1.7 MiB/s wr, 254 op/s 2023-12-05T13:26:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:00 smithi052 ceph-mon[121072]: pgmap v22: 65 pgs: 65 active+clean; 376 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 15 KiB/s rd, 1.7 MiB/s wr, 254 op/s 2023-12-05T13:26:03.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 -- 172.21.15.29:0/2428379807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 msgr2=0x7f0570102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 --2- 172.21.15.29:0/2428379807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 0x7f0570102440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0560004940 tx=0x7f0560009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 -- 172.21.15.29:0/2428379807 shutdown_connections 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 --2- 172.21.15.29:0/2428379807 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 0x7f0570102440 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 --2- 172.21.15.29:0/2428379807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f05700ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 -- 172.21.15.29:0/2428379807 >> 172.21.15.29:0/2428379807 conn(0x7f05700f71c0 msgr2=0x7f05700f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 -- 172.21.15.29:0/2428379807 shutdown_connections 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.435+0000 7f0578415700 1 -- 172.21.15.29:0/2428379807 wait complete. 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.436+0000 7f0578415700 1 Processor -- start 2023-12-05T13:26:03.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.436+0000 7f0578415700 1 -- start start 2023-12-05T13:26:03.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.436+0000 7f0578415700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f057010f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:03.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.436+0000 7f0578415700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 0x7f057010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:03.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.436+0000 7f0578415700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570110200 con 0x7f0570100060 2023-12-05T13:26:03.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.436+0000 7f0578415700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570110aa0 con 0x7f05700fd740 2023-12-05T13:26:03.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f057010f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f057010f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:41870/0 (socket says 172.21.15.29:41870) 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 -- 172.21.15.29:0/4185947417 learned_addr learned my addr 172.21.15.29:0/4185947417 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05759b0700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 0x7f057010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 -- 172.21.15.29:0/4185947417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 msgr2=0x7f057010fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 0x7f057010fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 -- 172.21.15.29:0/4185947417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560005040 con 0x7f05700fd740 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.437+0000 7f05761b1700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f057010f6c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f056c00eb40 tx=0x7f056c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.438+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056c007cc0 con 0x7f05700fd740 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.438+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f056c00f040 con 0x7f05700fd740 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.438+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0570110d20 con 0x7f05700fd740 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.438+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056c00c990 con 0x7f05700fd740 2023-12-05T13:26:03.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.438+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0570111260 con 0x7f05700fd740 2023-12-05T13:26:03.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.439+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05540052e0 con 0x7f05700fd740 2023-12-05T13:26:03.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.440+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f056c00cc00 con 0x7f05700fd740 2023-12-05T13:26:03.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.440+0000 7f0566ffd700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f055c06ae40 0x7f055c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:03.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.440+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f056c0893d0 con 0x7f05700fd740 2023-12-05T13:26:03.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.440+0000 7f05759b0700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f055c06ae40 0x7f055c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:03.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.441+0000 7f05759b0700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f055c06ae40 0x7f055c06d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05600135e0 tx=0x7f0560009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:03.446 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.446+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f056c04ece0 con 0x7f05700fd740 2023-12-05T13:26:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.720+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0554000bf0 con 0x7f055c06ae40 2023-12-05T13:26:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.722+0000 7f0566ffd700 1 -- 172.21.15.29:0/4185947417 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0554000bf0 con 0x7f055c06ae40 2023-12-05T13:26:03.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:03 smithi052 ceph-mon[121072]: pgmap v23: 65 pgs: 65 active+clean; 376 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 15 KiB/s rd, 1.6 MiB/s wr, 177 op/s 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f055c06ae40 msgr2=0x7f055c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f055c06ae40 0x7f055c06d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05600135e0 tx=0x7f0560009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 msgr2=0x7f057010f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f057010f6c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f056c00eb40 tx=0x7f056c00b040 comp rx=0 tx=0).stop 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 shutdown_connections 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f055c06ae40 0x7f055c06d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05700fd740 0x7f057010f6c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 --2- 172.21.15.29:0/4185947417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0570100060 0x7f057010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.728+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 >> 172.21.15.29:0/4185947417 conn(0x7f05700f71c0 msgr2=0x7f05700fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.730+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 shutdown_connections 2023-12-05T13:26:03.731 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.731+0000 7f0578415700 1 -- 172.21.15.29:0/4185947417 wait complete. 2023-12-05T13:26:03.750 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:26:03.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:03 smithi029 ceph-mon[112128]: pgmap v23: 65 pgs: 65 active+clean; 376 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 15 KiB/s rd, 1.6 MiB/s wr, 177 op/s 2023-12-05T13:26:03.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.929+0000 7f89bafce700 1 -- 172.21.15.29:0/2184811315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fcd00 msgr2=0x7f89b40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:03.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.929+0000 7f89bafce700 1 --2- 172.21.15.29:0/2184811315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fcd00 0x7f89b40fd150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89a8004940 tx=0x7f89a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:03.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.930+0000 7f89bafce700 1 -- 172.21.15.29:0/2184811315 shutdown_connections 2023-12-05T13:26:03.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.930+0000 7f89bafce700 1 --2- 172.21.15.29:0/2184811315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fcd00 0x7f89b40fd150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.930+0000 7f89bafce700 1 --2- 172.21.15.29:0/2184811315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fbaf0 0x7f89b40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.930+0000 7f89bafce700 1 -- 172.21.15.29:0/2184811315 >> 172.21.15.29:0/2184811315 conn(0x7f89b40f7190 msgr2=0x7f89b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:03.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.931+0000 7f89bafce700 1 -- 172.21.15.29:0/2184811315 shutdown_connections 2023-12-05T13:26:03.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.931+0000 7f89bafce700 1 -- 172.21.15.29:0/2184811315 wait complete. 2023-12-05T13:26:03.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.932+0000 7f89bafce700 1 Processor -- start 2023-12-05T13:26:03.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.932+0000 7f89bafce700 1 -- start start 2023-12-05T13:26:03.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89bafce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fbaf0 0x7f89b410b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89bafce700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 0x7f89b410b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89bafce700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b410be50 con 0x7f89b40fcd00 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89bafce700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b410c6f0 con 0x7f89b40fbaf0 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 0x7f89b410b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 0x7f89b410b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36524/0 (socket says 172.21.15.29:36524) 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b3fff700 1 -- 172.21.15.29:0/2206442218 learned_addr learned my addr 172.21.15.29:0/2206442218 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b8d6a700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fbaf0 0x7f89b410b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b3fff700 1 -- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fbaf0 msgr2=0x7f89b410b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:03.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b3fff700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fbaf0 0x7f89b410b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:03.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.933+0000 7f89b3fff700 1 -- 172.21.15.29:0/2206442218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8005040 con 0x7f89b40fcd00 2023-12-05T13:26:03.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.934+0000 7f89b3fff700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 0x7f89b410b800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000c00 tx=0x7f89a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:03.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.934+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a800e030 con 0x7f89b40fcd00 2023-12-05T13:26:03.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.934+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b410c8f0 con 0x7f89b40fcd00 2023-12-05T13:26:03.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.934+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b410cda0 con 0x7f89b40fcd00 2023-12-05T13:26:03.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.934+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89a801c400 con 0x7f89b40fcd00 2023-12-05T13:26:03.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.935+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a80125e0 con 0x7f89b40fcd00 2023-12-05T13:26:03.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.939+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89980052e0 con 0x7f89b40fcd00 2023-12-05T13:26:03.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.940+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f89a8013ab0 con 0x7f89b40fcd00 2023-12-05T13:26:03.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.940+0000 7f89b17fa700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f89a406aee0 0x7f89a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:03.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.941+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f89a808ae40 con 0x7f89b40fcd00 2023-12-05T13:26:03.941 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.941+0000 7f89b8d6a700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f89a406aee0 0x7f89a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:03.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.941+0000 7f89b8d6a700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f89a406aee0 0x7f89a406d390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89b410b050 tx=0x7f89a000b040 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:03.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:03.948+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f89a8055110 con 0x7f89b40fcd00 2023-12-05T13:26:04.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.190+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8998000bf0 con 0x7f89a406aee0 2023-12-05T13:26:04.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.192+0000 7f89b17fa700 1 -- 172.21.15.29:0/2206442218 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8998000bf0 con 0x7f89a406aee0 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f89a406aee0 msgr2=0x7f89a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f89a406aee0 0x7f89a406d390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89b410b050 tx=0x7f89a000b040 comp rx=0 tx=0).stop 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 msgr2=0x7f89b410b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 0x7f89b410b800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000c00 tx=0x7f89a8009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 shutdown_connections 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f89a406aee0 0x7f89a406d390 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89b40fbaf0 0x7f89b410b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 --2- 172.21.15.29:0/2206442218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89b40fcd00 0x7f89b410b800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 >> 172.21.15.29:0/2206442218 conn(0x7f89b40f7190 msgr2=0x7f89b40f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:04.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.194+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 shutdown_connections 2023-12-05T13:26:04.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.195+0000 7f89bafce700 1 -- 172.21.15.29:0/2206442218 wait complete. 2023-12-05T13:26:04.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 -- 172.21.15.29:0/1531653400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 msgr2=0x7f70e80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/1531653400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e80ffb10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f70d8004940 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:04.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 -- 172.21.15.29:0/1531653400 shutdown_connections 2023-12-05T13:26:04.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/1531653400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70e8100050 0x7f70e8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/1531653400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e80ffb10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 -- 172.21.15.29:0/1531653400 >> 172.21.15.29:0/1531653400 conn(0x7f70e80f7190 msgr2=0x7f70e80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:04.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 -- 172.21.15.29:0/1531653400 shutdown_connections 2023-12-05T13:26:04.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.309+0000 7f70ee9f3700 1 -- 172.21.15.29:0/1531653400 wait complete. 2023-12-05T13:26:04.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.310+0000 7f70ee9f3700 1 Processor -- start 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.310+0000 7f70ee9f3700 1 -- start start 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70ee9f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e810d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70ee9f3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70e8100050 0x7f70e810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70ee9f3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e810e040 con 0x7f70e80fd730 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70ee9f3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e810e8e0 con 0x7f70e8100050 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e810d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e810d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36532/0 (socket says 172.21.15.29:36532) 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 -- 172.21.15.29:0/2142480467 learned_addr learned my addr 172.21.15.29:0/2142480467 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e77fe700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70e8100050 0x7f70e810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 -- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70e8100050 msgr2=0x7f70e810da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70e8100050 0x7f70e810da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 -- 172.21.15.29:0/2142480467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8005040 con 0x7f70e80fd730 2023-12-05T13:26:04.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.311+0000 7f70e7fff700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e810d500 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009360 tx=0x7f70d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:04.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.312+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d800e040 con 0x7f70e80fd730 2023-12-05T13:26:04.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.312+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70d800bcd0 con 0x7f70e80fd730 2023-12-05T13:26:04.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.312+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d801c630 con 0x7f70e80fd730 2023-12-05T13:26:04.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.312+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e810eb60 con 0x7f70e80fd730 2023-12-05T13:26:04.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.313+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e810f070 con 0x7f70e80fd730 2023-12-05T13:26:04.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.314+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e80fae50 con 0x7f70e80fd730 2023-12-05T13:26:04.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.314+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f70d8013960 con 0x7f70e80fd730 2023-12-05T13:26:04.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.315+0000 7f70e4ff9700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f70d006ae40 0x7f70d006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:04.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.315+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f70d808a580 con 0x7f70e80fd730 2023-12-05T13:26:04.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.315+0000 7f70e77fe700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f70d006ae40 0x7f70d006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:04.316 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.316+0000 7f70e77fe700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f70d006ae40 0x7f70d006d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70dc004990 tx=0x7f70dc009ee0 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:04.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.319+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f70d8058420 con 0x7f70e80fd730 2023-12-05T13:26:04.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.575+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f70e810f5c0 con 0x7f70d006ae40 2023-12-05T13:26:04.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.587+0000 7f70e4ff9700 1 -- 172.21.15.29:0/2142480467 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f70e810f5c0 con 0x7f70d006ae40 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (6m) 2m ago 7m 26.4M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (7m) 2m ago 7m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (6m) 31s ago 6m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (6m) 2m ago 7m 86.6M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (3m) 2m ago 3m 18.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (3m) 2m ago 3m 15.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (3m) 31s ago 3m 16.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (3m) 31s ago 3m 16.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (8m) 2m ago 8m 495M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (51s) 31s ago 6m 490M - 19.0.0-13-ge6605fb8 104f332cd0a9 33d25b025398 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (8m) 2m ago 8m 76.2M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:26:04.588 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (6m) 31s ago 6m 57.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (7m) 2m ago 7m 18.2M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (6m) 31s ago 6m 18.0M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (5m) 2m ago 5m 56.2M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (5m) 2m ago 5m 59.1M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (5m) 2m ago 5m 53.6M 4300M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (4m) 31s ago 4m 560M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (4m) 31s ago 4m 440M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (4m) 31s ago 4m 537M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:26:04.589 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (5m) 2m ago 6m 48.7M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f70d006ae40 msgr2=0x7f70d006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f70d006ae40 0x7f70d006d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70dc004990 tx=0x7f70dc009ee0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 msgr2=0x7f70e810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e810d500 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009360 tx=0x7f70d8009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 shutdown_connections 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f70d006ae40 0x7f70d006d2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e80fd730 0x7f70e810d500 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 --2- 172.21.15.29:0/2142480467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70e8100050 0x7f70e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.591 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 >> 172.21.15.29:0/2142480467 conn(0x7f70e80f7190 msgr2=0x7f70e80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:04.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.590+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 shutdown_connections 2023-12-05T13:26:04.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.591+0000 7f70ee9f3700 1 -- 172.21.15.29:0/2142480467 wait complete. 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 -- 172.21.15.29:0/3684070310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 msgr2=0x7f5864101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 --2- 172.21.15.29:0/3684070310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f5864101ba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5858004940 tx=0x7f5858009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 -- 172.21.15.29:0/3684070310 shutdown_connections 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 --2- 172.21.15.29:0/3684070310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 0x7f58641044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 --2- 172.21.15.29:0/3684070310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f5864101ba0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 -- 172.21.15.29:0/3684070310 >> 172.21.15.29:0/3684070310 conn(0x7f58640f71b0 msgr2=0x7f58640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 -- 172.21.15.29:0/3684070310 shutdown_connections 2023-12-05T13:26:04.720 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.719+0000 7f586af69700 1 -- 172.21.15.29:0/3684070310 wait complete. 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f586af69700 1 Processor -- start 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f586af69700 1 -- start start 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f586af69700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f586410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f586af69700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 0x7f586410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f586af69700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58641102a0 con 0x7f5864066920 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f586af69700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864110b40 con 0x7f58641020e0 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.720+0000 7f5868d05700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f586410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5868d05700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f586410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36548/0 (socket says 172.21.15.29:36548) 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5868d05700 1 -- 172.21.15.29:0/3337800881 learned_addr learned my addr 172.21.15.29:0/3337800881 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5863fff700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 0x7f586410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5868d05700 1 -- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 msgr2=0x7f586410fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:04.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5868d05700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 0x7f586410fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:04.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5868d05700 1 -- 172.21.15.29:0/3337800881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858005040 con 0x7f5864066920 2023-12-05T13:26:04.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5863fff700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 0x7f586410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:26:04.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f5868d05700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f586410f760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5858009360 tx=0x7f5858009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:04.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585800e040 con 0x7f5864066920 2023-12-05T13:26:04.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f585800bcd0 con 0x7f5864066920 2023-12-05T13:26:04.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:04 smithi052 ceph-mon[121072]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:04.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5864110dc0 con 0x7f5864066920 2023-12-05T13:26:04.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585801c630 con 0x7f5864066920 2023-12-05T13:26:04.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.721+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5864111300 con 0x7f5864066920 2023-12-05T13:26:04.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.722+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58641097e0 con 0x7f5864066920 2023-12-05T13:26:04.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.723+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f5858013420 con 0x7f5864066920 2023-12-05T13:26:04.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.724+0000 7f58617fa700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f585406ae40 0x7f585406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:04.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.724+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f585808ac00 con 0x7f5864066920 2023-12-05T13:26:04.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.724+0000 7f5863fff700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f585406ae40 0x7f585406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:04.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.725+0000 7f5863fff700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f585406ae40 0x7f585406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5850009fd0 tx=0x7f5850009ee0 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:04.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:04.728+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5858090020 con 0x7f5864066920 2023-12-05T13:26:04.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:04 smithi029 ceph-mon[112128]: from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:05.028 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.028+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f586402b0e0 con 0x7f5864066920 2023-12-05T13:26:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.029+0000 7f58617fa700 1 -- 172.21.15.29:0/3337800881 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f5858058a00 con 0x7f5864066920 2023-12-05T13:26:05.029 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:26:05.029 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:26:05.029 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:26:05.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:05.029 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:26:05.030 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:26:05.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f585406ae40 msgr2=0x7f585406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f585406ae40 0x7f585406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5850009fd0 tx=0x7f5850009ee0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 msgr2=0x7f586410f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f586410f760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5858009360 tx=0x7f5858009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 shutdown_connections 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f585406ae40 0x7f585406d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5864066920 0x7f586410f760 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 --2- 172.21.15.29:0/3337800881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58641020e0 0x7f586410fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 >> 172.21.15.29:0/3337800881 conn(0x7f58640f71b0 msgr2=0x7f58640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 shutdown_connections 2023-12-05T13:26:05.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.031+0000 7f586af69700 1 -- 172.21.15.29:0/3337800881 wait complete. 2023-12-05T13:26:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 -- 172.21.15.29:0/2015126521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 msgr2=0x7f0a240fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 --2- 172.21.15.29:0/2015126521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a240fd160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a18004940 tx=0x7f0a18009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 -- 172.21.15.29:0/2015126521 shutdown_connections 2023-12-05T13:26:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 --2- 172.21.15.29:0/2015126521 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a240fd160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 --2- 172.21.15.29:0/2015126521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a240fbb00 0x7f0a240fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 -- 172.21.15.29:0/2015126521 >> 172.21.15.29:0/2015126521 conn(0x7f0a240f71c0 msgr2=0x7f0a240f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 -- 172.21.15.29:0/2015126521 shutdown_connections 2023-12-05T13:26:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.148+0000 7f0a2a383700 1 -- 172.21.15.29:0/2015126521 wait complete. 2023-12-05T13:26:05.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a2a383700 1 Processor -- start 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a2a383700 1 -- start start 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a2a383700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a240fbb00 0x7f0a2410d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a2a383700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a2410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a2a383700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2410dfe0 con 0x7f0a240fcd10 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a2a383700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2410e880 con 0x7f0a240fbb00 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.149+0000 7f0a237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a2410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:05.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a2410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36568/0 (socket says 172.21.15.29:36568) 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a237fe700 1 -- 172.21.15.29:0/1210388640 learned_addr learned my addr 172.21.15.29:0/1210388640 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a23fff700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a240fbb00 0x7f0a2410d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a237fe700 1 -- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a240fbb00 msgr2=0x7f0a2410d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a237fe700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a240fbb00 0x7f0a2410d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a237fe700 1 -- 172.21.15.29:0/1210388640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18005040 con 0x7f0a240fcd10 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a237fe700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a2410d9e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000c00 tx=0x7f0a18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a18021070 con 0x7f0a240fcd10 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a1801c400 con 0x7f0a240fcd10 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2410eb00 con 0x7f0a240fcd10 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a1800e070 con 0x7f0a240fcd10 2023-12-05T13:26:05.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.150+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2410efe0 con 0x7f0a240fcd10 2023-12-05T13:26:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.151+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2404bb80 con 0x7f0a240fcd10 2023-12-05T13:26:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.152+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f0a1801c9c0 con 0x7f0a240fcd10 2023-12-05T13:26:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.153+0000 7f0a20ff9700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a0c06ae40 0x7f0a0c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:05.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.153+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0a1808aa20 con 0x7f0a240fcd10 2023-12-05T13:26:05.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.153+0000 7f0a23fff700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a0c06ae40 0x7f0a0c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:05.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.153+0000 7f0a23fff700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a0c06ae40 0x7f0a0c06d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009b80 tx=0x7f0a1400b040 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:05.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.158+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0a18058820 con 0x7f0a240fcd10 2023-12-05T13:26:05.423 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.422+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a2410f4b0 con 0x7f0a0c06ae40 2023-12-05T13:26:05.424 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.424+0000 7f0a20ff9700 1 -- 172.21.15.29:0/1210388640 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0a2410f4b0 con 0x7f0a0c06ae40 2023-12-05T13:26:05.424 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:26:05.424 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "1/2 daemons upgraded", 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "", 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:26:05.425 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:26:05.426 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a0c06ae40 msgr2=0x7f0a0c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a0c06ae40 0x7f0a0c06d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009b80 tx=0x7f0a1400b040 comp rx=0 tx=0).stop 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 msgr2=0x7f0a2410d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a2410d9e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000c00 tx=0x7f0a18009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 shutdown_connections 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a0c06ae40 0x7f0a0c06d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a240fbb00 0x7f0a2410d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 --2- 172.21.15.29:0/1210388640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a240fcd10 0x7f0a2410d9e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 >> 172.21.15.29:0/1210388640 conn(0x7f0a240f71c0 msgr2=0x7f0a24065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 shutdown_connections 2023-12-05T13:26:05.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:05.426+0000 7f0a2a383700 1 -- 172.21.15.29:0/1210388640 wait complete. 2023-12-05T13:26:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:05 smithi052 ceph-mon[121072]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:05 smithi052 ceph-mon[121072]: pgmap v24: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 316 op/s 2023-12-05T13:26:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:05 smithi052 ceph-mon[121072]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:05 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3337800881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:26:05.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:05 smithi029 ceph-mon[112128]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:05.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:05 smithi029 ceph-mon[112128]: pgmap v24: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 2.3 MiB/s wr, 316 op/s 2023-12-05T13:26:05.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:05 smithi029 ceph-mon[112128]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:05.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:05 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3337800881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:26:06.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:06 smithi052 ceph-mon[121072]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:06.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:06 smithi029 ceph-mon[112128]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:07 smithi052 ceph-mon[121072]: pgmap v25: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 299 op/s 2023-12-05T13:26:07.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:07 smithi029 ceph-mon[112128]: pgmap v25: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 299 op/s 2023-12-05T13:26:08.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:08 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:08.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:08 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:09 smithi052 ceph-mon[121072]: pgmap v26: 65 pgs: 65 active+clean; 369 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.8 MiB/s wr, 426 op/s 2023-12-05T13:26:09.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:09 smithi029 ceph-mon[112128]: pgmap v26: 65 pgs: 65 active+clean; 369 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.8 MiB/s wr, 426 op/s 2023-12-05T13:26:11.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:10 smithi029 ceph-mon[112128]: pgmap v27: 65 pgs: 65 active+clean; 370 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 423 op/s 2023-12-05T13:26:11.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:10 smithi052 ceph-mon[121072]: pgmap v27: 65 pgs: 65 active+clean; 370 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 423 op/s 2023-12-05T13:26:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:13 smithi052 ceph-mon[121072]: pgmap v28: 65 pgs: 65 active+clean; 370 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 311 op/s 2023-12-05T13:26:13.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:13 smithi029 ceph-mon[112128]: pgmap v28: 65 pgs: 65 active+clean; 370 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 311 op/s 2023-12-05T13:26:15.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:15 smithi052 ceph-mon[121072]: pgmap v29: 65 pgs: 65 active+clean; 374 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 440 op/s 2023-12-05T13:26:15.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:15 smithi029 ceph-mon[112128]: pgmap v29: 65 pgs: 65 active+clean; 374 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 440 op/s 2023-12-05T13:26:17.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:17 smithi052 ceph-mon[121072]: pgmap v30: 65 pgs: 65 active+clean; 374 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 300 op/s 2023-12-05T13:26:17.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:17 smithi029 ceph-mon[112128]: pgmap v30: 65 pgs: 65 active+clean; 374 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 300 op/s 2023-12-05T13:26:19.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/6: sync 2023-12-05T13:26:19.477 INFO:tasks.workunit.client.0.smithi029.stdout:1/46: sync 2023-12-05T13:26:19.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/7: dread - no filename 2023-12-05T13:26:19.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/8: truncate - no filename 2023-12-05T13:26:19.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/9: dwrite - no filename 2023-12-05T13:26:19.477 INFO:tasks.workunit.client.0.smithi029.stdout:2/10: read - no filename 2023-12-05T13:26:19.477 INFO:tasks.workunit.client.0.smithi029.stdout:0/5: sync 2023-12-05T13:26:19.478 INFO:tasks.workunit.client.0.smithi029.stdout:0/6: truncate f0 327759 0 2023-12-05T13:26:19.478 INFO:tasks.workunit.client.0.smithi029.stdout:0/7: truncate f0 1272326 0 2023-12-05T13:26:19.479 INFO:tasks.workunit.client.0.smithi029.stdout:8/19: sync 2023-12-05T13:26:19.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/9: sync 2023-12-05T13:26:19.479 INFO:tasks.workunit.client.0.smithi029.stdout:8/20: chown c3 19724 1 2023-12-05T13:26:19.479 INFO:tasks.workunit.client.0.smithi029.stdout:3/41: sync 2023-12-05T13:26:19.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/15: sync 2023-12-05T13:26:19.479 INFO:tasks.workunit.client.0.smithi029.stdout:9/16: fsync - no filename 2023-12-05T13:26:19.480 INFO:tasks.workunit.client.0.smithi029.stdout:9/17: fsync - no filename 2023-12-05T13:26:19.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/146: sync 2023-12-05T13:26:19.483 INFO:tasks.workunit.client.0.smithi029.stdout:5/36: sync 2023-12-05T13:26:19.483 INFO:tasks.workunit.client.0.smithi029.stdout:7/81: sync 2023-12-05T13:26:19.483 INFO:tasks.workunit.client.0.smithi029.stdout:7/82: readlink d6/df/l14 0 2023-12-05T13:26:19.483 INFO:tasks.workunit.client.0.smithi029.stdout:2/11: stat c1 0 2023-12-05T13:26:19.486 INFO:tasks.workunit.client.0.smithi029.stdout:1/47: unlink d7/fa 0 2023-12-05T13:26:19.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/10: mknod d0/d1/c3 0 2023-12-05T13:26:19.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/11: dwrite - no filename 2023-12-05T13:26:19.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/12: dread - no filename 2023-12-05T13:26:19.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/13: dwrite - no filename 2023-12-05T13:26:19.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/14: dread - no filename 2023-12-05T13:26:19.489 INFO:tasks.workunit.client.0.smithi029.stdout:4/15: write - no filename 2023-12-05T13:26:19.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/42: write d1/f2 [759204,86193] 0 2023-12-05T13:26:19.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/83: dread d6/fa [8388608,4194304] 0 2023-12-05T13:26:19.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/84: write d6/f15 [825615,19024] 0 2023-12-05T13:26:19.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/85: stat c4 0 2023-12-05T13:26:19.498 INFO:tasks.workunit.client.0.smithi029.stdout:8/21: symlink d5/la 0 2023-12-05T13:26:19.503 INFO:tasks.workunit.client.0.smithi029.stdout:5/37: mkdir d1/dc/d10 0 2023-12-05T13:26:19.503 INFO:tasks.workunit.client.0.smithi029.stdout:5/38: truncate d1/fb 1128371 0 2023-12-05T13:26:19.503 INFO:tasks.workunit.client.0.smithi029.stdout:2/12: creat f2 x:0 0 0 2023-12-05T13:26:19.503 INFO:tasks.workunit.client.0.smithi029.stdout:2/13: rmdir - no directory 2023-12-05T13:26:19.506 INFO:tasks.workunit.client.0.smithi029.stdout:4/16: mkdir d0/d1/d4 0 2023-12-05T13:26:19.508 INFO:tasks.workunit.client.0.smithi029.stdout:6/147: dread d6/f10 [0,4194304] 0 2023-12-05T13:26:19.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/8: dwrite f0 [0,4194304] 0 2023-12-05T13:26:19.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/39: mkdir d1/dc/d11 0 2023-12-05T13:26:19.515 INFO:tasks.workunit.client.0.smithi029.stdout:5/40: getdents d1/dc/de 0 2023-12-05T13:26:19.516 INFO:tasks.workunit.client.0.smithi029.stdout:2/14: rename f2 to f3 0 2023-12-05T13:26:19.520 INFO:tasks.workunit.client.0.smithi029.stdout:1/48: dwrite d7/fd [0,4194304] 0 2023-12-05T13:26:19.526 INFO:tasks.workunit.client.0.smithi029.stdout:4/17: creat d0/f5 x:0 0 0 2023-12-05T13:26:19.527 INFO:tasks.workunit.client.0.smithi029.stdout:4/18: write d0/f5 [275537,13145] 0 2023-12-05T13:26:19.527 INFO:tasks.workunit.client.0.smithi029.stdout:6/148: mknod d6/d29/c34 0 2023-12-05T13:26:19.527 INFO:tasks.workunit.client.0.smithi029.stdout:0/9: link f0 f1 0 2023-12-05T13:26:19.531 INFO:tasks.workunit.client.0.smithi029.stdout:7/86: dwrite d6/f13 [0,4194304] 0 2023-12-05T13:26:19.531 INFO:tasks.workunit.client.0.smithi029.stdout:5/41: rename d1/f4 to d1/dc/d11/f12 0 2023-12-05T13:26:19.531 INFO:tasks.workunit.client.0.smithi029.stdout:5/42: write d1/f8 [403769,26990] 0 2023-12-05T13:26:19.534 INFO:tasks.workunit.client.0.smithi029.stdout:6/149: rename d6/l1a to d6/d21/l35 0 2023-12-05T13:26:19.534 INFO:tasks.workunit.client.0.smithi029.stdout:4/19: rename d0/d1/d4 to d0/d1/d6 0 2023-12-05T13:26:19.539 INFO:tasks.workunit.client.0.smithi029.stdout:5/43: rename d1/ca to d1/dc/c13 0 2023-12-05T13:26:19.541 INFO:tasks.workunit.client.0.smithi029.stdout:6/150: mkdir d6/d1d/d36 0 2023-12-05T13:26:19.541 INFO:tasks.workunit.client.0.smithi029.stdout:6/151: readlink d6/d21/l33 0 2023-12-05T13:26:19.542 INFO:tasks.workunit.client.0.smithi029.stdout:4/20: creat d0/d1/f7 x:0 0 0 2023-12-05T13:26:19.542 INFO:tasks.workunit.client.0.smithi029.stdout:4/21: readlink - no filename 2023-12-05T13:26:19.542 INFO:tasks.workunit.client.0.smithi029.stdout:4/22: chown d0 26119 1 2023-12-05T13:26:19.543 INFO:tasks.workunit.client.0.smithi029.stdout:4/23: dread - d0/d1/f7 zero size 2023-12-05T13:26:19.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/44: unlink d1/f8 0 2023-12-05T13:26:19.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/45: fdatasync d1/fb 0 2023-12-05T13:26:19.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/46: rename d1/dc/d11 to d1/dc/d11/d14 22 2023-12-05T13:26:19.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/47: chown d1/l9 0 1 2023-12-05T13:26:19.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/48: write d1/fb [1910651,59983] 0 2023-12-05T13:26:19.544 INFO:tasks.workunit.client.0.smithi029.stdout:4/24: symlink d0/d1/d6/l8 0 2023-12-05T13:26:19.544 INFO:tasks.workunit.client.0.smithi029.stdout:6/152: write d6/fc [292346,78764] 0 2023-12-05T13:26:19.544 INFO:tasks.workunit.client.0.smithi029.stdout:1/49: dwrite d7/fc [0,4194304] 0 2023-12-05T13:26:19.544 INFO:tasks.workunit.client.0.smithi029.stdout:1/50: stat d7/f9 0 2023-12-05T13:26:19.544 INFO:tasks.workunit.client.0.smithi029.stdout:1/51: write f5 [1008116,80549] 0 2023-12-05T13:26:19.548 INFO:tasks.workunit.client.0.smithi029.stdout:3/43: dwrite d1/d6/fa [0,4194304] 0 2023-12-05T13:26:19.550 INFO:tasks.workunit.client.0.smithi029.stdout:4/25: symlink d0/d1/l9 0 2023-12-05T13:26:19.553 INFO:tasks.workunit.client.0.smithi029.stdout:7/87: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:19.556 INFO:tasks.workunit.client.0.smithi029.stdout:1/52: symlink d7/le 0 2023-12-05T13:26:19.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/44: creat d1/d6/fb x:0 0 0 2023-12-05T13:26:19.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/45: write d1/d6/fa [5059416,7702] 0 2023-12-05T13:26:19.559 INFO:tasks.workunit.client.0.smithi029.stdout:3/46: readlink d1/l8 0 2023-12-05T13:26:19.559 INFO:tasks.workunit.client.0.smithi029.stdout:7/88: symlink d6/l16 0 2023-12-05T13:26:19.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/22: getdents d5 0 2023-12-05T13:26:19.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/23: fsync f4 0 2023-12-05T13:26:19.567 INFO:tasks.workunit.client.0.smithi029.stdout:7/89: creat d6/df/f17 x:0 0 0 2023-12-05T13:26:19.567 INFO:tasks.workunit.client.0.smithi029.stdout:1/53: dread d7/fc [0,4194304] 0 2023-12-05T13:26:19.567 INFO:tasks.workunit.client.0.smithi029.stdout:8/24: rmdir d5/d6 39 2023-12-05T13:26:19.568 INFO:tasks.workunit.client.0.smithi029.stdout:7/90: dread d6/f9 [0,4194304] 0 2023-12-05T13:26:19.568 INFO:tasks.workunit.client.0.smithi029.stdout:7/91: write d6/f11 [432572,19189] 0 2023-12-05T13:26:19.571 INFO:tasks.workunit.client.0.smithi029.stdout:7/92: dread d6/f9 [0,4194304] 0 2023-12-05T13:26:19.574 INFO:tasks.workunit.client.0.smithi029.stdout:7/93: mknod d6/c18 0 2023-12-05T13:26:19.574 INFO:tasks.workunit.client.0.smithi029.stdout:7/94: chown d6/df 156706 1 2023-12-05T13:26:19.574 INFO:tasks.workunit.client.0.smithi029.stdout:7/95: chown d6/ce 21035172 1 2023-12-05T13:26:19.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/26: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:26:19.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/49: link d1/dc/c13 d1/dc/c15 0 2023-12-05T13:26:19.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/50: chown d1/dc/d11 0 1 2023-12-05T13:26:19.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/10: fsync f1 0 2023-12-05T13:26:19.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/11: chown f1 106738822 1 2023-12-05T13:26:19.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/12: fsync f1 0 2023-12-05T13:26:19.596 INFO:tasks.workunit.client.0.smithi029.stdout:0/13: write f0 [4850677,19330] 0 2023-12-05T13:26:19.596 INFO:tasks.workunit.client.0.smithi029.stdout:7/96: dwrite d6/f15 [0,4194304] 0 2023-12-05T13:26:19.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/14: write f1 [580850,12512] 0 2023-12-05T13:26:19.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/51: mknod d1/c16 0 2023-12-05T13:26:19.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/97: mkdir d6/d19 0 2023-12-05T13:26:19.612 INFO:tasks.workunit.client.0.smithi029.stdout:1/54: getdents d7 0 2023-12-05T13:26:19.620 INFO:tasks.workunit.client.0.smithi029.stdout:4/27: dwrite d0/d1/f7 [0,4194304] 0 2023-12-05T13:26:19.620 INFO:tasks.workunit.client.0.smithi029.stdout:4/28: chown d0/d1/l9 205664320 1 2023-12-05T13:26:19.622 INFO:tasks.workunit.client.0.smithi029.stdout:5/52: dread d1/f7 [0,4194304] 0 2023-12-05T13:26:19.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/47: dwrite d1/d6/fa [0,4194304] 0 2023-12-05T13:26:19.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/48: chown d1 288 1 2023-12-05T13:26:19.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/49: fsync d1/d6/fa 0 2023-12-05T13:26:19.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/50: rename d1/d6 to d1/d6/dc 22 2023-12-05T13:26:19.629 INFO:tasks.workunit.client.0.smithi029.stdout:5/53: mkdir d1/dc/d11/d17 0 2023-12-05T13:26:19.629 INFO:tasks.workunit.client.0.smithi029.stdout:5/54: chown d1/c16 48 1 2023-12-05T13:26:19.629 INFO:tasks.workunit.client.0.smithi029.stdout:5/55: fsync d1/dc/d11/f12 0 2023-12-05T13:26:19.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/29: dread d0/f5 [0,4194304] 0 2023-12-05T13:26:19.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/30: write d0/f5 [633974,130171] 0 2023-12-05T13:26:19.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/56: symlink d1/dc/d11/d17/l18 0 2023-12-05T13:26:19.632 INFO:tasks.workunit.client.0.smithi029.stdout:5/57: stat d1/dc/d10 0 2023-12-05T13:26:19.637 INFO:tasks.workunit.client.0.smithi029.stdout:4/31: rename d0/d1/d6 to d0/da 0 2023-12-05T13:26:19.640 INFO:tasks.workunit.client.0.smithi029.stdout:7/98: dwrite d6/f9 [0,4194304] 0 2023-12-05T13:26:19.640 INFO:tasks.workunit.client.0.smithi029.stdout:7/99: chown l5 17554 1 2023-12-05T13:26:19.641 INFO:tasks.workunit.client.0.smithi029.stdout:4/32: creat d0/da/fb x:0 0 0 2023-12-05T13:26:19.645 INFO:tasks.workunit.client.0.smithi029.stdout:7/100: mkdir d6/df/d1a 0 2023-12-05T13:26:19.645 INFO:tasks.workunit.client.0.smithi029.stdout:7/101: read - d6/df/f17 zero size 2023-12-05T13:26:19.647 INFO:tasks.workunit.client.0.smithi029.stdout:4/33: creat d0/d1/fc x:0 0 0 2023-12-05T13:26:19.648 INFO:tasks.workunit.client.0.smithi029.stdout:1/55: dwrite f3 [0,4194304] 0 2023-12-05T13:26:19.650 INFO:tasks.workunit.client.0.smithi029.stdout:0/15: dwrite f0 [4194304,4194304] 0 2023-12-05T13:26:19.650 INFO:tasks.workunit.client.0.smithi029.stdout:8/25: dwrite d5/d6/f9 [4194304,4194304] 0 2023-12-05T13:26:19.651 INFO:tasks.workunit.client.0.smithi029.stdout:4/34: mknod d0/da/cd 0 2023-12-05T13:26:19.651 INFO:tasks.workunit.client.0.smithi029.stdout:4/35: write d0/da/fb [854733,116103] 0 2023-12-05T13:26:19.651 INFO:tasks.workunit.client.0.smithi029.stdout:1/56: mkdir d7/df 0 2023-12-05T13:26:19.654 INFO:tasks.workunit.client.0.smithi029.stdout:3/51: truncate d1/d6/fa 3902267 0 2023-12-05T13:26:19.655 INFO:tasks.workunit.client.0.smithi029.stdout:5/58: getdents d1/dc/d11/d17 0 2023-12-05T13:26:19.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/16: mknod c2 0 2023-12-05T13:26:19.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/17: chown f0 3665 1 2023-12-05T13:26:19.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/26: symlink d5/d6/lb 0 2023-12-05T13:26:19.660 INFO:tasks.workunit.client.0.smithi029.stdout:7/102: dwrite d6/df/f17 [0,4194304] 0 2023-12-05T13:26:19.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/27: write d5/d6/f9 [2531937,35580] 0 2023-12-05T13:26:19.662 INFO:tasks.workunit.client.0.smithi029.stdout:8/28: write f4 [187266,115818] 0 2023-12-05T13:26:19.662 INFO:tasks.workunit.client.0.smithi029.stdout:8/29: read d5/d6/f9 [1843359,123767] 0 2023-12-05T13:26:19.663 INFO:tasks.workunit.client.0.smithi029.stdout:8/30: read d5/d6/f9 [4350087,39711] 0 2023-12-05T13:26:19.664 INFO:tasks.workunit.client.0.smithi029.stdout:4/36: mkdir d0/de 0 2023-12-05T13:26:19.664 INFO:tasks.workunit.client.0.smithi029.stdout:4/37: dread - d0/d1/fc zero size 2023-12-05T13:26:19.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/52: creat d1/fd x:0 0 0 2023-12-05T13:26:19.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/53: truncate d1/fd 36958 0 2023-12-05T13:26:19.665 INFO:tasks.workunit.client.0.smithi029.stdout:3/54: readlink d1/l8 0 2023-12-05T13:26:19.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/38: fsync d0/da/fb 0 2023-12-05T13:26:19.668 INFO:tasks.workunit.client.0.smithi029.stdout:1/57: dwrite f3 [0,4194304] 0 2023-12-05T13:26:19.668 INFO:tasks.workunit.client.0.smithi029.stdout:1/58: stat d7/fd 0 2023-12-05T13:26:19.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/59: rmdir d1 39 2023-12-05T13:26:19.671 INFO:tasks.workunit.client.0.smithi029.stdout:0/18: symlink l3 0 2023-12-05T13:26:19.678 INFO:tasks.workunit.client.0.smithi029.stdout:7/103: symlink d6/l1b 0 2023-12-05T13:26:19.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/55: mknod d1/ce 0 2023-12-05T13:26:19.687 INFO:tasks.workunit.client.0.smithi029.stdout:4/39: rename d0/da/cd to d0/da/cf 0 2023-12-05T13:26:19.687 INFO:tasks.workunit.client.0.smithi029.stdout:4/40: readlink d0/d1/l9 0 2023-12-05T13:26:19.687 INFO:tasks.workunit.client.0.smithi029.stdout:4/41: stat d0/d1/c3 0 2023-12-05T13:26:19.690 INFO:tasks.workunit.client.0.smithi029.stdout:1/59: rename c1 to d7/c10 0 2023-12-05T13:26:19.690 INFO:tasks.workunit.client.0.smithi029.stdout:5/60: link d1/dc/d11/f12 d1/dc/de/f19 0 2023-12-05T13:26:19.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/19: creat f4 x:0 0 0 2023-12-05T13:26:19.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/31: mkdir d5/dc 0 2023-12-05T13:26:19.696 INFO:tasks.workunit.client.0.smithi029.stdout:4/42: dread d0/f5 [0,4194304] 0 2023-12-05T13:26:19.696 INFO:tasks.workunit.client.0.smithi029.stdout:1/60: rename d7/le to d7/l11 0 2023-12-05T13:26:19.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/32: mknod d5/dc/cd 0 2023-12-05T13:26:19.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/61: dread d1/fb [0,4194304] 0 2023-12-05T13:26:19.702 INFO:tasks.workunit.client.0.smithi029.stdout:8/33: write d5/d6/f9 [2448978,28150] 0 2023-12-05T13:26:19.702 INFO:tasks.workunit.client.0.smithi029.stdout:8/34: write f4 [1299872,31049] 0 2023-12-05T13:26:19.702 INFO:tasks.workunit.client.0.smithi029.stdout:4/43: symlink d0/da/l10 0 2023-12-05T13:26:19.702 INFO:tasks.workunit.client.0.smithi029.stdout:4/44: dread - d0/d1/fc zero size 2023-12-05T13:26:19.704 INFO:tasks.workunit.client.0.smithi029.stdout:5/62: write d1/f7 [3105492,77229] 0 2023-12-05T13:26:19.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/63: read d1/fb [1947416,104370] 0 2023-12-05T13:26:19.705 INFO:tasks.workunit.client.0.smithi029.stdout:7/104: dwrite f1 [4194304,4194304] 0 2023-12-05T13:26:19.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/35: creat d5/fe x:0 0 0 2023-12-05T13:26:19.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/36: chown c3 10 1 2023-12-05T13:26:19.713 INFO:tasks.workunit.client.0.smithi029.stdout:5/64: creat d1/dc/de/f1a x:0 0 0 2023-12-05T13:26:19.713 INFO:tasks.workunit.client.0.smithi029.stdout:5/65: readlink l0 0 2023-12-05T13:26:19.713 INFO:tasks.workunit.client.0.smithi029.stdout:5/66: truncate d1/dc/de/f19 2022450 0 2023-12-05T13:26:19.717 INFO:tasks.workunit.client.0.smithi029.stdout:7/105: unlink d6/fa 0 2023-12-05T13:26:19.717 INFO:tasks.workunit.client.0.smithi029.stdout:7/106: write d6/fc [2581221,35754] 0 2023-12-05T13:26:19.718 INFO:tasks.workunit.client.0.smithi029.stdout:8/37: creat d5/dc/ff x:0 0 0 2023-12-05T13:26:19.719 INFO:tasks.workunit.client.0.smithi029.stdout:8/38: chown d5/dc/cd 56 1 2023-12-05T13:26:19.721 INFO:tasks.workunit.client.0.smithi029.stdout:3/56: dwrite d1/d6/fa [0,4194304] 0 2023-12-05T13:26:19.722 INFO:tasks.workunit.client.0.smithi029.stdout:4/45: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:26:19.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:19 smithi052 ceph-mon[121072]: pgmap v31: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 416 op/s 2023-12-05T13:26:19.723 INFO:tasks.workunit.client.0.smithi029.stdout:0/20: getdents . 0 2023-12-05T13:26:19.724 INFO:tasks.workunit.client.0.smithi029.stdout:1/61: dwrite d7/f9 [0,4194304] 0 2023-12-05T13:26:19.724 INFO:tasks.workunit.client.0.smithi029.stdout:1/62: dread - d7/fb zero size 2023-12-05T13:26:19.726 INFO:tasks.workunit.client.0.smithi029.stdout:5/67: creat d1/dc/f1b x:0 0 0 2023-12-05T13:26:19.731 INFO:tasks.workunit.client.0.smithi029.stdout:7/107: symlink d6/d19/l1c 0 2023-12-05T13:26:19.732 INFO:tasks.workunit.client.0.smithi029.stdout:0/21: mknod c5 0 2023-12-05T13:26:19.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/22: creat f6 x:0 0 0 2023-12-05T13:26:19.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/63: mkdir d7/df/d12 0 2023-12-05T13:26:19.741 INFO:tasks.workunit.client.0.smithi029.stdout:8/39: dwrite d5/d6/f9 [4194304,4194304] 0 2023-12-05T13:26:19.742 INFO:tasks.workunit.client.0.smithi029.stdout:0/23: unlink c2 0 2023-12-05T13:26:19.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/64: creat d7/f13 x:0 0 0 2023-12-05T13:26:19.746 INFO:tasks.workunit.client.0.smithi029.stdout:3/57: dwrite d1/d6/fb [0,4194304] 0 2023-12-05T13:26:19.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/40: mkdir d5/d6/d10 0 2023-12-05T13:26:19.750 INFO:tasks.workunit.client.0.smithi029.stdout:0/24: write f4 [218136,121041] 0 2023-12-05T13:26:19.751 INFO:tasks.workunit.client.0.smithi029.stdout:8/41: fsync d5/fe 0 2023-12-05T13:26:19.753 INFO:tasks.workunit.client.0.smithi029.stdout:1/65: creat d7/df/f14 x:0 0 0 2023-12-05T13:26:19.753 INFO:tasks.workunit.client.0.smithi029.stdout:4/46: dwrite d0/da/fb [0,4194304] 0 2023-12-05T13:26:19.755 INFO:tasks.workunit.client.0.smithi029.stdout:5/68: dwrite d1/f7 [0,4194304] 0 2023-12-05T13:26:19.755 INFO:tasks.workunit.client.0.smithi029.stdout:5/69: chown d1/fb 4 1 2023-12-05T13:26:19.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/66: dread d7/fc [0,4194304] 0 2023-12-05T13:26:19.760 INFO:tasks.workunit.client.0.smithi029.stdout:3/58: creat d1/d6/ff x:0 0 0 2023-12-05T13:26:19.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/47: mknod d0/d1/c11 0 2023-12-05T13:26:19.769 INFO:tasks.workunit.client.0.smithi029.stdout:7/108: truncate d6/f15 3917204 0 2023-12-05T13:26:19.769 INFO:tasks.workunit.client.0.smithi029.stdout:7/109: chown d6/df/f17 105834 1 2023-12-05T13:26:19.773 INFO:tasks.workunit.client.0.smithi029.stdout:8/42: dwrite f4 [0,4194304] 0 2023-12-05T13:26:19.773 INFO:tasks.workunit.client.0.smithi029.stdout:5/70: link d1/dc/c15 d1/dc/d10/c1c 0 2023-12-05T13:26:19.776 INFO:tasks.workunit.client.0.smithi029.stdout:4/48: dread d0/f5 [0,4194304] 0 2023-12-05T13:26:19.784 INFO:tasks.workunit.client.0.smithi029.stdout:7/110: dwrite d6/f11 [0,4194304] 0 2023-12-05T13:26:19.784 INFO:tasks.workunit.client.0.smithi029.stdout:1/67: truncate d7/fd 1356514 0 2023-12-05T13:26:19.785 INFO:tasks.workunit.client.0.smithi029.stdout:1/68: write d7/fc [4190480,60476] 0 2023-12-05T13:26:19.786 INFO:tasks.workunit.client.0.smithi029.stdout:3/59: rmdir d1 39 2023-12-05T13:26:19.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/43: symlink d5/dc/l11 0 2023-12-05T13:26:19.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/44: dread - d5/fe zero size 2023-12-05T13:26:19.789 INFO:tasks.workunit.client.0.smithi029.stdout:5/71: mkdir d1/d1d 0 2023-12-05T13:26:19.792 INFO:tasks.workunit.client.0.smithi029.stdout:4/49: mknod d0/da/c12 0 2023-12-05T13:26:19.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/111: symlink d6/df/l1d 0 2023-12-05T13:26:19.798 INFO:tasks.workunit.client.0.smithi029.stdout:8/45: dread d5/d6/f9 [0,4194304] 0 2023-12-05T13:26:19.798 INFO:tasks.workunit.client.0.smithi029.stdout:8/46: chown c2 11539405 1 2023-12-05T13:26:19.799 INFO:tasks.workunit.client.0.smithi029.stdout:3/60: mkdir d1/d10 0 2023-12-05T13:26:19.800 INFO:tasks.workunit.client.0.smithi029.stdout:3/61: write d1/d6/ff [868047,122118] 0 2023-12-05T13:26:19.801 INFO:tasks.workunit.client.0.smithi029.stdout:4/50: rename d0/da/l10 to d0/l13 0 2023-12-05T13:26:19.804 INFO:tasks.workunit.client.0.smithi029.stdout:3/62: mkdir d1/d6/d11 0 2023-12-05T13:26:19.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/47: dread d5/d6/f9 [4194304,4194304] 0 2023-12-05T13:26:19.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/48: readlink l1 0 2023-12-05T13:26:19.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/49: dread - d5/fe zero size 2023-12-05T13:26:19.806 INFO:tasks.workunit.client.0.smithi029.stdout:5/72: dwrite d1/dc/f1b [0,4194304] 0 2023-12-05T13:26:19.806 INFO:tasks.workunit.client.0.smithi029.stdout:5/73: chown l0 139086 1 2023-12-05T13:26:19.806 INFO:tasks.workunit.client.0.smithi029.stdout:5/74: truncate d1/dc/d11/f12 2924428 0 2023-12-05T13:26:19.809 INFO:tasks.workunit.client.0.smithi029.stdout:4/51: rename d0/d1/c3 to d0/c14 0 2023-12-05T13:26:19.810 INFO:tasks.workunit.client.0.smithi029.stdout:1/69: dread d7/fd [0,4194304] 0 2023-12-05T13:26:19.813 INFO:tasks.workunit.client.0.smithi029.stdout:3/63: link d1/fd d1/d6/d11/f12 0 2023-12-05T13:26:19.815 INFO:tasks.workunit.client.0.smithi029.stdout:8/50: getdents d5/d6 0 2023-12-05T13:26:19.822 INFO:tasks.workunit.client.0.smithi029.stdout:5/75: mkdir d1/dc/d10/d1e 0 2023-12-05T13:26:19.824 INFO:tasks.workunit.client.0.smithi029.stdout:4/52: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:26:19.827 INFO:tasks.workunit.client.0.smithi029.stdout:3/64: symlink d1/d10/l13 0 2023-12-05T13:26:19.827 INFO:tasks.workunit.client.0.smithi029.stdout:3/65: chown d1/d6/d11 97508 1 2023-12-05T13:26:19.828 INFO:tasks.workunit.client.0.smithi029.stdout:8/51: creat d5/d6/f12 x:0 0 0 2023-12-05T13:26:19.828 INFO:tasks.workunit.client.0.smithi029.stdout:8/52: chown d5/d6 613257 1 2023-12-05T13:26:19.832 INFO:tasks.workunit.client.0.smithi029.stdout:5/76: symlink d1/dc/d11/l1f 0 2023-12-05T13:26:19.832 INFO:tasks.workunit.client.0.smithi029.stdout:5/77: chown d1/dc/d10 40482 1 2023-12-05T13:26:19.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/53: mkdir d0/de/d15 0 2023-12-05T13:26:19.836 INFO:tasks.workunit.client.0.smithi029.stdout:1/70: truncate d7/fc 2873244 0 2023-12-05T13:26:19.839 INFO:tasks.workunit.client.0.smithi029.stdout:3/66: creat d1/d6/f14 x:0 0 0 2023-12-05T13:26:19.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/67: getdents d1 0 2023-12-05T13:26:19.848 INFO:tasks.workunit.client.0.smithi029.stdout:3/68: write d1/fd [124011,123064] 0 2023-12-05T13:26:19.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/53: mkdir d5/d6/d10/d13 0 2023-12-05T13:26:19.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/54: readlink l1 0 2023-12-05T13:26:19.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:19 smithi029 ceph-mon[112128]: pgmap v31: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 416 op/s 2023-12-05T13:26:19.855 INFO:tasks.workunit.client.0.smithi029.stdout:1/71: dwrite d7/fd [0,4194304] 0 2023-12-05T13:26:19.861 INFO:tasks.workunit.client.0.smithi029.stdout:3/69: dwrite d1/d6/ff [0,4194304] 0 2023-12-05T13:26:19.862 INFO:tasks.workunit.client.0.smithi029.stdout:3/70: truncate d1/d6/fa 4406526 0 2023-12-05T13:26:19.862 INFO:tasks.workunit.client.0.smithi029.stdout:3/71: write d1/d6/f14 [490676,62604] 0 2023-12-05T13:26:19.862 INFO:tasks.workunit.client.0.smithi029.stdout:8/55: truncate f4 2166345 0 2023-12-05T13:26:19.864 INFO:tasks.workunit.client.0.smithi029.stdout:1/72: dread f3 [0,4194304] 0 2023-12-05T13:26:19.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/72: symlink d1/l15 0 2023-12-05T13:26:19.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/56: unlink d5/dc/cd 0 2023-12-05T13:26:19.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/57: dread - d5/d6/f12 zero size 2023-12-05T13:26:19.874 INFO:tasks.workunit.client.0.smithi029.stdout:3/73: mkdir d1/d16 0 2023-12-05T13:26:19.874 INFO:tasks.workunit.client.0.smithi029.stdout:1/73: dread d7/f9 [0,4194304] 0 2023-12-05T13:26:19.879 INFO:tasks.workunit.client.0.smithi029.stdout:3/74: mknod d1/d6/c17 0 2023-12-05T13:26:19.879 INFO:tasks.workunit.client.0.smithi029.stdout:3/75: readlink d1/l15 0 2023-12-05T13:26:19.880 INFO:tasks.workunit.client.0.smithi029.stdout:3/76: readlink d1/l8 0 2023-12-05T13:26:19.880 INFO:tasks.workunit.client.0.smithi029.stdout:1/74: rename d7/df/f14 to d7/df/f15 0 2023-12-05T13:26:19.881 INFO:tasks.workunit.client.0.smithi029.stdout:1/75: chown d7/fb 93724 1 2023-12-05T13:26:19.882 INFO:tasks.workunit.client.0.smithi029.stdout:8/58: link c3 d5/c14 0 2023-12-05T13:26:19.882 INFO:tasks.workunit.client.0.smithi029.stdout:3/77: truncate d1/d6/ff 75600 0 2023-12-05T13:26:19.883 INFO:tasks.workunit.client.0.smithi029.stdout:3/78: read d1/d6/f14 [298355,93997] 0 2023-12-05T13:26:19.883 INFO:tasks.workunit.client.0.smithi029.stdout:3/79: write d1/fd [436316,35095] 0 2023-12-05T13:26:19.886 INFO:tasks.workunit.client.0.smithi029.stdout:1/76: link d7/fb d7/df/f16 0 2023-12-05T13:26:19.890 INFO:tasks.workunit.client.0.smithi029.stdout:8/59: rename d5/c14 to d5/dc/c15 0 2023-12-05T13:26:19.898 INFO:tasks.workunit.client.0.smithi029.stdout:1/77: dwrite d7/df/f15 [0,4194304] 0 2023-12-05T13:26:19.898 INFO:tasks.workunit.client.0.smithi029.stdout:1/78: truncate d7/df/f16 436034 0 2023-12-05T13:26:19.906 INFO:tasks.workunit.client.0.smithi029.stdout:8/60: symlink d5/d6/l16 0 2023-12-05T13:26:19.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/61: write d5/dc/ff [143245,8999] 0 2023-12-05T13:26:19.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/62: write f4 [1395318,123848] 0 2023-12-05T13:26:19.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/63: mkdir d5/dc/d17 0 2023-12-05T13:26:19.911 INFO:tasks.workunit.client.0.smithi029.stdout:8/64: mkdir d5/dc/d18 0 2023-12-05T13:26:19.914 INFO:tasks.workunit.client.0.smithi029.stdout:8/65: unlink d5/d6/f12 0 2023-12-05T13:26:19.916 INFO:tasks.workunit.client.0.smithi029.stdout:8/66: creat d5/d6/d10/d13/f19 x:0 0 0 2023-12-05T13:26:19.919 INFO:tasks.workunit.client.0.smithi029.stdout:1/79: write d7/f8 [1891927,61044] 0 2023-12-05T13:26:19.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/67: rmdir d5/d6/d10/d13 39 2023-12-05T13:26:19.931 INFO:tasks.workunit.client.0.smithi029.stdout:8/68: dread d5/d6/f9 [4194304,4194304] 0 2023-12-05T13:26:19.941 INFO:tasks.workunit.client.0.smithi029.stdout:1/80: dwrite f5 [0,4194304] 0 2023-12-05T13:26:19.941 INFO:tasks.workunit.client.0.smithi029.stdout:1/81: fdatasync d7/fc 0 2023-12-05T13:26:19.942 INFO:tasks.workunit.client.0.smithi029.stdout:1/82: creat d7/df/d12/f17 x:0 0 0 2023-12-05T13:26:19.954 INFO:tasks.workunit.client.0.smithi029.stdout:8/69: dwrite f4 [0,4194304] 0 2023-12-05T13:26:19.960 INFO:tasks.workunit.client.0.smithi029.stdout:1/83: dwrite d7/f8 [12582912,4194304] 0 2023-12-05T13:26:19.960 INFO:tasks.workunit.client.0.smithi029.stdout:1/84: dread - d7/df/d12/f17 zero size 2023-12-05T13:26:19.962 INFO:tasks.workunit.client.0.smithi029.stdout:1/85: rename d7/df/d12/f17 to d7/df/f18 0 2023-12-05T13:26:19.962 INFO:tasks.workunit.client.0.smithi029.stdout:1/86: fdatasync f3 0 2023-12-05T13:26:19.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/87: write f3 [1026514,58398] 0 2023-12-05T13:26:19.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/88: fsync f5 0 2023-12-05T13:26:19.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/70: truncate f4 2871115 0 2023-12-05T13:26:19.968 INFO:tasks.workunit.client.0.smithi029.stdout:1/89: rmdir d7 39 2023-12-05T13:26:19.968 INFO:tasks.workunit.client.0.smithi029.stdout:1/90: readlink d7/l11 0 2023-12-05T13:26:19.970 INFO:tasks.workunit.client.0.smithi029.stdout:8/71: creat d5/d6/f1a x:0 0 0 2023-12-05T13:26:19.970 INFO:tasks.workunit.client.0.smithi029.stdout:8/72: write d5/fe [209339,78270] 0 2023-12-05T13:26:19.974 INFO:tasks.workunit.client.0.smithi029.stdout:1/91: unlink d7/f9 0 2023-12-05T13:26:19.978 INFO:tasks.workunit.client.0.smithi029.stdout:1/92: rename d7/df/f18 to d7/df/f19 0 2023-12-05T13:26:19.983 INFO:tasks.workunit.client.0.smithi029.stdout:1/93: rename c4 to d7/c1a 0 2023-12-05T13:26:19.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/94: symlink d7/df/d12/l1b 0 2023-12-05T13:26:19.987 INFO:tasks.workunit.client.0.smithi029.stdout:8/73: dwrite f4 [0,4194304] 0 2023-12-05T13:26:19.988 INFO:tasks.workunit.client.0.smithi029.stdout:1/95: mkdir d7/d1c 0 2023-12-05T13:26:19.988 INFO:tasks.workunit.client.0.smithi029.stdout:8/74: write d5/dc/ff [60840,74882] 0 2023-12-05T13:26:19.989 INFO:tasks.workunit.client.0.smithi029.stdout:8/75: readlink l1 0 2023-12-05T13:26:19.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/96: creat d7/df/d12/f1d x:0 0 0 2023-12-05T13:26:19.990 INFO:tasks.workunit.client.0.smithi029.stdout:1/97: symlink d7/df/d12/l1e 0 2023-12-05T13:26:19.992 INFO:tasks.workunit.client.0.smithi029.stdout:8/76: mknod d5/c1b 0 2023-12-05T13:26:19.992 INFO:tasks.workunit.client.0.smithi029.stdout:1/98: creat d7/d1c/f1f x:0 0 0 2023-12-05T13:26:19.993 INFO:tasks.workunit.client.0.smithi029.stdout:1/99: read d7/f8 [9086342,49011] 0 2023-12-05T13:26:19.993 INFO:tasks.workunit.client.0.smithi029.stdout:1/100: chown d7 2 1 2023-12-05T13:26:19.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/77: symlink d5/dc/l1c 0 2023-12-05T13:26:19.996 INFO:tasks.workunit.client.0.smithi029.stdout:1/101: mkdir d7/d1c/d20 0 2023-12-05T13:26:19.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/78: readlink d5/d6/l8 0 2023-12-05T13:26:19.999 INFO:tasks.workunit.client.0.smithi029.stdout:1/102: unlink d7/c1a 0 2023-12-05T13:26:19.999 INFO:tasks.workunit.client.0.smithi029.stdout:1/103: stat d7/df/d12/l1e 0 2023-12-05T13:26:20.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/79: mkdir d5/dc/d17/d1d 0 2023-12-05T13:26:20.001 INFO:tasks.workunit.client.0.smithi029.stdout:1/104: creat d7/df/f21 x:0 0 0 2023-12-05T13:26:20.004 INFO:tasks.workunit.client.0.smithi029.stdout:8/80: mkdir d5/d1e 0 2023-12-05T13:26:20.005 INFO:tasks.workunit.client.0.smithi029.stdout:8/81: dread - d5/d6/d10/d13/f19 zero size 2023-12-05T13:26:20.009 INFO:tasks.workunit.client.0.smithi029.stdout:8/82: rename d5/dc/c15 to d5/c1f 0 2023-12-05T13:26:20.009 INFO:tasks.workunit.client.0.smithi029.stdout:1/105: rmdir d7/df/d12 39 2023-12-05T13:26:20.011 INFO:tasks.workunit.client.0.smithi029.stdout:8/83: creat d5/d6/d10/d13/f20 x:0 0 0 2023-12-05T13:26:20.013 INFO:tasks.workunit.client.0.smithi029.stdout:1/106: unlink d7/df/d12/l1b 0 2023-12-05T13:26:20.017 INFO:tasks.workunit.client.0.smithi029.stdout:8/84: readlink d5/d6/l7 0 2023-12-05T13:26:20.018 INFO:tasks.workunit.client.0.smithi029.stdout:8/85: truncate d5/d6/d10/d13/f19 389272 0 2023-12-05T13:26:20.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/107: symlink d7/d1c/d20/l22 0 2023-12-05T13:26:20.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/108: truncate d7/df/f19 932190 0 2023-12-05T13:26:20.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/109: dread - d7/d1c/f1f zero size 2023-12-05T13:26:20.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/110: truncate d7/f13 909042 0 2023-12-05T13:26:20.022 INFO:tasks.workunit.client.0.smithi029.stdout:8/86: link d5/d6/l8 d5/d6/l21 0 2023-12-05T13:26:20.026 INFO:tasks.workunit.client.0.smithi029.stdout:8/87: creat d5/d1e/f22 x:0 0 0 2023-12-05T13:26:20.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/111: truncate d7/f8 10532593 0 2023-12-05T13:26:20.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/88: getdents d5/d1e 0 2023-12-05T13:26:20.035 INFO:tasks.workunit.client.0.smithi029.stdout:8/89: write d5/d6/d10/d13/f19 [634261,73] 0 2023-12-05T13:26:20.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/90: fdatasync d5/d1e/f22 0 2023-12-05T13:26:20.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/91: write d5/fe [868328,123832] 0 2023-12-05T13:26:20.036 INFO:tasks.workunit.client.0.smithi029.stdout:8/92: dread - d5/d1e/f22 zero size 2023-12-05T13:26:20.053 INFO:tasks.workunit.client.0.smithi029.stdout:8/93: dwrite d5/d6/d10/d13/f20 [0,4194304] 0 2023-12-05T13:26:20.053 INFO:tasks.workunit.client.0.smithi029.stdout:1/112: dwrite d7/fc [0,4194304] 0 2023-12-05T13:26:20.056 INFO:tasks.workunit.client.0.smithi029.stdout:8/94: link d5/d6/l8 d5/dc/l23 0 2023-12-05T13:26:20.057 INFO:tasks.workunit.client.0.smithi029.stdout:1/113: symlink d7/d1c/d20/l23 0 2023-12-05T13:26:20.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/95: mknod d5/dc/d18/c24 0 2023-12-05T13:26:20.059 INFO:tasks.workunit.client.0.smithi029.stdout:8/96: write d5/fe [1159662,528] 0 2023-12-05T13:26:20.059 INFO:tasks.workunit.client.0.smithi029.stdout:8/97: chown d5/dc/d18/c24 1 1 2023-12-05T13:26:20.059 INFO:tasks.workunit.client.0.smithi029.stdout:1/114: mknod d7/df/d12/c24 0 2023-12-05T13:26:20.061 INFO:tasks.workunit.client.0.smithi029.stdout:8/98: creat d5/d1e/f25 x:0 0 0 2023-12-05T13:26:20.062 INFO:tasks.workunit.client.0.smithi029.stdout:1/115: rename d7/df/f16 to d7/d1c/f25 0 2023-12-05T13:26:20.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/116: write d7/df/f19 [1349104,29213] 0 2023-12-05T13:26:20.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/117: fsync d7/df/f15 0 2023-12-05T13:26:20.064 INFO:tasks.workunit.client.0.smithi029.stdout:8/99: mkdir d5/dc/d18/d26 0 2023-12-05T13:26:20.066 INFO:tasks.workunit.client.0.smithi029.stdout:8/100: creat d5/f27 x:0 0 0 2023-12-05T13:26:20.066 INFO:tasks.workunit.client.0.smithi029.stdout:8/101: truncate d5/d1e/f22 890197 0 2023-12-05T13:26:20.069 INFO:tasks.workunit.client.0.smithi029.stdout:8/102: symlink d5/l28 0 2023-12-05T13:26:20.069 INFO:tasks.workunit.client.0.smithi029.stdout:8/103: fdatasync d5/d6/f1a 0 2023-12-05T13:26:20.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/104: link f4 d5/dc/d17/d1d/f29 0 2023-12-05T13:26:20.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/118: dread f5 [0,4194304] 0 2023-12-05T13:26:20.075 INFO:tasks.workunit.client.0.smithi029.stdout:8/105: creat d5/dc/d17/d1d/f2a x:0 0 0 2023-12-05T13:26:20.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/106: chown d5/la 175585 1 2023-12-05T13:26:20.080 INFO:tasks.workunit.client.0.smithi029.stdout:8/107: mknod d5/dc/d18/d26/c2b 0 2023-12-05T13:26:20.084 INFO:tasks.workunit.client.0.smithi029.stdout:8/108: mknod d5/d6/c2c 0 2023-12-05T13:26:20.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/109: mknod d5/dc/d17/c2d 0 2023-12-05T13:26:20.086 INFO:tasks.workunit.client.0.smithi029.stdout:8/110: stat d5/dc/l11 0 2023-12-05T13:26:20.086 INFO:tasks.workunit.client.0.smithi029.stdout:8/111: creat d5/dc/d17/d1d/f2e x:0 0 0 2023-12-05T13:26:20.086 INFO:tasks.workunit.client.0.smithi029.stdout:8/112: chown d5/dc/d18/d26 829 1 2023-12-05T13:26:20.088 INFO:tasks.workunit.client.0.smithi029.stdout:1/119: dwrite d7/f8 [0,4194304] 0 2023-12-05T13:26:20.089 INFO:tasks.workunit.client.0.smithi029.stdout:8/113: mkdir d5/d2f 0 2023-12-05T13:26:20.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/114: unlink d5/dc/l1c 0 2023-12-05T13:26:20.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/115: write d5/f27 [824055,57532] 0 2023-12-05T13:26:20.093 INFO:tasks.workunit.client.0.smithi029.stdout:8/116: symlink d5/d2f/l30 0 2023-12-05T13:26:20.097 INFO:tasks.workunit.client.0.smithi029.stdout:8/117: mknod d5/dc/c31 0 2023-12-05T13:26:20.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/120: dread d7/f8 [0,4194304] 0 2023-12-05T13:26:20.100 INFO:tasks.workunit.client.0.smithi029.stdout:8/118: creat d5/dc/f32 x:0 0 0 2023-12-05T13:26:20.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/121: symlink d7/d1c/l26 0 2023-12-05T13:26:20.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/119: rename d5/d6/d10/d13/f19 to d5/d1e/f33 0 2023-12-05T13:26:20.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/120: dread - d5/d6/f1a zero size 2023-12-05T13:26:20.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/121: stat d5/fe 0 2023-12-05T13:26:20.102 INFO:tasks.workunit.client.0.smithi029.stdout:8/122: stat d5/d6/f1a 0 2023-12-05T13:26:20.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/122: symlink d7/d1c/d20/l27 0 2023-12-05T13:26:20.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/123: creat d7/d1c/d20/f28 x:0 0 0 2023-12-05T13:26:20.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/124: write d7/fb [660546,30026] 0 2023-12-05T13:26:20.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/125: symlink d7/d1c/d20/l29 0 2023-12-05T13:26:20.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/126: chown d7/df/f15 1163 1 2023-12-05T13:26:20.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/127: readlink d7/d1c/d20/l29 0 2023-12-05T13:26:20.109 INFO:tasks.workunit.client.0.smithi029.stdout:1/128: mknod d7/d1c/d20/c2a 0 2023-12-05T13:26:20.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/129: rename d7/df/d12/l1e to d7/d1c/l2b 0 2023-12-05T13:26:20.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/130: chown d7/d1c/d20/l22 85 1 2023-12-05T13:26:20.114 INFO:tasks.workunit.client.0.smithi029.stdout:8/123: dwrite d5/d6/d10/d13/f20 [4194304,4194304] 0 2023-12-05T13:26:20.117 INFO:tasks.workunit.client.0.smithi029.stdout:8/124: symlink d5/d1e/l34 0 2023-12-05T13:26:20.117 INFO:tasks.workunit.client.0.smithi029.stdout:1/131: dread d7/df/f19 [0,4194304] 0 2023-12-05T13:26:20.134 INFO:tasks.workunit.client.0.smithi029.stdout:8/125: dwrite d5/d6/f1a [0,4194304] 0 2023-12-05T13:26:20.135 INFO:tasks.workunit.client.0.smithi029.stdout:1/132: truncate d7/fd 239403 0 2023-12-05T13:26:20.135 INFO:tasks.workunit.client.0.smithi029.stdout:1/133: readlink d7/l11 0 2023-12-05T13:26:20.135 INFO:tasks.workunit.client.0.smithi029.stdout:1/134: read d7/fc [47727,85103] 0 2023-12-05T13:26:20.140 INFO:tasks.workunit.client.0.smithi029.stdout:8/126: creat d5/dc/d18/f35 x:0 0 0 2023-12-05T13:26:20.154 INFO:tasks.workunit.client.0.smithi029.stdout:8/127: dwrite d5/d1e/f33 [0,4194304] 0 2023-12-05T13:26:20.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/135: truncate d7/f8 2854797 0 2023-12-05T13:26:20.164 INFO:tasks.workunit.client.0.smithi029.stdout:1/136: unlink d7/d1c/d20/l23 0 2023-12-05T13:26:20.181 INFO:tasks.workunit.client.0.smithi029.stdout:8/128: truncate d5/f27 9636 0 2023-12-05T13:26:20.182 INFO:tasks.workunit.client.0.smithi029.stdout:8/129: chown d5/d6/d10/d13/f20 21 1 2023-12-05T13:26:20.187 INFO:tasks.workunit.client.0.smithi029.stdout:1/137: dwrite d7/df/f15 [0,4194304] 0 2023-12-05T13:26:20.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/138: readlink d7/d1c/l2b 0 2023-12-05T13:26:20.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/139: write d7/df/d12/f1d [400331,92355] 0 2023-12-05T13:26:20.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/140: dread d7/fd [0,4194304] 0 2023-12-05T13:26:20.199 INFO:tasks.workunit.client.0.smithi029.stdout:8/130: truncate d5/d1e/f33 589596 0 2023-12-05T13:26:20.199 INFO:tasks.workunit.client.0.smithi029.stdout:8/131: write d5/dc/ff [148589,30050] 0 2023-12-05T13:26:20.202 INFO:tasks.workunit.client.0.smithi029.stdout:8/132: mknod d5/dc/d17/c36 0 2023-12-05T13:26:20.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/141: dwrite f3 [0,4194304] 0 2023-12-05T13:26:20.212 INFO:tasks.workunit.client.0.smithi029.stdout:1/142: write d7/d1c/f1f [987040,69088] 0 2023-12-05T13:26:20.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/133: dwrite d5/d6/d10/d13/f20 [4194304,4194304] 0 2023-12-05T13:26:20.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/134: readlink d5/d6/l8 0 2023-12-05T13:26:20.219 INFO:tasks.workunit.client.0.smithi029.stdout:8/135: symlink d5/d6/d10/d13/l37 0 2023-12-05T13:26:20.220 INFO:tasks.workunit.client.0.smithi029.stdout:1/143: dread d7/fc [0,4194304] 0 2023-12-05T13:26:20.225 INFO:tasks.workunit.client.0.smithi029.stdout:8/136: rename d5/d1e/l34 to d5/d6/d10/l38 0 2023-12-05T13:26:20.226 INFO:tasks.workunit.client.0.smithi029.stdout:8/137: dread d5/d1e/f33 [0,4194304] 0 2023-12-05T13:26:20.226 INFO:tasks.workunit.client.0.smithi029.stdout:1/144: rename f5 to d7/df/f2c 0 2023-12-05T13:26:20.226 INFO:tasks.workunit.client.0.smithi029.stdout:1/145: write d7/fb [1633973,23370] 0 2023-12-05T13:26:20.226 INFO:tasks.workunit.client.0.smithi029.stdout:1/146: stat f3 0 2023-12-05T13:26:20.227 INFO:tasks.workunit.client.0.smithi029.stdout:1/147: read d7/f13 [21512,94071] 0 2023-12-05T13:26:20.231 INFO:tasks.workunit.client.0.smithi029.stdout:8/138: rename d5/d6/lb to d5/d6/d10/d13/l39 0 2023-12-05T13:26:20.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/139: write f4 [1863043,49640] 0 2023-12-05T13:26:20.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/140: readlink d5/d6/l8 0 2023-12-05T13:26:20.232 INFO:tasks.workunit.client.0.smithi029.stdout:8/141: readlink d5/d2f/l30 0 2023-12-05T13:26:20.244 INFO:tasks.workunit.client.0.smithi029.stdout:8/142: rmdir d5 39 2023-12-05T13:26:20.244 INFO:tasks.workunit.client.0.smithi029.stdout:8/143: rmdir d5 39 2023-12-05T13:26:20.245 INFO:tasks.workunit.client.0.smithi029.stdout:8/144: chown d5/d6/l7 13095834 1 2023-12-05T13:26:20.246 INFO:tasks.workunit.client.0.smithi029.stdout:8/145: unlink d5/d6/d10/d13/l39 0 2023-12-05T13:26:20.246 INFO:tasks.workunit.client.0.smithi029.stdout:8/146: truncate d5/dc/f32 724225 0 2023-12-05T13:26:20.249 INFO:tasks.workunit.client.0.smithi029.stdout:8/147: mkdir d5/d2f/d3a 0 2023-12-05T13:26:20.249 INFO:tasks.workunit.client.0.smithi029.stdout:1/148: dwrite d7/df/f2c [0,4194304] 0 2023-12-05T13:26:20.252 INFO:tasks.workunit.client.0.smithi029.stdout:1/149: creat d7/df/d12/f2d x:0 0 0 2023-12-05T13:26:20.254 INFO:tasks.workunit.client.0.smithi029.stdout:1/150: link d7/c10 d7/df/d12/c2e 0 2023-12-05T13:26:20.260 INFO:tasks.workunit.client.0.smithi029.stdout:1/151: dread d7/d1c/f25 [0,4194304] 0 2023-12-05T13:26:20.260 INFO:tasks.workunit.client.0.smithi029.stdout:8/148: dread f4 [0,4194304] 0 2023-12-05T13:26:20.263 INFO:tasks.workunit.client.0.smithi029.stdout:8/149: creat d5/f3b x:0 0 0 2023-12-05T13:26:20.267 INFO:tasks.workunit.client.0.smithi029.stdout:8/150: mkdir d5/d2f/d3a/d3c 0 2023-12-05T13:26:20.277 INFO:tasks.workunit.client.0.smithi029.stdout:8/151: creat d5/dc/d18/f3d x:0 0 0 2023-12-05T13:26:20.277 INFO:tasks.workunit.client.0.smithi029.stdout:8/152: chown d5/dc/d18/d26/c2b 32543 1 2023-12-05T13:26:20.277 INFO:tasks.workunit.client.0.smithi029.stdout:8/153: write d5/d1e/f25 [1025539,49339] 0 2023-12-05T13:26:20.280 INFO:tasks.workunit.client.0.smithi029.stdout:8/154: link d5/dc/d17/c2d d5/d6/d10/c3e 0 2023-12-05T13:26:20.297 INFO:tasks.workunit.client.0.smithi029.stdout:8/155: dwrite d5/dc/ff [0,4194304] 0 2023-12-05T13:26:20.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/156: getdents d5/dc/d17/d1d 0 2023-12-05T13:26:20.301 INFO:tasks.workunit.client.0.smithi029.stdout:8/157: fdatasync d5/d1e/f22 0 2023-12-05T13:26:20.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/158: creat d5/d1e/f3f x:0 0 0 2023-12-05T13:26:20.302 INFO:tasks.workunit.client.0.smithi029.stdout:8/159: chown d5/d6/d10/d13/l37 0 1 2023-12-05T13:26:20.304 INFO:tasks.workunit.client.0.smithi029.stdout:8/160: rename d5/d6/l8 to d5/d6/l40 0 2023-12-05T13:26:20.306 INFO:tasks.workunit.client.0.smithi029.stdout:8/161: dread d5/dc/f32 [0,4194304] 0 2023-12-05T13:26:20.306 INFO:tasks.workunit.client.0.smithi029.stdout:8/162: truncate d5/d1e/f33 1084249 0 2023-12-05T13:26:20.319 INFO:tasks.workunit.client.0.smithi029.stdout:8/163: dwrite d5/d1e/f22 [0,4194304] 0 2023-12-05T13:26:20.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/164: dread f4 [0,4194304] 0 2023-12-05T13:26:20.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/165: fdatasync d5/dc/f32 0 2023-12-05T13:26:20.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/166: stat d5 0 2023-12-05T13:26:20.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/167: write d5/d6/f9 [4741312,16266] 0 2023-12-05T13:26:20.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/168: chown d5/dc/l23 4 1 2023-12-05T13:26:20.329 INFO:tasks.workunit.client.0.smithi029.stdout:8/169: dread d5/d1e/f25 [0,4194304] 0 2023-12-05T13:26:20.332 INFO:tasks.workunit.client.0.smithi029.stdout:8/170: creat d5/d6/d10/d13/f41 x:0 0 0 2023-12-05T13:26:20.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/171: link l1 d5/d6/l42 0 2023-12-05T13:26:20.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/172: chown d5/d2f/l30 842 1 2023-12-05T13:26:20.336 INFO:tasks.workunit.client.0.smithi029.stdout:8/173: dread - d5/dc/d17/d1d/f2e zero size 2023-12-05T13:26:20.337 INFO:tasks.workunit.client.0.smithi029.stdout:8/174: write d5/dc/f32 [12281,102548] 0 2023-12-05T13:26:20.350 INFO:tasks.workunit.client.0.smithi029.stdout:8/175: dwrite d5/d1e/f22 [4194304,4194304] 0 2023-12-05T13:26:20.350 INFO:tasks.workunit.client.0.smithi029.stdout:8/176: write d5/d1e/f33 [527749,109258] 0 2023-12-05T13:26:20.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/177: write d5/d6/d10/d13/f20 [2380688,100589] 0 2023-12-05T13:26:20.364 INFO:tasks.workunit.client.0.smithi029.stdout:8/178: dwrite d5/dc/d17/d1d/f2e [0,4194304] 0 2023-12-05T13:26:20.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/179: write d5/d6/d10/d13/f41 [515371,24899] 0 2023-12-05T13:26:20.366 INFO:tasks.workunit.client.0.smithi029.stdout:8/180: write d5/d6/d10/d13/f20 [6186091,114143] 0 2023-12-05T13:26:20.367 INFO:tasks.workunit.client.0.smithi029.stdout:8/181: write d5/d6/d10/d13/f20 [2171147,596] 0 2023-12-05T13:26:20.368 INFO:tasks.workunit.client.0.smithi029.stdout:8/182: symlink d5/dc/d17/d1d/l43 0 2023-12-05T13:26:20.370 INFO:tasks.workunit.client.0.smithi029.stdout:8/183: symlink d5/d1e/l44 0 2023-12-05T13:26:20.373 INFO:tasks.workunit.client.0.smithi029.stdout:8/184: rmdir d5/dc/d18 39 2023-12-05T13:26:20.376 INFO:tasks.workunit.client.0.smithi029.stdout:8/185: creat d5/dc/f45 x:0 0 0 2023-12-05T13:26:20.395 INFO:tasks.workunit.client.0.smithi029.stdout:8/186: dwrite d5/f3b [0,4194304] 0 2023-12-05T13:26:20.395 INFO:tasks.workunit.client.0.smithi029.stdout:8/187: rename d5 to d5/d2f/d3a/d46 22 2023-12-05T13:26:20.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/188: symlink d5/dc/d17/d1d/l47 0 2023-12-05T13:26:20.402 INFO:tasks.workunit.client.0.smithi029.stdout:8/189: fsync d5/d6/d10/d13/f20 0 2023-12-05T13:26:20.404 INFO:tasks.workunit.client.0.smithi029.stdout:8/190: creat d5/d2f/d3a/f48 x:0 0 0 2023-12-05T13:26:20.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/191: write d5/dc/d17/d1d/f2a [538856,87720] 0 2023-12-05T13:26:20.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/192: dread - d5/d2f/d3a/f48 zero size 2023-12-05T13:26:20.405 INFO:tasks.workunit.client.0.smithi029.stdout:8/193: write d5/d1e/f25 [2118881,12185] 0 2023-12-05T13:26:20.409 INFO:tasks.workunit.client.0.smithi029.stdout:8/194: link d5/dc/d17/d1d/l43 d5/dc/l49 0 2023-12-05T13:26:20.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/195: truncate d5/dc/f32 257925 0 2023-12-05T13:26:20.418 INFO:tasks.workunit.client.0.smithi029.stdout:8/196: mknod d5/d2f/d3a/d3c/c4a 0 2023-12-05T13:26:20.418 INFO:tasks.workunit.client.0.smithi029.stdout:8/197: stat d5/d1e 0 2023-12-05T13:26:20.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/198: dread d5/dc/d17/d1d/f29 [0,4194304] 0 2023-12-05T13:26:20.424 INFO:tasks.workunit.client.0.smithi029.stdout:8/199: dread d5/f27 [0,4194304] 0 2023-12-05T13:26:20.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/200: link d5/d6/d10/d13/f41 d5/d6/f4b 0 2023-12-05T13:26:20.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/201: fdatasync f4 0 2023-12-05T13:26:20.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/202: read d5/fe [863635,123021] 0 2023-12-05T13:26:20.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/203: rename d5/d6/l21 to d5/dc/d17/d1d/l4c 0 2023-12-05T13:26:20.435 INFO:tasks.workunit.client.0.smithi029.stdout:8/204: dread d5/d6/d10/d13/f41 [0,4194304] 0 2023-12-05T13:26:20.437 INFO:tasks.workunit.client.0.smithi029.stdout:8/205: fsync d5/dc/f32 0 2023-12-05T13:26:20.440 INFO:tasks.workunit.client.0.smithi029.stdout:8/206: rename d5/dc/f45 to d5/dc/d17/d1d/f4d 0 2023-12-05T13:26:21.012 INFO:tasks.workunit.client.0.smithi029.stdout:9/18: sync 2023-12-05T13:26:21.012 INFO:tasks.workunit.client.0.smithi029.stdout:9/19: write - no filename 2023-12-05T13:26:21.013 INFO:tasks.workunit.client.0.smithi029.stdout:9/20: write - no filename 2023-12-05T13:26:21.015 INFO:tasks.workunit.client.0.smithi029.stdout:9/21: mknod c5 0 2023-12-05T13:26:21.016 INFO:tasks.workunit.client.0.smithi029.stdout:9/22: chown c1 235 1 2023-12-05T13:26:21.016 INFO:tasks.workunit.client.0.smithi029.stdout:9/23: chown c5 14850 1 2023-12-05T13:26:21.017 INFO:tasks.workunit.client.0.smithi029.stdout:9/24: write - no filename 2023-12-05T13:26:21.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/25: symlink l6 0 2023-12-05T13:26:21.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/26: fsync - no filename 2023-12-05T13:26:21.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/27: dread - no filename 2023-12-05T13:26:21.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/28: mkdir d7 0 2023-12-05T13:26:21.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/29: fdatasync - no filename 2023-12-05T13:26:21.022 INFO:tasks.workunit.client.0.smithi029.stdout:9/30: dwrite - no filename 2023-12-05T13:26:21.023 INFO:tasks.workunit.client.0.smithi029.stdout:9/31: mknod d7/c8 0 2023-12-05T13:26:21.023 INFO:tasks.workunit.client.0.smithi029.stdout:9/32: dread - no filename 2023-12-05T13:26:21.023 INFO:tasks.workunit.client.0.smithi029.stdout:9/33: write - no filename 2023-12-05T13:26:21.025 INFO:tasks.workunit.client.0.smithi029.stdout:9/34: creat d7/f9 x:0 0 0 2023-12-05T13:26:21.025 INFO:tasks.workunit.client.0.smithi029.stdout:9/35: fdatasync d7/f9 0 2023-12-05T13:26:21.026 INFO:tasks.workunit.client.0.smithi029.stdout:9/36: creat d7/fa x:0 0 0 2023-12-05T13:26:21.026 INFO:tasks.workunit.client.0.smithi029.stdout:9/37: dread - d7/fa zero size 2023-12-05T13:26:21.036 INFO:tasks.workunit.client.0.smithi029.stdout:9/38: fsync d7/fa 0 2023-12-05T13:26:21.037 INFO:tasks.workunit.client.0.smithi029.stdout:9/39: rename d7/c8 to d7/cb 0 2023-12-05T13:26:21.041 INFO:tasks.workunit.client.0.smithi029.stdout:9/40: rmdir d7 39 2023-12-05T13:26:21.041 INFO:tasks.workunit.client.0.smithi029.stdout:9/41: write d7/fa [718406,63218] 0 2023-12-05T13:26:21.041 INFO:tasks.workunit.client.0.smithi029.stdout:9/42: write d7/fa [1786577,80960] 0 2023-12-05T13:26:21.047 INFO:tasks.workunit.client.0.smithi029.stdout:9/43: rename c3 to d7/cc 0 2023-12-05T13:26:21.047 INFO:tasks.workunit.client.0.smithi029.stdout:9/44: write d7/f9 [463478,66302] 0 2023-12-05T13:26:21.047 INFO:tasks.workunit.client.0.smithi029.stdout:9/45: write d7/f9 [131624,52269] 0 2023-12-05T13:26:21.047 INFO:tasks.workunit.client.0.smithi029.stdout:9/46: symlink d7/ld 0 2023-12-05T13:26:21.048 INFO:tasks.workunit.client.0.smithi029.stdout:9/47: creat d7/fe x:0 0 0 2023-12-05T13:26:21.048 INFO:tasks.workunit.client.0.smithi029.stdout:9/48: chown d7/cc 73 1 2023-12-05T13:26:21.048 INFO:tasks.workunit.client.0.smithi029.stdout:9/49: readlink l6 0 2023-12-05T13:26:21.049 INFO:tasks.workunit.client.0.smithi029.stdout:9/50: creat d7/ff x:0 0 0 2023-12-05T13:26:21.053 INFO:tasks.workunit.client.0.smithi029.stdout:9/51: link d7/cc d7/c10 0 2023-12-05T13:26:21.065 INFO:tasks.workunit.client.0.smithi029.stdout:9/52: getdents d7 0 2023-12-05T13:26:21.065 INFO:tasks.workunit.client.0.smithi029.stdout:9/53: fdatasync d7/fe 0 2023-12-05T13:26:21.065 INFO:tasks.workunit.client.0.smithi029.stdout:9/54: write d7/f9 [1361388,112659] 0 2023-12-05T13:26:21.065 INFO:tasks.workunit.client.0.smithi029.stdout:9/55: write d7/fe [246336,79576] 0 2023-12-05T13:26:21.066 INFO:tasks.workunit.client.0.smithi029.stdout:9/56: mknod d7/c11 0 2023-12-05T13:26:21.070 INFO:tasks.workunit.client.0.smithi029.stdout:9/57: fsync d7/f9 0 2023-12-05T13:26:21.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/58: dread d7/f9 [0,4194304] 0 2023-12-05T13:26:21.074 INFO:tasks.workunit.client.0.smithi029.stdout:9/59: symlink d7/l12 0 2023-12-05T13:26:21.074 INFO:tasks.workunit.client.0.smithi029.stdout:9/60: readlink d7/l12 0 2023-12-05T13:26:21.075 INFO:tasks.workunit.client.0.smithi029.stdout:9/61: dread - d7/ff zero size 2023-12-05T13:26:21.075 INFO:tasks.workunit.client.0.smithi029.stdout:9/62: dread - d7/ff zero size 2023-12-05T13:26:21.076 INFO:tasks.workunit.client.0.smithi029.stdout:9/63: creat d7/f13 x:0 0 0 2023-12-05T13:26:21.078 INFO:tasks.workunit.client.0.smithi029.stdout:9/64: mknod d7/c14 0 2023-12-05T13:26:21.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/65: dwrite d7/ff [0,4194304] 0 2023-12-05T13:26:21.095 INFO:tasks.workunit.client.0.smithi029.stdout:9/66: write d7/fa [2246766,48798] 0 2023-12-05T13:26:21.100 INFO:tasks.workunit.client.0.smithi029.stdout:9/67: symlink d7/l15 0 2023-12-05T13:26:21.102 INFO:tasks.workunit.client.0.smithi029.stdout:9/68: symlink d7/l16 0 2023-12-05T13:26:21.117 INFO:tasks.workunit.client.0.smithi029.stdout:9/69: dwrite d7/ff [0,4194304] 0 2023-12-05T13:26:21.137 INFO:tasks.workunit.client.0.smithi029.stdout:9/70: dwrite d7/f13 [0,4194304] 0 2023-12-05T13:26:21.149 INFO:tasks.workunit.client.0.smithi029.stdout:9/71: dread d7/ff [0,4194304] 0 2023-12-05T13:26:21.149 INFO:tasks.workunit.client.0.smithi029.stdout:9/72: chown c1 316 1 2023-12-05T13:26:21.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/73: symlink d7/l17 0 2023-12-05T13:26:21.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/74: fdatasync d7/ff 0 2023-12-05T13:26:21.159 INFO:tasks.workunit.client.0.smithi029.stdout:9/75: rmdir d7 39 2023-12-05T13:26:21.175 INFO:tasks.workunit.client.0.smithi029.stdout:9/76: truncate d7/ff 401751 0 2023-12-05T13:26:21.176 INFO:tasks.workunit.client.0.smithi029.stdout:9/77: creat d7/f18 x:0 0 0 2023-12-05T13:26:21.177 INFO:tasks.workunit.client.0.smithi029.stdout:9/78: chown d7/l17 0 1 2023-12-05T13:26:21.177 INFO:tasks.workunit.client.0.smithi029.stdout:9/79: dread - d7/f18 zero size 2023-12-05T13:26:21.177 INFO:tasks.workunit.client.0.smithi029.stdout:9/80: mkdir d7/d19 0 2023-12-05T13:26:21.178 INFO:tasks.workunit.client.0.smithi029.stdout:9/81: symlink d7/d19/l1a 0 2023-12-05T13:26:21.179 INFO:tasks.workunit.client.0.smithi029.stdout:9/82: link d7/f18 d7/d19/f1b 0 2023-12-05T13:26:21.181 INFO:tasks.workunit.client.0.smithi029.stdout:9/83: mkdir d7/d19/d1c 0 2023-12-05T13:26:21.183 INFO:tasks.workunit.client.0.smithi029.stdout:9/84: rename d7/fa to d7/d19/f1d 0 2023-12-05T13:26:21.183 INFO:tasks.workunit.client.0.smithi029.stdout:9/85: read d7/f13 [775948,14202] 0 2023-12-05T13:26:21.184 INFO:tasks.workunit.client.0.smithi029.stdout:9/86: mkdir d7/d19/d1c/d1e 0 2023-12-05T13:26:21.185 INFO:tasks.workunit.client.0.smithi029.stdout:9/87: write d7/f9 [504787,49986] 0 2023-12-05T13:26:21.211 INFO:tasks.workunit.client.0.smithi029.stdout:9/88: dwrite d7/d19/f1d [0,4194304] 0 2023-12-05T13:26:21.231 INFO:tasks.workunit.client.0.smithi029.stdout:9/89: dwrite d7/d19/f1b [0,4194304] 0 2023-12-05T13:26:21.233 INFO:tasks.workunit.client.0.smithi029.stdout:9/90: write d7/d19/f1b [3230586,91328] 0 2023-12-05T13:26:21.243 INFO:tasks.workunit.client.0.smithi029.stdout:9/91: mkdir d7/d19/d1f 0 2023-12-05T13:26:21.243 INFO:tasks.workunit.client.0.smithi029.stdout:9/92: readlink d7/l15 0 2023-12-05T13:26:21.249 INFO:tasks.workunit.client.0.smithi029.stdout:9/93: rename d7/l15 to d7/d19/d1c/d1e/l20 0 2023-12-05T13:26:21.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/94: creat d7/d19/d1f/f21 x:0 0 0 2023-12-05T13:26:21.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/95: readlink l6 0 2023-12-05T13:26:21.255 INFO:tasks.workunit.client.0.smithi029.stdout:9/96: symlink d7/d19/d1f/l22 0 2023-12-05T13:26:21.276 INFO:tasks.workunit.client.0.smithi029.stdout:9/97: truncate d7/f18 3515899 0 2023-12-05T13:26:21.278 INFO:tasks.workunit.client.0.smithi029.stdout:9/98: mknod d7/c23 0 2023-12-05T13:26:21.280 INFO:tasks.workunit.client.0.smithi029.stdout:9/99: symlink d7/d19/d1f/l24 0 2023-12-05T13:26:21.297 INFO:tasks.workunit.client.0.smithi029.stdout:9/100: dwrite d7/d19/f1b [0,4194304] 0 2023-12-05T13:26:21.302 INFO:tasks.workunit.client.0.smithi029.stdout:9/101: dread d7/f9 [0,4194304] 0 2023-12-05T13:26:21.302 INFO:tasks.workunit.client.0.smithi029.stdout:9/102: fsync d7/d19/f1d 0 2023-12-05T13:26:21.302 INFO:tasks.workunit.client.0.smithi029.stdout:9/103: fdatasync d7/d19/f1d 0 2023-12-05T13:26:21.303 INFO:tasks.workunit.client.0.smithi029.stdout:9/104: symlink d7/d19/l25 0 2023-12-05T13:26:21.306 INFO:tasks.workunit.client.0.smithi029.stdout:9/105: creat d7/f26 x:0 0 0 2023-12-05T13:26:21.307 INFO:tasks.workunit.client.0.smithi029.stdout:9/106: write d7/d19/f1d [1476040,66611] 0 2023-12-05T13:26:21.309 INFO:tasks.workunit.client.0.smithi029.stdout:9/107: mknod d7/d19/d1f/c27 0 2023-12-05T13:26:21.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:20 smithi029 ceph-mon[112128]: pgmap v32: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.6 MiB/s wr, 322 op/s 2023-12-05T13:26:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:20 smithi052 ceph-mon[121072]: pgmap v32: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.6 MiB/s wr, 322 op/s 2023-12-05T13:26:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:23 smithi052 ceph-mon[121072]: pgmap v33: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 278 op/s 2023-12-05T13:26:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:23 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:23.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:23 smithi029 ceph-mon[112128]: pgmap v33: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 278 op/s 2023-12-05T13:26:23.875 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:23 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:24.377 INFO:tasks.workunit.client.0.smithi029.stdout:7/112: sync 2023-12-05T13:26:24.378 INFO:tasks.workunit.client.0.smithi029.stdout:7/113: write d6/f15 [3604861,124748] 0 2023-12-05T13:26:24.378 INFO:tasks.workunit.client.0.smithi029.stdout:7/114: stat d6/df 0 2023-12-05T13:26:24.382 INFO:tasks.workunit.client.0.smithi029.stdout:7/115: rename d6/c18 to d6/df/d1a/c1e 0 2023-12-05T13:26:24.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/116: creat d6/df/f1f x:0 0 0 2023-12-05T13:26:24.386 INFO:tasks.workunit.client.0.smithi029.stdout:7/117: mknod d6/df/c20 0 2023-12-05T13:26:24.386 INFO:tasks.workunit.client.0.smithi029.stdout:7/118: fsync d6/fc 0 2023-12-05T13:26:24.387 INFO:tasks.workunit.client.0.smithi029.stdout:7/119: creat d6/d19/f21 x:0 0 0 2023-12-05T13:26:24.392 INFO:tasks.workunit.client.0.smithi029.stdout:7/120: creat d6/f22 x:0 0 0 2023-12-05T13:26:24.396 INFO:tasks.workunit.client.0.smithi029.stdout:7/121: truncate d6/f13 3720455 0 2023-12-05T13:26:24.399 INFO:tasks.workunit.client.0.smithi029.stdout:7/122: truncate f1 4609438 0 2023-12-05T13:26:24.402 INFO:tasks.workunit.client.0.smithi029.stdout:7/123: rename d6/ce to d6/c23 0 2023-12-05T13:26:24.427 INFO:tasks.workunit.client.0.smithi029.stdout:7/124: dwrite d6/f9 [0,4194304] 0 2023-12-05T13:26:24.427 INFO:tasks.workunit.client.0.smithi029.stdout:7/125: chown d6/f15 8 1 2023-12-05T13:26:24.429 INFO:tasks.workunit.client.0.smithi029.stdout:7/126: creat d6/df/d1a/f24 x:0 0 0 2023-12-05T13:26:24.444 INFO:tasks.workunit.client.0.smithi029.stdout:7/127: rmdir d6/df/d1a 39 2023-12-05T13:26:24.445 INFO:tasks.workunit.client.0.smithi029.stdout:7/128: creat d6/d19/f25 x:0 0 0 2023-12-05T13:26:24.449 INFO:tasks.workunit.client.0.smithi029.stdout:7/129: mkdir d6/df/d1a/d26 0 2023-12-05T13:26:24.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/130: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:24.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/131: chown f1 110763928 1 2023-12-05T13:26:24.454 INFO:tasks.workunit.client.0.smithi029.stdout:7/132: write d6/f15 [4571407,112007] 0 2023-12-05T13:26:24.455 INFO:tasks.workunit.client.0.smithi029.stdout:7/133: creat d6/df/d1a/f27 x:0 0 0 2023-12-05T13:26:24.456 INFO:tasks.workunit.client.0.smithi029.stdout:7/134: write d6/df/d1a/f24 [297028,61739] 0 2023-12-05T13:26:24.456 INFO:tasks.workunit.client.0.smithi029.stdout:7/135: readlink d6/df/l10 0 2023-12-05T13:26:24.460 INFO:tasks.workunit.client.0.smithi029.stdout:7/136: truncate d6/fc 839814 0 2023-12-05T13:26:24.460 INFO:tasks.workunit.client.0.smithi029.stdout:7/137: write d6/f9 [4833780,19276] 0 2023-12-05T13:26:24.460 INFO:tasks.workunit.client.0.smithi029.stdout:7/138: mknod d6/df/d1a/c28 0 2023-12-05T13:26:24.466 INFO:tasks.workunit.client.0.smithi029.stdout:7/139: fsync d6/fc 0 2023-12-05T13:26:24.467 INFO:tasks.workunit.client.0.smithi029.stdout:7/140: chown d6/df/d1a/c28 0 1 2023-12-05T13:26:24.467 INFO:tasks.workunit.client.0.smithi029.stdout:7/141: link d6/df/d1a/f27 d6/df/f29 0 2023-12-05T13:26:24.483 INFO:tasks.workunit.client.0.smithi029.stdout:7/142: dwrite d6/df/f1f [0,4194304] 0 2023-12-05T13:26:24.500 INFO:tasks.workunit.client.0.smithi029.stdout:7/143: dwrite d6/fc [0,4194304] 0 2023-12-05T13:26:24.504 INFO:tasks.workunit.client.0.smithi029.stdout:7/144: mkdir d6/d2a 0 2023-12-05T13:26:24.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/145: rename d6/fc to d6/df/d1a/d26/f2b 0 2023-12-05T13:26:24.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/146: dread - d6/d19/f21 zero size 2023-12-05T13:26:24.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/147: chown d6/df/d1a/f24 45 1 2023-12-05T13:26:24.506 INFO:tasks.workunit.client.0.smithi029.stdout:7/148: mknod d6/d19/c2c 0 2023-12-05T13:26:24.507 INFO:tasks.workunit.client.0.smithi029.stdout:7/149: fdatasync d6/df/f29 0 2023-12-05T13:26:24.508 INFO:tasks.workunit.client.0.smithi029.stdout:7/150: mknod d6/d19/c2d 0 2023-12-05T13:26:24.508 INFO:tasks.workunit.client.0.smithi029.stdout:7/151: chown d6/d19/f21 807902 1 2023-12-05T13:26:24.513 INFO:tasks.workunit.client.0.smithi029.stdout:3/80: sync 2023-12-05T13:26:24.513 INFO:tasks.workunit.client.0.smithi029.stdout:5/78: sync 2023-12-05T13:26:24.513 INFO:tasks.workunit.client.0.smithi029.stdout:4/54: sync 2023-12-05T13:26:24.513 INFO:tasks.workunit.client.0.smithi029.stdout:6/153: sync 2023-12-05T13:26:24.513 INFO:tasks.workunit.client.0.smithi029.stdout:5/79: stat d1/dc/d10/d1e 0 2023-12-05T13:26:24.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/25: sync 2023-12-05T13:26:24.518 INFO:tasks.workunit.client.0.smithi029.stdout:5/80: unlink d1/dc/d11/d17/l18 0 2023-12-05T13:26:24.518 INFO:tasks.workunit.client.0.smithi029.stdout:5/81: truncate d1/dc/de/f1a 602273 0 2023-12-05T13:26:24.519 INFO:tasks.workunit.client.0.smithi029.stdout:6/154: mknod d6/c37 0 2023-12-05T13:26:24.520 INFO:tasks.workunit.client.0.smithi029.stdout:6/155: chown d6/d1d 948943132 1 2023-12-05T13:26:24.522 INFO:tasks.workunit.client.0.smithi029.stdout:5/82: dread d1/dc/de/f19 [0,4194304] 0 2023-12-05T13:26:24.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/156: write d6/f1c [1275730,64898] 0 2023-12-05T13:26:24.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/157: chown d6/d21/l25 50954 1 2023-12-05T13:26:24.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/158: chown d6/l19 60631 1 2023-12-05T13:26:24.524 INFO:tasks.workunit.client.0.smithi029.stdout:3/81: mkdir d1/d18 0 2023-12-05T13:26:24.524 INFO:tasks.workunit.client.0.smithi029.stdout:3/82: chown d1/d10 2769 1 2023-12-05T13:26:24.525 INFO:tasks.workunit.client.0.smithi029.stdout:3/83: read d1/f2 [657406,83578] 0 2023-12-05T13:26:24.525 INFO:tasks.workunit.client.0.smithi029.stdout:3/84: rename d1 to d1/d6/d19 22 2023-12-05T13:26:24.525 INFO:tasks.workunit.client.0.smithi029.stdout:7/152: dwrite d6/d19/f25 [0,4194304] 0 2023-12-05T13:26:24.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/83: truncate d1/dc/f1b 3444580 0 2023-12-05T13:26:24.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/84: fsync d1/dc/de/f1a 0 2023-12-05T13:26:24.530 INFO:tasks.workunit.client.0.smithi029.stdout:6/159: readlink l4 0 2023-12-05T13:26:24.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/85: creat d1/d18/f1a x:0 0 0 2023-12-05T13:26:24.534 INFO:tasks.workunit.client.0.smithi029.stdout:0/26: dread f0 [4194304,4194304] 0 2023-12-05T13:26:24.544 INFO:tasks.workunit.client.0.smithi029.stdout:5/85: rmdir d1/d1d 0 2023-12-05T13:26:24.549 INFO:tasks.workunit.client.0.smithi029.stdout:6/160: unlink d6/lf 0 2023-12-05T13:26:24.552 INFO:tasks.workunit.client.0.smithi029.stdout:1/152: sync 2023-12-05T13:26:24.552 INFO:tasks.workunit.client.0.smithi029.stdout:9/108: sync 2023-12-05T13:26:24.552 INFO:tasks.workunit.client.0.smithi029.stdout:8/207: sync 2023-12-05T13:26:24.552 INFO:tasks.workunit.client.0.smithi029.stdout:2/15: sync 2023-12-05T13:26:24.552 INFO:tasks.workunit.client.0.smithi029.stdout:1/153: fsync d7/df/f21 0 2023-12-05T13:26:24.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/86: mkdir d1/d10/d1b 0 2023-12-05T13:26:24.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/87: fsync d1/d6/fb 0 2023-12-05T13:26:24.554 INFO:tasks.workunit.client.0.smithi029.stdout:0/27: truncate f4 219935 0 2023-12-05T13:26:24.554 INFO:tasks.workunit.client.0.smithi029.stdout:0/28: dread - f6 zero size 2023-12-05T13:26:24.555 INFO:tasks.workunit.client.0.smithi029.stdout:1/154: dread d7/d1c/f25 [0,4194304] 0 2023-12-05T13:26:24.558 INFO:tasks.workunit.client.0.smithi029.stdout:5/86: creat d1/f20 x:0 0 0 2023-12-05T13:26:24.558 INFO:tasks.workunit.client.0.smithi029.stdout:9/109: truncate d7/fe 269544 0 2023-12-05T13:26:24.563 INFO:tasks.workunit.client.0.smithi029.stdout:8/208: creat d5/dc/d17/f4e x:0 0 0 2023-12-05T13:26:24.564 INFO:tasks.workunit.client.0.smithi029.stdout:2/16: creat f4 x:0 0 0 2023-12-05T13:26:24.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/88: symlink d1/d6/d11/l1c 0 2023-12-05T13:26:24.567 INFO:tasks.workunit.client.0.smithi029.stdout:0/29: getdents . 0 2023-12-05T13:26:24.572 INFO:tasks.workunit.client.0.smithi029.stdout:1/155: mkdir d7/df/d2f 0 2023-12-05T13:26:24.572 INFO:tasks.workunit.client.0.smithi029.stdout:1/156: write d7/df/d12/f1d [1051598,14714] 0 2023-12-05T13:26:24.572 INFO:tasks.workunit.client.0.smithi029.stdout:0/30: read f4 [218651,95316] 0 2023-12-05T13:26:24.573 INFO:tasks.workunit.client.0.smithi029.stdout:5/87: mknod d1/dc/d11/c21 0 2023-12-05T13:26:24.573 INFO:tasks.workunit.client.0.smithi029.stdout:5/88: dread - d1/f20 zero size 2023-12-05T13:26:24.574 INFO:tasks.workunit.client.0.smithi029.stdout:5/89: dread d1/dc/de/f1a [0,4194304] 0 2023-12-05T13:26:24.575 INFO:tasks.workunit.client.0.smithi029.stdout:9/110: rename d7/d19/d1c/d1e to d7/d19/d28 0 2023-12-05T13:26:24.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/209: symlink d5/d6/d10/d13/l4f 0 2023-12-05T13:26:24.577 INFO:tasks.workunit.client.0.smithi029.stdout:8/210: chown d5/dc/d18 7533 1 2023-12-05T13:26:24.577 INFO:tasks.workunit.client.0.smithi029.stdout:8/211: readlink d5/dc/d17/d1d/l47 0 2023-12-05T13:26:24.577 INFO:tasks.workunit.client.0.smithi029.stdout:8/212: chown d5/dc/d17/d1d/f2a 183965892 1 2023-12-05T13:26:24.578 INFO:tasks.workunit.client.0.smithi029.stdout:3/89: creat d1/d18/f1d x:0 0 0 2023-12-05T13:26:24.578 INFO:tasks.workunit.client.0.smithi029.stdout:3/90: dread - d1/d18/f1d zero size 2023-12-05T13:26:24.578 INFO:tasks.workunit.client.0.smithi029.stdout:0/31: dread f0 [4194304,4194304] 0 2023-12-05T13:26:24.582 INFO:tasks.workunit.client.0.smithi029.stdout:1/157: rename d7/df/d12/c24 to d7/c30 0 2023-12-05T13:26:24.583 INFO:tasks.workunit.client.0.smithi029.stdout:1/158: chown d7/df/d2f 1 1 2023-12-05T13:26:24.585 INFO:tasks.workunit.client.0.smithi029.stdout:2/17: dwrite f4 [0,4194304] 0 2023-12-05T13:26:24.585 INFO:tasks.workunit.client.0.smithi029.stdout:9/111: creat d7/d19/d1f/f29 x:0 0 0 2023-12-05T13:26:24.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/213: unlink d5/d6/d10/d13/f20 0 2023-12-05T13:26:24.588 INFO:tasks.workunit.client.0.smithi029.stdout:0/32: rename c5 to c7 0 2023-12-05T13:26:24.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/33: readlink l3 0 2023-12-05T13:26:24.589 INFO:tasks.workunit.client.0.smithi029.stdout:2/18: write f4 [417384,107480] 0 2023-12-05T13:26:24.590 INFO:tasks.workunit.client.0.smithi029.stdout:2/19: truncate f3 879567 0 2023-12-05T13:26:24.590 INFO:tasks.workunit.client.0.smithi029.stdout:2/20: chown f4 833 1 2023-12-05T13:26:24.592 INFO:tasks.workunit.client.0.smithi029.stdout:1/159: mkdir d7/d31 0 2023-12-05T13:26:24.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/91: dwrite d1/d6/ff [0,4194304] 0 2023-12-05T13:26:24.595 INFO:tasks.workunit.client.0.smithi029.stdout:5/90: dwrite d1/f7 [0,4194304] 0 2023-12-05T13:26:24.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/214: rename d5/d6/l16 to d5/d6/d10/l50 0 2023-12-05T13:26:24.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/34: mknod c8 0 2023-12-05T13:26:24.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/35: stat l3 0 2023-12-05T13:26:24.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/36: read - f6 zero size 2023-12-05T13:26:24.607 INFO:tasks.workunit.client.0.smithi029.stdout:1/160: symlink d7/d1c/l32 0 2023-12-05T13:26:24.610 INFO:tasks.workunit.client.0.smithi029.stdout:3/92: creat d1/d6/d11/f1e x:0 0 0 2023-12-05T13:26:24.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/91: creat d1/dc/de/f22 x:0 0 0 2023-12-05T13:26:24.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/92: chown d1/dc/c15 175624581 1 2023-12-05T13:26:24.615 INFO:tasks.workunit.client.0.smithi029.stdout:8/215: unlink d5/dc/d17/d1d/f4d 0 2023-12-05T13:26:24.615 INFO:tasks.workunit.client.0.smithi029.stdout:8/216: fdatasync d5/d1e/f25 0 2023-12-05T13:26:24.615 INFO:tasks.workunit.client.0.smithi029.stdout:8/217: chown d5/dc/ff 5497 1 2023-12-05T13:26:24.616 INFO:tasks.workunit.client.0.smithi029.stdout:8/218: write d5/dc/d17/d1d/f2e [2044367,110848] 0 2023-12-05T13:26:24.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/37: creat f9 x:0 0 0 2023-12-05T13:26:24.620 INFO:tasks.workunit.client.0.smithi029.stdout:0/38: write f0 [2619696,14638] 0 2023-12-05T13:26:24.622 INFO:tasks.workunit.client.0.smithi029.stdout:1/161: rmdir d7/df/d2f 0 2023-12-05T13:26:24.625 INFO:tasks.workunit.client.0.smithi029.stdout:3/93: mkdir d1/d16/d1f 0 2023-12-05T13:26:24.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/93: symlink d1/dc/l23 0 2023-12-05T13:26:24.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/94: readlink l0 0 2023-12-05T13:26:24.626 INFO:tasks.workunit.client.0.smithi029.stdout:2/21: dwrite f4 [4194304,4194304] 0 2023-12-05T13:26:24.628 INFO:tasks.workunit.client.0.smithi029.stdout:2/22: dread f3 [0,4194304] 0 2023-12-05T13:26:24.628 INFO:tasks.workunit.client.0.smithi029.stdout:9/112: rmdir d7/d19/d1c 0 2023-12-05T13:26:24.629 INFO:tasks.workunit.client.0.smithi029.stdout:0/39: link f1 fa 0 2023-12-05T13:26:24.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/162: truncate d7/d1c/f1f 847257 0 2023-12-05T13:26:24.631 INFO:tasks.workunit.client.0.smithi029.stdout:8/219: dwrite d5/fe [0,4194304] 0 2023-12-05T13:26:24.632 INFO:tasks.workunit.client.0.smithi029.stdout:3/94: creat d1/d18/f20 x:0 0 0 2023-12-05T13:26:24.635 INFO:tasks.workunit.client.0.smithi029.stdout:5/95: symlink d1/dc/d11/l24 0 2023-12-05T13:26:24.635 INFO:tasks.workunit.client.0.smithi029.stdout:5/96: fdatasync d1/fb 0 2023-12-05T13:26:24.635 INFO:tasks.workunit.client.0.smithi029.stdout:5/97: write d1/dc/de/f22 [830397,71473] 0 2023-12-05T13:26:24.637 INFO:tasks.workunit.client.0.smithi029.stdout:2/23: creat f5 x:0 0 0 2023-12-05T13:26:24.637 INFO:tasks.workunit.client.0.smithi029.stdout:2/24: write f5 [694489,78724] 0 2023-12-05T13:26:24.637 INFO:tasks.workunit.client.0.smithi029.stdout:8/220: write d5/d1e/f25 [1652428,73726] 0 2023-12-05T13:26:24.637 INFO:tasks.workunit.client.0.smithi029.stdout:8/221: write d5/dc/d17/d1d/f29 [4255768,44807] 0 2023-12-05T13:26:24.638 INFO:tasks.workunit.client.0.smithi029.stdout:8/222: readlink d5/d6/d10/l50 0 2023-12-05T13:26:24.638 INFO:tasks.workunit.client.0.smithi029.stdout:9/113: rename d7/ld to d7/d19/l2a 0 2023-12-05T13:26:24.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/40: symlink lb 0 2023-12-05T13:26:24.641 INFO:tasks.workunit.client.0.smithi029.stdout:5/98: mkdir d1/dc/d25 0 2023-12-05T13:26:24.641 INFO:tasks.workunit.client.0.smithi029.stdout:5/99: readlink d1/dc/l23 0 2023-12-05T13:26:24.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/100: write d1/dc/d11/f12 [2138685,78529] 0 2023-12-05T13:26:24.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/25: rename f5 to f6 0 2023-12-05T13:26:24.645 INFO:tasks.workunit.client.0.smithi029.stdout:8/223: rmdir d5/d1e 39 2023-12-05T13:26:24.649 INFO:tasks.workunit.client.0.smithi029.stdout:3/95: rename d1/ce to d1/d6/d11/c21 0 2023-12-05T13:26:24.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/224: dread d5/d6/f9 [4194304,4194304] 0 2023-12-05T13:26:24.650 INFO:tasks.workunit.client.0.smithi029.stdout:8/225: read d5/d6/d10/d13/f41 [125215,30511] 0 2023-12-05T13:26:24.650 INFO:tasks.workunit.client.0.smithi029.stdout:9/114: mknod d7/c2b 0 2023-12-05T13:26:24.652 INFO:tasks.workunit.client.0.smithi029.stdout:0/41: mkdir dc 0 2023-12-05T13:26:24.653 INFO:tasks.workunit.client.0.smithi029.stdout:1/163: dwrite d7/fd [0,4194304] 0 2023-12-05T13:26:24.654 INFO:tasks.workunit.client.0.smithi029.stdout:5/101: unlink d1/c16 0 2023-12-05T13:26:24.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/226: rmdir d5/d1e 39 2023-12-05T13:26:24.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/227: stat d5/f27 0 2023-12-05T13:26:24.655 INFO:tasks.workunit.client.0.smithi029.stdout:8/228: chown d5/dc/d17/d1d/l47 0 1 2023-12-05T13:26:24.656 INFO:tasks.workunit.client.0.smithi029.stdout:9/115: mkdir d7/d2c 0 2023-12-05T13:26:24.657 INFO:tasks.workunit.client.0.smithi029.stdout:3/96: dread d1/d6/fb [0,4194304] 0 2023-12-05T13:26:24.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/42: creat dc/fd x:0 0 0 2023-12-05T13:26:24.658 INFO:tasks.workunit.client.0.smithi029.stdout:3/97: read d1/f2 [2125279,50237] 0 2023-12-05T13:26:24.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/164: symlink d7/d31/l33 0 2023-12-05T13:26:24.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/229: creat d5/d6/f51 x:0 0 0 2023-12-05T13:26:24.663 INFO:tasks.workunit.client.0.smithi029.stdout:9/116: truncate d7/d19/f1d 593708 0 2023-12-05T13:26:24.666 INFO:tasks.workunit.client.0.smithi029.stdout:0/43: creat dc/fe x:0 0 0 2023-12-05T13:26:24.669 INFO:tasks.workunit.client.0.smithi029.stdout:2/26: dwrite f4 [0,4194304] 0 2023-12-05T13:26:24.670 INFO:tasks.workunit.client.0.smithi029.stdout:1/165: rename d7/df/f15 to d7/f34 0 2023-12-05T13:26:24.673 INFO:tasks.workunit.client.0.smithi029.stdout:5/102: dread d1/dc/de/f22 [0,4194304] 0 2023-12-05T13:26:24.673 INFO:tasks.workunit.client.0.smithi029.stdout:5/103: truncate d1/f20 68471 0 2023-12-05T13:26:24.673 INFO:tasks.workunit.client.0.smithi029.stdout:5/104: chown d1/dc/d11/d17 7510740 1 2023-12-05T13:26:24.674 INFO:tasks.workunit.client.0.smithi029.stdout:9/117: creat d7/d19/d28/f2d x:0 0 0 2023-12-05T13:26:24.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/98: dread d1/d6/fa [0,4194304] 0 2023-12-05T13:26:24.675 INFO:tasks.workunit.client.0.smithi029.stdout:0/44: creat dc/ff x:0 0 0 2023-12-05T13:26:24.675 INFO:tasks.workunit.client.0.smithi029.stdout:0/45: chown dc/fe 26164814 1 2023-12-05T13:26:24.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/230: dwrite d5/dc/d18/f3d [0,4194304] 0 2023-12-05T13:26:24.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/166: mkdir d7/d1c/d35 0 2023-12-05T13:26:24.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/167: chown d7/d1c/d35 0 1 2023-12-05T13:26:24.682 INFO:tasks.workunit.client.0.smithi029.stdout:3/99: dread d1/d6/fa [0,4194304] 0 2023-12-05T13:26:24.682 INFO:tasks.workunit.client.0.smithi029.stdout:3/100: stat d1/d6/c17 0 2023-12-05T13:26:24.685 INFO:tasks.workunit.client.0.smithi029.stdout:3/101: read d1/d6/fa [3991094,97970] 0 2023-12-05T13:26:24.685 INFO:tasks.workunit.client.0.smithi029.stdout:3/102: chown d1/d10 198 1 2023-12-05T13:26:24.689 INFO:tasks.workunit.client.0.smithi029.stdout:0/46: symlink dc/l10 0 2023-12-05T13:26:24.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/47: dread f4 [0,4194304] 0 2023-12-05T13:26:24.699 INFO:tasks.workunit.client.0.smithi029.stdout:8/231: truncate d5/f3b 24545 0 2023-12-05T13:26:24.699 INFO:tasks.workunit.client.0.smithi029.stdout:1/168: dwrite d7/f34 [0,4194304] 0 2023-12-05T13:26:24.701 INFO:tasks.workunit.client.0.smithi029.stdout:8/232: write d5/dc/ff [2623520,100743] 0 2023-12-05T13:26:24.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/27: dwrite f6 [0,4194304] 0 2023-12-05T13:26:24.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/28: stat f3 0 2023-12-05T13:26:24.704 INFO:tasks.workunit.client.0.smithi029.stdout:2/29: chown f3 62 1 2023-12-05T13:26:24.706 INFO:tasks.workunit.client.0.smithi029.stdout:3/103: dwrite d1/f2 [0,4194304] 0 2023-12-05T13:26:24.709 INFO:tasks.workunit.client.0.smithi029.stdout:0/48: symlink dc/l11 0 2023-12-05T13:26:24.709 INFO:tasks.workunit.client.0.smithi029.stdout:0/49: chown fa 56 1 2023-12-05T13:26:24.709 INFO:tasks.workunit.client.0.smithi029.stdout:1/169: mknod d7/c36 0 2023-12-05T13:26:24.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/233: mknod d5/d2f/c52 0 2023-12-05T13:26:24.712 INFO:tasks.workunit.client.0.smithi029.stdout:2/30: symlink l7 0 2023-12-05T13:26:24.712 INFO:tasks.workunit.client.0.smithi029.stdout:2/31: fdatasync f4 0 2023-12-05T13:26:24.713 INFO:tasks.workunit.client.0.smithi029.stdout:3/104: creat d1/d6/d11/f22 x:0 0 0 2023-12-05T13:26:24.883 INFO:tasks.workunit.client.0.smithi029.stdout:0/50: dwrite f4 [0,4194304] 0 2023-12-05T13:26:24.883 INFO:tasks.workunit.client.0.smithi029.stdout:0/51: chown dc/fe 6342701 1 2023-12-05T13:26:24.922 INFO:tasks.workunit.client.0.smithi029.stdout:1/170: truncate d7/df/f2c 1649362 0 2023-12-05T13:26:24.923 INFO:tasks.workunit.client.0.smithi029.stdout:8/234: unlink d5/dc/d18/d26/c2b 0 2023-12-05T13:26:24.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/32: symlink l8 0 2023-12-05T13:26:24.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/33: readlink l8 0 2023-12-05T13:26:24.929 INFO:tasks.workunit.client.0.smithi029.stdout:3/105: creat d1/d6/f23 x:0 0 0 2023-12-05T13:26:24.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/106: write d1/d6/fa [4307371,92767] 0 2023-12-05T13:26:24.933 INFO:tasks.workunit.client.0.smithi029.stdout:0/52: rmdir dc 39 2023-12-05T13:26:24.936 INFO:tasks.workunit.client.0.smithi029.stdout:1/171: creat d7/d1c/d20/f37 x:0 0 0 2023-12-05T13:26:24.938 INFO:tasks.workunit.client.0.smithi029.stdout:8/235: mkdir d5/dc/d17/d53 0 2023-12-05T13:26:24.939 INFO:tasks.workunit.client.0.smithi029.stdout:2/34: creat f9 x:0 0 0 2023-12-05T13:26:24.939 INFO:tasks.workunit.client.0.smithi029.stdout:8/236: write f4 [714661,114641] 0 2023-12-05T13:26:24.939 INFO:tasks.workunit.client.0.smithi029.stdout:8/237: fdatasync d5/f3b 0 2023-12-05T13:26:24.947 INFO:tasks.workunit.client.0.smithi029.stdout:3/107: rmdir d1/d10/d1b 0 2023-12-05T13:26:24.951 INFO:tasks.workunit.client.0.smithi029.stdout:8/238: link d5/dc/l23 d5/dc/d17/d1d/l54 0 2023-12-05T13:26:24.952 INFO:tasks.workunit.client.0.smithi029.stdout:0/53: getdents dc 0 2023-12-05T13:26:24.955 INFO:tasks.workunit.client.0.smithi029.stdout:8/239: creat d5/d6/d10/d13/f55 x:0 0 0 2023-12-05T13:26:24.958 INFO:tasks.workunit.client.0.smithi029.stdout:0/54: symlink dc/l12 0 2023-12-05T13:26:24.961 INFO:tasks.workunit.client.0.smithi029.stdout:8/240: rmdir d5/d2f/d3a/d3c 39 2023-12-05T13:26:24.961 INFO:tasks.workunit.client.0.smithi029.stdout:8/241: chown d5/f3b 5 1 2023-12-05T13:26:24.962 INFO:tasks.workunit.client.0.smithi029.stdout:8/242: rmdir d5/d1e 39 2023-12-05T13:26:24.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/243: truncate d5/dc/d17/f4e 154116 0 2023-12-05T13:26:24.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/244: chown d5/d2f/c52 21 1 2023-12-05T13:26:24.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/172: dwrite d7/df/f21 [0,4194304] 0 2023-12-05T13:26:24.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/35: dwrite f4 [0,4194304] 0 2023-12-05T13:26:24.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/173: write d7/fc [1044784,4029] 0 2023-12-05T13:26:24.964 INFO:tasks.workunit.client.0.smithi029.stdout:1/174: chown d7/c30 0 1 2023-12-05T13:26:24.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/175: write d7/df/d12/f2d [792728,41922] 0 2023-12-05T13:26:24.965 INFO:tasks.workunit.client.0.smithi029.stdout:1/176: write d7/df/f2c [861860,44767] 0 2023-12-05T13:26:24.965 INFO:tasks.workunit.client.0.smithi029.stdout:0/55: mkdir dc/d13 0 2023-12-05T13:26:24.967 INFO:tasks.workunit.client.0.smithi029.stdout:8/245: mkdir d5/dc/d56 0 2023-12-05T13:26:24.978 INFO:tasks.workunit.client.0.smithi029.stdout:2/36: creat fa x:0 0 0 2023-12-05T13:26:24.980 INFO:tasks.workunit.client.0.smithi029.stdout:1/177: creat d7/d1c/d20/f38 x:0 0 0 2023-12-05T13:26:24.980 INFO:tasks.workunit.client.0.smithi029.stdout:0/56: read - dc/fe zero size 2023-12-05T13:26:24.982 INFO:tasks.workunit.client.0.smithi029.stdout:8/246: creat d5/dc/d18/f57 x:0 0 0 2023-12-05T13:26:24.983 INFO:tasks.workunit.client.0.smithi029.stdout:2/37: creat fb x:0 0 0 2023-12-05T13:26:24.984 INFO:tasks.workunit.client.0.smithi029.stdout:2/38: readlink l8 0 2023-12-05T13:26:24.986 INFO:tasks.workunit.client.0.smithi029.stdout:1/178: link d7/d1c/f25 d7/d1c/d35/f39 0 2023-12-05T13:26:24.987 INFO:tasks.workunit.client.0.smithi029.stdout:1/179: readlink d7/d31/l33 0 2023-12-05T13:26:24.987 INFO:tasks.workunit.client.0.smithi029.stdout:1/180: chown d7/d1c/d20/f38 60 1 2023-12-05T13:26:24.987 INFO:tasks.workunit.client.0.smithi029.stdout:1/181: chown d7/c10 64611644 1 2023-12-05T13:26:24.987 INFO:tasks.workunit.client.0.smithi029.stdout:1/182: readlink d7/d1c/d20/l29 0 2023-12-05T13:26:24.988 INFO:tasks.workunit.client.0.smithi029.stdout:1/183: dread d7/f13 [0,4194304] 0 2023-12-05T13:26:24.988 INFO:tasks.workunit.client.0.smithi029.stdout:0/57: unlink l3 0 2023-12-05T13:26:24.988 INFO:tasks.workunit.client.0.smithi029.stdout:0/58: readlink lb 0 2023-12-05T13:26:24.989 INFO:tasks.workunit.client.0.smithi029.stdout:0/59: write f1 [827366,87690] 0 2023-12-05T13:26:24.990 INFO:tasks.workunit.client.0.smithi029.stdout:8/247: rename d5/d1e/l44 to d5/dc/d18/l58 0 2023-12-05T13:26:24.990 INFO:tasks.workunit.client.0.smithi029.stdout:8/248: readlink d5/d6/d10/d13/l37 0 2023-12-05T13:26:24.991 INFO:tasks.workunit.client.0.smithi029.stdout:2/39: creat fc x:0 0 0 2023-12-05T13:26:24.991 INFO:tasks.workunit.client.0.smithi029.stdout:0/60: fdatasync fa 0 2023-12-05T13:26:24.992 INFO:tasks.workunit.client.0.smithi029.stdout:0/61: fsync f0 0 2023-12-05T13:26:24.992 INFO:tasks.workunit.client.0.smithi029.stdout:0/62: chown f1 39 1 2023-12-05T13:26:24.993 INFO:tasks.workunit.client.0.smithi029.stdout:1/184: unlink d7/df/f2c 0 2023-12-05T13:26:24.995 INFO:tasks.workunit.client.0.smithi029.stdout:2/40: mknod cd 0 2023-12-05T13:26:24.997 INFO:tasks.workunit.client.0.smithi029.stdout:0/63: creat dc/f14 x:0 0 0 2023-12-05T13:26:24.997 INFO:tasks.workunit.client.0.smithi029.stdout:0/64: stat dc/l12 0 2023-12-05T13:26:24.998 INFO:tasks.workunit.client.0.smithi029.stdout:1/185: mknod d7/d1c/d20/c3a 0 2023-12-05T13:26:24.999 INFO:tasks.workunit.client.0.smithi029.stdout:2/41: mkdir de 0 2023-12-05T13:26:25.002 INFO:tasks.workunit.client.0.smithi029.stdout:1/186: unlink d7/f8 0 2023-12-05T13:26:25.002 INFO:tasks.workunit.client.0.smithi029.stdout:2/42: mknod de/cf 0 2023-12-05T13:26:25.004 INFO:tasks.workunit.client.0.smithi029.stdout:1/187: symlink d7/d1c/d20/l3b 0 2023-12-05T13:26:25.005 INFO:tasks.workunit.client.0.smithi029.stdout:2/43: mknod de/c10 0 2023-12-05T13:26:25.007 INFO:tasks.workunit.client.0.smithi029.stdout:1/188: unlink d7/d1c/d20/l3b 0 2023-12-05T13:26:25.007 INFO:tasks.workunit.client.0.smithi029.stdout:2/44: mkdir de/d11 0 2023-12-05T13:26:25.007 INFO:tasks.workunit.client.0.smithi029.stdout:2/45: chown f3 480784 1 2023-12-05T13:26:25.008 INFO:tasks.workunit.client.0.smithi029.stdout:2/46: write fb [427513,51278] 0 2023-12-05T13:26:25.008 INFO:tasks.workunit.client.0.smithi029.stdout:2/47: dread - fa zero size 2023-12-05T13:26:25.008 INFO:tasks.workunit.client.0.smithi029.stdout:2/48: fdatasync f9 0 2023-12-05T13:26:25.008 INFO:tasks.workunit.client.0.smithi029.stdout:2/49: read f6 [1645009,18617] 0 2023-12-05T13:26:25.009 INFO:tasks.workunit.client.0.smithi029.stdout:1/189: link d7/f34 d7/d31/f3c 0 2023-12-05T13:26:25.011 INFO:tasks.workunit.client.0.smithi029.stdout:1/190: creat d7/d31/f3d x:0 0 0 2023-12-05T13:26:25.011 INFO:tasks.workunit.client.0.smithi029.stdout:1/191: fdatasync d7/f13 0 2023-12-05T13:26:25.014 INFO:tasks.workunit.client.0.smithi029.stdout:1/192: symlink d7/d1c/d35/l3e 0 2023-12-05T13:26:25.015 INFO:tasks.workunit.client.0.smithi029.stdout:1/193: read f3 [1113758,101827] 0 2023-12-05T13:26:25.015 INFO:tasks.workunit.client.0.smithi029.stdout:8/249: getdents d5/dc/d18 0 2023-12-05T13:26:25.023 INFO:tasks.workunit.client.0.smithi029.stdout:0/65: truncate fa 3504490 0 2023-12-05T13:26:25.026 INFO:tasks.workunit.client.0.smithi029.stdout:2/50: dwrite f4 [4194304,4194304] 0 2023-12-05T13:26:25.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/51: write fc [591109,100371] 0 2023-12-05T13:26:25.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/52: readlink l7 0 2023-12-05T13:26:25.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/53: chown fc 3 1 2023-12-05T13:26:25.027 INFO:tasks.workunit.client.0.smithi029.stdout:0/66: link dc/l12 dc/d13/l15 0 2023-12-05T13:26:25.027 INFO:tasks.workunit.client.0.smithi029.stdout:0/67: chown f4 183591 1 2023-12-05T13:26:25.030 INFO:tasks.workunit.client.0.smithi029.stdout:0/68: creat dc/f16 x:0 0 0 2023-12-05T13:26:25.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/54: dread fc [0,4194304] 0 2023-12-05T13:26:25.031 INFO:tasks.workunit.client.0.smithi029.stdout:2/55: read fc [316923,11829] 0 2023-12-05T13:26:25.033 INFO:tasks.workunit.client.0.smithi029.stdout:0/69: symlink dc/d13/l17 0 2023-12-05T13:26:25.033 INFO:tasks.workunit.client.0.smithi029.stdout:8/250: dwrite d5/dc/ff [0,4194304] 0 2023-12-05T13:26:25.034 INFO:tasks.workunit.client.0.smithi029.stdout:8/251: dread - d5/d2f/d3a/f48 zero size 2023-12-05T13:26:25.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/56: creat de/f12 x:0 0 0 2023-12-05T13:26:25.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/57: dread - fa zero size 2023-12-05T13:26:25.037 INFO:tasks.workunit.client.0.smithi029.stdout:0/70: mknod dc/d13/c18 0 2023-12-05T13:26:25.037 INFO:tasks.workunit.client.0.smithi029.stdout:0/71: chown dc/d13/l17 52 1 2023-12-05T13:26:25.040 INFO:tasks.workunit.client.0.smithi029.stdout:2/58: creat de/f13 x:0 0 0 2023-12-05T13:26:25.040 INFO:tasks.workunit.client.0.smithi029.stdout:2/59: dread - de/f13 zero size 2023-12-05T13:26:25.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/194: truncate d7/fc 2541089 0 2023-12-05T13:26:25.044 INFO:tasks.workunit.client.0.smithi029.stdout:0/72: creat dc/d13/f19 x:0 0 0 2023-12-05T13:26:25.045 INFO:tasks.workunit.client.0.smithi029.stdout:8/252: mkdir d5/d6/d59 0 2023-12-05T13:26:25.047 INFO:tasks.workunit.client.0.smithi029.stdout:2/60: dread fb [0,4194304] 0 2023-12-05T13:26:25.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/73: creat dc/f1a x:0 0 0 2023-12-05T13:26:25.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/74: dread - dc/f1a zero size 2023-12-05T13:26:25.048 INFO:tasks.workunit.client.0.smithi029.stdout:0/75: truncate dc/f1a 645315 0 2023-12-05T13:26:25.048 INFO:tasks.workunit.client.0.smithi029.stdout:8/253: dread d5/dc/d17/d1d/f2a [0,4194304] 0 2023-12-05T13:26:25.049 INFO:tasks.workunit.client.0.smithi029.stdout:0/76: creat dc/d13/f1b x:0 0 0 2023-12-05T13:26:25.049 INFO:tasks.workunit.client.0.smithi029.stdout:0/77: fsync f0 0 2023-12-05T13:26:25.049 INFO:tasks.workunit.client.0.smithi029.stdout:0/78: dread - dc/f16 zero size 2023-12-05T13:26:25.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/79: fdatasync dc/f14 0 2023-12-05T13:26:25.050 INFO:tasks.workunit.client.0.smithi029.stdout:0/80: write f6 [155910,93700] 0 2023-12-05T13:26:25.050 INFO:tasks.workunit.client.0.smithi029.stdout:8/254: creat d5/dc/d18/d26/f5a x:0 0 0 2023-12-05T13:26:25.053 INFO:tasks.workunit.client.0.smithi029.stdout:0/81: creat dc/d13/f1c x:0 0 0 2023-12-05T13:26:25.057 INFO:tasks.workunit.client.0.smithi029.stdout:0/82: symlink dc/l1d 0 2023-12-05T13:26:25.062 INFO:tasks.workunit.client.0.smithi029.stdout:0/83: fsync f6 0 2023-12-05T13:26:25.062 INFO:tasks.workunit.client.0.smithi029.stdout:0/84: dread - dc/f14 zero size 2023-12-05T13:26:25.062 INFO:tasks.workunit.client.0.smithi029.stdout:1/195: dwrite f3 [0,4194304] 0 2023-12-05T13:26:25.065 INFO:tasks.workunit.client.0.smithi029.stdout:2/61: truncate f4 1149675 0 2023-12-05T13:26:25.071 INFO:tasks.workunit.client.0.smithi029.stdout:1/196: symlink d7/d31/l3f 0 2023-12-05T13:26:25.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/255: dwrite d5/d1e/f3f [0,4194304] 0 2023-12-05T13:26:25.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/256: chown d5/d6/d10 1 1 2023-12-05T13:26:25.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/257: write d5/d1e/f22 [2506278,85990] 0 2023-12-05T13:26:25.078 INFO:tasks.workunit.client.0.smithi029.stdout:2/62: dwrite fc [0,4194304] 0 2023-12-05T13:26:25.079 INFO:tasks.workunit.client.0.smithi029.stdout:2/63: fdatasync de/f13 0 2023-12-05T13:26:25.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/85: link dc/fd dc/f1e 0 2023-12-05T13:26:25.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/86: stat dc/f16 0 2023-12-05T13:26:25.083 INFO:tasks.workunit.client.0.smithi029.stdout:0/87: chown dc/d13 189364 1 2023-12-05T13:26:25.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/197: dwrite d7/d31/f3c [0,4194304] 0 2023-12-05T13:26:25.088 INFO:tasks.workunit.client.0.smithi029.stdout:8/258: mknod d5/c5b 0 2023-12-05T13:26:25.088 INFO:tasks.workunit.client.0.smithi029.stdout:8/259: write d5/dc/d18/f35 [917448,33479] 0 2023-12-05T13:26:25.091 INFO:tasks.workunit.client.0.smithi029.stdout:0/88: mknod dc/d13/c1f 0 2023-12-05T13:26:25.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/198: truncate d7/fc 1612311 0 2023-12-05T13:26:25.095 INFO:tasks.workunit.client.0.smithi029.stdout:8/260: truncate d5/d6/f1a 692569 0 2023-12-05T13:26:25.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/89: mknod dc/c20 0 2023-12-05T13:26:25.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/90: fdatasync dc/d13/f1b 0 2023-12-05T13:26:25.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/91: write dc/f1e [254205,37593] 0 2023-12-05T13:26:25.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/64: dwrite f4 [0,4194304] 0 2023-12-05T13:26:25.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/65: truncate fa 581066 0 2023-12-05T13:26:25.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/66: write fb [468587,104734] 0 2023-12-05T13:26:25.102 INFO:tasks.workunit.client.0.smithi029.stdout:2/67: read f4 [1163713,39098] 0 2023-12-05T13:26:25.104 INFO:tasks.workunit.client.0.smithi029.stdout:0/92: link dc/d13/l15 dc/d13/l21 0 2023-12-05T13:26:25.115 INFO:tasks.workunit.client.0.smithi029.stdout:1/199: dwrite d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:25.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/261: dwrite d5/d6/d10/d13/f55 [0,4194304] 0 2023-12-05T13:26:25.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/68: dwrite f4 [4194304,4194304] 0 2023-12-05T13:26:25.124 INFO:tasks.workunit.client.0.smithi029.stdout:1/200: dread d7/df/f21 [0,4194304] 0 2023-12-05T13:26:25.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/69: chown fa 748 1 2023-12-05T13:26:25.126 INFO:tasks.workunit.client.0.smithi029.stdout:1/201: dread d7/d1c/d35/f39 [0,4194304] 0 2023-12-05T13:26:25.127 INFO:tasks.workunit.client.0.smithi029.stdout:1/202: read f3 [2453339,105911] 0 2023-12-05T13:26:25.136 INFO:tasks.workunit.client.0.smithi029.stdout:8/262: mknod d5/dc/d18/c5c 0 2023-12-05T13:26:25.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/203: symlink d7/d1c/l40 0 2023-12-05T13:26:25.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/204: truncate d7/f34 5190282 0 2023-12-05T13:26:25.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/205: readlink d7/d31/l33 0 2023-12-05T13:26:25.145 INFO:tasks.workunit.client.0.smithi029.stdout:0/93: link dc/d13/l17 dc/l22 0 2023-12-05T13:26:25.146 INFO:tasks.workunit.client.0.smithi029.stdout:8/263: symlink d5/dc/d17/d1d/l5d 0 2023-12-05T13:26:25.148 INFO:tasks.workunit.client.0.smithi029.stdout:8/264: dread d5/d6/f4b [0,4194304] 0 2023-12-05T13:26:25.149 INFO:tasks.workunit.client.0.smithi029.stdout:1/206: mknod d7/df/c41 0 2023-12-05T13:26:25.149 INFO:tasks.workunit.client.0.smithi029.stdout:1/207: fsync d7/fb 0 2023-12-05T13:26:25.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/208: symlink d7/d1c/d35/l42 0 2023-12-05T13:26:25.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/209: chown d7/d1c/d20/l27 3182 1 2023-12-05T13:26:25.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/210: chown f3 51674 1 2023-12-05T13:26:25.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/211: fdatasync d7/d31/f3c 0 2023-12-05T13:26:25.154 INFO:tasks.workunit.client.0.smithi029.stdout:1/212: fsync d7/d1c/d20/f28 0 2023-12-05T13:26:25.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/94: dread f0 [0,4194304] 0 2023-12-05T13:26:25.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/95: write dc/fe [236266,37068] 0 2023-12-05T13:26:25.155 INFO:tasks.workunit.client.0.smithi029.stdout:0/96: dread - dc/d13/f19 zero size 2023-12-05T13:26:25.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/213: rmdir d7/d1c/d35 39 2023-12-05T13:26:25.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/214: truncate d7/d1c/d20/f28 892046 0 2023-12-05T13:26:25.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/215: chown d7/c30 217 1 2023-12-05T13:26:25.156 INFO:tasks.workunit.client.0.smithi029.stdout:8/265: dread d5/d1e/f3f [0,4194304] 0 2023-12-05T13:26:25.156 INFO:tasks.workunit.client.0.smithi029.stdout:8/266: write d5/d6/f4b [1288806,59987] 0 2023-12-05T13:26:25.157 INFO:tasks.workunit.client.0.smithi029.stdout:1/216: mknod d7/d1c/d20/c43 0 2023-12-05T13:26:25.157 INFO:tasks.workunit.client.0.smithi029.stdout:1/217: fsync d7/df/d12/f2d 0 2023-12-05T13:26:25.157 INFO:tasks.workunit.client.0.smithi029.stdout:1/218: fsync d7/d1c/d35/f39 0 2023-12-05T13:26:25.158 INFO:tasks.workunit.client.0.smithi029.stdout:2/70: truncate fb 148291 0 2023-12-05T13:26:25.159 INFO:tasks.workunit.client.0.smithi029.stdout:0/97: mkdir dc/d23 0 2023-12-05T13:26:25.159 INFO:tasks.workunit.client.0.smithi029.stdout:2/71: write f6 [2038488,119551] 0 2023-12-05T13:26:25.163 INFO:tasks.workunit.client.0.smithi029.stdout:8/267: creat d5/dc/d56/f5e x:0 0 0 2023-12-05T13:26:25.163 INFO:tasks.workunit.client.0.smithi029.stdout:8/268: dread - d5/dc/d18/d26/f5a zero size 2023-12-05T13:26:25.167 INFO:tasks.workunit.client.0.smithi029.stdout:1/219: creat d7/df/d12/f44 x:0 0 0 2023-12-05T13:26:25.173 INFO:tasks.workunit.client.0.smithi029.stdout:4/55: sync 2023-12-05T13:26:25.173 INFO:tasks.workunit.client.0.smithi029.stdout:7/153: sync 2023-12-05T13:26:25.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/269: rename d5/d6/d10/l38 to d5/d2f/d3a/l5f 0 2023-12-05T13:26:25.173 INFO:tasks.workunit.client.0.smithi029.stdout:8/270: chown d5/d6/l40 793213866 1 2023-12-05T13:26:25.175 INFO:tasks.workunit.client.0.smithi029.stdout:1/220: truncate d7/d31/f3d 2530665 0 2023-12-05T13:26:25.177 INFO:tasks.workunit.client.0.smithi029.stdout:4/56: mkdir d0/d16 0 2023-12-05T13:26:25.177 INFO:tasks.workunit.client.0.smithi029.stdout:4/57: stat d0/da/l8 0 2023-12-05T13:26:25.177 INFO:tasks.workunit.client.0.smithi029.stdout:4/58: fdatasync d0/d1/fc 0 2023-12-05T13:26:25.177 INFO:tasks.workunit.client.0.smithi029.stdout:0/98: dwrite dc/f14 [0,4194304] 0 2023-12-05T13:26:25.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/154: mknod d6/df/c2e 0 2023-12-05T13:26:25.179 INFO:tasks.workunit.client.0.smithi029.stdout:8/271: link d5/d1e/f3f d5/dc/d17/d53/f60 0 2023-12-05T13:26:25.180 INFO:tasks.workunit.client.0.smithi029.stdout:8/272: write d5/dc/d18/f3d [3470346,33685] 0 2023-12-05T13:26:25.181 INFO:tasks.workunit.client.0.smithi029.stdout:1/221: symlink d7/df/l45 0 2023-12-05T13:26:25.181 INFO:tasks.workunit.client.0.smithi029.stdout:1/222: stat d7/df/d12/f1d 0 2023-12-05T13:26:25.182 INFO:tasks.workunit.client.0.smithi029.stdout:4/59: truncate d0/d1/f7 3004870 0 2023-12-05T13:26:25.182 INFO:tasks.workunit.client.0.smithi029.stdout:2/72: dwrite f6 [0,4194304] 0 2023-12-05T13:26:25.182 INFO:tasks.workunit.client.0.smithi029.stdout:0/99: dread fa [0,4194304] 0 2023-12-05T13:26:25.185 INFO:tasks.workunit.client.0.smithi029.stdout:7/155: mkdir d6/d2a/d2f 0 2023-12-05T13:26:25.192 INFO:tasks.workunit.client.0.smithi029.stdout:1/223: unlink d7/d1c/f1f 0 2023-12-05T13:26:25.192 INFO:tasks.workunit.client.0.smithi029.stdout:1/224: truncate d7/d1c/d20/f28 1638156 0 2023-12-05T13:26:25.195 INFO:tasks.workunit.client.0.smithi029.stdout:8/273: rmdir d5/dc/d17 39 2023-12-05T13:26:25.199 INFO:tasks.workunit.client.0.smithi029.stdout:4/60: rename d0/da/l8 to d0/d16/l17 0 2023-12-05T13:26:25.199 INFO:tasks.workunit.client.0.smithi029.stdout:4/61: truncate d0/d1/fc 472188 0 2023-12-05T13:26:25.201 INFO:tasks.workunit.client.0.smithi029.stdout:2/73: mkdir de/d14 0 2023-12-05T13:26:25.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/156: mkdir d6/d30 0 2023-12-05T13:26:25.209 INFO:tasks.workunit.client.0.smithi029.stdout:7/157: fsync d6/df/d1a/f27 0 2023-12-05T13:26:25.214 INFO:tasks.workunit.client.0.smithi029.stdout:1/225: rename d7/df/f21 to d7/df/d12/f46 0 2023-12-05T13:26:25.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/62: getdents d0 0 2023-12-05T13:26:25.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/63: readlink d0/l13 0 2023-12-05T13:26:25.219 INFO:tasks.workunit.client.0.smithi029.stdout:2/74: getdents de 0 2023-12-05T13:26:25.220 INFO:tasks.workunit.client.0.smithi029.stdout:0/100: mknod dc/c24 0 2023-12-05T13:26:25.220 INFO:tasks.workunit.client.0.smithi029.stdout:0/101: write dc/f16 [231321,43341] 0 2023-12-05T13:26:25.220 INFO:tasks.workunit.client.0.smithi029.stdout:0/102: write dc/f14 [144037,72741] 0 2023-12-05T13:26:25.221 INFO:tasks.workunit.client.0.smithi029.stdout:0/103: truncate dc/f1a 1093201 0 2023-12-05T13:26:25.222 INFO:tasks.workunit.client.0.smithi029.stdout:7/158: creat d6/df/d1a/d26/f31 x:0 0 0 2023-12-05T13:26:25.224 INFO:tasks.workunit.client.0.smithi029.stdout:1/226: creat d7/d1c/d20/f47 x:0 0 0 2023-12-05T13:26:25.224 INFO:tasks.workunit.client.0.smithi029.stdout:1/227: fsync d7/fc 0 2023-12-05T13:26:25.225 INFO:tasks.workunit.client.0.smithi029.stdout:4/64: rmdir d0/de 39 2023-12-05T13:26:25.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/75: unlink fc 0 2023-12-05T13:26:25.231 INFO:tasks.workunit.client.0.smithi029.stdout:7/159: truncate d6/f15 3632205 0 2023-12-05T13:26:25.233 INFO:tasks.workunit.client.0.smithi029.stdout:7/160: write d6/f9 [2512346,101677] 0 2023-12-05T13:26:25.233 INFO:tasks.workunit.client.0.smithi029.stdout:8/274: rename d5/d1e to d5/d6/d61 0 2023-12-05T13:26:25.233 INFO:tasks.workunit.client.0.smithi029.stdout:0/104: dwrite f9 [0,4194304] 0 2023-12-05T13:26:25.233 INFO:tasks.workunit.client.0.smithi029.stdout:8/275: write d5/dc/d56/f5e [975601,99255] 0 2023-12-05T13:26:25.234 INFO:tasks.workunit.client.0.smithi029.stdout:8/276: dread d5/dc/f32 [0,4194304] 0 2023-12-05T13:26:25.235 INFO:tasks.workunit.client.0.smithi029.stdout:8/277: fdatasync d5/d6/d61/f25 0 2023-12-05T13:26:25.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/228: mkdir d7/df/d48 0 2023-12-05T13:26:25.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/229: stat d7/df/d12/f1d 0 2023-12-05T13:26:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:2/76: symlink de/d11/l15 0 2023-12-05T13:26:25.240 INFO:tasks.workunit.client.0.smithi029.stdout:2/77: dread - de/f12 zero size 2023-12-05T13:26:25.249 INFO:tasks.workunit.client.0.smithi029.stdout:7/161: creat d6/d30/f32 x:0 0 0 2023-12-05T13:26:25.253 INFO:tasks.workunit.client.0.smithi029.stdout:8/278: creat d5/dc/d17/d53/f62 x:0 0 0 2023-12-05T13:26:25.253 INFO:tasks.workunit.client.0.smithi029.stdout:8/279: rename d5 to d5/dc/d17/d1d/d63 22 2023-12-05T13:26:25.254 INFO:tasks.workunit.client.0.smithi029.stdout:1/230: creat d7/f49 x:0 0 0 2023-12-05T13:26:25.257 INFO:tasks.workunit.client.0.smithi029.stdout:2/78: mkdir de/d16 0 2023-12-05T13:26:25.259 INFO:tasks.workunit.client.0.smithi029.stdout:7/162: symlink d6/df/l33 0 2023-12-05T13:26:25.259 INFO:tasks.workunit.client.0.smithi029.stdout:0/105: mknod dc/c25 0 2023-12-05T13:26:25.262 INFO:tasks.workunit.client.0.smithi029.stdout:8/280: creat d5/dc/d18/d26/f64 x:0 0 0 2023-12-05T13:26:25.263 INFO:tasks.workunit.client.0.smithi029.stdout:1/231: creat d7/df/d48/f4a x:0 0 0 2023-12-05T13:26:25.264 INFO:tasks.workunit.client.0.smithi029.stdout:1/232: write d7/df/d12/f46 [4970132,23023] 0 2023-12-05T13:26:25.266 INFO:tasks.workunit.client.0.smithi029.stdout:2/79: unlink c1 0 2023-12-05T13:26:25.269 INFO:tasks.workunit.client.0.smithi029.stdout:7/163: truncate d6/d19/f25 927578 0 2023-12-05T13:26:25.272 INFO:tasks.workunit.client.0.smithi029.stdout:1/233: mkdir d7/d31/d4b 0 2023-12-05T13:26:25.273 INFO:tasks.workunit.client.0.smithi029.stdout:2/80: mknod de/c17 0 2023-12-05T13:26:25.273 INFO:tasks.workunit.client.0.smithi029.stdout:2/81: dread - de/f12 zero size 2023-12-05T13:26:25.276 INFO:tasks.workunit.client.0.smithi029.stdout:7/164: creat d6/d19/f34 x:0 0 0 2023-12-05T13:26:25.276 INFO:tasks.workunit.client.0.smithi029.stdout:8/281: symlink d5/d6/l65 0 2023-12-05T13:26:25.278 INFO:tasks.workunit.client.0.smithi029.stdout:0/106: dwrite fa [0,4194304] 0 2023-12-05T13:26:25.278 INFO:tasks.workunit.client.0.smithi029.stdout:0/107: chown dc/d13 989 1 2023-12-05T13:26:25.279 INFO:tasks.workunit.client.0.smithi029.stdout:4/65: dwrite d0/d1/f7 [0,4194304] 0 2023-12-05T13:26:25.279 INFO:tasks.workunit.client.0.smithi029.stdout:1/234: symlink d7/d31/l4c 0 2023-12-05T13:26:25.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/82: mkdir de/d16/d18 0 2023-12-05T13:26:25.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/83: fdatasync f4 0 2023-12-05T13:26:25.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/84: fsync fa 0 2023-12-05T13:26:25.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/85: write fb [1124901,114316] 0 2023-12-05T13:26:25.286 INFO:tasks.workunit.client.0.smithi029.stdout:7/165: mkdir d6/d35 0 2023-12-05T13:26:25.290 INFO:tasks.workunit.client.0.smithi029.stdout:8/282: unlink d5/d6/d61/f3f 0 2023-12-05T13:26:25.295 INFO:tasks.workunit.client.0.smithi029.stdout:0/108: unlink dc/l12 0 2023-12-05T13:26:25.299 INFO:tasks.workunit.client.0.smithi029.stdout:1/235: rename d7/f34 to d7/f4d 0 2023-12-05T13:26:25.302 INFO:tasks.workunit.client.0.smithi029.stdout:2/86: creat de/d16/d18/f19 x:0 0 0 2023-12-05T13:26:25.302 INFO:tasks.workunit.client.0.smithi029.stdout:2/87: chown de/d11/l15 0 1 2023-12-05T13:26:25.302 INFO:tasks.workunit.client.0.smithi029.stdout:7/166: dwrite d6/f11 [0,4194304] 0 2023-12-05T13:26:25.303 INFO:tasks.workunit.client.0.smithi029.stdout:8/283: rename d5/f3b to d5/dc/d18/d26/f66 0 2023-12-05T13:26:25.306 INFO:tasks.workunit.client.0.smithi029.stdout:0/109: dread f0 [0,4194304] 0 2023-12-05T13:26:25.306 INFO:tasks.workunit.client.0.smithi029.stdout:7/167: write d6/df/d1a/d26/f2b [2495022,74957] 0 2023-12-05T13:26:25.306 INFO:tasks.workunit.client.0.smithi029.stdout:1/236: dread d7/df/d12/f46 [0,4194304] 0 2023-12-05T13:26:25.306 INFO:tasks.workunit.client.0.smithi029.stdout:1/237: fdatasync d7/d31/f3c 0 2023-12-05T13:26:25.307 INFO:tasks.workunit.client.0.smithi029.stdout:0/110: read dc/fd [232212,121895] 0 2023-12-05T13:26:25.307 INFO:tasks.workunit.client.0.smithi029.stdout:0/111: rename dc to dc/d23/d26 22 2023-12-05T13:26:25.307 INFO:tasks.workunit.client.0.smithi029.stdout:0/112: chown dc/l22 90274902 1 2023-12-05T13:26:25.307 INFO:tasks.workunit.client.0.smithi029.stdout:0/113: chown dc/c20 3940667 1 2023-12-05T13:26:25.307 INFO:tasks.workunit.client.0.smithi029.stdout:4/66: truncate d0/f5 857076 0 2023-12-05T13:26:25.309 INFO:tasks.workunit.client.0.smithi029.stdout:8/284: mkdir d5/dc/d18/d67 0 2023-12-05T13:26:25.310 INFO:tasks.workunit.client.0.smithi029.stdout:7/168: creat d6/df/f36 x:0 0 0 2023-12-05T13:26:25.310 INFO:tasks.workunit.client.0.smithi029.stdout:7/169: fdatasync d6/f15 0 2023-12-05T13:26:25.311 INFO:tasks.workunit.client.0.smithi029.stdout:1/238: symlink d7/d1c/l4e 0 2023-12-05T13:26:25.312 INFO:tasks.workunit.client.0.smithi029.stdout:1/239: write d7/d1c/f25 [480077,34909] 0 2023-12-05T13:26:25.312 INFO:tasks.workunit.client.0.smithi029.stdout:1/240: write d7/fc [2420115,38678] 0 2023-12-05T13:26:25.312 INFO:tasks.workunit.client.0.smithi029.stdout:1/241: write f3 [4337026,79081] 0 2023-12-05T13:26:25.314 INFO:tasks.workunit.client.0.smithi029.stdout:0/114: creat dc/f27 x:0 0 0 2023-12-05T13:26:25.315 INFO:tasks.workunit.client.0.smithi029.stdout:4/67: unlink d0/d1/f7 0 2023-12-05T13:26:25.316 INFO:tasks.workunit.client.0.smithi029.stdout:8/285: creat d5/d2f/f68 x:0 0 0 2023-12-05T13:26:25.317 INFO:tasks.workunit.client.0.smithi029.stdout:8/286: read d5/dc/d18/f35 [318969,115433] 0 2023-12-05T13:26:25.318 INFO:tasks.workunit.client.0.smithi029.stdout:7/170: mknod d6/df/d1a/c37 0 2023-12-05T13:26:25.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/242: mkdir d7/d1c/d35/d4f 0 2023-12-05T13:26:25.321 INFO:tasks.workunit.client.0.smithi029.stdout:1/243: fdatasync d7/fd 0 2023-12-05T13:26:25.324 INFO:tasks.workunit.client.0.smithi029.stdout:2/88: dwrite fb [0,4194304] 0 2023-12-05T13:26:25.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/89: write f4 [5069801,18310] 0 2023-12-05T13:26:25.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/90: stat l8 0 2023-12-05T13:26:25.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/91: read - f9 zero size 2023-12-05T13:26:25.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/92: readlink l7 0 2023-12-05T13:26:25.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/171: dread d6/df/d1a/d26/f2b [0,4194304] 0 2023-12-05T13:26:25.343 INFO:tasks.workunit.client.0.smithi029.stdout:8/287: rmdir d5/dc/d18/d67 0 2023-12-05T13:26:25.343 INFO:tasks.workunit.client.0.smithi029.stdout:8/288: dread - d5/d6/f51 zero size 2023-12-05T13:26:25.343 INFO:tasks.workunit.client.0.smithi029.stdout:8/289: truncate d5/dc/ff 4715283 0 2023-12-05T13:26:25.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/115: creat dc/d13/f28 x:0 0 0 2023-12-05T13:26:25.352 INFO:tasks.workunit.client.0.smithi029.stdout:7/172: dwrite f1 [4194304,4194304] 0 2023-12-05T13:26:25.352 INFO:tasks.workunit.client.0.smithi029.stdout:7/173: fsync d6/df/d1a/d26/f31 0 2023-12-05T13:26:25.358 INFO:tasks.workunit.client.0.smithi029.stdout:8/290: dwrite d5/dc/d17/d1d/f2a [0,4194304] 0 2023-12-05T13:26:25.358 INFO:tasks.workunit.client.0.smithi029.stdout:1/244: dwrite f3 [0,4194304] 0 2023-12-05T13:26:25.358 INFO:tasks.workunit.client.0.smithi029.stdout:1/245: read - d7/d1c/d20/f38 zero size 2023-12-05T13:26:25.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/93: mknod de/c1a 0 2023-12-05T13:26:25.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/94: write de/f13 [8853,100613] 0 2023-12-05T13:26:25.359 INFO:tasks.workunit.client.0.smithi029.stdout:4/68: creat d0/da/f18 x:0 0 0 2023-12-05T13:26:25.361 INFO:tasks.workunit.client.0.smithi029.stdout:1/246: dread d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:25.361 INFO:tasks.workunit.client.0.smithi029.stdout:1/247: chown d7/df/d12/f46 3325 1 2023-12-05T13:26:25.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/174: truncate d6/df/f17 1111853 0 2023-12-05T13:26:25.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/291: creat d5/dc/f69 x:0 0 0 2023-12-05T13:26:25.366 INFO:tasks.workunit.client.0.smithi029.stdout:2/95: rmdir de 39 2023-12-05T13:26:25.366 INFO:tasks.workunit.client.0.smithi029.stdout:2/96: chown cd 6861 1 2023-12-05T13:26:25.368 INFO:tasks.workunit.client.0.smithi029.stdout:4/69: unlink d0/d1/c11 0 2023-12-05T13:26:25.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/116: unlink dc/l11 0 2023-12-05T13:26:25.373 INFO:tasks.workunit.client.0.smithi029.stdout:1/248: creat d7/d1c/d20/f50 x:0 0 0 2023-12-05T13:26:25.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/175: unlink d6/df/d1a/f24 0 2023-12-05T13:26:25.377 INFO:tasks.workunit.client.0.smithi029.stdout:8/292: getdents d5/dc/d18 0 2023-12-05T13:26:25.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/249: dread d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:25.382 INFO:tasks.workunit.client.0.smithi029.stdout:0/117: truncate dc/ff 22404 0 2023-12-05T13:26:25.382 INFO:tasks.workunit.client.0.smithi029.stdout:1/250: creat d7/d31/f51 x:0 0 0 2023-12-05T13:26:25.382 INFO:tasks.workunit.client.0.smithi029.stdout:1/251: write d7/df/d12/f2d [1621477,37923] 0 2023-12-05T13:26:25.386 INFO:tasks.workunit.client.0.smithi029.stdout:0/118: creat dc/f29 x:0 0 0 2023-12-05T13:26:25.387 INFO:tasks.workunit.client.0.smithi029.stdout:0/119: readlink dc/l22 0 2023-12-05T13:26:25.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/120: dread dc/f1e [0,4194304] 0 2023-12-05T13:26:25.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/121: chown dc/c25 18352 1 2023-12-05T13:26:25.389 INFO:tasks.workunit.client.0.smithi029.stdout:1/252: rmdir d7/df/d48 39 2023-12-05T13:26:25.389 INFO:tasks.workunit.client.0.smithi029.stdout:2/97: dwrite f6 [0,4194304] 0 2023-12-05T13:26:25.389 INFO:tasks.workunit.client.0.smithi029.stdout:2/98: chown de/c1a 743 1 2023-12-05T13:26:25.389 INFO:tasks.workunit.client.0.smithi029.stdout:2/99: chown f4 0 1 2023-12-05T13:26:25.391 INFO:tasks.workunit.client.0.smithi029.stdout:2/100: dread f3 [0,4194304] 0 2023-12-05T13:26:25.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/293: dwrite d5/d2f/f68 [0,4194304] 0 2023-12-05T13:26:25.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/294: dread d5/dc/d17/f4e [0,4194304] 0 2023-12-05T13:26:25.406 INFO:tasks.workunit.client.0.smithi029.stdout:2/101: dread f4 [0,4194304] 0 2023-12-05T13:26:25.408 INFO:tasks.workunit.client.0.smithi029.stdout:1/253: dwrite d7/fd [0,4194304] 0 2023-12-05T13:26:25.410 INFO:tasks.workunit.client.0.smithi029.stdout:8/295: rename d5/c5b to d5/d2f/d3a/d3c/c6a 0 2023-12-05T13:26:25.411 INFO:tasks.workunit.client.0.smithi029.stdout:1/254: dread d7/df/f19 [0,4194304] 0 2023-12-05T13:26:25.413 INFO:tasks.workunit.client.0.smithi029.stdout:8/296: symlink d5/dc/d17/d1d/l6b 0 2023-12-05T13:26:25.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/70: dwrite d0/f5 [0,4194304] 0 2023-12-05T13:26:25.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/71: fsync d0/da/f18 0 2023-12-05T13:26:25.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/72: chown d0/d1/fc 1570655 1 2023-12-05T13:26:25.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/297: write d5/dc/d17/d53/f60 [3757765,105219] 0 2023-12-05T13:26:25.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/298: fdatasync d5/d6/d61/f22 0 2023-12-05T13:26:25.424 INFO:tasks.workunit.client.0.smithi029.stdout:1/255: dwrite d7/df/d12/f1d [0,4194304] 0 2023-12-05T13:26:25.427 INFO:tasks.workunit.client.0.smithi029.stdout:4/73: rename d0/f5 to d0/d16/f19 0 2023-12-05T13:26:25.427 INFO:tasks.workunit.client.0.smithi029.stdout:4/74: chown d0/d1/l9 2440 1 2023-12-05T13:26:25.429 INFO:tasks.workunit.client.0.smithi029.stdout:8/299: symlink d5/dc/d17/d53/l6c 0 2023-12-05T13:26:25.434 INFO:tasks.workunit.client.0.smithi029.stdout:1/256: mkdir d7/d1c/d20/d52 0 2023-12-05T13:26:25.438 INFO:tasks.workunit.client.0.smithi029.stdout:1/257: getdents d7/df/d12 0 2023-12-05T13:26:25.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/75: rmdir d0/de 39 2023-12-05T13:26:25.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/76: truncate d0/da/f18 119211 0 2023-12-05T13:26:25.453 INFO:tasks.workunit.client.0.smithi029.stdout:4/77: dwrite d0/d16/f19 [4194304,4194304] 0 2023-12-05T13:26:25.455 INFO:tasks.workunit.client.0.smithi029.stdout:4/78: dread d0/d1/fc [0,4194304] 0 2023-12-05T13:26:25.460 INFO:tasks.workunit.client.0.smithi029.stdout:1/258: dwrite d7/f49 [0,4194304] 0 2023-12-05T13:26:25.461 INFO:tasks.workunit.client.0.smithi029.stdout:1/259: write d7/fc [237302,31260] 0 2023-12-05T13:26:25.462 INFO:tasks.workunit.client.0.smithi029.stdout:1/260: write d7/f49 [3965207,123701] 0 2023-12-05T13:26:25.463 INFO:tasks.workunit.client.0.smithi029.stdout:4/79: stat d0/da/cf 0 2023-12-05T13:26:25.469 INFO:tasks.workunit.client.0.smithi029.stdout:1/261: creat d7/f53 x:0 0 0 2023-12-05T13:26:25.474 INFO:tasks.workunit.client.0.smithi029.stdout:1/262: unlink d7/d1c/d20/l29 0 2023-12-05T13:26:25.474 INFO:tasks.workunit.client.0.smithi029.stdout:1/263: write d7/df/d12/f44 [79532,13976] 0 2023-12-05T13:26:25.474 INFO:tasks.workunit.client.0.smithi029.stdout:1/264: write d7/d31/f51 [593843,8026] 0 2023-12-05T13:26:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/265: write d7/d1c/d20/f50 [442017,46022] 0 2023-12-05T13:26:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/266: chown d7/fb 5422 1 2023-12-05T13:26:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/267: write d7/d1c/d20/f37 [813061,116786] 0 2023-12-05T13:26:25.475 INFO:tasks.workunit.client.0.smithi029.stdout:1/268: creat d7/d1c/d35/d4f/f54 x:0 0 0 2023-12-05T13:26:25.476 INFO:tasks.workunit.client.0.smithi029.stdout:4/80: dwrite d0/d16/f19 [4194304,4194304] 0 2023-12-05T13:26:25.476 INFO:tasks.workunit.client.0.smithi029.stdout:1/269: link d7/c30 d7/d1c/d20/d52/c55 0 2023-12-05T13:26:25.476 INFO:tasks.workunit.client.0.smithi029.stdout:1/270: chown d7/d31/l4c 25 1 2023-12-05T13:26:25.478 INFO:tasks.workunit.client.0.smithi029.stdout:4/81: mkdir d0/de/d15/d1a 0 2023-12-05T13:26:25.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/82: fsync d0/d16/f19 0 2023-12-05T13:26:25.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/83: chown d0/da/cf 4019223 1 2023-12-05T13:26:25.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/84: creat d0/da/f1b x:0 0 0 2023-12-05T13:26:25.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/85: read - d0/da/f1b zero size 2023-12-05T13:26:25.491 INFO:tasks.workunit.client.0.smithi029.stdout:4/86: rename d0/da/cf to d0/de/c1c 0 2023-12-05T13:26:25.501 INFO:tasks.workunit.client.0.smithi029.stdout:4/87: rmdir d0/da 39 2023-12-05T13:26:25.502 INFO:tasks.workunit.client.0.smithi029.stdout:4/88: creat d0/f1d x:0 0 0 2023-12-05T13:26:25.504 INFO:tasks.workunit.client.0.smithi029.stdout:4/89: link d0/d16/l17 d0/d1/l1e 0 2023-12-05T13:26:25.504 INFO:tasks.workunit.client.0.smithi029.stdout:4/90: symlink d0/de/d15/l1f 0 2023-12-05T13:26:25.505 INFO:tasks.workunit.client.0.smithi029.stdout:4/91: stat d0/da/f18 0 2023-12-05T13:26:25.506 INFO:tasks.workunit.client.0.smithi029.stdout:4/92: creat d0/da/f20 x:0 0 0 2023-12-05T13:26:25.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/93: creat d0/d1/f21 x:0 0 0 2023-12-05T13:26:25.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/94: mkdir d0/d16/d22 0 2023-12-05T13:26:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:25 smithi052 ceph-mon[121072]: pgmap v34: 65 pgs: 65 active+clean; 477 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 8.1 MiB/s rd, 20 MiB/s wr, 412 op/s 2023-12-05T13:26:25.749 INFO:tasks.workunit.client.0.smithi029.stdout:6/161: sync 2023-12-05T13:26:25.750 INFO:tasks.workunit.client.0.smithi029.stdout:6/162: chown d6/l8 8331342 1 2023-12-05T13:26:25.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:25 smithi029 ceph-mon[112128]: pgmap v34: 65 pgs: 65 active+clean; 477 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 8.1 MiB/s rd, 20 MiB/s wr, 412 op/s 2023-12-05T13:26:26.050 INFO:tasks.workunit.client.0.smithi029.stdout:5/105: sync 2023-12-05T13:26:26.051 INFO:tasks.workunit.client.0.smithi029.stdout:5/106: mknod d1/c26 0 2023-12-05T13:26:26.051 INFO:tasks.workunit.client.0.smithi029.stdout:5/107: chown d1/dc/de 25705920 1 2023-12-05T13:26:26.053 INFO:tasks.workunit.client.0.smithi029.stdout:5/108: getdents d1/dc/de 0 2023-12-05T13:26:26.053 INFO:tasks.workunit.client.0.smithi029.stdout:5/109: fsync d1/fb 0 2023-12-05T13:26:26.054 INFO:tasks.workunit.client.0.smithi029.stdout:5/110: write d1/f7 [3007116,42559] 0 2023-12-05T13:26:26.054 INFO:tasks.workunit.client.0.smithi029.stdout:5/111: write d1/dc/f1b [3894842,67860] 0 2023-12-05T13:26:26.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/118: sync 2023-12-05T13:26:26.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/119: write d7/d19/d28/f2d [169314,76999] 0 2023-12-05T13:26:26.334 INFO:tasks.workunit.client.0.smithi029.stdout:9/120: dwrite d7/fe [0,4194304] 0 2023-12-05T13:26:26.340 INFO:tasks.workunit.client.0.smithi029.stdout:9/121: unlink c1 0 2023-12-05T13:26:26.343 INFO:tasks.workunit.client.0.smithi029.stdout:9/122: dread d7/d19/d28/f2d [0,4194304] 0 2023-12-05T13:26:26.344 INFO:tasks.workunit.client.0.smithi029.stdout:9/123: truncate d7/d19/f1b 4445266 0 2023-12-05T13:26:26.346 INFO:tasks.workunit.client.0.smithi029.stdout:9/124: getdents d7/d19/d28 0 2023-12-05T13:26:26.347 INFO:tasks.workunit.client.0.smithi029.stdout:9/125: write d7/d19/f1b [2243774,127915] 0 2023-12-05T13:26:26.353 INFO:tasks.workunit.client.0.smithi029.stdout:9/126: mknod d7/d2c/c2e 0 2023-12-05T13:26:26.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/127: link d7/c14 d7/d19/d1f/c2f 0 2023-12-05T13:26:26.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/128: write d7/f26 [838330,23190] 0 2023-12-05T13:26:26.385 INFO:tasks.workunit.client.0.smithi029.stdout:9/129: dwrite d7/ff [0,4194304] 0 2023-12-05T13:26:26.390 INFO:tasks.workunit.client.0.smithi029.stdout:9/130: write d7/d19/d28/f2d [605084,13778] 0 2023-12-05T13:26:26.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/131: mkdir d7/d19/d30 0 2023-12-05T13:26:26.398 INFO:tasks.workunit.client.0.smithi029.stdout:9/132: rename d7/d19/d1f/l24 to d7/d19/l31 0 2023-12-05T13:26:26.398 INFO:tasks.workunit.client.0.smithi029.stdout:9/133: fdatasync d7/d19/d1f/f21 0 2023-12-05T13:26:26.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/108: sync 2023-12-05T13:26:26.989 INFO:tasks.workunit.client.0.smithi029.stdout:7/176: sync 2023-12-05T13:26:26.989 INFO:tasks.workunit.client.0.smithi029.stdout:7/177: truncate d6/df/d1a/d26/f31 393552 0 2023-12-05T13:26:26.989 INFO:tasks.workunit.client.0.smithi029.stdout:7/178: stat d6/f11 0 2023-12-05T13:26:26.989 INFO:tasks.workunit.client.0.smithi029.stdout:3/109: mknod d1/d10/c24 0 2023-12-05T13:26:26.991 INFO:tasks.workunit.client.0.smithi029.stdout:7/179: symlink d6/d2a/l38 0 2023-12-05T13:26:26.995 INFO:tasks.workunit.client.0.smithi029.stdout:3/110: unlink d1/l15 0 2023-12-05T13:26:26.995 INFO:tasks.workunit.client.0.smithi029.stdout:3/111: readlink d1/l8 0 2023-12-05T13:26:26.995 INFO:tasks.workunit.client.0.smithi029.stdout:3/112: read d1/f2 [947820,12594] 0 2023-12-05T13:26:26.995 INFO:tasks.workunit.client.0.smithi029.stdout:3/113: read - d1/d18/f20 zero size 2023-12-05T13:26:26.995 INFO:tasks.workunit.client.0.smithi029.stdout:3/114: stat d1/d6/f14 0 2023-12-05T13:26:26.997 INFO:tasks.workunit.client.0.smithi029.stdout:3/115: link d1/d6/f14 d1/f25 0 2023-12-05T13:26:27.006 INFO:tasks.workunit.client.0.smithi029.stdout:7/180: dwrite d6/d30/f32 [0,4194304] 0 2023-12-05T13:26:27.007 INFO:tasks.workunit.client.0.smithi029.stdout:7/181: read d6/d19/f25 [19640,4950] 0 2023-12-05T13:26:27.007 INFO:tasks.workunit.client.0.smithi029.stdout:3/116: dread d1/f2 [0,4194304] 0 2023-12-05T13:26:27.011 INFO:tasks.workunit.client.0.smithi029.stdout:3/117: mknod d1/d6/d11/c26 0 2023-12-05T13:26:27.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/182: dread d6/df/d1a/d26/f2b [0,4194304] 0 2023-12-05T13:26:27.012 INFO:tasks.workunit.client.0.smithi029.stdout:7/183: dread - d6/d19/f21 zero size 2023-12-05T13:26:27.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/184: read - d6/df/d1a/f27 zero size 2023-12-05T13:26:27.013 INFO:tasks.workunit.client.0.smithi029.stdout:3/118: mknod d1/d18/c27 0 2023-12-05T13:26:27.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/185: creat d6/df/d1a/d26/f39 x:0 0 0 2023-12-05T13:26:27.016 INFO:tasks.workunit.client.0.smithi029.stdout:7/186: dread - d6/df/d1a/f27 zero size 2023-12-05T13:26:27.017 INFO:tasks.workunit.client.0.smithi029.stdout:3/119: mkdir d1/d16/d28 0 2023-12-05T13:26:27.017 INFO:tasks.workunit.client.0.smithi029.stdout:3/120: write d1/d6/d11/f1e [333585,46874] 0 2023-12-05T13:26:27.029 INFO:tasks.workunit.client.0.smithi029.stdout:7/187: dwrite d6/df/d1a/f27 [0,4194304] 0 2023-12-05T13:26:27.029 INFO:tasks.workunit.client.0.smithi029.stdout:7/188: stat d6/l16 0 2023-12-05T13:26:27.064 INFO:tasks.workunit.client.0.smithi029.stdout:3/121: getdents d1/d6/d11 0 2023-12-05T13:26:27.065 INFO:tasks.workunit.client.0.smithi029.stdout:3/122: readlink d1/d10/l13 0 2023-12-05T13:26:27.065 INFO:tasks.workunit.client.0.smithi029.stdout:3/123: readlink d1/d10/l13 0 2023-12-05T13:26:27.080 INFO:tasks.workunit.client.0.smithi029.stdout:3/124: dwrite d1/d6/ff [0,4194304] 0 2023-12-05T13:26:27.084 INFO:tasks.workunit.client.0.smithi029.stdout:3/125: symlink d1/l29 0 2023-12-05T13:26:27.086 INFO:tasks.workunit.client.0.smithi029.stdout:3/126: link d1/d6/d11/f12 d1/d6/f2a 0 2023-12-05T13:26:27.086 INFO:tasks.workunit.client.0.smithi029.stdout:3/127: chown d1/f2 499050514 1 2023-12-05T13:26:27.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/128: dwrite d1/d6/f2a [0,4194304] 0 2023-12-05T13:26:27.115 INFO:tasks.workunit.client.0.smithi029.stdout:3/129: dwrite d1/d6/d11/f1e [0,4194304] 0 2023-12-05T13:26:27.116 INFO:tasks.workunit.client.0.smithi029.stdout:3/130: dread - d1/d6/d11/f22 zero size 2023-12-05T13:26:27.123 INFO:tasks.workunit.client.0.smithi029.stdout:3/131: rmdir d1/d18 39 2023-12-05T13:26:27.129 INFO:tasks.workunit.client.0.smithi029.stdout:3/132: mknod d1/d16/d28/c2b 0 2023-12-05T13:26:27.146 INFO:tasks.workunit.client.0.smithi029.stdout:3/133: dwrite d1/d18/f1a [0,4194304] 0 2023-12-05T13:26:27.147 INFO:tasks.workunit.client.0.smithi029.stdout:3/134: fdatasync d1/d18/f1a 0 2023-12-05T13:26:27.147 INFO:tasks.workunit.client.0.smithi029.stdout:3/135: chown d1/d18/f1a 26674 1 2023-12-05T13:26:27.153 INFO:tasks.workunit.client.0.smithi029.stdout:3/136: mknod d1/d10/c2c 0 2023-12-05T13:26:27.155 INFO:tasks.workunit.client.0.smithi029.stdout:3/137: symlink d1/d16/d1f/l2d 0 2023-12-05T13:26:27.158 INFO:tasks.workunit.client.0.smithi029.stdout:3/138: creat d1/d18/f2e x:0 0 0 2023-12-05T13:26:27.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/139: creat d1/d10/f2f x:0 0 0 2023-12-05T13:26:27.162 INFO:tasks.workunit.client.0.smithi029.stdout:3/140: mknod d1/d16/c30 0 2023-12-05T13:26:27.163 INFO:tasks.workunit.client.0.smithi029.stdout:3/141: fsync d1/d6/d11/f1e 0 2023-12-05T13:26:27.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/142: symlink d1/d6/d11/l31 0 2023-12-05T13:26:27.168 INFO:tasks.workunit.client.0.smithi029.stdout:3/143: dread d1/f2 [0,4194304] 0 2023-12-05T13:26:27.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/144: rmdir d1/d16/d1f 39 2023-12-05T13:26:27.171 INFO:tasks.workunit.client.0.smithi029.stdout:3/145: unlink d1/l8 0 2023-12-05T13:26:27.173 INFO:tasks.workunit.client.0.smithi029.stdout:3/146: link d1/d6/d11/c21 d1/d16/d28/c32 0 2023-12-05T13:26:27.173 INFO:tasks.workunit.client.0.smithi029.stdout:3/147: chown d1/d18/f1a 119 1 2023-12-05T13:26:27.189 INFO:tasks.workunit.client.0.smithi029.stdout:3/148: dwrite d1/d18/f20 [0,4194304] 0 2023-12-05T13:26:27.192 INFO:tasks.workunit.client.0.smithi029.stdout:3/149: symlink d1/d6/l33 0 2023-12-05T13:26:27.192 INFO:tasks.workunit.client.0.smithi029.stdout:3/150: chown d1/f25 186749404 1 2023-12-05T13:26:27.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/151: dread d1/d6/d11/f1e [0,4194304] 0 2023-12-05T13:26:27.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/152: stat d1/d6 0 2023-12-05T13:26:27.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/153: chown d1/d6/d11/c21 7 1 2023-12-05T13:26:27.324 INFO:tasks.workunit.client.0.smithi029.stdout:6/163: sync 2023-12-05T13:26:27.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/300: sync 2023-12-05T13:26:27.324 INFO:tasks.workunit.client.0.smithi029.stdout:9/134: sync 2023-12-05T13:26:27.324 INFO:tasks.workunit.client.0.smithi029.stdout:0/122: sync 2023-12-05T13:26:27.324 INFO:tasks.workunit.client.0.smithi029.stdout:8/301: fsync d5/d6/d61/f33 0 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/123: getdents dc/d23 0 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/124: fsync f0 0 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:8/302: write d5/dc/f32 [1180612,68261] 0 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/102: sync 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:4/95: sync 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:1/271: sync 2023-12-05T13:26:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:5/112: sync 2023-12-05T13:26:27.329 INFO:tasks.workunit.client.0.smithi029.stdout:5/113: write d1/dc/de/f22 [151182,24613] 0 2023-12-05T13:26:27.329 INFO:tasks.workunit.client.0.smithi029.stdout:5/114: fdatasync d1/f20 0 2023-12-05T13:26:27.335 INFO:tasks.workunit.client.0.smithi029.stdout:5/115: dread d1/fb [0,4194304] 0 2023-12-05T13:26:27.335 INFO:tasks.workunit.client.0.smithi029.stdout:5/116: chown d1/dc/d10/d1e 32235 1 2023-12-05T13:26:27.335 INFO:tasks.workunit.client.0.smithi029.stdout:5/117: truncate d1/dc/de/f1a 1428402 0 2023-12-05T13:26:27.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/103: creat de/d16/f1b x:0 0 0 2023-12-05T13:26:27.344 INFO:tasks.workunit.client.0.smithi029.stdout:9/135: dwrite d7/f26 [0,4194304] 0 2023-12-05T13:26:27.344 INFO:tasks.workunit.client.0.smithi029.stdout:2/104: dread fa [0,4194304] 0 2023-12-05T13:26:27.350 INFO:tasks.workunit.client.0.smithi029.stdout:5/118: dwrite d1/dc/de/f1a [0,4194304] 0 2023-12-05T13:26:27.350 INFO:tasks.workunit.client.0.smithi029.stdout:0/125: link dc/fd dc/f2a 0 2023-12-05T13:26:27.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/303: mknod d5/dc/d17/d53/c6d 0 2023-12-05T13:26:27.351 INFO:tasks.workunit.client.0.smithi029.stdout:8/304: chown d5/d2f/d3a/f48 1041227 1 2023-12-05T13:26:27.358 INFO:tasks.workunit.client.0.smithi029.stdout:9/136: truncate d7/f13 1016059 0 2023-12-05T13:26:27.359 INFO:tasks.workunit.client.0.smithi029.stdout:2/105: creat de/d16/d18/f1c x:0 0 0 2023-12-05T13:26:27.359 INFO:tasks.workunit.client.0.smithi029.stdout:2/106: write f6 [4974577,116572] 0 2023-12-05T13:26:27.371 INFO:tasks.workunit.client.0.smithi029.stdout:8/305: symlink d5/d2f/d3a/d3c/l6e 0 2023-12-05T13:26:27.373 INFO:tasks.workunit.client.0.smithi029.stdout:2/107: dwrite de/d16/d18/f1c [0,4194304] 0 2023-12-05T13:26:27.373 INFO:tasks.workunit.client.0.smithi029.stdout:2/108: dread - de/d16/f1b zero size 2023-12-05T13:26:27.373 INFO:tasks.workunit.client.0.smithi029.stdout:2/109: write f9 [884142,50765] 0 2023-12-05T13:26:27.373 INFO:tasks.workunit.client.0.smithi029.stdout:8/306: dread d5/d6/d61/f33 [0,4194304] 0 2023-12-05T13:26:27.374 INFO:tasks.workunit.client.0.smithi029.stdout:8/307: fdatasync d5/dc/d18/f35 0 2023-12-05T13:26:27.374 INFO:tasks.workunit.client.0.smithi029.stdout:8/308: truncate d5/dc/d18/f57 588768 0 2023-12-05T13:26:27.374 INFO:tasks.workunit.client.0.smithi029.stdout:2/110: write de/d16/d18/f1c [1200914,4151] 0 2023-12-05T13:26:27.375 INFO:tasks.workunit.client.0.smithi029.stdout:8/309: read d5/dc/f32 [836355,102544] 0 2023-12-05T13:26:27.375 INFO:tasks.workunit.client.0.smithi029.stdout:8/310: fsync f4 0 2023-12-05T13:26:27.378 INFO:tasks.workunit.client.0.smithi029.stdout:8/311: creat d5/d6/d59/f6f x:0 0 0 2023-12-05T13:26:27.387 INFO:tasks.workunit.client.0.smithi029.stdout:0/126: dwrite dc/d13/f1b [0,4194304] 0 2023-12-05T13:26:27.393 INFO:tasks.workunit.client.0.smithi029.stdout:0/127: creat dc/d23/f2b x:0 0 0 2023-12-05T13:26:27.394 INFO:tasks.workunit.client.0.smithi029.stdout:0/128: write dc/f2a [916624,360] 0 2023-12-05T13:26:27.394 INFO:tasks.workunit.client.0.smithi029.stdout:0/129: stat f4 0 2023-12-05T13:26:27.394 INFO:tasks.workunit.client.0.smithi029.stdout:0/130: write dc/fd [1161395,52452] 0 2023-12-05T13:26:27.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/111: dwrite fb [0,4194304] 0 2023-12-05T13:26:27.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/112: chown de/d16/d18 1299 1 2023-12-05T13:26:27.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/113: write de/d16/f1b [166004,39139] 0 2023-12-05T13:26:27.398 INFO:tasks.workunit.client.0.smithi029.stdout:0/131: write dc/d13/f19 [802381,73211] 0 2023-12-05T13:26:27.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/132: dwrite dc/f16 [0,4194304] 0 2023-12-05T13:26:27.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/133: creat dc/f2c x:0 0 0 2023-12-05T13:26:27.435 INFO:tasks.workunit.client.0.smithi029.stdout:0/134: link dc/f27 dc/d13/f2d 0 2023-12-05T13:26:27.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/135: creat dc/d23/f2e x:0 0 0 2023-12-05T13:26:27.439 INFO:tasks.workunit.client.0.smithi029.stdout:0/136: creat dc/f2f x:0 0 0 2023-12-05T13:26:27.446 INFO:tasks.workunit.client.0.smithi029.stdout:0/137: symlink dc/d13/l30 0 2023-12-05T13:26:27.472 INFO:tasks.workunit.client.0.smithi029.stdout:6/164: rename d6/c37 to d6/d29/c38 0 2023-12-05T13:26:27.477 INFO:tasks.workunit.client.0.smithi029.stdout:6/165: mkdir d6/d1d/d39 0 2023-12-05T13:26:27.477 INFO:tasks.workunit.client.0.smithi029.stdout:0/138: dwrite dc/f2a [0,4194304] 0 2023-12-05T13:26:27.479 INFO:tasks.workunit.client.0.smithi029.stdout:2/114: fsync de/d16/f1b 0 2023-12-05T13:26:27.479 INFO:tasks.workunit.client.0.smithi029.stdout:2/115: dread - de/d16/d18/f19 zero size 2023-12-05T13:26:27.479 INFO:tasks.workunit.client.0.smithi029.stdout:2/116: write de/d16/d18/f19 [768390,17173] 0 2023-12-05T13:26:27.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/166: symlink d6/d21/l3a 0 2023-12-05T13:26:27.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/167: write d6/fc [3999811,127959] 0 2023-12-05T13:26:27.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/168: chown d6/d21/f31 1209772323 1 2023-12-05T13:26:27.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/169: fdatasync d6/d21/f28 0 2023-12-05T13:26:27.551 INFO:tasks.workunit.client.0.smithi029.stdout:5/119: mkdir d1/dc/d27 0 2023-12-05T13:26:27.564 INFO:tasks.workunit.client.0.smithi029.stdout:8/312: rename d5/dc/d17/d1d/l47 to d5/dc/l70 0 2023-12-05T13:26:27.565 INFO:tasks.workunit.client.0.smithi029.stdout:1/272: rename d7/d1c to d7/d56 0 2023-12-05T13:26:27.568 INFO:tasks.workunit.client.0.smithi029.stdout:1/273: unlink d7/df/f19 0 2023-12-05T13:26:27.570 INFO:tasks.workunit.client.0.smithi029.stdout:8/313: write d5/d6/f4b [1283868,70936] 0 2023-12-05T13:26:27.571 INFO:tasks.workunit.client.0.smithi029.stdout:2/117: rename cd to de/d16/c1d 0 2023-12-05T13:26:27.573 INFO:tasks.workunit.client.0.smithi029.stdout:1/274: dread d7/df/d12/f2d [0,4194304] 0 2023-12-05T13:26:27.573 INFO:tasks.workunit.client.0.smithi029.stdout:1/275: dread - d7/f53 zero size 2023-12-05T13:26:27.574 INFO:tasks.workunit.client.0.smithi029.stdout:1/276: fsync d7/d31/f3d 0 2023-12-05T13:26:27.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/118: rename de/c1a to de/d11/c1e 0 2023-12-05T13:26:27.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/119: truncate de/d16/f1b 902570 0 2023-12-05T13:26:27.579 INFO:tasks.workunit.client.0.smithi029.stdout:1/277: link d7/df/d12/f2d d7/d56/d20/d52/f57 0 2023-12-05T13:26:27.583 INFO:tasks.workunit.client.0.smithi029.stdout:1/278: mknod d7/df/d48/c58 0 2023-12-05T13:26:27.587 INFO:tasks.workunit.client.0.smithi029.stdout:8/314: dwrite d5/dc/d17/f4e [0,4194304] 0 2023-12-05T13:26:27.590 INFO:tasks.workunit.client.0.smithi029.stdout:8/315: dread d5/d6/f4b [0,4194304] 0 2023-12-05T13:26:27.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/316: creat d5/d6/d61/f71 x:0 0 0 2023-12-05T13:26:27.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/317: getdents d5/dc 0 2023-12-05T13:26:27.598 INFO:tasks.workunit.client.0.smithi029.stdout:1/279: dwrite d7/d56/d20/f38 [0,4194304] 0 2023-12-05T13:26:27.600 INFO:tasks.workunit.client.0.smithi029.stdout:8/318: creat d5/d6/d59/f72 x:0 0 0 2023-12-05T13:26:27.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/319: write d5/dc/d17/d1d/f2e [106568,35434] 0 2023-12-05T13:26:27.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/280: creat d7/d56/d35/f59 x:0 0 0 2023-12-05T13:26:27.605 INFO:tasks.workunit.client.0.smithi029.stdout:1/281: write d7/df/d12/f44 [362433,47763] 0 2023-12-05T13:26:27.609 INFO:tasks.workunit.client.0.smithi029.stdout:1/282: creat d7/d56/d20/f5a x:0 0 0 2023-12-05T13:26:27.611 INFO:tasks.workunit.client.0.smithi029.stdout:8/320: dread d5/d6/d10/d13/f55 [0,4194304] 0 2023-12-05T13:26:27.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/321: write d5/d2f/f68 [879380,99930] 0 2023-12-05T13:26:27.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/322: write d5/d2f/d3a/f48 [276896,59937] 0 2023-12-05T13:26:27.614 INFO:tasks.workunit.client.0.smithi029.stdout:1/283: dread d7/fc [0,4194304] 0 2023-12-05T13:26:27.615 INFO:tasks.workunit.client.0.smithi029.stdout:8/323: mknod d5/d2f/d3a/d3c/c73 0 2023-12-05T13:26:27.621 INFO:tasks.workunit.client.0.smithi029.stdout:8/324: mknod d5/d2f/d3a/c74 0 2023-12-05T13:26:27.623 INFO:tasks.workunit.client.0.smithi029.stdout:8/325: rename d5/d6/d61 to d5/d2f/d75 0 2023-12-05T13:26:27.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/284: fsync d7/d56/d35/f59 0 2023-12-05T13:26:27.624 INFO:tasks.workunit.client.0.smithi029.stdout:1/285: dread d7/f13 [0,4194304] 0 2023-12-05T13:26:27.624 INFO:tasks.workunit.client.0.smithi029.stdout:8/326: creat d5/d6/d10/f76 x:0 0 0 2023-12-05T13:26:27.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/286: mkdir d7/d5b 0 2023-12-05T13:26:27.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/287: dread - d7/d56/d35/f59 zero size 2023-12-05T13:26:27.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/288: dread d7/f13 [0,4194304] 0 2023-12-05T13:26:27.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/289: readlink d7/d31/l4c 0 2023-12-05T13:26:27.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/290: symlink d7/df/d12/l5c 0 2023-12-05T13:26:27.630 INFO:tasks.workunit.client.0.smithi029.stdout:1/291: write d7/d31/f3d [706293,97852] 0 2023-12-05T13:26:27.632 INFO:tasks.workunit.client.0.smithi029.stdout:8/327: mkdir d5/d6/d77 0 2023-12-05T13:26:27.639 INFO:tasks.workunit.client.0.smithi029.stdout:8/328: symlink d5/d6/d10/d13/l78 0 2023-12-05T13:26:27.639 INFO:tasks.workunit.client.0.smithi029.stdout:8/329: truncate d5/d2f/d3a/f48 603425 0 2023-12-05T13:26:27.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/292: dwrite d7/d56/f25 [0,4194304] 0 2023-12-05T13:26:27.649 INFO:tasks.workunit.client.0.smithi029.stdout:8/330: dread d5/dc/d17/d1d/f2a [0,4194304] 0 2023-12-05T13:26:27.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/293: creat d7/d56/d35/d4f/f5d x:0 0 0 2023-12-05T13:26:27.657 INFO:tasks.workunit.client.0.smithi029.stdout:1/294: write d7/d31/f3c [541503,72797] 0 2023-12-05T13:26:27.657 INFO:tasks.workunit.client.0.smithi029.stdout:1/295: chown d7/df/d48 3 1 2023-12-05T13:26:27.657 INFO:tasks.workunit.client.0.smithi029.stdout:1/296: stat d7/df/c41 0 2023-12-05T13:26:27.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/331: rmdir d5/d6/d77 0 2023-12-05T13:26:27.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/332: dread d5/dc/d18/f57 [0,4194304] 0 2023-12-05T13:26:27.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/333: fsync d5/d6/d10/f76 0 2023-12-05T13:26:27.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/334: chown d5/dc/d18/l58 159 1 2023-12-05T13:26:27.662 INFO:tasks.workunit.client.0.smithi029.stdout:8/335: truncate d5/d6/f9 5864769 0 2023-12-05T13:26:27.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/336: dwrite d5/d2f/d75/f22 [8388608,4194304] 0 2023-12-05T13:26:27.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/337: chown d5/dc/d17/d1d/l6b 3095394 1 2023-12-05T13:26:27.681 INFO:tasks.workunit.client.0.smithi029.stdout:8/338: dread d5/dc/d18/f35 [0,4194304] 0 2023-12-05T13:26:27.684 INFO:tasks.workunit.client.0.smithi029.stdout:8/339: symlink d5/dc/d17/l79 0 2023-12-05T13:26:27.685 INFO:tasks.workunit.client.0.smithi029.stdout:8/340: creat d5/dc/f7a x:0 0 0 2023-12-05T13:26:27.691 INFO:tasks.workunit.client.0.smithi029.stdout:8/341: dread d5/dc/d18/f3d [0,4194304] 0 2023-12-05T13:26:27.694 INFO:tasks.workunit.client.0.smithi029.stdout:8/342: creat d5/d2f/d75/f7b x:0 0 0 2023-12-05T13:26:27.695 INFO:tasks.workunit.client.0.smithi029.stdout:8/343: getdents d5/d6/d59 0 2023-12-05T13:26:27.697 INFO:tasks.workunit.client.0.smithi029.stdout:8/344: symlink d5/d6/d10/d13/l7c 0 2023-12-05T13:26:27.699 INFO:tasks.workunit.client.0.smithi029.stdout:8/345: truncate d5/d6/d10/d13/f55 875339 0 2023-12-05T13:26:27.701 INFO:tasks.workunit.client.0.smithi029.stdout:8/346: rename d5/dc/d56/f5e to d5/d2f/f7d 0 2023-12-05T13:26:27.701 INFO:tasks.workunit.client.0.smithi029.stdout:8/347: read d5/dc/d18/f3d [243921,62902] 0 2023-12-05T13:26:27.702 INFO:tasks.workunit.client.0.smithi029.stdout:8/348: creat d5/dc/d17/d53/f7e x:0 0 0 2023-12-05T13:26:27.704 INFO:tasks.workunit.client.0.smithi029.stdout:8/349: dread - d5/dc/d17/d53/f62 zero size 2023-12-05T13:26:27.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/350: truncate d5/d6/f4b 815908 0 2023-12-05T13:26:27.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/351: chown d5/dc/d17/d53/f62 495031636 1 2023-12-05T13:26:27.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/352: write d5/dc/d18/d26/f5a [862638,21980] 0 2023-12-05T13:26:27.710 INFO:tasks.workunit.client.0.smithi029.stdout:8/353: creat d5/dc/d17/d1d/f7f x:0 0 0 2023-12-05T13:26:27.713 INFO:tasks.workunit.client.0.smithi029.stdout:8/354: link d5/d6/l65 d5/d6/d10/l80 0 2023-12-05T13:26:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:27 smithi052 ceph-mon[121072]: pgmap v35: 65 pgs: 65 active+clean; 477 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 8.0 MiB/s rd, 20 MiB/s wr, 283 op/s 2023-12-05T13:26:27.731 INFO:tasks.workunit.client.0.smithi029.stdout:8/355: dwrite d5/dc/d17/d53/f62 [0,4194304] 0 2023-12-05T13:26:27.731 INFO:tasks.workunit.client.0.smithi029.stdout:8/356: write d5/d6/f51 [765074,104882] 0 2023-12-05T13:26:27.734 INFO:tasks.workunit.client.0.smithi029.stdout:8/357: truncate d5/dc/d18/f35 648338 0 2023-12-05T13:26:27.735 INFO:tasks.workunit.client.0.smithi029.stdout:8/358: write d5/d2f/d3a/f48 [622090,64311] 0 2023-12-05T13:26:27.735 INFO:tasks.workunit.client.0.smithi029.stdout:8/359: write d5/dc/f69 [293265,63455] 0 2023-12-05T13:26:27.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:27 smithi029 ceph-mon[112128]: pgmap v35: 65 pgs: 65 active+clean; 477 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 8.0 MiB/s rd, 20 MiB/s wr, 283 op/s 2023-12-05T13:26:28.622 INFO:tasks.workunit.client.0.smithi029.stdout:7/189: sync 2023-12-05T13:26:28.622 INFO:tasks.workunit.client.0.smithi029.stdout:4/96: sync 2023-12-05T13:26:28.622 INFO:tasks.workunit.client.0.smithi029.stdout:7/190: fdatasync d6/df/f36 0 2023-12-05T13:26:28.622 INFO:tasks.workunit.client.0.smithi029.stdout:7/191: chown d6/df/l10 4350070 1 2023-12-05T13:26:28.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/192: write d6/f13 [481878,39115] 0 2023-12-05T13:26:28.623 INFO:tasks.workunit.client.0.smithi029.stdout:7/193: truncate d6/d19/f34 412846 0 2023-12-05T13:26:28.624 INFO:tasks.workunit.client.0.smithi029.stdout:7/194: chown d6/d19/l1c 394022003 1 2023-12-05T13:26:28.624 INFO:tasks.workunit.client.0.smithi029.stdout:4/97: creat d0/f23 x:0 0 0 2023-12-05T13:26:28.813 INFO:tasks.workunit.client.0.smithi029.stdout:7/195: truncate d6/df/d1a/f27 3953185 0 2023-12-05T13:26:28.816 INFO:tasks.workunit.client.0.smithi029.stdout:4/98: creat d0/d16/d22/f24 x:0 0 0 2023-12-05T13:26:28.837 INFO:tasks.workunit.client.0.smithi029.stdout:7/196: rename d6/c23 to d6/d30/c3a 0 2023-12-05T13:26:28.837 INFO:tasks.workunit.client.0.smithi029.stdout:7/197: dread - d6/df/d1a/d26/f39 zero size 2023-12-05T13:26:28.844 INFO:tasks.workunit.client.0.smithi029.stdout:4/99: unlink d0/d16/f19 0 2023-12-05T13:26:28.848 INFO:tasks.workunit.client.0.smithi029.stdout:7/198: mknod d6/df/d1a/c3b 0 2023-12-05T13:26:28.852 INFO:tasks.workunit.client.0.smithi029.stdout:4/100: symlink d0/d16/d22/l25 0 2023-12-05T13:26:28.852 INFO:tasks.workunit.client.0.smithi029.stdout:4/101: dread - d0/f23 zero size 2023-12-05T13:26:28.852 INFO:tasks.workunit.client.0.smithi029.stdout:4/102: write d0/f23 [5196,64930] 0 2023-12-05T13:26:28.852 INFO:tasks.workunit.client.0.smithi029.stdout:4/103: fdatasync d0/da/fb 0 2023-12-05T13:26:28.854 INFO:tasks.workunit.client.0.smithi029.stdout:4/104: dread d0/d1/fc [0,4194304] 0 2023-12-05T13:26:28.854 INFO:tasks.workunit.client.0.smithi029.stdout:4/105: write d0/da/f20 [589244,81441] 0 2023-12-05T13:26:28.857 INFO:tasks.workunit.client.0.smithi029.stdout:4/106: rmdir d0/de/d15 39 2023-12-05T13:26:28.857 INFO:tasks.workunit.client.0.smithi029.stdout:4/107: dread - d0/d16/d22/f24 zero size 2023-12-05T13:26:28.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/108: mknod d0/de/c26 0 2023-12-05T13:26:28.864 INFO:tasks.workunit.client.0.smithi029.stdout:4/109: readlink d0/l13 0 2023-12-05T13:26:28.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/110: write d0/da/f1b [303744,14727] 0 2023-12-05T13:26:28.865 INFO:tasks.workunit.client.0.smithi029.stdout:7/199: dwrite d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:28.865 INFO:tasks.workunit.client.0.smithi029.stdout:7/200: chown d6/l1b 178 1 2023-12-05T13:26:28.873 INFO:tasks.workunit.client.0.smithi029.stdout:4/111: dread d0/da/fb [0,4194304] 0 2023-12-05T13:26:28.877 INFO:tasks.workunit.client.0.smithi029.stdout:4/112: mknod d0/d16/d22/c27 0 2023-12-05T13:26:28.879 INFO:tasks.workunit.client.0.smithi029.stdout:4/113: getdents d0/d16 0 2023-12-05T13:26:28.883 INFO:tasks.workunit.client.0.smithi029.stdout:4/114: symlink d0/da/l28 0 2023-12-05T13:26:28.883 INFO:tasks.workunit.client.0.smithi029.stdout:4/115: readlink d0/d16/l17 0 2023-12-05T13:26:28.898 INFO:tasks.workunit.client.0.smithi029.stdout:7/201: write d6/df/f17 [125963,52915] 0 2023-12-05T13:26:28.899 INFO:tasks.workunit.client.0.smithi029.stdout:7/202: read d6/f15 [927612,87152] 0 2023-12-05T13:26:28.901 INFO:tasks.workunit.client.0.smithi029.stdout:7/203: mknod d6/d2a/d2f/c3c 0 2023-12-05T13:26:28.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/116: dwrite d0/da/fb [0,4194304] 0 2023-12-05T13:26:28.903 INFO:tasks.workunit.client.0.smithi029.stdout:7/204: mknod d6/d2a/d2f/c3d 0 2023-12-05T13:26:28.904 INFO:tasks.workunit.client.0.smithi029.stdout:4/117: mkdir d0/d16/d22/d29 0 2023-12-05T13:26:28.906 INFO:tasks.workunit.client.0.smithi029.stdout:7/205: mkdir d6/d35/d3e 0 2023-12-05T13:26:28.906 INFO:tasks.workunit.client.0.smithi029.stdout:7/206: truncate d6/f22 303546 0 2023-12-05T13:26:28.906 INFO:tasks.workunit.client.0.smithi029.stdout:7/207: fsync d6/d19/f34 0 2023-12-05T13:26:28.907 INFO:tasks.workunit.client.0.smithi029.stdout:7/208: rename d6/df/d1a/c28 to d6/df/d1a/d26/c3f 0 2023-12-05T13:26:28.907 INFO:tasks.workunit.client.0.smithi029.stdout:7/209: stat d6/f22 0 2023-12-05T13:26:28.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/210: fdatasync d6/d19/f34 0 2023-12-05T13:26:28.909 INFO:tasks.workunit.client.0.smithi029.stdout:7/211: mkdir d6/d35/d3e/d40 0 2023-12-05T13:26:28.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/212: creat d6/d30/f41 x:0 0 0 2023-12-05T13:26:28.918 INFO:tasks.workunit.client.0.smithi029.stdout:7/213: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:28.918 INFO:tasks.workunit.client.0.smithi029.stdout:7/214: write d6/d30/f41 [979799,29714] 0 2023-12-05T13:26:28.919 INFO:tasks.workunit.client.0.smithi029.stdout:7/215: creat d6/d35/d3e/d40/f42 x:0 0 0 2023-12-05T13:26:28.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/216: symlink d6/d35/d3e/d40/l43 0 2023-12-05T13:26:28.922 INFO:tasks.workunit.client.0.smithi029.stdout:4/118: dwrite d0/da/f18 [0,4194304] 0 2023-12-05T13:26:28.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/217: write d6/d19/f34 [212028,72327] 0 2023-12-05T13:26:28.922 INFO:tasks.workunit.client.0.smithi029.stdout:4/119: write d0/da/f1b [232934,116217] 0 2023-12-05T13:26:28.930 INFO:tasks.workunit.client.0.smithi029.stdout:7/218: symlink d6/d2a/l44 0 2023-12-05T13:26:28.932 INFO:tasks.workunit.client.0.smithi029.stdout:4/120: unlink d0/d16/d22/f24 0 2023-12-05T13:26:28.940 INFO:tasks.workunit.client.0.smithi029.stdout:7/219: dread d6/d30/f32 [0,4194304] 0 2023-12-05T13:26:28.940 INFO:tasks.workunit.client.0.smithi029.stdout:7/220: truncate d6/d19/f34 424129 0 2023-12-05T13:26:28.941 INFO:tasks.workunit.client.0.smithi029.stdout:7/221: rmdir d6/d35/d3e 39 2023-12-05T13:26:28.941 INFO:tasks.workunit.client.0.smithi029.stdout:7/222: fsync d6/df/d1a/f27 0 2023-12-05T13:26:28.941 INFO:tasks.workunit.client.0.smithi029.stdout:7/223: chown d6/d2a 103 1 2023-12-05T13:26:28.941 INFO:tasks.workunit.client.0.smithi029.stdout:7/224: chown d6/f22 3055 1 2023-12-05T13:26:28.945 INFO:tasks.workunit.client.0.smithi029.stdout:4/121: dwrite d0/da/fb [4194304,4194304] 0 2023-12-05T13:26:28.945 INFO:tasks.workunit.client.0.smithi029.stdout:4/122: rename d0/de/d15/d1a to d0/de/d15/d1a/d2a 22 2023-12-05T13:26:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:6/170: sync 2023-12-05T13:26:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/154: sync 2023-12-05T13:26:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/155: fdatasync d1/d18/f1a 0 2023-12-05T13:26:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/156: write d1/d18/f2e [393274,28517] 0 2023-12-05T13:26:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/157: write d1/d18/f2e [605066,87887] 0 2023-12-05T13:26:28.953 INFO:tasks.workunit.client.0.smithi029.stdout:4/123: rmdir d0/d16/d22/d29 0 2023-12-05T13:26:28.957 INFO:tasks.workunit.client.0.smithi029.stdout:7/225: dwrite d6/f22 [0,4194304] 0 2023-12-05T13:26:28.958 INFO:tasks.workunit.client.0.smithi029.stdout:6/171: creat d6/d29/f3b x:0 0 0 2023-12-05T13:26:28.959 INFO:tasks.workunit.client.0.smithi029.stdout:6/172: dread f5 [0,4194304] 0 2023-12-05T13:26:28.961 INFO:tasks.workunit.client.0.smithi029.stdout:3/158: link d1/d18/f20 d1/d16/f34 0 2023-12-05T13:26:28.962 INFO:tasks.workunit.client.0.smithi029.stdout:1/297: sync 2023-12-05T13:26:28.963 INFO:tasks.workunit.client.0.smithi029.stdout:4/124: mkdir d0/de/d15/d2b 0 2023-12-05T13:26:28.963 INFO:tasks.workunit.client.0.smithi029.stdout:4/125: fdatasync d0/d1/fc 0 2023-12-05T13:26:28.963 INFO:tasks.workunit.client.0.smithi029.stdout:3/159: write d1/d6/fb [1719057,73982] 0 2023-12-05T13:26:28.969 INFO:tasks.workunit.client.0.smithi029.stdout:5/120: sync 2023-12-05T13:26:28.969 INFO:tasks.workunit.client.0.smithi029.stdout:0/139: sync 2023-12-05T13:26:28.969 INFO:tasks.workunit.client.0.smithi029.stdout:8/360: sync 2023-12-05T13:26:28.969 INFO:tasks.workunit.client.0.smithi029.stdout:2/120: sync 2023-12-05T13:26:28.969 INFO:tasks.workunit.client.0.smithi029.stdout:2/121: truncate de/f12 132548 0 2023-12-05T13:26:28.969 INFO:tasks.workunit.client.0.smithi029.stdout:9/137: sync 2023-12-05T13:26:28.976 INFO:tasks.workunit.client.0.smithi029.stdout:3/160: dread d1/d18/f2e [0,4194304] 0 2023-12-05T13:26:28.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/173: dwrite d6/fc [0,4194304] 0 2023-12-05T13:26:28.978 INFO:tasks.workunit.client.0.smithi029.stdout:0/140: dread dc/d13/f1b [0,4194304] 0 2023-12-05T13:26:28.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/226: link d6/d35/d3e/d40/f42 d6/d35/d3e/d40/f45 0 2023-12-05T13:26:28.984 INFO:tasks.workunit.client.0.smithi029.stdout:0/141: dread dc/d13/f19 [0,4194304] 0 2023-12-05T13:26:28.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/298: rename d7/d56/d20 to d7/d5e 0 2023-12-05T13:26:28.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/299: fdatasync d7/d56/d35/f39 0 2023-12-05T13:26:28.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/300: chown d7/df/c41 522801872 1 2023-12-05T13:26:28.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/301: truncate d7/d31/f3c 6099429 0 2023-12-05T13:26:28.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/361: dwrite d5/dc/d17/d1d/f29 [0,4194304] 0 2023-12-05T13:26:28.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/138: creat d7/d19/f32 x:0 0 0 2023-12-05T13:26:28.998 INFO:tasks.workunit.client.0.smithi029.stdout:8/362: dread d5/d6/f9 [4194304,4194304] 0 2023-12-05T13:26:29.001 INFO:tasks.workunit.client.0.smithi029.stdout:6/174: link d6/d21/l3a d6/d1d/d36/l3c 0 2023-12-05T13:26:29.001 INFO:tasks.workunit.client.0.smithi029.stdout:5/121: dwrite d1/fb [0,4194304] 0 2023-12-05T13:26:29.004 INFO:tasks.workunit.client.0.smithi029.stdout:2/122: dwrite fb [0,4194304] 0 2023-12-05T13:26:29.004 INFO:tasks.workunit.client.0.smithi029.stdout:3/161: dwrite d1/d18/f1d [0,4194304] 0 2023-12-05T13:26:29.004 INFO:tasks.workunit.client.0.smithi029.stdout:3/162: read - d1/d6/d11/f22 zero size 2023-12-05T13:26:29.005 INFO:tasks.workunit.client.0.smithi029.stdout:3/163: fdatasync d1/d6/d11/f12 0 2023-12-05T13:26:29.008 INFO:tasks.workunit.client.0.smithi029.stdout:7/227: dwrite d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:29.008 INFO:tasks.workunit.client.0.smithi029.stdout:4/126: rename d0/da/l28 to d0/d1/l2c 0 2023-12-05T13:26:29.008 INFO:tasks.workunit.client.0.smithi029.stdout:4/127: truncate d0/da/f1b 885682 0 2023-12-05T13:26:29.009 INFO:tasks.workunit.client.0.smithi029.stdout:9/139: mkdir d7/d2c/d33 0 2023-12-05T13:26:29.013 INFO:tasks.workunit.client.0.smithi029.stdout:4/128: fsync d0/da/f20 0 2023-12-05T13:26:29.013 INFO:tasks.workunit.client.0.smithi029.stdout:8/363: dwrite d5/dc/d17/d1d/f2a [0,4194304] 0 2023-12-05T13:26:29.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/122: symlink d1/dc/d11/l28 0 2023-12-05T13:26:29.014 INFO:tasks.workunit.client.0.smithi029.stdout:5/123: chown d1/f7 433878434 1 2023-12-05T13:26:29.015 INFO:tasks.workunit.client.0.smithi029.stdout:0/142: link dc/fe dc/f31 0 2023-12-05T13:26:29.020 INFO:tasks.workunit.client.0.smithi029.stdout:2/123: truncate f4 4808508 0 2023-12-05T13:26:29.022 INFO:tasks.workunit.client.0.smithi029.stdout:6/175: dread d6/fe [4194304,4194304] 0 2023-12-05T13:26:29.022 INFO:tasks.workunit.client.0.smithi029.stdout:6/176: readlink d6/l19 0 2023-12-05T13:26:29.026 INFO:tasks.workunit.client.0.smithi029.stdout:7/228: mkdir d6/d30/d46 0 2023-12-05T13:26:29.027 INFO:tasks.workunit.client.0.smithi029.stdout:9/140: dwrite d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:29.027 INFO:tasks.workunit.client.0.smithi029.stdout:9/141: chown d7/f18 8 1 2023-12-05T13:26:29.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/302: rename d7/df to d7/d5e/d52/d5f 0 2023-12-05T13:26:29.033 INFO:tasks.workunit.client.0.smithi029.stdout:4/129: mknod d0/de/d15/c2d 0 2023-12-05T13:26:29.034 INFO:tasks.workunit.client.0.smithi029.stdout:4/130: dread d0/d1/fc [0,4194304] 0 2023-12-05T13:26:29.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/364: creat d5/dc/d56/f81 x:0 0 0 2023-12-05T13:26:29.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/365: chown d5/d6/f1a 1899 1 2023-12-05T13:26:29.037 INFO:tasks.workunit.client.0.smithi029.stdout:8/366: dread - d5/d6/d59/f72 zero size 2023-12-05T13:26:29.038 INFO:tasks.workunit.client.0.smithi029.stdout:5/124: mkdir d1/dc/d11/d17/d29 0 2023-12-05T13:26:29.039 INFO:tasks.workunit.client.0.smithi029.stdout:0/143: creat dc/f32 x:0 0 0 2023-12-05T13:26:29.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/144: write f1 [4418546,1491] 0 2023-12-05T13:26:29.041 INFO:tasks.workunit.client.0.smithi029.stdout:0/145: write dc/f16 [403497,33646] 0 2023-12-05T13:26:29.041 INFO:tasks.workunit.client.0.smithi029.stdout:0/146: write dc/ff [375853,102499] 0 2023-12-05T13:26:29.042 INFO:tasks.workunit.client.0.smithi029.stdout:9/142: dwrite d7/d19/f1d [0,4194304] 0 2023-12-05T13:26:29.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/124: creat de/d16/f1f x:0 0 0 2023-12-05T13:26:29.044 INFO:tasks.workunit.client.0.smithi029.stdout:2/125: dread fa [0,4194304] 0 2023-12-05T13:26:29.045 INFO:tasks.workunit.client.0.smithi029.stdout:6/177: creat d6/d21/f3d x:0 0 0 2023-12-05T13:26:29.049 INFO:tasks.workunit.client.0.smithi029.stdout:6/178: read d6/f1c [1415114,99787] 0 2023-12-05T13:26:29.050 INFO:tasks.workunit.client.0.smithi029.stdout:6/179: fdatasync d6/f1c 0 2023-12-05T13:26:29.050 INFO:tasks.workunit.client.0.smithi029.stdout:6/180: fsync d6/f1c 0 2023-12-05T13:26:29.050 INFO:tasks.workunit.client.0.smithi029.stdout:7/229: symlink d6/d2a/d2f/l47 0 2023-12-05T13:26:29.052 INFO:tasks.workunit.client.0.smithi029.stdout:0/147: dread dc/f2a [0,4194304] 0 2023-12-05T13:26:29.052 INFO:tasks.workunit.client.0.smithi029.stdout:0/148: write dc/f29 [264267,125920] 0 2023-12-05T13:26:29.053 INFO:tasks.workunit.client.0.smithi029.stdout:5/125: dwrite d1/f20 [0,4194304] 0 2023-12-05T13:26:29.054 INFO:tasks.workunit.client.0.smithi029.stdout:1/303: mkdir d7/d5e/d52/d5f/d12/d60 0 2023-12-05T13:26:29.054 INFO:tasks.workunit.client.0.smithi029.stdout:4/131: truncate d0/da/fb 3446816 0 2023-12-05T13:26:29.056 INFO:tasks.workunit.client.0.smithi029.stdout:4/132: dread d0/f23 [0,4194304] 0 2023-12-05T13:26:29.059 INFO:tasks.workunit.client.0.smithi029.stdout:9/143: mkdir d7/d19/d34 0 2023-12-05T13:26:29.060 INFO:tasks.workunit.client.0.smithi029.stdout:2/126: symlink de/d11/l20 0 2023-12-05T13:26:29.061 INFO:tasks.workunit.client.0.smithi029.stdout:9/144: dread d7/d19/d28/f2d [0,4194304] 0 2023-12-05T13:26:29.061 INFO:tasks.workunit.client.0.smithi029.stdout:9/145: chown d7/d19/d1f/f21 112 1 2023-12-05T13:26:29.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/181: creat d6/d1d/d39/f3e x:0 0 0 2023-12-05T13:26:29.063 INFO:tasks.workunit.client.0.smithi029.stdout:7/230: mknod d6/d2a/d2f/c48 0 2023-12-05T13:26:29.063 INFO:tasks.workunit.client.0.smithi029.stdout:7/231: chown d6/d19/f25 92522 1 2023-12-05T13:26:29.067 INFO:tasks.workunit.client.0.smithi029.stdout:5/126: creat d1/dc/d27/f2a x:0 0 0 2023-12-05T13:26:29.067 INFO:tasks.workunit.client.0.smithi029.stdout:5/127: fdatasync d1/dc/de/f19 0 2023-12-05T13:26:29.069 INFO:tasks.workunit.client.0.smithi029.stdout:1/304: rename d7/d56/d35 to d7/d61 0 2023-12-05T13:26:29.070 INFO:tasks.workunit.client.0.smithi029.stdout:8/367: link d5/fe d5/f82 0 2023-12-05T13:26:29.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/146: symlink d7/d2c/l35 0 2023-12-05T13:26:29.074 INFO:tasks.workunit.client.0.smithi029.stdout:6/182: mkdir d6/d3f 0 2023-12-05T13:26:29.074 INFO:tasks.workunit.client.0.smithi029.stdout:6/183: chown d6/d21/l23 952254 1 2023-12-05T13:26:29.075 INFO:tasks.workunit.client.0.smithi029.stdout:2/127: dwrite de/f13 [0,4194304] 0 2023-12-05T13:26:29.076 INFO:tasks.workunit.client.0.smithi029.stdout:7/232: link d6/d2a/d2f/l47 d6/l49 0 2023-12-05T13:26:29.076 INFO:tasks.workunit.client.0.smithi029.stdout:4/133: fsync d0/da/fb 0 2023-12-05T13:26:29.076 INFO:tasks.workunit.client.0.smithi029.stdout:4/134: chown d0/de/d15/c2d 213 1 2023-12-05T13:26:29.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/149: mkdir dc/d33 0 2023-12-05T13:26:29.078 INFO:tasks.workunit.client.0.smithi029.stdout:0/150: chown dc/d23/f2b 1 1 2023-12-05T13:26:29.079 INFO:tasks.workunit.client.0.smithi029.stdout:0/151: write dc/f14 [2173840,117101] 0 2023-12-05T13:26:29.079 INFO:tasks.workunit.client.0.smithi029.stdout:4/135: write d0/da/fb [654318,26311] 0 2023-12-05T13:26:29.081 INFO:tasks.workunit.client.0.smithi029.stdout:5/128: symlink d1/dc/d27/l2b 0 2023-12-05T13:26:29.083 INFO:tasks.workunit.client.0.smithi029.stdout:1/305: symlink d7/d5e/d52/d5f/l62 0 2023-12-05T13:26:29.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/368: rmdir d5/d6/d10/d13 39 2023-12-05T13:26:29.085 INFO:tasks.workunit.client.0.smithi029.stdout:1/306: dread d7/d5e/f37 [0,4194304] 0 2023-12-05T13:26:29.089 INFO:tasks.workunit.client.0.smithi029.stdout:9/147: unlink d7/f26 0 2023-12-05T13:26:29.089 INFO:tasks.workunit.client.0.smithi029.stdout:9/148: chown d7/d19/l1a 505919725 1 2023-12-05T13:26:29.089 INFO:tasks.workunit.client.0.smithi029.stdout:6/184: mkdir d6/d21/d40 0 2023-12-05T13:26:29.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/128: link fb de/d14/f21 0 2023-12-05T13:26:29.096 INFO:tasks.workunit.client.0.smithi029.stdout:7/233: mkdir d6/d30/d46/d4a 0 2023-12-05T13:26:29.099 INFO:tasks.workunit.client.0.smithi029.stdout:5/129: dwrite d1/dc/f1b [0,4194304] 0 2023-12-05T13:26:29.101 INFO:tasks.workunit.client.0.smithi029.stdout:8/369: creat d5/d6/d59/f83 x:0 0 0 2023-12-05T13:26:29.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/307: truncate d7/fb 466213 0 2023-12-05T13:26:29.105 INFO:tasks.workunit.client.0.smithi029.stdout:9/149: link d7/c2b d7/d19/d34/c36 0 2023-12-05T13:26:29.107 INFO:tasks.workunit.client.0.smithi029.stdout:6/185: creat d6/d21/d40/f41 x:0 0 0 2023-12-05T13:26:29.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/129: dwrite de/d16/f1f [0,4194304] 0 2023-12-05T13:26:29.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/130: stat f6 0 2023-12-05T13:26:29.110 INFO:tasks.workunit.client.0.smithi029.stdout:7/234: mkdir d6/d30/d46/d4a/d4b 0 2023-12-05T13:26:29.111 INFO:tasks.workunit.client.0.smithi029.stdout:7/235: read d6/df/d1a/f27 [3713048,45200] 0 2023-12-05T13:26:29.113 INFO:tasks.workunit.client.0.smithi029.stdout:0/152: rename fa to dc/d13/f34 0 2023-12-05T13:26:29.118 INFO:tasks.workunit.client.0.smithi029.stdout:5/130: rename d1/dc/d11/l1f to d1/dc/d11/l2c 0 2023-12-05T13:26:29.118 INFO:tasks.workunit.client.0.smithi029.stdout:5/131: stat d1/dc/d11/d17 0 2023-12-05T13:26:29.118 INFO:tasks.workunit.client.0.smithi029.stdout:5/132: fdatasync d1/fb 0 2023-12-05T13:26:29.119 INFO:tasks.workunit.client.0.smithi029.stdout:5/133: write d1/dc/de/f22 [504155,69940] 0 2023-12-05T13:26:29.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/370: creat d5/d2f/d75/f84 x:0 0 0 2023-12-05T13:26:29.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/371: write d5/dc/f69 [791169,115410] 0 2023-12-05T13:26:29.122 INFO:tasks.workunit.client.0.smithi029.stdout:8/372: write d5/dc/ff [4443667,129444] 0 2023-12-05T13:26:29.123 INFO:tasks.workunit.client.0.smithi029.stdout:9/150: creat d7/d19/d28/f37 x:0 0 0 2023-12-05T13:26:29.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/373: chown d5/d6 1 1 2023-12-05T13:26:29.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/186: dwrite d6/d21/f3d [0,4194304] 0 2023-12-05T13:26:29.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/187: write d6/d1d/d39/f3e [391282,82934] 0 2023-12-05T13:26:29.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/188: chown d6/d21/d40/f41 187 1 2023-12-05T13:26:29.126 INFO:tasks.workunit.client.0.smithi029.stdout:5/134: dread d1/dc/de/f22 [0,4194304] 0 2023-12-05T13:26:29.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/131: symlink de/d16/d18/l22 0 2023-12-05T13:26:29.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/132: fdatasync de/f12 0 2023-12-05T13:26:29.129 INFO:tasks.workunit.client.0.smithi029.stdout:2/133: chown de/cf 98 1 2023-12-05T13:26:29.131 INFO:tasks.workunit.client.0.smithi029.stdout:7/236: mknod d6/d35/c4c 0 2023-12-05T13:26:29.131 INFO:tasks.workunit.client.0.smithi029.stdout:7/237: chown d6/d2a/d2f/c48 13363 1 2023-12-05T13:26:29.132 INFO:tasks.workunit.client.0.smithi029.stdout:7/238: chown d6/df/d1a 0 1 2023-12-05T13:26:29.134 INFO:tasks.workunit.client.0.smithi029.stdout:0/153: readlink dc/l10 0 2023-12-05T13:26:29.134 INFO:tasks.workunit.client.0.smithi029.stdout:0/154: read - dc/d23/f2b zero size 2023-12-05T13:26:29.138 INFO:tasks.workunit.client.0.smithi029.stdout:9/151: unlink d7/d19/d1f/c2f 0 2023-12-05T13:26:29.138 INFO:tasks.workunit.client.0.smithi029.stdout:9/152: fdatasync d7/ff 0 2023-12-05T13:26:29.138 INFO:tasks.workunit.client.0.smithi029.stdout:9/153: write d7/d19/d28/f2d [495925,115059] 0 2023-12-05T13:26:29.141 INFO:tasks.workunit.client.0.smithi029.stdout:8/374: mkdir d5/d6/d10/d85 0 2023-12-05T13:26:29.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/308: dwrite d7/d61/f39 [0,4194304] 0 2023-12-05T13:26:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:6/189: creat d6/d1d/d36/f42 x:0 0 0 2023-12-05T13:26:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/239: truncate d6/f22 560278 0 2023-12-05T13:26:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/240: write d6/d35/d3e/d40/f42 [815508,13327] 0 2023-12-05T13:26:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/241: write d6/f9 [5854786,55370] 0 2023-12-05T13:26:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:7/242: truncate d6/df/d1a/d26/f31 1217903 0 2023-12-05T13:26:29.147 INFO:tasks.workunit.client.0.smithi029.stdout:4/136: rename d0/d1/f21 to d0/f2e 0 2023-12-05T13:26:29.147 INFO:tasks.workunit.client.0.smithi029.stdout:4/137: chown d0/da/f1b 2908891 1 2023-12-05T13:26:29.149 INFO:tasks.workunit.client.0.smithi029.stdout:5/135: dwrite d1/f20 [0,4194304] 0 2023-12-05T13:26:29.149 INFO:tasks.workunit.client.0.smithi029.stdout:2/134: dwrite de/d16/f1b [0,4194304] 0 2023-12-05T13:26:29.150 INFO:tasks.workunit.client.0.smithi029.stdout:2/135: write f4 [2889943,13411] 0 2023-12-05T13:26:29.150 INFO:tasks.workunit.client.0.smithi029.stdout:0/155: creat dc/f35 x:0 0 0 2023-12-05T13:26:29.153 INFO:tasks.workunit.client.0.smithi029.stdout:8/375: mkdir d5/d2f/d3a/d86 0 2023-12-05T13:26:29.153 INFO:tasks.workunit.client.0.smithi029.stdout:8/376: truncate d5/dc/d18/d26/f64 785533 0 2023-12-05T13:26:29.153 INFO:tasks.workunit.client.0.smithi029.stdout:8/377: truncate d5/dc/d17/d53/f60 4687708 0 2023-12-05T13:26:29.158 INFO:tasks.workunit.client.0.smithi029.stdout:6/190: unlink d6/d1d/d39/f3e 0 2023-12-05T13:26:29.158 INFO:tasks.workunit.client.0.smithi029.stdout:6/191: readlink d6/l8 0 2023-12-05T13:26:29.161 INFO:tasks.workunit.client.0.smithi029.stdout:7/243: mknod d6/df/d1a/d26/c4d 0 2023-12-05T13:26:29.166 INFO:tasks.workunit.client.0.smithi029.stdout:9/154: rename d7/d19/f1d to d7/f38 0 2023-12-05T13:26:29.169 INFO:tasks.workunit.client.0.smithi029.stdout:9/155: write d7/f18 [2425634,75998] 0 2023-12-05T13:26:29.170 INFO:tasks.workunit.client.0.smithi029.stdout:6/192: dwrite d6/d29/f3b [0,4194304] 0 2023-12-05T13:26:29.170 INFO:tasks.workunit.client.0.smithi029.stdout:6/193: chown d6/d21/l33 81 1 2023-12-05T13:26:29.170 INFO:tasks.workunit.client.0.smithi029.stdout:6/194: readlink d6/l13 0 2023-12-05T13:26:29.170 INFO:tasks.workunit.client.0.smithi029.stdout:9/156: write d7/fe [3450308,22221] 0 2023-12-05T13:26:29.172 INFO:tasks.workunit.client.0.smithi029.stdout:2/136: rmdir de 39 2023-12-05T13:26:29.172 INFO:tasks.workunit.client.0.smithi029.stdout:2/137: fdatasync de/d16/d18/f19 0 2023-12-05T13:26:29.174 INFO:tasks.workunit.client.0.smithi029.stdout:0/156: mknod dc/d23/c36 0 2023-12-05T13:26:29.177 INFO:tasks.workunit.client.0.smithi029.stdout:8/378: creat d5/dc/f87 x:0 0 0 2023-12-05T13:26:29.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/244: truncate d6/d19/f25 151679 0 2023-12-05T13:26:29.183 INFO:tasks.workunit.client.0.smithi029.stdout:1/309: rename d7/d56/l4e to d7/d5e/d52/d5f/d12/d60/l63 0 2023-12-05T13:26:29.183 INFO:tasks.workunit.client.0.smithi029.stdout:9/157: dwrite d7/f9 [0,4194304] 0 2023-12-05T13:26:29.189 INFO:tasks.workunit.client.0.smithi029.stdout:6/195: mknod d6/d1d/c43 0 2023-12-05T13:26:29.196 INFO:tasks.workunit.client.0.smithi029.stdout:1/310: dwrite d7/d5e/f37 [0,4194304] 0 2023-12-05T13:26:29.197 INFO:tasks.workunit.client.0.smithi029.stdout:7/245: link d6/f15 d6/df/f4e 0 2023-12-05T13:26:29.200 INFO:tasks.workunit.client.0.smithi029.stdout:4/138: rename d0/de/d15/d1a to d0/d16/d2f 0 2023-12-05T13:26:29.207 INFO:tasks.workunit.client.0.smithi029.stdout:9/158: creat d7/d19/d28/f39 x:0 0 0 2023-12-05T13:26:29.207 INFO:tasks.workunit.client.0.smithi029.stdout:9/159: chown d7/fe 206 1 2023-12-05T13:26:29.208 INFO:tasks.workunit.client.0.smithi029.stdout:9/160: stat d7/d19/d1f/c27 0 2023-12-05T13:26:29.209 INFO:tasks.workunit.client.0.smithi029.stdout:6/196: creat d6/d1d/d39/f44 x:0 0 0 2023-12-05T13:26:29.209 INFO:tasks.workunit.client.0.smithi029.stdout:6/197: chown d6/f1c 12416540 1 2023-12-05T13:26:29.210 INFO:tasks.workunit.client.0.smithi029.stdout:8/379: symlink d5/dc/d17/d53/l88 0 2023-12-05T13:26:29.210 INFO:tasks.workunit.client.0.smithi029.stdout:4/139: dread d0/da/f18 [0,4194304] 0 2023-12-05T13:26:29.211 INFO:tasks.workunit.client.0.smithi029.stdout:0/157: dwrite dc/d13/f1c [0,4194304] 0 2023-12-05T13:26:29.217 INFO:tasks.workunit.client.0.smithi029.stdout:1/311: link d7/d5e/d52/d5f/d12/l5c d7/d31/d4b/l64 0 2023-12-05T13:26:29.219 INFO:tasks.workunit.client.0.smithi029.stdout:7/246: mkdir d6/d2a/d4f 0 2023-12-05T13:26:29.219 INFO:tasks.workunit.client.0.smithi029.stdout:7/247: truncate d6/f22 593222 0 2023-12-05T13:26:29.219 INFO:tasks.workunit.client.0.smithi029.stdout:6/198: dread d6/f10 [0,4194304] 0 2023-12-05T13:26:29.223 INFO:tasks.workunit.client.0.smithi029.stdout:6/199: write d6/fc [3161022,16040] 0 2023-12-05T13:26:29.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/136: rename l0 to d1/dc/d11/l2d 0 2023-12-05T13:26:29.227 INFO:tasks.workunit.client.0.smithi029.stdout:0/158: dwrite dc/f27 [0,4194304] 0 2023-12-05T13:26:29.230 INFO:tasks.workunit.client.0.smithi029.stdout:9/161: getdents d7 0 2023-12-05T13:26:29.230 INFO:tasks.workunit.client.0.smithi029.stdout:9/162: getdents d7/d2c/d33 0 2023-12-05T13:26:29.230 INFO:tasks.workunit.client.0.smithi029.stdout:9/163: fsync d7/d19/d28/f37 0 2023-12-05T13:26:29.233 INFO:tasks.workunit.client.0.smithi029.stdout:4/140: mkdir d0/de/d30 0 2023-12-05T13:26:29.238 INFO:tasks.workunit.client.0.smithi029.stdout:1/312: creat d7/d61/d4f/f65 x:0 0 0 2023-12-05T13:26:29.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/248: rename d6/d30 to d6/d50 0 2023-12-05T13:26:29.244 INFO:tasks.workunit.client.0.smithi029.stdout:1/313: dread d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:29.244 INFO:tasks.workunit.client.0.smithi029.stdout:1/314: chown d7/c10 0 1 2023-12-05T13:26:29.248 INFO:tasks.workunit.client.0.smithi029.stdout:6/200: dwrite d6/f18 [0,4194304] 0 2023-12-05T13:26:29.250 INFO:tasks.workunit.client.0.smithi029.stdout:0/159: dwrite dc/f2a [0,4194304] 0 2023-12-05T13:26:29.258 INFO:tasks.workunit.client.0.smithi029.stdout:5/137: link d1/f20 d1/dc/d27/f2e 0 2023-12-05T13:26:29.260 INFO:tasks.workunit.client.0.smithi029.stdout:1/315: dwrite d7/d5e/d52/d5f/d48/f4a [0,4194304] 0 2023-12-05T13:26:29.261 INFO:tasks.workunit.client.0.smithi029.stdout:2/138: rename de/d11/l15 to de/d16/d18/l23 0 2023-12-05T13:26:29.266 INFO:tasks.workunit.client.0.smithi029.stdout:9/164: getdents d7/d19/d1f 0 2023-12-05T13:26:29.300 INFO:tasks.workunit.client.0.smithi029.stdout:4/141: mkdir d0/de/d15/d2b/d31 0 2023-12-05T13:26:29.304 INFO:tasks.workunit.client.0.smithi029.stdout:7/249: mkdir d6/d50/d46/d51 0 2023-12-05T13:26:29.304 INFO:tasks.workunit.client.0.smithi029.stdout:7/250: write d6/f15 [1476762,31234] 0 2023-12-05T13:26:29.305 INFO:tasks.workunit.client.0.smithi029.stdout:6/201: link d6/d29/f3b d6/f45 0 2023-12-05T13:26:29.305 INFO:tasks.workunit.client.0.smithi029.stdout:6/202: write d6/f45 [4402039,89913] 0 2023-12-05T13:26:29.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/160: getdents dc/d23 0 2023-12-05T13:26:29.311 INFO:tasks.workunit.client.0.smithi029.stdout:5/138: symlink d1/dc/d10/d1e/l2f 0 2023-12-05T13:26:29.318 INFO:tasks.workunit.client.0.smithi029.stdout:8/380: rename d5/dc/d18/f35 to d5/d2f/d3a/d3c/f89 0 2023-12-05T13:26:29.320 INFO:tasks.workunit.client.0.smithi029.stdout:9/165: stat d7/c2b 0 2023-12-05T13:26:29.327 INFO:tasks.workunit.client.0.smithi029.stdout:7/251: mkdir d6/d35/d3e/d40/d52 0 2023-12-05T13:26:29.327 INFO:tasks.workunit.client.0.smithi029.stdout:7/252: chown l5 32928 1 2023-12-05T13:26:29.327 INFO:tasks.workunit.client.0.smithi029.stdout:7/253: dread - d6/df/f36 zero size 2023-12-05T13:26:29.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/161: dwrite dc/d23/f2b [0,4194304] 0 2023-12-05T13:26:29.331 INFO:tasks.workunit.client.0.smithi029.stdout:0/162: stat dc/f29 0 2023-12-05T13:26:29.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/139: getdents d1 0 2023-12-05T13:26:29.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/254: fsync d6/df/f4e 0 2023-12-05T13:26:29.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/255: readlink d6/df/l14 0 2023-12-05T13:26:29.333 INFO:tasks.workunit.client.0.smithi029.stdout:2/139: rename de/d16/d18 to de/d14/d24 0 2023-12-05T13:26:29.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/166: mkdir d7/d2c/d3a 0 2023-12-05T13:26:29.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/167: write d7/d19/d28/f37 [163518,73258] 0 2023-12-05T13:26:29.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/381: dwrite d5/dc/d18/d26/f5a [0,4194304] 0 2023-12-05T13:26:29.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/382: chown d5/d6/l40 9 1 2023-12-05T13:26:29.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/383: read - d5/d2f/d75/f7b zero size 2023-12-05T13:26:29.342 INFO:tasks.workunit.client.0.smithi029.stdout:8/384: read - d5/d6/d10/f76 zero size 2023-12-05T13:26:29.345 INFO:tasks.workunit.client.0.smithi029.stdout:5/140: symlink d1/dc/d27/l30 0 2023-12-05T13:26:29.348 INFO:tasks.workunit.client.0.smithi029.stdout:7/256: mknod d6/d35/d3e/d40/d52/c53 0 2023-12-05T13:26:29.348 INFO:tasks.workunit.client.0.smithi029.stdout:7/257: readlink d6/df/l10 0 2023-12-05T13:26:29.349 INFO:tasks.workunit.client.0.smithi029.stdout:9/168: dwrite d7/d19/d28/f2d [0,4194304] 0 2023-12-05T13:26:29.349 INFO:tasks.workunit.client.0.smithi029.stdout:4/142: rename d0/de/d15/d2b/d31 to d0/de/d30/d32 0 2023-12-05T13:26:29.353 INFO:tasks.workunit.client.0.smithi029.stdout:2/140: creat de/d11/f25 x:0 0 0 2023-12-05T13:26:29.353 INFO:tasks.workunit.client.0.smithi029.stdout:2/141: chown de/cf 1032709594 1 2023-12-05T13:26:29.353 INFO:tasks.workunit.client.0.smithi029.stdout:2/142: chown de/d16/f1f 127 1 2023-12-05T13:26:29.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/385: mkdir d5/d6/d10/d8a 0 2023-12-05T13:26:29.360 INFO:tasks.workunit.client.0.smithi029.stdout:5/141: truncate d1/dc/f1b 667660 0 2023-12-05T13:26:29.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/169: dread d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:29.362 INFO:tasks.workunit.client.0.smithi029.stdout:2/143: dread f6 [0,4194304] 0 2023-12-05T13:26:29.365 INFO:tasks.workunit.client.0.smithi029.stdout:8/386: dread d5/dc/d18/f3d [0,4194304] 0 2023-12-05T13:26:29.365 INFO:tasks.workunit.client.0.smithi029.stdout:5/142: dread d1/dc/de/f19 [0,4194304] 0 2023-12-05T13:26:29.367 INFO:tasks.workunit.client.0.smithi029.stdout:6/203: rename d6/l8 to d6/d3f/l46 0 2023-12-05T13:26:29.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/170: mknod d7/d2c/d33/c3b 0 2023-12-05T13:26:29.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/387: mkdir d5/dc/d17/d8b 0 2023-12-05T13:26:29.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/388: fdatasync d5/d2f/d75/f84 0 2023-12-05T13:26:29.371 INFO:tasks.workunit.client.0.smithi029.stdout:5/143: symlink d1/dc/d10/l31 0 2023-12-05T13:26:29.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/143: rename d0/de/d15/c2d to d0/d16/c33 0 2023-12-05T13:26:29.375 INFO:tasks.workunit.client.0.smithi029.stdout:6/204: mkdir d6/d3f/d47 0 2023-12-05T13:26:29.375 INFO:tasks.workunit.client.0.smithi029.stdout:6/205: stat d6/f11 0 2023-12-05T13:26:29.377 INFO:tasks.workunit.client.0.smithi029.stdout:6/206: dread d6/f45 [4194304,4194304] 0 2023-12-05T13:26:29.377 INFO:tasks.workunit.client.0.smithi029.stdout:6/207: chown d6/d1d/d39/f44 60957 1 2023-12-05T13:26:29.379 INFO:tasks.workunit.client.0.smithi029.stdout:6/208: write d6/fc [288272,64792] 0 2023-12-05T13:26:29.380 INFO:tasks.workunit.client.0.smithi029.stdout:5/144: truncate d1/f7 3309853 0 2023-12-05T13:26:29.383 INFO:tasks.workunit.client.0.smithi029.stdout:5/145: dread d1/dc/de/f22 [0,4194304] 0 2023-12-05T13:26:29.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/389: dwrite d5/d6/d10/d13/f41 [0,4194304] 0 2023-12-05T13:26:29.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/390: readlink d5/d6/d10/d13/l78 0 2023-12-05T13:26:29.383 INFO:tasks.workunit.client.0.smithi029.stdout:2/144: rename f9 to de/d11/f26 0 2023-12-05T13:26:29.384 INFO:tasks.workunit.client.0.smithi029.stdout:2/145: stat de/d14/d24/f19 0 2023-12-05T13:26:29.386 INFO:tasks.workunit.client.0.smithi029.stdout:4/144: dread d0/da/f18 [0,4194304] 0 2023-12-05T13:26:29.386 INFO:tasks.workunit.client.0.smithi029.stdout:4/145: truncate d0/f23 738104 0 2023-12-05T13:26:29.386 INFO:tasks.workunit.client.0.smithi029.stdout:9/171: dread d7/d19/d28/f37 [0,4194304] 0 2023-12-05T13:26:29.387 INFO:tasks.workunit.client.0.smithi029.stdout:6/209: truncate d6/fe 4196642 0 2023-12-05T13:26:29.387 INFO:tasks.workunit.client.0.smithi029.stdout:4/146: read d0/da/f1b [362552,15822] 0 2023-12-05T13:26:29.387 INFO:tasks.workunit.client.0.smithi029.stdout:4/147: fdatasync d0/da/f20 0 2023-12-05T13:26:29.390 INFO:tasks.workunit.client.0.smithi029.stdout:8/391: unlink d5/dc/l70 0 2023-12-05T13:26:29.390 INFO:tasks.workunit.client.0.smithi029.stdout:8/392: truncate d5/d2f/f68 4314572 0 2023-12-05T13:26:29.392 INFO:tasks.workunit.client.0.smithi029.stdout:9/172: link d7/d19/d28/f37 d7/f3c 0 2023-12-05T13:26:29.397 INFO:tasks.workunit.client.0.smithi029.stdout:4/148: symlink d0/de/d15/l34 0 2023-12-05T13:26:29.397 INFO:tasks.workunit.client.0.smithi029.stdout:9/173: readlink l6 0 2023-12-05T13:26:29.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/146: dread d1/fb [0,4194304] 0 2023-12-05T13:26:29.399 INFO:tasks.workunit.client.0.smithi029.stdout:5/147: creat d1/f32 x:0 0 0 2023-12-05T13:26:29.405 INFO:tasks.workunit.client.0.smithi029.stdout:2/146: dwrite de/d11/f26 [0,4194304] 0 2023-12-05T13:26:29.408 INFO:tasks.workunit.client.0.smithi029.stdout:2/147: creat de/f27 x:0 0 0 2023-12-05T13:26:29.409 INFO:tasks.workunit.client.0.smithi029.stdout:2/148: creat de/f28 x:0 0 0 2023-12-05T13:26:29.411 INFO:tasks.workunit.client.0.smithi029.stdout:5/148: write d1/f20 [3104939,48042] 0 2023-12-05T13:26:29.412 INFO:tasks.workunit.client.0.smithi029.stdout:5/149: truncate d1/dc/de/f22 723267 0 2023-12-05T13:26:29.415 INFO:tasks.workunit.client.0.smithi029.stdout:5/150: mkdir d1/dc/d10/d1e/d33 0 2023-12-05T13:26:29.417 INFO:tasks.workunit.client.0.smithi029.stdout:8/393: dwrite d5/dc/d18/d26/f5a [0,4194304] 0 2023-12-05T13:26:29.417 INFO:tasks.workunit.client.0.smithi029.stdout:5/151: truncate d1/fb 3908369 0 2023-12-05T13:26:29.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/394: dread d5/d2f/d3a/d3c/f89 [0,4194304] 0 2023-12-05T13:26:29.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/395: readlink d5/dc/d17/d53/l88 0 2023-12-05T13:26:29.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/396: dread d5/d2f/d75/f22 [8388608,4194304] 0 2023-12-05T13:26:29.431 INFO:tasks.workunit.client.0.smithi029.stdout:2/149: dwrite f4 [0,4194304] 0 2023-12-05T13:26:29.431 INFO:tasks.workunit.client.0.smithi029.stdout:2/150: truncate fa 1121050 0 2023-12-05T13:26:29.431 INFO:tasks.workunit.client.0.smithi029.stdout:2/151: fdatasync de/d14/f21 0 2023-12-05T13:26:29.431 INFO:tasks.workunit.client.0.smithi029.stdout:2/152: read de/f13 [2514251,86143] 0 2023-12-05T13:26:29.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/153: write fa [855682,123573] 0 2023-12-05T13:26:29.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/174: read d7/d19/d28/f2d [1356230,52129] 0 2023-12-05T13:26:29.449 INFO:tasks.workunit.client.0.smithi029.stdout:8/397: dwrite d5/d2f/f7d [0,4194304] 0 2023-12-05T13:26:29.451 INFO:tasks.workunit.client.0.smithi029.stdout:7/258: dwrite d6/f22 [0,4194304] 0 2023-12-05T13:26:29.458 INFO:tasks.workunit.client.0.smithi029.stdout:6/210: dread d6/d29/f3b [0,4194304] 0 2023-12-05T13:26:29.458 INFO:tasks.workunit.client.0.smithi029.stdout:6/211: dread - d6/d1d/d36/f42 zero size 2023-12-05T13:26:29.464 INFO:tasks.workunit.client.0.smithi029.stdout:8/398: dread d5/dc/d17/d1d/f2e [0,4194304] 0 2023-12-05T13:26:29.464 INFO:tasks.workunit.client.0.smithi029.stdout:8/399: chown d5/dc/d56/f81 8 1 2023-12-05T13:26:29.466 INFO:tasks.workunit.client.0.smithi029.stdout:4/149: dwrite d0/f23 [0,4194304] 0 2023-12-05T13:26:29.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/212: creat d6/d1d/d36/f48 x:0 0 0 2023-12-05T13:26:29.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/213: dread - d6/d1d/d39/f44 zero size 2023-12-05T13:26:29.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/214: write d6/f45 [593827,5360] 0 2023-12-05T13:26:29.474 INFO:tasks.workunit.client.0.smithi029.stdout:8/400: dread f4 [0,4194304] 0 2023-12-05T13:26:29.474 INFO:tasks.workunit.client.0.smithi029.stdout:8/401: dread - d5/d6/d59/f6f zero size 2023-12-05T13:26:29.475 INFO:tasks.workunit.client.0.smithi029.stdout:8/402: readlink d5/dc/d17/l79 0 2023-12-05T13:26:29.477 INFO:tasks.workunit.client.0.smithi029.stdout:4/150: mkdir d0/de/d30/d32/d35 0 2023-12-05T13:26:29.479 INFO:tasks.workunit.client.0.smithi029.stdout:6/215: rename d6/c15 to d6/d21/c49 0 2023-12-05T13:26:29.479 INFO:tasks.workunit.client.0.smithi029.stdout:6/216: chown d6/c2e 1974 1 2023-12-05T13:26:29.486 INFO:tasks.workunit.client.0.smithi029.stdout:9/175: truncate d7/d19/d28/f2d 1230750 0 2023-12-05T13:26:29.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/259: dwrite d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:29.495 INFO:tasks.workunit.client.0.smithi029.stdout:7/260: truncate d6/f11 1826580 0 2023-12-05T13:26:29.496 INFO:tasks.workunit.client.0.smithi029.stdout:8/403: dwrite d5/dc/d17/d1d/f2a [0,4194304] 0 2023-12-05T13:26:29.498 INFO:tasks.workunit.client.0.smithi029.stdout:7/261: unlink d6/d50/f32 0 2023-12-05T13:26:29.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/404: link d5/dc/l23 d5/dc/d18/l8c 0 2023-12-05T13:26:29.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/405: truncate d5/d6/d10/f76 100477 0 2023-12-05T13:26:29.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/406: chown d5/la 4 1 2023-12-05T13:26:29.504 INFO:tasks.workunit.client.0.smithi029.stdout:7/262: rmdir d6/d35 39 2023-12-05T13:26:29.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/263: write d6/df/d1a/d26/f31 [1063474,70286] 0 2023-12-05T13:26:29.505 INFO:tasks.workunit.client.0.smithi029.stdout:7/264: read d6/d35/d3e/d40/f42 [822827,15776] 0 2023-12-05T13:26:29.511 INFO:tasks.workunit.client.0.smithi029.stdout:8/407: link d5/c1b d5/d2f/d75/c8d 0 2023-12-05T13:26:29.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/265: unlink d6/df/c20 0 2023-12-05T13:26:29.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/266: read d6/df/d1a/f27 [1833615,27847] 0 2023-12-05T13:26:29.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/267: chown f1 62400956 1 2023-12-05T13:26:29.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/268: write d6/df/d1a/d26/f31 [1386783,18259] 0 2023-12-05T13:26:29.527 INFO:tasks.workunit.client.0.smithi029.stdout:2/154: truncate de/d11/f26 472226 0 2023-12-05T13:26:29.536 INFO:tasks.workunit.client.0.smithi029.stdout:8/408: dwrite d5/dc/d17/d1d/f29 [4194304,4194304] 0 2023-12-05T13:26:29.542 INFO:tasks.workunit.client.0.smithi029.stdout:8/409: dread d5/d6/d10/d13/f55 [0,4194304] 0 2023-12-05T13:26:29.542 INFO:tasks.workunit.client.0.smithi029.stdout:8/410: chown d5/d2f/c52 567741 1 2023-12-05T13:26:29.542 INFO:tasks.workunit.client.0.smithi029.stdout:7/269: dwrite d6/df/f36 [0,4194304] 0 2023-12-05T13:26:29.542 INFO:tasks.workunit.client.0.smithi029.stdout:7/270: chown d6/d19/f34 763861 1 2023-12-05T13:26:29.547 INFO:tasks.workunit.client.0.smithi029.stdout:8/411: creat d5/d6/d10/d8a/f8e x:0 0 0 2023-12-05T13:26:29.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/412: rename d5/dc/d17/d53/l88 to d5/dc/d17/d8b/l8f 0 2023-12-05T13:26:29.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/413: write d5/dc/d17/d1d/f29 [9024558,12964] 0 2023-12-05T13:26:29.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/155: dwrite f6 [4194304,4194304] 0 2023-12-05T13:26:29.562 INFO:tasks.workunit.client.0.smithi029.stdout:9/176: write d7/d19/d28/f2d [64324,5218] 0 2023-12-05T13:26:29.562 INFO:tasks.workunit.client.0.smithi029.stdout:9/177: truncate d7/d19/d1f/f29 117902 0 2023-12-05T13:26:29.562 INFO:tasks.workunit.client.0.smithi029.stdout:8/414: dread d5/dc/d18/f3d [0,4194304] 0 2023-12-05T13:26:29.570 INFO:tasks.workunit.client.0.smithi029.stdout:9/178: creat d7/d19/d28/f3d x:0 0 0 2023-12-05T13:26:29.570 INFO:tasks.workunit.client.0.smithi029.stdout:9/179: chown d7/f9 6 1 2023-12-05T13:26:29.572 INFO:tasks.workunit.client.0.smithi029.stdout:8/415: rename d5/d6/d59/f83 to d5/dc/f90 0 2023-12-05T13:26:29.572 INFO:tasks.workunit.client.0.smithi029.stdout:7/271: dwrite d6/d35/d3e/d40/f42 [0,4194304] 0 2023-12-05T13:26:29.572 INFO:tasks.workunit.client.0.smithi029.stdout:7/272: stat d6/df/d1a/c37 0 2023-12-05T13:26:29.573 INFO:tasks.workunit.client.0.smithi029.stdout:7/273: write d6/df/d1a/d26/f2b [1873786,74853] 0 2023-12-05T13:26:29.573 INFO:tasks.workunit.client.0.smithi029.stdout:2/156: dread de/f13 [0,4194304] 0 2023-12-05T13:26:29.574 INFO:tasks.workunit.client.0.smithi029.stdout:2/157: chown de/f12 17797491 1 2023-12-05T13:26:29.585 INFO:tasks.workunit.client.0.smithi029.stdout:7/274: write d6/f15 [1469035,65879] 0 2023-12-05T13:26:29.585 INFO:tasks.workunit.client.0.smithi029.stdout:7/275: fdatasync d6/df/d1a/d26/f39 0 2023-12-05T13:26:29.594 INFO:tasks.workunit.client.0.smithi029.stdout:8/416: dwrite d5/dc/d18/f57 [0,4194304] 0 2023-12-05T13:26:29.594 INFO:tasks.workunit.client.0.smithi029.stdout:2/158: dwrite fa [0,4194304] 0 2023-12-05T13:26:29.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/417: dread d5/d2f/d75/f33 [0,4194304] 0 2023-12-05T13:26:29.599 INFO:tasks.workunit.client.0.smithi029.stdout:8/418: write d5/d2f/d75/f84 [296268,5373] 0 2023-12-05T13:26:29.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/276: symlink d6/d50/d46/d51/l54 0 2023-12-05T13:26:29.602 INFO:tasks.workunit.client.0.smithi029.stdout:5/152: truncate d1/fb 2345248 0 2023-12-05T13:26:29.602 INFO:tasks.workunit.client.0.smithi029.stdout:5/153: chown d1/dc/d10/l31 2405 1 2023-12-05T13:26:29.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/154: write d1/dc/d27/f2e [2543781,10815] 0 2023-12-05T13:26:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:29 smithi052 ceph-mon[121072]: pgmap v36: 65 pgs: 65 active+clean; 598 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 431 op/s 2023-12-05T13:26:29.729 INFO:tasks.workunit.client.0.smithi029.stdout:8/419: creat d5/dc/d17/f91 x:0 0 0 2023-12-05T13:26:29.731 INFO:tasks.workunit.client.0.smithi029.stdout:8/420: dread d5/d6/f1a [0,4194304] 0 2023-12-05T13:26:29.735 INFO:tasks.workunit.client.0.smithi029.stdout:6/217: truncate d6/fe 2123969 0 2023-12-05T13:26:29.739 INFO:tasks.workunit.client.0.smithi029.stdout:7/277: creat d6/d35/d3e/d40/d52/f55 x:0 0 0 2023-12-05T13:26:29.741 INFO:tasks.workunit.client.0.smithi029.stdout:5/155: mknod d1/dc/d11/d17/d29/c34 0 2023-12-05T13:26:29.741 INFO:tasks.workunit.client.0.smithi029.stdout:5/156: stat d1/dc/d11 0 2023-12-05T13:26:29.743 INFO:tasks.workunit.client.0.smithi029.stdout:6/218: rename d6/d21/c49 to d6/d29/c4a 0 2023-12-05T13:26:29.745 INFO:tasks.workunit.client.0.smithi029.stdout:7/278: truncate d6/d35/d3e/d40/f45 2531130 0 2023-12-05T13:26:29.748 INFO:tasks.workunit.client.0.smithi029.stdout:7/279: write d6/df/f36 [1127510,74122] 0 2023-12-05T13:26:29.748 INFO:tasks.workunit.client.0.smithi029.stdout:7/280: chown d6/d50/c3a 10538973 1 2023-12-05T13:26:29.749 INFO:tasks.workunit.client.0.smithi029.stdout:7/281: chown d6/d35/c4c 217440 1 2023-12-05T13:26:29.752 INFO:tasks.workunit.client.0.smithi029.stdout:5/157: truncate d1/dc/de/f22 439636 0 2023-12-05T13:26:29.754 INFO:tasks.workunit.client.0.smithi029.stdout:7/282: mknod d6/d19/c56 0 2023-12-05T13:26:29.757 INFO:tasks.workunit.client.0.smithi029.stdout:3/164: sync 2023-12-05T13:26:29.760 INFO:tasks.workunit.client.0.smithi029.stdout:8/421: dwrite d5/dc/d17/d53/f62 [0,4194304] 0 2023-12-05T13:26:29.761 INFO:tasks.workunit.client.0.smithi029.stdout:3/165: link d1/d6/d11/l1c d1/d16/d28/l35 0 2023-12-05T13:26:29.761 INFO:tasks.workunit.client.0.smithi029.stdout:9/180: dwrite d7/f13 [0,4194304] 0 2023-12-05T13:26:29.761 INFO:tasks.workunit.client.0.smithi029.stdout:9/181: stat d7/d19/d1f/f21 0 2023-12-05T13:26:29.761 INFO:tasks.workunit.client.0.smithi029.stdout:9/182: fsync d7/f38 0 2023-12-05T13:26:29.764 INFO:tasks.workunit.client.0.smithi029.stdout:6/219: dwrite d6/d21/f31 [0,4194304] 0 2023-12-05T13:26:29.764 INFO:tasks.workunit.client.0.smithi029.stdout:6/220: chown d6/c30 654723 1 2023-12-05T13:26:29.765 INFO:tasks.workunit.client.0.smithi029.stdout:9/183: link d7/f9 d7/d2c/d3a/f3e 0 2023-12-05T13:26:29.769 INFO:tasks.workunit.client.0.smithi029.stdout:5/158: dread d1/dc/de/f1a [0,4194304] 0 2023-12-05T13:26:29.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/221: rename d6/d21/l2a to d6/l4b 0 2023-12-05T13:26:29.776 INFO:tasks.workunit.client.0.smithi029.stdout:5/159: dread d1/dc/de/f1a [0,4194304] 0 2023-12-05T13:26:29.776 INFO:tasks.workunit.client.0.smithi029.stdout:3/166: write d1/d6/ff [72680,17993] 0 2023-12-05T13:26:29.779 INFO:tasks.workunit.client.0.smithi029.stdout:7/283: dwrite d6/d19/f34 [0,4194304] 0 2023-12-05T13:26:29.779 INFO:tasks.workunit.client.0.smithi029.stdout:3/167: mkdir d1/d16/d36 0 2023-12-05T13:26:29.779 INFO:tasks.workunit.client.0.smithi029.stdout:7/284: fsync d6/df/d1a/d26/f39 0 2023-12-05T13:26:29.783 INFO:tasks.workunit.client.0.smithi029.stdout:7/285: creat d6/d50/d46/f57 x:0 0 0 2023-12-05T13:26:29.793 INFO:tasks.workunit.client.0.smithi029.stdout:8/422: dwrite d5/dc/d17/d1d/f29 [4194304,4194304] 0 2023-12-05T13:26:29.795 INFO:tasks.workunit.client.0.smithi029.stdout:9/184: dwrite d7/ff [4194304,4194304] 0 2023-12-05T13:26:29.796 INFO:tasks.workunit.client.0.smithi029.stdout:6/222: dwrite d6/d21/f3d [4194304,4194304] 0 2023-12-05T13:26:29.796 INFO:tasks.workunit.client.0.smithi029.stdout:6/223: readlink d6/d21/l3a 0 2023-12-05T13:26:29.796 INFO:tasks.workunit.client.0.smithi029.stdout:7/286: dread d6/df/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:29.798 INFO:tasks.workunit.client.0.smithi029.stdout:8/423: dread d5/dc/d18/f3d [0,4194304] 0 2023-12-05T13:26:29.799 INFO:tasks.workunit.client.0.smithi029.stdout:9/185: truncate d7/d19/f1b 2101498 0 2023-12-05T13:26:29.800 INFO:tasks.workunit.client.0.smithi029.stdout:9/186: write d7/f13 [2226470,116466] 0 2023-12-05T13:26:29.803 INFO:tasks.workunit.client.0.smithi029.stdout:6/224: unlink d6/d21/f31 0 2023-12-05T13:26:29.807 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-05T13:26:29.808 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-05T13:26:29.809 INFO:tasks.workunit.client.0.smithi029.stdout:7/287: mkdir d6/d50/d46/d51/d58 0 2023-12-05T13:26:29.809 INFO:tasks.workunit.client.0.smithi029.stdout:9/187: read d7/f18 [1754201,120297] 0 2023-12-05T13:26:29.809 INFO:tasks.workunit.client.0.smithi029.stdout:8/424: rmdir d5/d6/d59 39 2023-12-05T13:26:29.810 INFO:tasks.workunit.client.0.smithi029.stdout:9/188: dread d7/f3c [0,4194304] 0 2023-12-05T13:26:29.812 INFO:tasks.workunit.client.0.smithi029.stdout:6/225: rmdir d6 39 2023-12-05T13:26:29.815 INFO:tasks.workunit.client.0.smithi029.stdout:7/288: link d6/f11 d6/df/d1a/d26/f59 0 2023-12-05T13:26:29.815 INFO:tasks.workunit.client.0.smithi029.stdout:7/289: dread - d6/d35/d3e/d40/d52/f55 zero size 2023-12-05T13:26:29.815 INFO:tasks.workunit.client.0.smithi029.stdout:7/290: dread - d6/df/d1a/d26/f39 zero size 2023-12-05T13:26:29.816 INFO:tasks.workunit.client.0.smithi029.stdout:8/425: symlink d5/d2f/d3a/d3c/l92 0 2023-12-05T13:26:29.817 INFO:tasks.workunit.client.0.smithi029.stdout:9/189: link d7/cc d7/d19/d28/c3f 0 2023-12-05T13:26:29.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/426: link d5/d2f/d3a/c74 d5/d6/d59/c93 0 2023-12-05T13:26:29.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/427: read d5/dc/d18/f57 [2958059,100421] 0 2023-12-05T13:26:29.821 INFO:tasks.workunit.client.0.smithi029.stdout:8/428: creat d5/dc/d18/d26/f94 x:0 0 0 2023-12-05T13:26:29.838 INFO:tasks.workunit.client.0.smithi029.stdout:6/226: dwrite d6/f11 [0,4194304] 0 2023-12-05T13:26:29.844 INFO:tasks.workunit.client.0.smithi029.stdout:7/291: dwrite d6/df/f1f [0,4194304] 0 2023-12-05T13:26:29.844 INFO:tasks.workunit.client.0.smithi029.stdout:7/292: write d6/df/f4e [3851906,83230] 0 2023-12-05T13:26:29.844 INFO:tasks.workunit.client.0.smithi029.stdout:7/293: mknod d6/c5a 0 2023-12-05T13:26:29.848 INFO:tasks.workunit.client.0.smithi029.stdout:7/294: dread d6/d35/d3e/d40/f45 [0,4194304] 0 2023-12-05T13:26:29.852 INFO:tasks.workunit.client.0.smithi029.stdout:7/295: rename d6/df to d6/d50/d5b 0 2023-12-05T13:26:29.853 INFO:tasks.workunit.client.0.smithi029.stdout:8/429: dwrite d5/d6/d59/f6f [0,4194304] 0 2023-12-05T13:26:29.853 INFO:tasks.workunit.client.0.smithi029.stdout:9/190: dwrite d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:29.853 INFO:tasks.workunit.client.0.smithi029.stdout:6/227: dread d6/f11 [0,4194304] 0 2023-12-05T13:26:29.854 INFO:tasks.workunit.client.0.smithi029.stdout:6/228: dread - d6/d1d/d36/f48 zero size 2023-12-05T13:26:29.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/191: chown d7/d19/f1b 0 1 2023-12-05T13:26:29.854 INFO:tasks.workunit.client.0.smithi029.stdout:6/229: fsync d6/f45 0 2023-12-05T13:26:29.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/192: truncate d7/d19/d28/f3d 310081 0 2023-12-05T13:26:29.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:29 smithi029 ceph-mon[112128]: pgmap v36: 65 pgs: 65 active+clean; 598 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 431 op/s 2023-12-05T13:26:29.855 INFO:tasks.workunit.client.0.smithi029.stdout:7/296: mkdir d6/d35/d5c 0 2023-12-05T13:26:29.857 INFO:tasks.workunit.client.0.smithi029.stdout:9/193: mkdir d7/d19/d30/d40 0 2023-12-05T13:26:29.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/297: rmdir d6/d50/d5b 39 2023-12-05T13:26:29.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/298: chown d6/d50/d5b/d1a/c3b 1909132 1 2023-12-05T13:26:29.859 INFO:tasks.workunit.client.0.smithi029.stdout:7/299: read d6/d50/d5b/f17 [401772,121186] 0 2023-12-05T13:26:29.862 INFO:tasks.workunit.client.0.smithi029.stdout:9/194: creat d7/d19/f41 x:0 0 0 2023-12-05T13:26:29.865 INFO:tasks.workunit.client.0.smithi029.stdout:7/300: dread d6/d50/d5b/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:29.866 INFO:tasks.workunit.client.0.smithi029.stdout:7/301: truncate d6/f11 2217491 0 2023-12-05T13:26:29.866 INFO:tasks.workunit.client.0.smithi029.stdout:7/302: chown d6/d50/d5b/f29 1495 1 2023-12-05T13:26:29.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/195: dwrite d7/d19/d28/f2d [0,4194304] 0 2023-12-05T13:26:29.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/303: dwrite d6/d35/d3e/d40/f42 [0,4194304] 0 2023-12-05T13:26:29.884 INFO:tasks.workunit.client.0.smithi029.stdout:7/304: readlink d6/lb 0 2023-12-05T13:26:29.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/196: dread d7/f38 [0,4194304] 0 2023-12-05T13:26:29.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/197: dread d7/d19/d28/f3d [0,4194304] 0 2023-12-05T13:26:29.894 INFO:tasks.workunit.client.0.smithi029.stdout:9/198: mknod d7/c42 0 2023-12-05T13:26:29.895 INFO:tasks.workunit.client.0.smithi029.stdout:9/199: dread d7/d19/d28/f37 [0,4194304] 0 2023-12-05T13:26:29.896 INFO:tasks.workunit.client.0.smithi029.stdout:7/305: dwrite d6/d50/d5b/f4e [0,4194304] 0 2023-12-05T13:26:29.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/200: unlink d7/c23 0 2023-12-05T13:26:29.899 INFO:tasks.workunit.client.0.smithi029.stdout:7/306: symlink d6/d50/d46/d51/d58/l5d 0 2023-12-05T13:26:29.913 INFO:tasks.workunit.client.0.smithi029.stdout:9/201: dwrite d7/f9 [4194304,4194304] 0 2023-12-05T13:26:29.914 INFO:tasks.workunit.client.0.smithi029.stdout:9/202: write d7/f38 [2240847,118596] 0 2023-12-05T13:26:29.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/307: dwrite d6/d50/d5b/f29 [0,4194304] 0 2023-12-05T13:26:29.917 INFO:tasks.workunit.client.0.smithi029.stdout:7/308: creat d6/d50/d5b/d1a/d26/f5e x:0 0 0 2023-12-05T13:26:29.929 INFO:tasks.workunit.client.0.smithi029.stdout:9/203: dwrite d7/f3c [0,4194304] 0 2023-12-05T13:26:29.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/204: rename d7/d19/d34 to d7/d19/d30/d43 0 2023-12-05T13:26:29.934 INFO:tasks.workunit.client.0.smithi029.stdout:7/309: dwrite d6/d50/d5b/d1a/d26/f39 [0,4194304] 0 2023-12-05T13:26:29.935 INFO:tasks.workunit.client.0.smithi029.stdout:7/310: write d6/f15 [3004467,70389] 0 2023-12-05T13:26:29.937 INFO:tasks.workunit.client.0.smithi029.stdout:7/311: mkdir d6/d50/d5b/d5f 0 2023-12-05T13:26:29.938 INFO:tasks.workunit.client.0.smithi029.stdout:7/312: readlink d6/l16 0 2023-12-05T13:26:29.938 INFO:tasks.workunit.client.0.smithi029.stdout:7/313: readlink d6/d35/d3e/d40/l43 0 2023-12-05T13:26:29.939 INFO:tasks.workunit.client.0.smithi029.stdout:7/314: dread d6/d19/f25 [0,4194304] 0 2023-12-05T13:26:30.033 INFO:tasks.workunit.client.0.smithi029.stdout:7/315: dwrite d6/f9 [0,4194304] 0 2023-12-05T13:26:30.033 INFO:tasks.workunit.client.0.smithi029.stdout:7/316: write d6/d50/d5b/d1a/f27 [3668918,37624] 0 2023-12-05T13:26:30.120 DEBUG:teuthology.parallel:result is None 2023-12-05T13:26:30.124 INFO:tasks.workunit.client.0.smithi029.stdout:7/317: dwrite d6/d50/d5b/f17 [0,4194304] 0 2023-12-05T13:26:30.124 INFO:tasks.workunit.client.0.smithi029.stdout:7/318: chown c2 382237381 1 2023-12-05T13:26:30.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/319: mknod d6/d50/d46/d4a/d4b/c60 0 2023-12-05T13:26:30.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/320: dread d6/d50/d5b/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:30.130 INFO:tasks.workunit.client.0.smithi029.stdout:7/321: chown d6/d50/d46 41916421 1 2023-12-05T13:26:30.137 INFO:tasks.workunit.client.0.smithi029.stdout:7/322: dread f1 [0,4194304] 0 2023-12-05T13:26:30.137 INFO:tasks.workunit.client.0.smithi029.stdout:7/323: fsync d6/d50/d5b/f17 0 2023-12-05T13:26:30.138 INFO:tasks.workunit.client.0.smithi029.stdout:7/324: write d6/d50/d5b/f4e [3666165,25723] 0 2023-12-05T13:26:30.139 INFO:tasks.workunit.client.0.smithi029.stdout:7/325: read d6/f11 [74667,42279] 0 2023-12-05T13:26:30.139 INFO:tasks.workunit.client.0.smithi029.stdout:7/326: chown d6/d2a 482981093 1 2023-12-05T13:26:30.140 INFO:tasks.workunit.client.0.smithi029.stdout:7/327: mknod d6/d50/d46/d4a/d4b/c61 0 2023-12-05T13:26:30.147 INFO:tasks.workunit.client.0.smithi029.stdout:7/328: dread d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:30.165 INFO:tasks.workunit.client.0.smithi029.stdout:7/329: dwrite d6/d50/d5b/f1f [0,4194304] 0 2023-12-05T13:26:30.166 INFO:tasks.workunit.client.0.smithi029.stdout:7/330: getdents d6/d50/d5b/d1a/d26 0 2023-12-05T13:26:30.168 INFO:tasks.workunit.client.0.smithi029.stdout:7/331: symlink d6/d50/d46/d4a/l62 0 2023-12-05T13:26:30.169 INFO:tasks.workunit.client.0.smithi029.stdout:7/332: rename d6/d35/d3e/d40/d52/f55 to d6/f63 0 2023-12-05T13:26:30.170 INFO:tasks.workunit.client.0.smithi029.stdout:7/333: fdatasync d6/f9 0 2023-12-05T13:26:30.170 INFO:tasks.workunit.client.0.smithi029.stdout:7/334: getdents d6/d50/d5b/d1a 0 2023-12-05T13:26:30.170 INFO:tasks.workunit.client.0.smithi029.stdout:7/335: fsync d6/d50/d46/f57 0 2023-12-05T13:26:30.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/336: creat d6/d50/f64 x:0 0 0 2023-12-05T13:26:30.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/316: sync 2023-12-05T13:26:30.179 INFO:tasks.workunit.client.0.smithi029.stdout:1/317: write d7/d5e/f28 [1567020,127006] 0 2023-12-05T13:26:30.181 INFO:tasks.workunit.client.0.smithi029.stdout:1/318: creat d7/d5e/d52/d5f/d48/f66 x:0 0 0 2023-12-05T13:26:30.183 INFO:tasks.workunit.client.0.smithi029.stdout:7/337: dwrite d6/d50/d46/f57 [0,4194304] 0 2023-12-05T13:26:30.186 INFO:tasks.workunit.client.0.smithi029.stdout:1/319: dread d7/d5e/f28 [0,4194304] 0 2023-12-05T13:26:30.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/338: link d6/d50/d5b/d1a/d26/c3f d6/d50/d5b/c65 0 2023-12-05T13:26:30.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/320: creat d7/d5e/d52/d5f/d48/f67 x:0 0 0 2023-12-05T13:26:30.190 INFO:tasks.workunit.client.0.smithi029.stdout:7/339: mkdir d6/d2a/d66 0 2023-12-05T13:26:30.202 INFO:tasks.workunit.client.0.smithi029.stdout:7/340: dread d6/d50/d5b/f1f [0,4194304] 0 2023-12-05T13:26:30.206 INFO:tasks.workunit.client.0.smithi029.stdout:7/341: dread f1 [0,4194304] 0 2023-12-05T13:26:30.207 INFO:tasks.workunit.client.0.smithi029.stdout:1/321: dwrite d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:30.207 INFO:tasks.workunit.client.0.smithi029.stdout:1/322: stat d7/d31/l3f 0 2023-12-05T13:26:30.207 INFO:tasks.workunit.client.0.smithi029.stdout:7/342: unlink d6/d19/l1c 0 2023-12-05T13:26:30.229 INFO:tasks.workunit.client.0.smithi029.stdout:7/343: dwrite f1 [0,4194304] 0 2023-12-05T13:26:30.229 INFO:tasks.workunit.client.0.smithi029.stdout:7/344: chown d6/d50/d46/f57 1 1 2023-12-05T13:26:30.229 INFO:tasks.workunit.client.0.smithi029.stdout:1/323: dwrite d7/d61/f59 [0,4194304] 0 2023-12-05T13:26:30.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/324: creat d7/d56/f68 x:0 0 0 2023-12-05T13:26:30.236 INFO:tasks.workunit.client.0.smithi029.stdout:1/325: read d7/d5e/f38 [775,83098] 0 2023-12-05T13:26:30.237 INFO:tasks.workunit.client.0.smithi029.stdout:1/326: mknod d7/d5e/d52/d5f/d12/c69 0 2023-12-05T13:26:30.239 INFO:tasks.workunit.client.0.smithi029.stdout:1/327: mknod d7/c6a 0 2023-12-05T13:26:30.245 INFO:tasks.workunit.client.0.smithi029.stdout:7/345: dwrite d6/d19/f25 [0,4194304] 0 2023-12-05T13:26:30.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/346: write d6/d50/d5b/d1a/f27 [3017672,30595] 0 2023-12-05T13:26:30.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/347: fdatasync d6/d50/d5b/f17 0 2023-12-05T13:26:30.248 INFO:tasks.workunit.client.0.smithi029.stdout:7/348: stat d6/d50/d5b/l1d 0 2023-12-05T13:26:30.250 INFO:tasks.workunit.client.0.smithi029.stdout:7/349: creat d6/d50/d5b/d1a/f67 x:0 0 0 2023-12-05T13:26:30.250 INFO:tasks.workunit.client.0.smithi029.stdout:2/159: sync 2023-12-05T13:26:30.251 INFO:tasks.workunit.client.0.smithi029.stdout:4/151: sync 2023-12-05T13:26:30.251 INFO:tasks.workunit.client.0.smithi029.stdout:0/163: sync 2023-12-05T13:26:30.251 INFO:tasks.workunit.client.0.smithi029.stdout:7/350: write d6/d50/d5b/d1a/d26/f31 [45730,60932] 0 2023-12-05T13:26:30.251 INFO:tasks.workunit.client.0.smithi029.stdout:7/351: chown d6/d2a/l44 394310129 1 2023-12-05T13:26:30.252 INFO:tasks.workunit.client.0.smithi029.stdout:7/352: read d6/d50/d5b/f1f [3314608,125659] 0 2023-12-05T13:26:30.252 INFO:tasks.workunit.client.0.smithi029.stdout:2/160: link de/f28 de/d16/f29 0 2023-12-05T13:26:30.252 INFO:tasks.workunit.client.0.smithi029.stdout:2/161: write de/f27 [603065,978] 0 2023-12-05T13:26:30.253 INFO:tasks.workunit.client.0.smithi029.stdout:2/162: fsync de/d16/f1b 0 2023-12-05T13:26:30.253 INFO:tasks.workunit.client.0.smithi029.stdout:2/163: stat de/d16/f29 0 2023-12-05T13:26:30.253 INFO:tasks.workunit.client.0.smithi029.stdout:1/328: dwrite d7/d5e/d52/f57 [0,4194304] 0 2023-12-05T13:26:30.253 INFO:tasks.workunit.client.0.smithi029.stdout:4/152: dread d0/da/f20 [0,4194304] 0 2023-12-05T13:26:30.254 INFO:tasks.workunit.client.0.smithi029.stdout:7/353: write d6/d50/d5b/f17 [3655837,112110] 0 2023-12-05T13:26:30.254 INFO:tasks.workunit.client.0.smithi029.stdout:1/329: write d7/d56/f25 [1581336,56872] 0 2023-12-05T13:26:30.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/153: read d0/f23 [2752039,28375] 0 2023-12-05T13:26:30.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/154: dread - d0/f1d zero size 2023-12-05T13:26:30.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/155: write d0/da/f20 [1167109,115756] 0 2023-12-05T13:26:30.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/164: truncate dc/d13/f2d 1006784 0 2023-12-05T13:26:30.257 INFO:tasks.workunit.client.0.smithi029.stdout:2/164: mknod de/d11/c2a 0 2023-12-05T13:26:30.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/156: rename d0/d1/c2 to d0/de/d30/d32/d35/c36 0 2023-12-05T13:26:30.261 INFO:tasks.workunit.client.0.smithi029.stdout:1/330: dread d7/d61/f59 [0,4194304] 0 2023-12-05T13:26:30.261 INFO:tasks.workunit.client.0.smithi029.stdout:7/354: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:30.262 INFO:tasks.workunit.client.0.smithi029.stdout:0/165: unlink dc/f1a 0 2023-12-05T13:26:30.265 INFO:tasks.workunit.client.0.smithi029.stdout:2/165: creat de/d16/f2b x:0 0 0 2023-12-05T13:26:30.266 INFO:tasks.workunit.client.0.smithi029.stdout:4/157: mkdir d0/d1/d37 0 2023-12-05T13:26:30.268 INFO:tasks.workunit.client.0.smithi029.stdout:7/355: link d6/d50/d5b/l14 d6/d50/d46/d51/d58/l68 0 2023-12-05T13:26:30.269 INFO:tasks.workunit.client.0.smithi029.stdout:7/356: write d6/f11 [2750302,46825] 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:2/166: creat de/d16/f2c x:0 0 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:2/167: fdatasync fb 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:4/158: symlink d0/de/d15/d2b/l38 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:4/159: readlink d0/d1/l1e 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:4/160: readlink d0/d1/l1e 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:7/357: unlink d6/d50/d46/d4a/d4b/c60 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/166: mknod dc/c37 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:1/331: dwrite d7/d5e/f28 [0,4194304] 0 2023-12-05T13:26:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:2/168: mknod de/d14/c2d 0 2023-12-05T13:26:30.275 INFO:tasks.workunit.client.0.smithi029.stdout:4/161: creat d0/da/f39 x:0 0 0 2023-12-05T13:26:30.275 INFO:tasks.workunit.client.0.smithi029.stdout:4/162: fdatasync d0/f1d 0 2023-12-05T13:26:30.275 INFO:tasks.workunit.client.0.smithi029.stdout:4/163: fsync d0/d1/fc 0 2023-12-05T13:26:30.275 INFO:tasks.workunit.client.0.smithi029.stdout:7/358: stat d6/l49 0 2023-12-05T13:26:30.277 INFO:tasks.workunit.client.0.smithi029.stdout:0/167: creat dc/d33/f38 x:0 0 0 2023-12-05T13:26:30.281 INFO:tasks.workunit.client.0.smithi029.stdout:1/332: mknod d7/d61/c6b 0 2023-12-05T13:26:30.282 INFO:tasks.workunit.client.0.smithi029.stdout:4/164: symlink d0/d1/l3a 0 2023-12-05T13:26:30.283 INFO:tasks.workunit.client.0.smithi029.stdout:7/359: mknod d6/d2a/d66/c69 0 2023-12-05T13:26:30.284 INFO:tasks.workunit.client.0.smithi029.stdout:2/169: dread de/d16/f1b [0,4194304] 0 2023-12-05T13:26:30.290 INFO:tasks.workunit.client.0.smithi029.stdout:2/170: link de/d16/f2c de/d14/d24/f2e 0 2023-12-05T13:26:30.290 INFO:tasks.workunit.client.0.smithi029.stdout:2/171: readlink l8 0 2023-12-05T13:26:30.291 INFO:tasks.workunit.client.0.smithi029.stdout:0/168: mknod dc/c39 0 2023-12-05T13:26:30.294 INFO:tasks.workunit.client.0.smithi029.stdout:0/169: mkdir dc/d23/d3a 0 2023-12-05T13:26:30.305 INFO:tasks.workunit.client.0.smithi029.stdout:0/170: write dc/d13/f1c [3113301,110619] 0 2023-12-05T13:26:30.306 INFO:tasks.workunit.client.0.smithi029.stdout:0/171: symlink dc/d23/l3b 0 2023-12-05T13:26:30.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/172: symlink dc/d33/l3c 0 2023-12-05T13:26:30.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/173: fdatasync dc/f27 0 2023-12-05T13:26:30.308 INFO:tasks.workunit.client.0.smithi029.stdout:0/174: mkdir dc/d33/d3d 0 2023-12-05T13:26:30.308 INFO:tasks.workunit.client.0.smithi029.stdout:4/165: dwrite d0/da/f1b [0,4194304] 0 2023-12-05T13:26:30.316 INFO:tasks.workunit.client.0.smithi029.stdout:0/175: dread f0 [0,4194304] 0 2023-12-05T13:26:30.329 INFO:tasks.workunit.client.0.smithi029.stdout:1/333: dwrite d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:30.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/172: dwrite de/d16/f1b [0,4194304] 0 2023-12-05T13:26:30.337 INFO:tasks.workunit.client.0.smithi029.stdout:5/160: sync 2023-12-05T13:26:30.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/168: sync 2023-12-05T13:26:30.338 INFO:tasks.workunit.client.0.smithi029.stdout:9/205: sync 2023-12-05T13:26:30.338 INFO:tasks.workunit.client.0.smithi029.stdout:6/230: sync 2023-12-05T13:26:30.338 INFO:tasks.workunit.client.0.smithi029.stdout:8/430: sync 2023-12-05T13:26:30.338 INFO:tasks.workunit.client.0.smithi029.stdout:0/176: dwrite dc/d33/f38 [0,4194304] 0 2023-12-05T13:26:30.339 INFO:tasks.workunit.client.0.smithi029.stdout:4/166: dwrite d0/d1/fc [0,4194304] 0 2023-12-05T13:26:30.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/161: rename d1/dc/de/f19 to d1/dc/d11/f35 0 2023-12-05T13:26:30.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/162: fsync d1/fb 0 2023-12-05T13:26:30.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/163: stat d1/f7 0 2023-12-05T13:26:30.341 INFO:tasks.workunit.client.0.smithi029.stdout:9/206: symlink d7/d2c/d3a/l44 0 2023-12-05T13:26:30.343 INFO:tasks.workunit.client.0.smithi029.stdout:6/231: creat d6/d1d/d36/f4c x:0 0 0 2023-12-05T13:26:30.345 INFO:tasks.workunit.client.0.smithi029.stdout:8/431: creat d5/d2f/d3a/d86/f95 x:0 0 0 2023-12-05T13:26:30.346 INFO:tasks.workunit.client.0.smithi029.stdout:0/177: dread - dc/d13/f28 zero size 2023-12-05T13:26:30.347 INFO:tasks.workunit.client.0.smithi029.stdout:3/169: write d1/d6/fa [4176033,51756] 0 2023-12-05T13:26:30.348 INFO:tasks.workunit.client.0.smithi029.stdout:4/167: dread d0/da/fb [0,4194304] 0 2023-12-05T13:26:30.349 INFO:tasks.workunit.client.0.smithi029.stdout:0/178: dread dc/d13/f19 [0,4194304] 0 2023-12-05T13:26:30.349 INFO:tasks.workunit.client.0.smithi029.stdout:5/164: symlink d1/dc/de/l36 0 2023-12-05T13:26:30.350 INFO:tasks.workunit.client.0.smithi029.stdout:6/232: rmdir d6 39 2023-12-05T13:26:30.350 INFO:tasks.workunit.client.0.smithi029.stdout:1/334: dwrite d7/d5e/d52/d5f/d12/f1d [0,4194304] 0 2023-12-05T13:26:30.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/432: mkdir d5/d6/d10/d85/d96 0 2023-12-05T13:26:30.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/433: fdatasync d5/dc/d17/d1d/f7f 0 2023-12-05T13:26:30.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/434: readlink d5/d6/d10/d13/l78 0 2023-12-05T13:26:30.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/170: mknod d1/d16/d28/c37 0 2023-12-05T13:26:30.353 INFO:tasks.workunit.client.0.smithi029.stdout:0/179: symlink dc/d33/l3e 0 2023-12-05T13:26:30.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/165: mkdir d1/dc/d10/d1e/d37 0 2023-12-05T13:26:30.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/166: truncate d1/dc/de/f22 700348 0 2023-12-05T13:26:30.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/233: mkdir d6/d21/d40/d4d 0 2023-12-05T13:26:30.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/234: read - d6/d21/d40/f41 zero size 2023-12-05T13:26:30.358 INFO:tasks.workunit.client.0.smithi029.stdout:2/173: dwrite fb [0,4194304] 0 2023-12-05T13:26:30.359 INFO:tasks.workunit.client.0.smithi029.stdout:1/335: dread d7/fb [0,4194304] 0 2023-12-05T13:26:30.359 INFO:tasks.workunit.client.0.smithi029.stdout:8/435: mkdir d5/dc/d18/d97 0 2023-12-05T13:26:30.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/207: dwrite d7/d19/d28/f39 [0,4194304] 0 2023-12-05T13:26:30.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/235: mkdir d6/d21/d40/d4e 0 2023-12-05T13:26:30.367 INFO:tasks.workunit.client.0.smithi029.stdout:3/171: dread d1/d18/f20 [0,4194304] 0 2023-12-05T13:26:30.367 INFO:tasks.workunit.client.0.smithi029.stdout:8/436: creat d5/f98 x:0 0 0 2023-12-05T13:26:30.368 INFO:tasks.workunit.client.0.smithi029.stdout:0/180: truncate dc/d33/f38 1452005 0 2023-12-05T13:26:30.368 INFO:tasks.workunit.client.0.smithi029.stdout:8/437: dread d5/f27 [0,4194304] 0 2023-12-05T13:26:30.370 INFO:tasks.workunit.client.0.smithi029.stdout:5/167: rename d1/dc/de to d1/dc/d38 0 2023-12-05T13:26:30.371 INFO:tasks.workunit.client.0.smithi029.stdout:5/168: write d1/dc/d38/f1a [1830972,91959] 0 2023-12-05T13:26:30.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/168: dwrite d0/da/fb [0,4194304] 0 2023-12-05T13:26:30.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/169: stat d0/de/d15 0 2023-12-05T13:26:30.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/170: chown d0/de/d15 378737 1 2023-12-05T13:26:30.374 INFO:tasks.workunit.client.0.smithi029.stdout:9/208: creat d7/d2c/d3a/f45 x:0 0 0 2023-12-05T13:26:30.374 INFO:tasks.workunit.client.0.smithi029.stdout:5/169: dread d1/fb [0,4194304] 0 2023-12-05T13:26:30.375 INFO:tasks.workunit.client.0.smithi029.stdout:5/170: fdatasync d1/dc/d11/f12 0 2023-12-05T13:26:30.375 INFO:tasks.workunit.client.0.smithi029.stdout:5/171: stat d1/dc/d10/d1e/d33 0 2023-12-05T13:26:30.376 INFO:tasks.workunit.client.0.smithi029.stdout:6/236: creat d6/f4f x:0 0 0 2023-12-05T13:26:30.377 INFO:tasks.workunit.client.0.smithi029.stdout:3/172: creat d1/d18/f38 x:0 0 0 2023-12-05T13:26:30.380 INFO:tasks.workunit.client.0.smithi029.stdout:0/181: truncate f4 2452001 0 2023-12-05T13:26:30.380 INFO:tasks.workunit.client.0.smithi029.stdout:2/174: dwrite fb [0,4194304] 0 2023-12-05T13:26:30.382 INFO:tasks.workunit.client.0.smithi029.stdout:4/171: dread d0/da/f18 [0,4194304] 0 2023-12-05T13:26:30.382 INFO:tasks.workunit.client.0.smithi029.stdout:1/336: dwrite d7/d61/d4f/f5d [0,4194304] 0 2023-12-05T13:26:30.383 INFO:tasks.workunit.client.0.smithi029.stdout:8/438: symlink d5/d2f/d3a/d86/l99 0 2023-12-05T13:26:30.386 INFO:tasks.workunit.client.0.smithi029.stdout:9/209: creat d7/d19/d1f/f46 x:0 0 0 2023-12-05T13:26:30.388 INFO:tasks.workunit.client.0.smithi029.stdout:5/172: symlink d1/dc/d10/l39 0 2023-12-05T13:26:30.391 INFO:tasks.workunit.client.0.smithi029.stdout:3/173: mkdir d1/d16/d39 0 2023-12-05T13:26:30.393 INFO:tasks.workunit.client.0.smithi029.stdout:0/182: creat dc/f3f x:0 0 0 2023-12-05T13:26:30.397 INFO:tasks.workunit.client.0.smithi029.stdout:4/172: creat d0/de/d30/f3b x:0 0 0 2023-12-05T13:26:30.398 INFO:tasks.workunit.client.0.smithi029.stdout:1/337: creat d7/d61/d4f/f6c x:0 0 0 2023-12-05T13:26:30.398 INFO:tasks.workunit.client.0.smithi029.stdout:1/338: chown d7/l11 60300082 1 2023-12-05T13:26:30.399 INFO:tasks.workunit.client.0.smithi029.stdout:6/237: dwrite d6/fc [0,4194304] 0 2023-12-05T13:26:30.401 INFO:tasks.workunit.client.0.smithi029.stdout:9/210: rename d7/d19/l2a to d7/d19/l47 0 2023-12-05T13:26:30.401 INFO:tasks.workunit.client.0.smithi029.stdout:3/174: mkdir d1/d16/d36/d3a 0 2023-12-05T13:26:30.404 INFO:tasks.workunit.client.0.smithi029.stdout:5/173: dread d1/dc/d38/f1a [0,4194304] 0 2023-12-05T13:26:30.405 INFO:tasks.workunit.client.0.smithi029.stdout:6/238: rename f5 to d6/d29/f50 0 2023-12-05T13:26:30.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/175: rename d1/d6 to d1/d6/d11/d3b 22 2023-12-05T13:26:30.405 INFO:tasks.workunit.client.0.smithi029.stdout:6/239: readlink d6/d21/l25 0 2023-12-05T13:26:30.405 INFO:tasks.workunit.client.0.smithi029.stdout:6/240: chown d6/d29/f3b 273466 1 2023-12-05T13:26:30.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/176: chown d1/d6/d11/f22 640619 1 2023-12-05T13:26:30.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/173: mkdir d0/d3c 0 2023-12-05T13:26:30.407 INFO:tasks.workunit.client.0.smithi029.stdout:8/439: dwrite d5/d2f/d75/f7b [0,4194304] 0 2023-12-05T13:26:30.409 INFO:tasks.workunit.client.0.smithi029.stdout:6/241: dread d6/d29/f3b [0,4194304] 0 2023-12-05T13:26:30.409 INFO:tasks.workunit.client.0.smithi029.stdout:5/174: mkdir d1/dc/d38/d3a 0 2023-12-05T13:26:30.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/177: link d1/d6/d11/f22 d1/d6/f3c 0 2023-12-05T13:26:30.416 INFO:tasks.workunit.client.0.smithi029.stdout:8/440: rmdir d5/d2f/d3a 39 2023-12-05T13:26:30.418 INFO:tasks.workunit.client.0.smithi029.stdout:6/242: symlink d6/d29/l51 0 2023-12-05T13:26:30.418 INFO:tasks.workunit.client.0.smithi029.stdout:6/243: fdatasync d6/f4f 0 2023-12-05T13:26:30.421 INFO:tasks.workunit.client.0.smithi029.stdout:0/183: dwrite dc/d23/f2b [0,4194304] 0 2023-12-05T13:26:30.421 INFO:tasks.workunit.client.0.smithi029.stdout:5/175: unlink d1/dc/d10/d1e/l2f 0 2023-12-05T13:26:30.422 INFO:tasks.workunit.client.0.smithi029.stdout:3/178: dread d1/d18/f1a [0,4194304] 0 2023-12-05T13:26:30.422 INFO:tasks.workunit.client.0.smithi029.stdout:2/175: dwrite de/d14/d24/f2e [0,4194304] 0 2023-12-05T13:26:30.422 INFO:tasks.workunit.client.0.smithi029.stdout:4/174: dread d0/d1/fc [0,4194304] 0 2023-12-05T13:26:30.424 INFO:tasks.workunit.client.0.smithi029.stdout:5/176: dread d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:30.424 INFO:tasks.workunit.client.0.smithi029.stdout:5/177: getdents d1/dc/d25 0 2023-12-05T13:26:30.424 INFO:tasks.workunit.client.0.smithi029.stdout:9/211: dwrite d7/d2c/d3a/f45 [0,4194304] 0 2023-12-05T13:26:30.425 INFO:tasks.workunit.client.0.smithi029.stdout:8/441: rmdir d5/dc/d18/d97 0 2023-12-05T13:26:30.426 INFO:tasks.workunit.client.0.smithi029.stdout:6/244: mkdir d6/d3f/d47/d52 0 2023-12-05T13:26:30.429 INFO:tasks.workunit.client.0.smithi029.stdout:0/184: link dc/c25 dc/d33/d3d/c40 0 2023-12-05T13:26:30.430 INFO:tasks.workunit.client.0.smithi029.stdout:3/179: creat d1/d16/d36/d3a/f3d x:0 0 0 2023-12-05T13:26:30.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/212: dread d7/fe [0,4194304] 0 2023-12-05T13:26:30.434 INFO:tasks.workunit.client.0.smithi029.stdout:9/213: chown d7/d2c/l35 21810122 1 2023-12-05T13:26:30.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/176: creat de/d14/d24/f2f x:0 0 0 2023-12-05T13:26:30.438 INFO:tasks.workunit.client.0.smithi029.stdout:2/177: fdatasync fb 0 2023-12-05T13:26:30.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/175: mkdir d0/de/d30/d32/d35/d3d 0 2023-12-05T13:26:30.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/176: fsync d0/da/f1b 0 2023-12-05T13:26:30.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/178: creat d1/dc/d25/f3b x:0 0 0 2023-12-05T13:26:30.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/179: truncate d1/f32 352000 0 2023-12-05T13:26:30.445 INFO:tasks.workunit.client.0.smithi029.stdout:6/245: creat d6/d3f/d47/f53 x:0 0 0 2023-12-05T13:26:30.445 INFO:tasks.workunit.client.0.smithi029.stdout:6/246: write d6/d1d/d36/f48 [886824,106960] 0 2023-12-05T13:26:30.446 INFO:tasks.workunit.client.0.smithi029.stdout:0/185: mkdir dc/d23/d3a/d41 0 2023-12-05T13:26:30.448 INFO:tasks.workunit.client.0.smithi029.stdout:2/178: creat de/d11/f30 x:0 0 0 2023-12-05T13:26:30.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/214: dread d7/d19/d28/f3d [0,4194304] 0 2023-12-05T13:26:30.449 INFO:tasks.workunit.client.0.smithi029.stdout:9/215: dread - d7/d19/d1f/f46 zero size 2023-12-05T13:26:30.454 INFO:tasks.workunit.client.0.smithi029.stdout:4/177: getdents d0/de/d30 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:8/442: dwrite d5/d2f/d75/f7b [0,4194304] 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:5/180: link d1/c6 d1/dc/d38/c3c 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:5/181: chown d1/dc/d38/l36 143471 1 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/180: dwrite d1/d16/d36/d3a/f3d [0,4194304] 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/181: fsync d1/d6/f2a 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/182: getdents d1/d16/d39 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/183: write d1/d6/f3c [272486,117760] 0 2023-12-05T13:26:30.455 INFO:tasks.workunit.client.0.smithi029.stdout:6/247: rmdir d6/d21 39 2023-12-05T13:26:30.457 INFO:tasks.workunit.client.0.smithi029.stdout:2/179: getdents de/d14 0 2023-12-05T13:26:30.459 INFO:tasks.workunit.client.0.smithi029.stdout:5/182: mkdir d1/dc/d11/d17/d3d 0 2023-12-05T13:26:30.463 INFO:tasks.workunit.client.0.smithi029.stdout:0/186: dwrite dc/f35 [0,4194304] 0 2023-12-05T13:26:30.463 INFO:tasks.workunit.client.0.smithi029.stdout:0/187: chown dc/d23/f2e 423398 1 2023-12-05T13:26:30.466 INFO:tasks.workunit.client.0.smithi029.stdout:6/248: unlink d6/d29/l51 0 2023-12-05T13:26:30.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/180: creat de/d16/f31 x:0 0 0 2023-12-05T13:26:30.471 INFO:tasks.workunit.client.0.smithi029.stdout:5/183: symlink d1/dc/d27/l3e 0 2023-12-05T13:26:30.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/181: write fb [2383037,57940] 0 2023-12-05T13:26:30.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/182: chown de/d16/f2b 173445 1 2023-12-05T13:26:30.472 INFO:tasks.workunit.client.0.smithi029.stdout:2/183: dread - de/d14/d24/f2f zero size 2023-12-05T13:26:30.473 INFO:tasks.workunit.client.0.smithi029.stdout:2/184: read de/d14/d24/f19 [300522,19414] 0 2023-12-05T13:26:30.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/185: read de/f27 [205409,105672] 0 2023-12-05T13:26:30.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/186: truncate de/f28 783579 0 2023-12-05T13:26:30.476 INFO:tasks.workunit.client.0.smithi029.stdout:0/188: symlink dc/d33/l42 0 2023-12-05T13:26:30.482 INFO:tasks.workunit.client.0.smithi029.stdout:0/189: truncate dc/d13/f2d 893646 0 2023-12-05T13:26:30.482 INFO:tasks.workunit.client.0.smithi029.stdout:6/249: dread d6/f11 [0,4194304] 0 2023-12-05T13:26:30.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/184: dread d1/dc/f1b [0,4194304] 0 2023-12-05T13:26:30.482 INFO:tasks.workunit.client.0.smithi029.stdout:9/216: dwrite d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:30.482 INFO:tasks.workunit.client.0.smithi029.stdout:5/185: mkdir d1/dc/d10/d3f 0 2023-12-05T13:26:30.485 INFO:tasks.workunit.client.0.smithi029.stdout:0/190: symlink dc/d33/l43 0 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:5/186: rename d1/f32 to d1/dc/d38/f40 0 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/184: dwrite d1/d6/f3c [0,4194304] 0 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:4/178: dwrite d0/da/f18 [0,4194304] 0 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:5/187: symlink d1/dc/d11/d17/d3d/l41 0 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:8/443: dwrite d5/d6/d10/d13/f55 [0,4194304] 0 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:0/191: rename dc/d23/d3a to dc/d23/d3a/d41/d44 22 2023-12-05T13:26:30.491 INFO:tasks.workunit.client.0.smithi029.stdout:0/192: stat dc/ff 0 2023-12-05T13:26:30.492 INFO:tasks.workunit.client.0.smithi029.stdout:5/188: read d1/fb [638274,41774] 0 2023-12-05T13:26:30.493 INFO:tasks.workunit.client.0.smithi029.stdout:4/179: mknod d0/da/c3e 0 2023-12-05T13:26:30.494 INFO:tasks.workunit.client.0.smithi029.stdout:0/193: write dc/d13/f1c [2441808,43990] 0 2023-12-05T13:26:30.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/444: read d5/d2f/d75/f22 [8150928,12217] 0 2023-12-05T13:26:30.496 INFO:tasks.workunit.client.0.smithi029.stdout:5/189: mkdir d1/dc/d10/d1e/d42 0 2023-12-05T13:26:30.496 INFO:tasks.workunit.client.0.smithi029.stdout:4/180: stat d0/c14 0 2023-12-05T13:26:30.496 INFO:tasks.workunit.client.0.smithi029.stdout:4/181: truncate d0/da/f20 2128885 0 2023-12-05T13:26:30.497 INFO:tasks.workunit.client.0.smithi029.stdout:3/185: dread d1/d18/f1d [0,4194304] 0 2023-12-05T13:26:30.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/187: dwrite de/f27 [0,4194304] 0 2023-12-05T13:26:30.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/445: truncate d5/dc/ff 2543125 0 2023-12-05T13:26:30.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/446: write d5/dc/f90 [334043,25909] 0 2023-12-05T13:26:30.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/447: dread - d5/d2f/d3a/d86/f95 zero size 2023-12-05T13:26:30.501 INFO:tasks.workunit.client.0.smithi029.stdout:4/182: symlink d0/de/l3f 0 2023-12-05T13:26:30.502 INFO:tasks.workunit.client.0.smithi029.stdout:3/186: mknod d1/d16/d28/c3e 0 2023-12-05T13:26:30.504 INFO:tasks.workunit.client.0.smithi029.stdout:6/250: dwrite d6/d21/f28 [0,4194304] 0 2023-12-05T13:26:30.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/217: dwrite d7/fe [0,4194304] 0 2023-12-05T13:26:30.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/218: stat d7/fe 0 2023-12-05T13:26:30.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/219: getdents d7/d19/d30/d40 0 2023-12-05T13:26:30.505 INFO:tasks.workunit.client.0.smithi029.stdout:9/220: chown d7/f18 484251 1 2023-12-05T13:26:30.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/188: mkdir de/d11/d32 0 2023-12-05T13:26:30.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/189: dread - de/d11/f25 zero size 2023-12-05T13:26:30.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/183: mknod d0/da/c40 0 2023-12-05T13:26:30.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/184: readlink d0/d16/d22/l25 0 2023-12-05T13:26:30.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/185: fsync d0/f23 0 2023-12-05T13:26:30.508 INFO:tasks.workunit.client.0.smithi029.stdout:4/186: chown d0/d16/d22 1705638 1 2023-12-05T13:26:30.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/187: creat d1/d6/f3f x:0 0 0 2023-12-05T13:26:30.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/188: chown d1/d6/d11/f12 3 1 2023-12-05T13:26:30.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/189: readlink d1/d16/d1f/l2d 0 2023-12-05T13:26:30.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/190: chown d1/d18/f2e 1505699346 1 2023-12-05T13:26:30.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/194: dwrite dc/f16 [4194304,4194304] 0 2023-12-05T13:26:30.514 INFO:tasks.workunit.client.0.smithi029.stdout:6/251: dread d6/d21/f28 [0,4194304] 0 2023-12-05T13:26:30.524 INFO:tasks.workunit.client.0.smithi029.stdout:4/187: dwrite d0/f1d [0,4194304] 0 2023-12-05T13:26:30.528 INFO:tasks.workunit.client.0.smithi029.stdout:9/221: creat d7/d19/d30/d43/f48 x:0 0 0 2023-12-05T13:26:30.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/190: symlink de/d11/d32/l33 0 2023-12-05T13:26:30.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/191: write de/d14/f21 [4221446,14886] 0 2023-12-05T13:26:30.530 INFO:tasks.workunit.client.0.smithi029.stdout:2/192: dread de/d16/f29 [0,4194304] 0 2023-12-05T13:26:30.531 INFO:tasks.workunit.client.0.smithi029.stdout:8/448: rename d5/d6/l42 to d5/l9a 0 2023-12-05T13:26:30.531 INFO:tasks.workunit.client.0.smithi029.stdout:8/449: fdatasync d5/dc/f7a 0 2023-12-05T13:26:30.532 INFO:tasks.workunit.client.0.smithi029.stdout:3/191: symlink d1/d18/l40 0 2023-12-05T13:26:30.537 INFO:tasks.workunit.client.0.smithi029.stdout:9/222: dread d7/ff [0,4194304] 0 2023-12-05T13:26:30.538 INFO:tasks.workunit.client.0.smithi029.stdout:4/188: unlink d0/d1/l2c 0 2023-12-05T13:26:30.546 INFO:tasks.workunit.client.0.smithi029.stdout:9/223: dread d7/d19/d28/f37 [0,4194304] 0 2023-12-05T13:26:30.546 INFO:tasks.workunit.client.0.smithi029.stdout:9/224: write d7/f13 [1726565,42233] 0 2023-12-05T13:26:30.552 INFO:tasks.workunit.client.0.smithi029.stdout:6/252: rename d6/d29/f3b to d6/f54 0 2023-12-05T13:26:30.552 INFO:tasks.workunit.client.0.smithi029.stdout:8/450: creat d5/d2f/d3a/f9b x:0 0 0 2023-12-05T13:26:30.553 INFO:tasks.workunit.client.0.smithi029.stdout:3/192: rmdir d1 39 2023-12-05T13:26:30.555 INFO:tasks.workunit.client.0.smithi029.stdout:9/225: mknod d7/d2c/c49 0 2023-12-05T13:26:30.557 INFO:tasks.workunit.client.0.smithi029.stdout:2/193: rename l7 to de/d14/l34 0 2023-12-05T13:26:30.557 INFO:tasks.workunit.client.0.smithi029.stdout:2/194: read de/d16/f2c [2909830,97992] 0 2023-12-05T13:26:30.558 INFO:tasks.workunit.client.0.smithi029.stdout:6/253: unlink d6/f11 0 2023-12-05T13:26:30.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/451: getdents d5/dc/d18/d26 0 2023-12-05T13:26:30.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/452: read - d5/d2f/d75/f71 zero size 2023-12-05T13:26:30.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/453: chown d5/c1f 534579729 1 2023-12-05T13:26:30.560 INFO:tasks.workunit.client.0.smithi029.stdout:8/454: write d5/d6/f1a [50416,97825] 0 2023-12-05T13:26:30.561 INFO:tasks.workunit.client.0.smithi029.stdout:4/189: mkdir d0/d41 0 2023-12-05T13:26:30.562 INFO:tasks.workunit.client.0.smithi029.stdout:9/226: mkdir d7/d19/d30/d40/d4a 0 2023-12-05T13:26:30.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/193: rename d1/d16/f34 to d1/d10/f41 0 2023-12-05T13:26:30.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/194: dread - d1/d6/f23 zero size 2023-12-05T13:26:30.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/195: readlink d1/d6/d11/l1c 0 2023-12-05T13:26:30.567 INFO:tasks.workunit.client.0.smithi029.stdout:2/195: creat de/d14/f35 x:0 0 0 2023-12-05T13:26:30.568 INFO:tasks.workunit.client.0.smithi029.stdout:6/254: creat d6/d1d/f55 x:0 0 0 2023-12-05T13:26:30.571 INFO:tasks.workunit.client.0.smithi029.stdout:4/190: link d0/d16/d22/l25 d0/de/d30/d32/d35/d3d/l42 0 2023-12-05T13:26:30.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/227: symlink d7/d19/d30/l4b 0 2023-12-05T13:26:30.572 INFO:tasks.workunit.client.0.smithi029.stdout:4/191: write d0/da/f18 [2280677,68658] 0 2023-12-05T13:26:30.572 INFO:tasks.workunit.client.0.smithi029.stdout:4/192: getdents d0/d41 0 2023-12-05T13:26:30.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/193: fsync d0/f2e 0 2023-12-05T13:26:30.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/194: readlink d0/de/d15/d2b/l38 0 2023-12-05T13:26:30.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/195: readlink d0/de/d15/l1f 0 2023-12-05T13:26:30.573 INFO:tasks.workunit.client.0.smithi029.stdout:3/196: rename d1/d16/d28/c37 to d1/d16/d1f/c42 0 2023-12-05T13:26:30.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/196: mknod de/d16/c36 0 2023-12-05T13:26:30.575 INFO:tasks.workunit.client.0.smithi029.stdout:8/455: dwrite d5/dc/f90 [0,4194304] 0 2023-12-05T13:26:30.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/456: fsync d5/d2f/d75/f25 0 2023-12-05T13:26:30.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/457: readlink d5/d2f/l30 0 2023-12-05T13:26:30.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/458: dread - d5/d6/d59/f72 zero size 2023-12-05T13:26:30.576 INFO:tasks.workunit.client.0.smithi029.stdout:8/459: write d5/d2f/d3a/f9b [280733,46967] 0 2023-12-05T13:26:30.576 INFO:tasks.workunit.client.0.smithi029.stdout:6/255: rmdir d6/d3f 39 2023-12-05T13:26:30.578 INFO:tasks.workunit.client.0.smithi029.stdout:6/256: dread d6/d29/f50 [0,4194304] 0 2023-12-05T13:26:30.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/228: getdents d7/d19/d30/d43 0 2023-12-05T13:26:30.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/229: readlink d7/d2c/d3a/l44 0 2023-12-05T13:26:30.580 INFO:tasks.workunit.client.0.smithi029.stdout:4/196: creat d0/de/d15/d2b/f43 x:0 0 0 2023-12-05T13:26:30.582 INFO:tasks.workunit.client.0.smithi029.stdout:2/197: dread fa [0,4194304] 0 2023-12-05T13:26:30.583 INFO:tasks.workunit.client.0.smithi029.stdout:3/197: creat d1/f43 x:0 0 0 2023-12-05T13:26:30.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/460: stat d5/c1b 0 2023-12-05T13:26:30.586 INFO:tasks.workunit.client.0.smithi029.stdout:8/461: write d5/dc/d18/d26/f94 [44580,127729] 0 2023-12-05T13:26:30.587 INFO:tasks.workunit.client.0.smithi029.stdout:6/257: symlink d6/d1d/d39/l56 0 2023-12-05T13:26:30.589 INFO:tasks.workunit.client.0.smithi029.stdout:9/230: creat d7/d2c/f4c x:0 0 0 2023-12-05T13:26:30.591 INFO:tasks.workunit.client.0.smithi029.stdout:4/197: mknod d0/de/d30/d32/d35/c44 0 2023-12-05T13:26:30.592 INFO:tasks.workunit.client.0.smithi029.stdout:2/198: symlink de/d14/l37 0 2023-12-05T13:26:30.595 INFO:tasks.workunit.client.0.smithi029.stdout:3/198: rename d1/d6/ff to d1/d16/d36/f44 0 2023-12-05T13:26:30.596 INFO:tasks.workunit.client.0.smithi029.stdout:8/462: link d5/dc/l49 d5/dc/d17/d1d/l9c 0 2023-12-05T13:26:30.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/258: creat d6/d21/d40/d4d/f57 x:0 0 0 2023-12-05T13:26:30.599 INFO:tasks.workunit.client.0.smithi029.stdout:9/231: getdents d7/d19/d30/d40 0 2023-12-05T13:26:30.599 INFO:tasks.workunit.client.0.smithi029.stdout:9/232: chown d7 1329116 1 2023-12-05T13:26:30.599 INFO:tasks.workunit.client.0.smithi029.stdout:9/233: fsync d7/d19/d28/f3d 0 2023-12-05T13:26:30.600 INFO:tasks.workunit.client.0.smithi029.stdout:9/234: write d7/d19/d28/f37 [4635373,34980] 0 2023-12-05T13:26:30.600 INFO:tasks.workunit.client.0.smithi029.stdout:8/463: getdents d5/d6/d10/d85 0 2023-12-05T13:26:30.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/464: chown d5/d6/d10/d8a/f8e 14 1 2023-12-05T13:26:30.602 INFO:tasks.workunit.client.0.smithi029.stdout:6/259: mkdir d6/d1d/d39/d58 0 2023-12-05T13:26:30.602 INFO:tasks.workunit.client.0.smithi029.stdout:2/199: dread de/d16/f2c [0,4194304] 0 2023-12-05T13:26:30.603 INFO:tasks.workunit.client.0.smithi029.stdout:8/465: unlink d5/d2f/d3a/c74 0 2023-12-05T13:26:30.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/260: mkdir d6/d3f/d47/d59 0 2023-12-05T13:26:30.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/261: stat d6/d29 0 2023-12-05T13:26:30.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/200: mknod de/d14/c38 0 2023-12-05T13:26:30.609 INFO:tasks.workunit.client.0.smithi029.stdout:8/466: rename d5/dc/d18/c24 to d5/c9d 0 2023-12-05T13:26:30.609 INFO:tasks.workunit.client.0.smithi029.stdout:2/201: dread fa [0,4194304] 0 2023-12-05T13:26:30.611 INFO:tasks.workunit.client.0.smithi029.stdout:2/202: dread de/f28 [0,4194304] 0 2023-12-05T13:26:30.611 INFO:tasks.workunit.client.0.smithi029.stdout:2/203: fsync de/d14/d24/f2f 0 2023-12-05T13:26:30.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/198: dwrite d0/de/d30/f3b [0,4194304] 0 2023-12-05T13:26:30.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/199: fsync d0/da/f1b 0 2023-12-05T13:26:30.612 INFO:tasks.workunit.client.0.smithi029.stdout:2/204: creat de/d14/f39 x:0 0 0 2023-12-05T13:26:30.612 INFO:tasks.workunit.client.0.smithi029.stdout:2/205: chown de/d11/c1e 49713757 1 2023-12-05T13:26:30.616 INFO:tasks.workunit.client.0.smithi029.stdout:3/199: unlink d1/d16/d36/f44 0 2023-12-05T13:26:30.616 INFO:tasks.workunit.client.0.smithi029.stdout:3/200: truncate d1/d10/f2f 743940 0 2023-12-05T13:26:30.618 INFO:tasks.workunit.client.0.smithi029.stdout:6/262: dread d6/d21/f28 [0,4194304] 0 2023-12-05T13:26:30.618 INFO:tasks.workunit.client.0.smithi029.stdout:6/263: fdatasync d6/d1d/d39/f44 0 2023-12-05T13:26:30.619 INFO:tasks.workunit.client.0.smithi029.stdout:4/200: write d0/f23 [3076148,16879] 0 2023-12-05T13:26:30.619 INFO:tasks.workunit.client.0.smithi029.stdout:2/206: symlink de/l3a 0 2023-12-05T13:26:30.621 INFO:tasks.workunit.client.0.smithi029.stdout:3/201: rename d1/d18/f1a to d1/d18/f45 0 2023-12-05T13:26:30.622 INFO:tasks.workunit.client.0.smithi029.stdout:3/202: write d1/d6/f14 [893179,48546] 0 2023-12-05T13:26:30.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/235: truncate d7/d19/d28/f37 894783 0 2023-12-05T13:26:30.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/236: stat d7/d19/d30 0 2023-12-05T13:26:30.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/237: fsync d7/d19/d28/f2d 0 2023-12-05T13:26:30.628 INFO:tasks.workunit.client.0.smithi029.stdout:8/467: dwrite d5/d2f/d75/f84 [0,4194304] 0 2023-12-05T13:26:30.628 INFO:tasks.workunit.client.0.smithi029.stdout:8/468: chown d5/dc/d56 725 1 2023-12-05T13:26:30.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/264: rmdir d6/d21/d40 39 2023-12-05T13:26:30.633 INFO:tasks.workunit.client.0.smithi029.stdout:4/201: creat d0/de/f45 x:0 0 0 2023-12-05T13:26:30.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/207: mknod de/c3b 0 2023-12-05T13:26:30.634 INFO:tasks.workunit.client.0.smithi029.stdout:2/208: write de/d14/d24/f2f [84550,27521] 0 2023-12-05T13:26:30.638 INFO:tasks.workunit.client.0.smithi029.stdout:3/203: rmdir d1/d10 39 2023-12-05T13:26:30.641 INFO:tasks.workunit.client.0.smithi029.stdout:9/238: creat d7/d19/d30/d43/f4d x:0 0 0 2023-12-05T13:26:30.646 INFO:tasks.workunit.client.0.smithi029.stdout:8/469: dwrite d5/dc/d17/f4e [0,4194304] 0 2023-12-05T13:26:30.649 INFO:tasks.workunit.client.0.smithi029.stdout:6/265: mkdir d6/d5a 0 2023-12-05T13:26:30.649 INFO:tasks.workunit.client.0.smithi029.stdout:4/202: symlink d0/d3c/l46 0 2023-12-05T13:26:30.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/209: creat de/f3c x:0 0 0 2023-12-05T13:26:30.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/210: fdatasync fb 0 2023-12-05T13:26:30.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/211: fsync de/f28 0 2023-12-05T13:26:30.652 INFO:tasks.workunit.client.0.smithi029.stdout:3/204: symlink d1/d10/l46 0 2023-12-05T13:26:30.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/239: mkdir d7/d19/d30/d40/d4e 0 2023-12-05T13:26:30.654 INFO:tasks.workunit.client.0.smithi029.stdout:8/470: symlink d5/dc/l9e 0 2023-12-05T13:26:30.655 INFO:tasks.workunit.client.0.smithi029.stdout:6/266: mknod d6/d1d/c5b 0 2023-12-05T13:26:30.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/212: mkdir de/d3d 0 2023-12-05T13:26:30.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/213: stat de/d14/d24/f1c 0 2023-12-05T13:26:30.661 INFO:tasks.workunit.client.0.smithi029.stdout:3/205: rename d1/d16/d28/c2b to d1/d16/d36/d3a/c47 0 2023-12-05T13:26:30.662 INFO:tasks.workunit.client.0.smithi029.stdout:8/471: dread d5/dc/d17/d1d/f2e [0,4194304] 0 2023-12-05T13:26:30.662 INFO:tasks.workunit.client.0.smithi029.stdout:6/267: mkdir d6/d3f/d47/d52/d5c 0 2023-12-05T13:26:30.663 INFO:tasks.workunit.client.0.smithi029.stdout:2/214: creat de/d11/d32/f3e x:0 0 0 2023-12-05T13:26:30.665 INFO:tasks.workunit.client.0.smithi029.stdout:8/472: creat d5/dc/d18/d26/f9f x:0 0 0 2023-12-05T13:26:30.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/268: creat d6/d5a/f5d x:0 0 0 2023-12-05T13:26:30.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/269: dread - d6/d1d/f55 zero size 2023-12-05T13:26:30.667 INFO:tasks.workunit.client.0.smithi029.stdout:2/215: write de/d16/f1b [1549516,24025] 0 2023-12-05T13:26:30.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/270: creat d6/d21/f5e x:0 0 0 2023-12-05T13:26:30.669 INFO:tasks.workunit.client.0.smithi029.stdout:4/203: dwrite d0/f2e [0,4194304] 0 2023-12-05T13:26:30.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/271: mkdir d6/d1d/d39/d58/d5f 0 2023-12-05T13:26:30.673 INFO:tasks.workunit.client.0.smithi029.stdout:9/240: dwrite d7/d19/f32 [0,4194304] 0 2023-12-05T13:26:30.673 INFO:tasks.workunit.client.0.smithi029.stdout:9/241: chown d7/d2c/d3a/f45 469975 1 2023-12-05T13:26:30.678 INFO:tasks.workunit.client.0.smithi029.stdout:4/204: write d0/f23 [1996984,91883] 0 2023-12-05T13:26:30.678 INFO:tasks.workunit.client.0.smithi029.stdout:6/272: unlink d6/d29/c2c 0 2023-12-05T13:26:30.678 INFO:tasks.workunit.client.0.smithi029.stdout:4/205: write d0/da/fb [169119,89996] 0 2023-12-05T13:26:30.679 INFO:tasks.workunit.client.0.smithi029.stdout:4/206: fdatasync d0/da/f39 0 2023-12-05T13:26:30.680 INFO:tasks.workunit.client.0.smithi029.stdout:3/206: rmdir d1/d16/d36 39 2023-12-05T13:26:30.682 INFO:tasks.workunit.client.0.smithi029.stdout:9/242: creat d7/d19/d1f/f4f x:0 0 0 2023-12-05T13:26:30.682 INFO:tasks.workunit.client.0.smithi029.stdout:9/243: getdents d7/d19/d30/d40/d4a 0 2023-12-05T13:26:30.687 INFO:tasks.workunit.client.0.smithi029.stdout:2/216: dwrite de/d14/d24/f2f [0,4194304] 0 2023-12-05T13:26:30.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/273: mkdir d6/d29/d60 0 2023-12-05T13:26:30.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/274: readlink d6/d21/l35 0 2023-12-05T13:26:30.687 INFO:tasks.workunit.client.0.smithi029.stdout:9/244: mkdir d7/d19/d28/d50 0 2023-12-05T13:26:30.687 INFO:tasks.workunit.client.0.smithi029.stdout:9/245: chown d7/d19/l31 0 1 2023-12-05T13:26:30.687 INFO:tasks.workunit.client.0.smithi029.stdout:9/246: write d7/d19/d1f/f21 [4806215,4532] 0 2023-12-05T13:26:30.689 INFO:tasks.workunit.client.0.smithi029.stdout:2/217: rmdir de/d3d 0 2023-12-05T13:26:30.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/207: dread d0/da/fb [0,4194304] 0 2023-12-05T13:26:30.692 INFO:tasks.workunit.client.0.smithi029.stdout:6/275: symlink d6/d21/d40/l61 0 2023-12-05T13:26:30.694 INFO:tasks.workunit.client.0.smithi029.stdout:9/247: symlink d7/d19/l51 0 2023-12-05T13:26:30.694 INFO:tasks.workunit.client.0.smithi029.stdout:7/360: sync 2023-12-05T13:26:30.694 INFO:tasks.workunit.client.0.smithi029.stdout:9/248: read d7/d19/f1b [300007,72675] 0 2023-12-05T13:26:30.695 INFO:tasks.workunit.client.0.smithi029.stdout:2/218: mknod de/d14/c3f 0 2023-12-05T13:26:30.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/276: rename d6/d21/l25 to d6/d1d/d39/l62 0 2023-12-05T13:26:30.699 INFO:tasks.workunit.client.0.smithi029.stdout:6/277: chown d6/d21/d40/f41 39296753 1 2023-12-05T13:26:30.699 INFO:tasks.workunit.client.0.smithi029.stdout:6/278: chown d6/d1d/c43 18744 1 2023-12-05T13:26:30.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/361: getdents d6/d35/d3e 0 2023-12-05T13:26:30.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/279: symlink d6/d3f/d47/d52/d5c/l63 0 2023-12-05T13:26:30.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/280: write d6/d21/d40/f41 [252406,101929] 0 2023-12-05T13:26:30.706 INFO:tasks.workunit.client.0.smithi029.stdout:2/219: dread de/d16/f1f [0,4194304] 0 2023-12-05T13:26:30.706 INFO:tasks.workunit.client.0.smithi029.stdout:2/220: write de/d11/f26 [664840,32352] 0 2023-12-05T13:26:30.706 INFO:tasks.workunit.client.0.smithi029.stdout:2/221: fdatasync de/d11/f30 0 2023-12-05T13:26:30.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/362: dread d6/d50/d46/f57 [0,4194304] 0 2023-12-05T13:26:30.708 INFO:tasks.workunit.client.0.smithi029.stdout:6/281: getdents d6/d3f/d47 0 2023-12-05T13:26:30.708 INFO:tasks.workunit.client.0.smithi029.stdout:6/282: readlink d6/d1d/d39/l62 0 2023-12-05T13:26:30.708 INFO:tasks.workunit.client.0.smithi029.stdout:6/283: chown l4 125 1 2023-12-05T13:26:30.710 INFO:tasks.workunit.client.0.smithi029.stdout:4/208: dwrite d0/f23 [0,4194304] 0 2023-12-05T13:26:30.710 INFO:tasks.workunit.client.0.smithi029.stdout:4/209: fdatasync d0/f2e 0 2023-12-05T13:26:30.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/249: dwrite d7/f18 [0,4194304] 0 2023-12-05T13:26:30.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/222: creat de/d14/d24/f40 x:0 0 0 2023-12-05T13:26:30.711 INFO:tasks.workunit.client.0.smithi029.stdout:7/363: mkdir d6/d35/d6a 0 2023-12-05T13:26:30.713 INFO:tasks.workunit.client.0.smithi029.stdout:4/210: link d0/de/d30/f3b d0/de/d30/d32/d35/f47 0 2023-12-05T13:26:30.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/284: dread d6/d21/f28 [0,4194304] 0 2023-12-05T13:26:30.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/250: rename d7/d19/d30/d40/d4a to d7/d2c/d3a/d52 0 2023-12-05T13:26:30.717 INFO:tasks.workunit.client.0.smithi029.stdout:2/223: mkdir de/d41 0 2023-12-05T13:26:30.717 INFO:tasks.workunit.client.0.smithi029.stdout:2/224: write de/d14/d24/f40 [659399,108940] 0 2023-12-05T13:26:30.717 INFO:tasks.workunit.client.0.smithi029.stdout:2/225: chown de/d16/f2c 51 1 2023-12-05T13:26:30.717 INFO:tasks.workunit.client.0.smithi029.stdout:2/226: chown de/d14/f21 0 1 2023-12-05T13:26:30.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/285: rename d6/d21/d40/d4e to d6/d64 0 2023-12-05T13:26:30.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/286: chown d6/d1d/d39/f44 1 1 2023-12-05T13:26:30.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/287: fdatasync d6/fe 0 2023-12-05T13:26:30.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/288: chown d6/d1d/c5b 3818844 1 2023-12-05T13:26:30.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/289: chown d6/d21/c2d 920 1 2023-12-05T13:26:30.720 INFO:tasks.workunit.client.0.smithi029.stdout:7/364: dread d6/d19/f25 [0,4194304] 0 2023-12-05T13:26:30.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/251: mkdir d7/d2c/d3a/d52/d53 0 2023-12-05T13:26:30.722 INFO:tasks.workunit.client.0.smithi029.stdout:9/252: write d7/f9 [4054993,90473] 0 2023-12-05T13:26:30.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/227: symlink de/d16/l42 0 2023-12-05T13:26:30.728 INFO:tasks.workunit.client.0.smithi029.stdout:9/253: rename d7/d2c/d33/c3b to d7/d2c/d33/c54 0 2023-12-05T13:26:30.728 INFO:tasks.workunit.client.0.smithi029.stdout:9/254: readlink d7/l12 0 2023-12-05T13:26:30.729 INFO:tasks.workunit.client.0.smithi029.stdout:2/228: mkdir de/d16/d43 0 2023-12-05T13:26:30.730 INFO:tasks.workunit.client.0.smithi029.stdout:7/365: dread d6/d50/d5b/f1f [0,4194304] 0 2023-12-05T13:26:30.736 INFO:tasks.workunit.client.0.smithi029.stdout:6/290: rename d6/d21 to d6/d64/d65 0 2023-12-05T13:26:30.737 INFO:tasks.workunit.client.0.smithi029.stdout:7/366: write d6/d50/d5b/f1f [2983796,42234] 0 2023-12-05T13:26:30.737 INFO:tasks.workunit.client.0.smithi029.stdout:7/367: chown d6/d50/f41 69068313 1 2023-12-05T13:26:30.748 INFO:tasks.workunit.client.0.smithi029.stdout:7/368: read d6/d19/f25 [535673,83476] 0 2023-12-05T13:26:30.749 INFO:tasks.workunit.client.0.smithi029.stdout:7/369: fsync d6/f63 0 2023-12-05T13:26:30.750 INFO:tasks.workunit.client.0.smithi029.stdout:7/370: creat d6/f6b x:0 0 0 2023-12-05T13:26:30.752 INFO:tasks.workunit.client.0.smithi029.stdout:7/371: creat d6/d35/d5c/f6c x:0 0 0 2023-12-05T13:26:30.753 INFO:tasks.workunit.client.0.smithi029.stdout:7/372: read d6/d35/d3e/d40/f42 [757415,82443] 0 2023-12-05T13:26:30.754 INFO:tasks.workunit.client.0.smithi029.stdout:9/255: dwrite d7/d19/d30/d43/f4d [0,4194304] 0 2023-12-05T13:26:30.754 INFO:tasks.workunit.client.0.smithi029.stdout:7/373: mkdir d6/d2a/d4f/d6d 0 2023-12-05T13:26:30.756 INFO:tasks.workunit.client.0.smithi029.stdout:2/229: dwrite de/d16/f1f [0,4194304] 0 2023-12-05T13:26:30.756 INFO:tasks.workunit.client.0.smithi029.stdout:6/291: dwrite d6/d1d/d39/f44 [0,4194304] 0 2023-12-05T13:26:30.756 INFO:tasks.workunit.client.0.smithi029.stdout:6/292: fsync d6/d1d/f2b 0 2023-12-05T13:26:30.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/256: symlink d7/d19/d30/l55 0 2023-12-05T13:26:30.758 INFO:tasks.workunit.client.0.smithi029.stdout:7/374: mkdir d6/d50/d5b/d1a/d26/d6e 0 2023-12-05T13:26:30.765 INFO:tasks.workunit.client.0.smithi029.stdout:6/293: creat d6/d64/d65/d40/f66 x:0 0 0 2023-12-05T13:26:30.766 INFO:tasks.workunit.client.0.smithi029.stdout:7/375: creat d6/d2a/d2f/f6f x:0 0 0 2023-12-05T13:26:30.766 INFO:tasks.workunit.client.0.smithi029.stdout:9/257: dread d7/fe [0,4194304] 0 2023-12-05T13:26:30.768 INFO:tasks.workunit.client.0.smithi029.stdout:9/258: unlink d7/c11 0 2023-12-05T13:26:30.769 INFO:tasks.workunit.client.0.smithi029.stdout:6/294: dread d6/f54 [0,4194304] 0 2023-12-05T13:26:30.770 INFO:tasks.workunit.client.0.smithi029.stdout:2/230: dwrite de/d14/f39 [0,4194304] 0 2023-12-05T13:26:30.770 INFO:tasks.workunit.client.0.smithi029.stdout:9/259: mknod d7/d2c/c56 0 2023-12-05T13:26:30.770 INFO:tasks.workunit.client.0.smithi029.stdout:9/260: chown d7/f9 95740286 1 2023-12-05T13:26:30.772 INFO:tasks.workunit.client.0.smithi029.stdout:7/376: getdents d6/d50/d5b/d1a/d26 0 2023-12-05T13:26:30.772 INFO:tasks.workunit.client.0.smithi029.stdout:7/377: write d6/f63 [67949,6273] 0 2023-12-05T13:26:30.773 INFO:tasks.workunit.client.0.smithi029.stdout:2/231: rename de/d16/l42 to de/d11/l44 0 2023-12-05T13:26:30.789 INFO:tasks.workunit.client.0.smithi029.stdout:9/261: truncate d7/f9 1718801 0 2023-12-05T13:26:30.789 INFO:tasks.workunit.client.0.smithi029.stdout:6/295: dwrite d6/f4f [0,4194304] 0 2023-12-05T13:26:30.790 INFO:tasks.workunit.client.0.smithi029.stdout:9/262: symlink d7/d19/l57 0 2023-12-05T13:26:30.794 INFO:tasks.workunit.client.0.smithi029.stdout:6/296: dread d6/f45 [0,4194304] 0 2023-12-05T13:26:30.794 INFO:tasks.workunit.client.0.smithi029.stdout:9/263: symlink d7/d2c/d33/l58 0 2023-12-05T13:26:30.796 INFO:tasks.workunit.client.0.smithi029.stdout:6/297: mknod d6/d3f/d47/d59/c67 0 2023-12-05T13:26:30.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/232: dwrite de/d14/d24/f40 [0,4194304] 0 2023-12-05T13:26:30.798 INFO:tasks.workunit.client.0.smithi029.stdout:6/298: mknod d6/d3f/d47/d59/c68 0 2023-12-05T13:26:30.798 INFO:tasks.workunit.client.0.smithi029.stdout:7/378: dwrite d6/d50/d5b/d1a/d26/f59 [0,4194304] 0 2023-12-05T13:26:30.799 INFO:tasks.workunit.client.0.smithi029.stdout:7/379: write d6/f6b [209308,19636] 0 2023-12-05T13:26:30.802 INFO:tasks.workunit.client.0.smithi029.stdout:6/299: rmdir d6/d1d/d39/d58/d5f 0 2023-12-05T13:26:30.804 INFO:tasks.workunit.client.0.smithi029.stdout:7/380: mkdir d6/d35/d70 0 2023-12-05T13:26:30.804 INFO:tasks.workunit.client.0.smithi029.stdout:7/381: readlink d6/d2a/l38 0 2023-12-05T13:26:30.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/382: write d6/d50/d5b/d1a/f27 [1815161,36875] 0 2023-12-05T13:26:30.807 INFO:tasks.workunit.client.0.smithi029.stdout:7/383: rename d6/d50/d46/d51/d58 to d6/d2a/d71 0 2023-12-05T13:26:30.808 INFO:tasks.workunit.client.0.smithi029.stdout:7/384: mkdir d6/d50/d5b/d1a/d26/d72 0 2023-12-05T13:26:30.808 INFO:tasks.workunit.client.0.smithi029.stdout:7/385: dread - d6/d35/d5c/f6c zero size 2023-12-05T13:26:30.808 INFO:tasks.workunit.client.0.smithi029.stdout:7/386: chown d6/d50/d5b/l14 1 1 2023-12-05T13:26:30.813 INFO:tasks.workunit.client.0.smithi029.stdout:2/233: dwrite de/f13 [0,4194304] 0 2023-12-05T13:26:30.814 INFO:tasks.workunit.client.0.smithi029.stdout:2/234: rename de/d16/f1f to de/d14/d24/f45 0 2023-12-05T13:26:30.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/235: creat de/d16/d43/f46 x:0 0 0 2023-12-05T13:26:30.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/236: fsync f3 0 2023-12-05T13:26:30.817 INFO:tasks.workunit.client.0.smithi029.stdout:2/237: read - de/d16/f31 zero size 2023-12-05T13:26:30.818 INFO:tasks.workunit.client.0.smithi029.stdout:7/387: dread d6/d35/d3e/d40/f45 [0,4194304] 0 2023-12-05T13:26:30.818 INFO:tasks.workunit.client.0.smithi029.stdout:7/388: chown d6/d2a/d71/l68 127242368 1 2023-12-05T13:26:30.818 INFO:tasks.workunit.client.0.smithi029.stdout:7/389: fsync d6/d50/d5b/f4e 0 2023-12-05T13:26:30.818 INFO:tasks.workunit.client.0.smithi029.stdout:2/238: dread de/f12 [0,4194304] 0 2023-12-05T13:26:30.818 INFO:tasks.workunit.client.0.smithi029.stdout:2/239: readlink de/d14/l37 0 2023-12-05T13:26:30.820 INFO:tasks.workunit.client.0.smithi029.stdout:7/390: mkdir d6/d50/d46/d73 0 2023-12-05T13:26:30.821 INFO:tasks.workunit.client.0.smithi029.stdout:2/240: creat de/d16/f47 x:0 0 0 2023-12-05T13:26:30.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/391: getdents d6/d2a/d2f 0 2023-12-05T13:26:30.822 INFO:tasks.workunit.client.0.smithi029.stdout:7/392: truncate d6/f22 2535438 0 2023-12-05T13:26:30.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/393: creat d6/d50/d5b/d1a/d26/f74 x:0 0 0 2023-12-05T13:26:30.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/394: write d6/d50/d5b/f29 [4819899,108724] 0 2023-12-05T13:26:30.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/395: stat d6/d19/f21 0 2023-12-05T13:26:30.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/396: readlink d6/lb 0 2023-12-05T13:26:30.824 INFO:tasks.workunit.client.0.smithi029.stdout:7/397: truncate d6/d50/f64 36704 0 2023-12-05T13:26:30.826 INFO:tasks.workunit.client.0.smithi029.stdout:7/398: rmdir d6/d2a/d4f/d6d 0 2023-12-05T13:26:30.826 INFO:tasks.workunit.client.0.smithi029.stdout:7/399: write d6/d35/d3e/d40/f45 [754902,5520] 0 2023-12-05T13:26:30.828 INFO:tasks.workunit.client.0.smithi029.stdout:7/400: getdents d6/d50/d5b/d1a 0 2023-12-05T13:26:30.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/401: creat d6/d50/d5b/d1a/d26/d6e/f75 x:0 0 0 2023-12-05T13:26:30.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/402: chown d6/d35/d6a 62 1 2023-12-05T13:26:30.833 INFO:tasks.workunit.client.0.smithi029.stdout:7/403: rmdir d6/d50/d46 39 2023-12-05T13:26:30.834 INFO:tasks.workunit.client.0.smithi029.stdout:7/404: read d6/f63 [30841,96373] 0 2023-12-05T13:26:30.836 INFO:tasks.workunit.client.0.smithi029.stdout:2/241: dwrite de/d14/f39 [0,4194304] 0 2023-12-05T13:26:30.836 INFO:tasks.workunit.client.0.smithi029.stdout:2/242: write de/d16/f31 [605294,129176] 0 2023-12-05T13:26:30.836 INFO:tasks.workunit.client.0.smithi029.stdout:7/405: creat d6/d50/d5b/d1a/d26/d72/f76 x:0 0 0 2023-12-05T13:26:30.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/243: write fb [2295726,116857] 0 2023-12-05T13:26:30.839 INFO:tasks.workunit.client.0.smithi029.stdout:7/406: rename d6/d50/d5b/f17 to d6/d50/d46/d51/f77 0 2023-12-05T13:26:30.840 INFO:tasks.workunit.client.0.smithi029.stdout:2/244: mknod de/d14/d24/c48 0 2023-12-05T13:26:30.841 INFO:tasks.workunit.client.0.smithi029.stdout:2/245: fsync de/d14/d24/f1c 0 2023-12-05T13:26:30.842 INFO:tasks.workunit.client.0.smithi029.stdout:7/407: mknod d6/d50/d46/d51/c78 0 2023-12-05T13:26:30.843 INFO:tasks.workunit.client.0.smithi029.stdout:2/246: rename de/d14/d24/f45 to de/d16/d43/f49 0 2023-12-05T13:26:30.846 INFO:tasks.workunit.client.0.smithi029.stdout:2/247: mknod de/d11/d32/c4a 0 2023-12-05T13:26:30.847 INFO:tasks.workunit.client.0.smithi029.stdout:2/248: truncate de/f28 572089 0 2023-12-05T13:26:30.847 INFO:tasks.workunit.client.0.smithi029.stdout:2/249: truncate de/d16/d43/f49 1057499 0 2023-12-05T13:26:30.848 INFO:tasks.workunit.client.0.smithi029.stdout:2/250: mknod de/d14/c4b 0 2023-12-05T13:26:30.849 INFO:tasks.workunit.client.0.smithi029.stdout:7/408: dread d6/d35/d3e/d40/f45 [0,4194304] 0 2023-12-05T13:26:30.849 INFO:tasks.workunit.client.0.smithi029.stdout:2/251: mkdir de/d16/d4c 0 2023-12-05T13:26:30.850 INFO:tasks.workunit.client.0.smithi029.stdout:7/409: dread d6/f63 [0,4194304] 0 2023-12-05T13:26:30.850 INFO:tasks.workunit.client.0.smithi029.stdout:7/410: stat d6/d50/f41 0 2023-12-05T13:26:30.851 INFO:tasks.workunit.client.0.smithi029.stdout:2/252: unlink de/d14/c3f 0 2023-12-05T13:26:30.852 INFO:tasks.workunit.client.0.smithi029.stdout:7/411: truncate d6/d50/d5b/f4e 2277151 0 2023-12-05T13:26:30.853 INFO:tasks.workunit.client.0.smithi029.stdout:2/253: symlink de/l4d 0 2023-12-05T13:26:30.855 INFO:tasks.workunit.client.0.smithi029.stdout:2/254: getdents de/d11/d32 0 2023-12-05T13:26:30.856 INFO:tasks.workunit.client.0.smithi029.stdout:2/255: symlink de/d14/d24/l4e 0 2023-12-05T13:26:30.856 INFO:tasks.workunit.client.0.smithi029.stdout:2/256: chown de/f12 2404 1 2023-12-05T13:26:30.856 INFO:tasks.workunit.client.0.smithi029.stdout:2/257: fdatasync de/d11/f25 0 2023-12-05T13:26:30.857 INFO:tasks.workunit.client.0.smithi029.stdout:2/258: creat de/d11/f4f x:0 0 0 2023-12-05T13:26:30.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/412: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:30.858 INFO:tasks.workunit.client.0.smithi029.stdout:7/413: dread - d6/d35/d5c/f6c zero size 2023-12-05T13:26:30.870 INFO:tasks.workunit.client.0.smithi029.stdout:7/414: dread d6/d50/d5b/d1a/f27 [4194304,4194304] 0 2023-12-05T13:26:30.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/415: mknod d6/d2a/d2f/c79 0 2023-12-05T13:26:30.871 INFO:tasks.workunit.client.0.smithi029.stdout:7/416: truncate d6/d50/d5b/f29 5832428 0 2023-12-05T13:26:30.873 INFO:tasks.workunit.client.0.smithi029.stdout:7/417: mkdir d6/d50/d46/d7a 0 2023-12-05T13:26:30.874 INFO:tasks.workunit.client.0.smithi029.stdout:7/418: mkdir d6/d50/d46/d7a/d7b 0 2023-12-05T13:26:30.875 INFO:tasks.workunit.client.0.smithi029.stdout:7/419: mknod d6/d35/c7c 0 2023-12-05T13:26:30.876 INFO:tasks.workunit.client.0.smithi029.stdout:7/420: mkdir d6/d50/d5b/d5f/d7d 0 2023-12-05T13:26:30.878 INFO:tasks.workunit.client.0.smithi029.stdout:2/259: dwrite f4 [0,4194304] 0 2023-12-05T13:26:30.878 INFO:tasks.workunit.client.0.smithi029.stdout:2/260: link de/d11/d32/c4a de/d11/d32/c50 0 2023-12-05T13:26:30.883 INFO:tasks.workunit.client.0.smithi029.stdout:7/421: rename d6/d50/d46/d7a to d6/d2a/d7e 0 2023-12-05T13:26:30.885 INFO:tasks.workunit.client.0.smithi029.stdout:7/422: creat d6/d50/d46/d4a/d4b/f7f x:0 0 0 2023-12-05T13:26:30.887 INFO:tasks.workunit.client.0.smithi029.stdout:7/423: symlink d6/d50/l80 0 2023-12-05T13:26:30.899 INFO:tasks.workunit.client.0.smithi029.stdout:2/261: dwrite f4 [0,4194304] 0 2023-12-05T13:26:30.904 INFO:tasks.workunit.client.0.smithi029.stdout:7/424: dwrite d6/d50/d5b/d1a/d26/f74 [0,4194304] 0 2023-12-05T13:26:30.905 INFO:tasks.workunit.client.0.smithi029.stdout:7/425: stat d6/d50/d5b/f29 0 2023-12-05T13:26:30.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/426: write d6/d50/d5b/d1a/d26/f39 [1648328,4562] 0 2023-12-05T13:26:30.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/427: fdatasync d6/d35/d3e/d40/f42 0 2023-12-05T13:26:30.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/428: chown d6/d50/d5b/f29 74 1 2023-12-05T13:26:30.910 INFO:tasks.workunit.client.0.smithi029.stdout:7/429: write d6/d50/d5b/f1f [4970751,90083] 0 2023-12-05T13:26:30.911 INFO:tasks.workunit.client.0.smithi029.stdout:7/430: creat d6/d50/d5b/d1a/d26/d72/f81 x:0 0 0 2023-12-05T13:26:30.911 INFO:tasks.workunit.client.0.smithi029.stdout:7/431: mkdir d6/d50/d5b/d1a/d26/d82 0 2023-12-05T13:26:30.913 INFO:tasks.workunit.client.0.smithi029.stdout:1/339: sync 2023-12-05T13:26:30.914 INFO:tasks.workunit.client.0.smithi029.stdout:7/432: symlink d6/d35/d3e/d40/d52/l83 0 2023-12-05T13:26:30.915 INFO:tasks.workunit.client.0.smithi029.stdout:7/433: chown d6/d50/d46/d4a 928569 1 2023-12-05T13:26:30.917 INFO:tasks.workunit.client.0.smithi029.stdout:1/340: link d7/d61/f59 d7/d61/f6d 0 2023-12-05T13:26:30.920 INFO:tasks.workunit.client.0.smithi029.stdout:2/262: dwrite de/f13 [0,4194304] 0 2023-12-05T13:26:30.920 INFO:tasks.workunit.client.0.smithi029.stdout:7/434: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:30.920 INFO:tasks.workunit.client.0.smithi029.stdout:7/435: truncate d6/f13 4724111 0 2023-12-05T13:26:30.920 INFO:tasks.workunit.client.0.smithi029.stdout:1/341: mkdir d7/d6e 0 2023-12-05T13:26:30.920 INFO:tasks.workunit.client.0.smithi029.stdout:1/342: chown d7/c6a 57 1 2023-12-05T13:26:30.920 INFO:tasks.workunit.client.0.smithi029.stdout:7/436: write d6/d50/d5b/d1a/d26/f39 [2776852,5826] 0 2023-12-05T13:26:30.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/437: readlink d6/d50/l80 0 2023-12-05T13:26:30.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/438: fdatasync d6/f9 0 2023-12-05T13:26:30.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/439: read - d6/d50/d5b/d1a/d26/d72/f76 zero size 2023-12-05T13:26:30.921 INFO:tasks.workunit.client.0.smithi029.stdout:7/440: dread - d6/d50/d5b/d1a/d26/f5e zero size 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/190: sync 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/191: readlink d1/dc/d11/l2d 0 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:5/192: chown d1/dc/d11/d17/d29 2165 1 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/441: write d6/d50/d5b/f29 [3288513,63238] 0 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/442: readlink d6/d2a/l44 0 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/443: write d6/d2a/d2f/f6f [845409,45324] 0 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/444: chown d6/d50/d5b/d1a/d26/f2b 110 1 2023-12-05T13:26:30.922 INFO:tasks.workunit.client.0.smithi029.stdout:7/445: dread - d6/d50/d5b/d1a/d26/f5e zero size 2023-12-05T13:26:30.923 INFO:tasks.workunit.client.0.smithi029.stdout:7/446: read d6/d50/f41 [209020,13252] 0 2023-12-05T13:26:30.923 INFO:tasks.workunit.client.0.smithi029.stdout:7/447: dread - d6/d35/d5c/f6c zero size 2023-12-05T13:26:30.923 INFO:tasks.workunit.client.0.smithi029.stdout:7/448: write d6/f6b [361191,6903] 0 2023-12-05T13:26:30.927 INFO:tasks.workunit.client.0.smithi029.stdout:7/449: dread d6/d50/d5b/f4e [0,4194304] 0 2023-12-05T13:26:30.928 INFO:tasks.workunit.client.0.smithi029.stdout:2/263: rmdir de/d11/d32 39 2023-12-05T13:26:30.929 INFO:tasks.workunit.client.0.smithi029.stdout:1/343: getdents d7/d5e/d52/d5f/d48 0 2023-12-05T13:26:30.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/193: rename d1/dc/f1b to d1/dc/d11/d17/d29/f43 0 2023-12-05T13:26:30.934 INFO:tasks.workunit.client.0.smithi029.stdout:5/194: readlink d1/dc/l23 0 2023-12-05T13:26:30.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/450: creat d6/d50/d5b/d5f/f84 x:0 0 0 2023-12-05T13:26:30.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/451: stat d6/lb 0 2023-12-05T13:26:30.936 INFO:tasks.workunit.client.0.smithi029.stdout:7/452: write d6/f15 [2769364,33960] 0 2023-12-05T13:26:30.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/344: getdents d7/d31 0 2023-12-05T13:26:30.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/345: fsync d7/d5e/f37 0 2023-12-05T13:26:30.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/346: write d7/d5e/f50 [1228605,86536] 0 2023-12-05T13:26:30.940 INFO:tasks.workunit.client.0.smithi029.stdout:2/264: rename de/f3c to de/d41/f51 0 2023-12-05T13:26:30.943 INFO:tasks.workunit.client.0.smithi029.stdout:5/195: rmdir d1/dc/d10/d1e/d42 0 2023-12-05T13:26:30.945 INFO:tasks.workunit.client.0.smithi029.stdout:7/453: mkdir d6/d2a/d7e/d7b/d85 0 2023-12-05T13:26:30.945 INFO:tasks.workunit.client.0.smithi029.stdout:7/454: write d6/d19/f21 [4921787,48018] 0 2023-12-05T13:26:30.947 INFO:tasks.workunit.client.0.smithi029.stdout:1/347: creat d7/d5e/d52/d5f/f6f x:0 0 0 2023-12-05T13:26:30.947 INFO:tasks.workunit.client.0.smithi029.stdout:1/348: chown d7/d5e/f37 2076951853 1 2023-12-05T13:26:30.947 INFO:tasks.workunit.client.0.smithi029.stdout:1/349: chown d7/d5e/f28 0 1 2023-12-05T13:26:30.947 INFO:tasks.workunit.client.0.smithi029.stdout:1/350: chown d7/d31/f3c 11097 1 2023-12-05T13:26:30.949 INFO:tasks.workunit.client.0.smithi029.stdout:2/265: rename de/d14/d24/l4e to de/d14/l52 0 2023-12-05T13:26:30.951 INFO:tasks.workunit.client.0.smithi029.stdout:5/196: truncate d1/dc/d27/f2e 1933045 0 2023-12-05T13:26:30.953 INFO:tasks.workunit.client.0.smithi029.stdout:7/455: creat d6/d50/d5b/d1a/d26/d6e/f86 x:0 0 0 2023-12-05T13:26:30.955 INFO:tasks.workunit.client.0.smithi029.stdout:7/456: creat d6/d50/d5b/d1a/d26/f87 x:0 0 0 2023-12-05T13:26:30.956 INFO:tasks.workunit.client.0.smithi029.stdout:7/457: write d6/d50/d5b/d1a/f27 [2901411,20225] 0 2023-12-05T13:26:30.970 INFO:tasks.workunit.client.0.smithi029.stdout:1/351: dwrite d7/d5e/f38 [0,4194304] 0 2023-12-05T13:26:30.971 INFO:tasks.workunit.client.0.smithi029.stdout:1/352: truncate d7/d31/f51 1158442 0 2023-12-05T13:26:30.971 INFO:tasks.workunit.client.0.smithi029.stdout:7/458: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:30.975 INFO:tasks.workunit.client.0.smithi029.stdout:2/266: dwrite de/d11/f26 [0,4194304] 0 2023-12-05T13:26:30.984 INFO:tasks.workunit.client.0.smithi029.stdout:5/197: dwrite d1/fb [0,4194304] 0 2023-12-05T13:26:30.984 INFO:tasks.workunit.client.0.smithi029.stdout:5/198: read - d1/dc/d27/f2a zero size 2023-12-05T13:26:30.985 INFO:tasks.workunit.client.0.smithi029.stdout:5/199: creat d1/dc/d38/f44 x:0 0 0 2023-12-05T13:26:30.991 INFO:tasks.workunit.client.0.smithi029.stdout:1/353: dwrite d7/f4d [0,4194304] 0 2023-12-05T13:26:30.992 INFO:tasks.workunit.client.0.smithi029.stdout:7/459: dwrite d6/d50/d46/d4a/d4b/f7f [0,4194304] 0 2023-12-05T13:26:30.992 INFO:tasks.workunit.client.0.smithi029.stdout:1/354: read d7/d5e/d52/d5f/d12/f2d [652501,129763] 0 2023-12-05T13:26:30.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/460: symlink d6/d35/d5c/l88 0 2023-12-05T13:26:30.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/461: chown d6/d50/d46/d4a/d4b/c61 3622504 1 2023-12-05T13:26:30.993 INFO:tasks.workunit.client.0.smithi029.stdout:1/355: symlink d7/d31/d4b/l70 0 2023-12-05T13:26:30.994 INFO:tasks.workunit.client.0.smithi029.stdout:7/462: stat d6/d50/d5b/d1a/d26/c3f 0 2023-12-05T13:26:30.995 INFO:tasks.workunit.client.0.smithi029.stdout:1/356: mknod d7/d5e/d52/d5f/d48/c71 0 2023-12-05T13:26:30.995 INFO:tasks.workunit.client.0.smithi029.stdout:1/357: stat d7/d31 0 2023-12-05T13:26:30.997 INFO:tasks.workunit.client.0.smithi029.stdout:7/463: mkdir d6/d2a/d2f/d89 0 2023-12-05T13:26:30.997 INFO:tasks.workunit.client.0.smithi029.stdout:2/267: dwrite de/f12 [0,4194304] 0 2023-12-05T13:26:31.000 INFO:tasks.workunit.client.0.smithi029.stdout:1/358: unlink d7/d56/f68 0 2023-12-05T13:26:31.000 INFO:tasks.workunit.client.0.smithi029.stdout:1/359: readlink d7/d31/l4c 0 2023-12-05T13:26:31.001 INFO:tasks.workunit.client.0.smithi029.stdout:5/200: fsync d1/dc/d38/f44 0 2023-12-05T13:26:31.008 INFO:tasks.workunit.client.0.smithi029.stdout:7/464: unlink d6/d50/d5b/d1a/c1e 0 2023-12-05T13:26:31.010 INFO:tasks.workunit.client.0.smithi029.stdout:2/268: dwrite de/d11/f25 [0,4194304] 0 2023-12-05T13:26:31.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/360: mkdir d7/d31/d4b/d72 0 2023-12-05T13:26:31.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/361: truncate d7/d61/d4f/f6c 697085 0 2023-12-05T13:26:31.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/362: write d7/d61/d4f/f6c [553558,46061] 0 2023-12-05T13:26:31.017 INFO:tasks.workunit.client.0.smithi029.stdout:1/363: readlink d7/d56/l40 0 2023-12-05T13:26:31.018 INFO:tasks.workunit.client.0.smithi029.stdout:5/201: mknod d1/dc/d38/d3a/c45 0 2023-12-05T13:26:31.018 INFO:tasks.workunit.client.0.smithi029.stdout:5/202: truncate d1/dc/d38/f22 729542 0 2023-12-05T13:26:31.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/364: write d7/fc [1586362,129817] 0 2023-12-05T13:26:31.019 INFO:tasks.workunit.client.0.smithi029.stdout:7/465: unlink d6/d50/d5b/d1a/f67 0 2023-12-05T13:26:31.021 INFO:tasks.workunit.client.0.smithi029.stdout:2/269: truncate de/d14/f39 111167 0 2023-12-05T13:26:31.022 INFO:tasks.workunit.client.0.smithi029.stdout:5/203: creat d1/dc/d25/f46 x:0 0 0 2023-12-05T13:26:31.022 INFO:tasks.workunit.client.0.smithi029.stdout:1/365: mknod d7/d56/c73 0 2023-12-05T13:26:31.023 INFO:tasks.workunit.client.0.smithi029.stdout:7/466: rmdir d6/d2a/d2f 39 2023-12-05T13:26:31.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/270: rmdir de/d11 39 2023-12-05T13:26:31.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/271: truncate de/d41/f51 837415 0 2023-12-05T13:26:31.025 INFO:tasks.workunit.client.0.smithi029.stdout:2/272: write de/d11/d32/f3e [199310,12228] 0 2023-12-05T13:26:31.026 INFO:tasks.workunit.client.0.smithi029.stdout:5/204: creat d1/dc/d10/d1e/f47 x:0 0 0 2023-12-05T13:26:31.026 INFO:tasks.workunit.client.0.smithi029.stdout:5/205: fdatasync d1/fb 0 2023-12-05T13:26:31.028 INFO:tasks.workunit.client.0.smithi029.stdout:1/366: getdents d7/d5e/d52 0 2023-12-05T13:26:31.028 INFO:tasks.workunit.client.0.smithi029.stdout:1/367: read - d7/d5e/d52/d5f/d48/f67 zero size 2023-12-05T13:26:31.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/273: symlink de/d14/l53 0 2023-12-05T13:26:31.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/368: creat d7/d5e/d52/d5f/d12/f74 x:0 0 0 2023-12-05T13:26:31.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/369: read d7/d5e/d52/d5f/d12/f46 [2788474,110185] 0 2023-12-05T13:26:31.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/274: symlink de/d14/d24/l54 0 2023-12-05T13:26:31.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/275: chown de/d16/d43 2450192 1 2023-12-05T13:26:31.038 INFO:tasks.workunit.client.0.smithi029.stdout:1/370: symlink d7/d56/l75 0 2023-12-05T13:26:31.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/467: dwrite d6/f63 [0,4194304] 0 2023-12-05T13:26:31.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/468: truncate d6/d50/d5b/d1a/d26/f5e 704310 0 2023-12-05T13:26:31.040 INFO:tasks.workunit.client.0.smithi029.stdout:1/371: creat d7/d5e/d52/d5f/d12/f76 x:0 0 0 2023-12-05T13:26:31.044 INFO:tasks.workunit.client.0.smithi029.stdout:7/469: rename d6/d35/d3e/d40/d52/c53 to d6/d50/d5b/d5f/d7d/c8a 0 2023-12-05T13:26:31.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/470: fdatasync d6/d50/d5b/d1a/d26/d6e/f86 0 2023-12-05T13:26:31.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/372: mkdir d7/d61/d77 0 2023-12-05T13:26:31.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/373: fdatasync d7/d61/d4f/f6c 0 2023-12-05T13:26:31.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/374: write d7/d5e/f47 [576759,46128] 0 2023-12-05T13:26:31.047 INFO:tasks.workunit.client.0.smithi029.stdout:7/471: mkdir d6/d50/d5b/d1a/d26/d6e/d8b 0 2023-12-05T13:26:31.048 INFO:tasks.workunit.client.0.smithi029.stdout:7/472: truncate d6/f15 545441 0 2023-12-05T13:26:31.061 INFO:tasks.workunit.client.0.smithi029.stdout:7/473: dread d6/d50/d5b/f36 [0,4194304] 0 2023-12-05T13:26:31.061 INFO:tasks.workunit.client.0.smithi029.stdout:7/474: getdents d6/d2a/d66 0 2023-12-05T13:26:31.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/375: dwrite d7/fd [0,4194304] 0 2023-12-05T13:26:31.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/376: readlink d7/d5e/l27 0 2023-12-05T13:26:31.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/377: creat d7/d61/d77/f78 x:0 0 0 2023-12-05T13:26:31.070 INFO:tasks.workunit.client.0.smithi029.stdout:1/378: creat d7/d31/d4b/d72/f79 x:0 0 0 2023-12-05T13:26:31.070 INFO:tasks.workunit.client.0.smithi029.stdout:1/379: chown d7/d5e/l27 15 1 2023-12-05T13:26:31.071 INFO:tasks.workunit.client.0.smithi029.stdout:1/380: rmdir d7/d5e/d52/d5f/d48 39 2023-12-05T13:26:31.071 INFO:tasks.workunit.client.0.smithi029.stdout:1/381: chown d7/d5e/d52/d5f/c41 540 1 2023-12-05T13:26:31.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/475: dread d6/d50/d5b/d1a/d26/f74 [0,4194304] 0 2023-12-05T13:26:31.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/382: rename d7/d5e/d52/d5f/d12/l5c to d7/d5e/d52/d5f/l7a 0 2023-12-05T13:26:31.073 INFO:tasks.workunit.client.0.smithi029.stdout:7/476: creat d6/d35/d70/f8c x:0 0 0 2023-12-05T13:26:31.073 INFO:tasks.workunit.client.0.smithi029.stdout:1/383: symlink d7/d5e/d52/d5f/l7b 0 2023-12-05T13:26:31.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/384: symlink d7/d5e/d52/d5f/d12/d60/l7c 0 2023-12-05T13:26:31.075 INFO:tasks.workunit.client.0.smithi029.stdout:1/385: creat d7/d5e/f7d x:0 0 0 2023-12-05T13:26:31.077 INFO:tasks.workunit.client.0.smithi029.stdout:1/386: creat d7/d61/f7e x:0 0 0 2023-12-05T13:26:31.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/387: fdatasync f3 0 2023-12-05T13:26:31.079 INFO:tasks.workunit.client.0.smithi029.stdout:1/388: truncate d7/d61/f6d 3083845 0 2023-12-05T13:26:31.085 INFO:tasks.workunit.client.0.smithi029.stdout:1/389: rmdir d7/d61 39 2023-12-05T13:26:31.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/390: symlink d7/l7f 0 2023-12-05T13:26:31.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/391: stat d7/d56 0 2023-12-05T13:26:31.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/392: creat d7/d31/d4b/d72/f80 x:0 0 0 2023-12-05T13:26:31.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/393: fsync d7/d5e/d52/d5f/d12/f74 0 2023-12-05T13:26:31.090 INFO:tasks.workunit.client.0.smithi029.stdout:7/477: dwrite d6/d50/f64 [0,4194304] 0 2023-12-05T13:26:31.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/478: symlink d6/d2a/d2f/d89/l8d 0 2023-12-05T13:26:31.094 INFO:tasks.workunit.client.0.smithi029.stdout:7/479: mkdir d6/d2a/d8e 0 2023-12-05T13:26:31.095 INFO:tasks.workunit.client.0.smithi029.stdout:7/480: symlink d6/d50/d5b/d1a/l8f 0 2023-12-05T13:26:31.095 INFO:tasks.workunit.client.0.smithi029.stdout:7/481: mknod d6/d35/d3e/d40/d52/c90 0 2023-12-05T13:26:31.097 INFO:tasks.workunit.client.0.smithi029.stdout:7/482: getdents d6/d50/d5b/d5f 0 2023-12-05T13:26:31.098 INFO:tasks.workunit.client.0.smithi029.stdout:7/483: dread d6/d50/d5b/d1a/d26/f5e [0,4194304] 0 2023-12-05T13:26:31.099 INFO:tasks.workunit.client.0.smithi029.stdout:7/484: write d6/d50/d46/d51/f77 [1118960,116390] 0 2023-12-05T13:26:31.100 INFO:tasks.workunit.client.0.smithi029.stdout:1/394: dwrite d7/d5e/d52/d5f/d12/f1d [0,4194304] 0 2023-12-05T13:26:31.103 INFO:tasks.workunit.client.0.smithi029.stdout:1/395: dread d7/d61/f6d [0,4194304] 0 2023-12-05T13:26:31.103 INFO:tasks.workunit.client.0.smithi029.stdout:7/485: dread d6/f9 [4194304,4194304] 0 2023-12-05T13:26:31.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:30 smithi029 ceph-mon[112128]: pgmap v37: 65 pgs: 65 active+clean; 598 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 315 op/s 2023-12-05T13:26:31.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/486: stat d6/d2a/d66 0 2023-12-05T13:26:31.104 INFO:tasks.workunit.client.0.smithi029.stdout:1/396: unlink d7/d5e/f37 0 2023-12-05T13:26:31.105 INFO:tasks.workunit.client.0.smithi029.stdout:7/487: creat d6/d2a/d2f/f91 x:0 0 0 2023-12-05T13:26:31.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/397: creat d7/d5e/d52/d5f/d12/f81 x:0 0 0 2023-12-05T13:26:31.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/398: link d7/d56/l40 d7/d31/d4b/l82 0 2023-12-05T13:26:31.107 INFO:tasks.workunit.client.0.smithi029.stdout:1/399: stat d7/d5e/f47 0 2023-12-05T13:26:31.109 INFO:tasks.workunit.client.0.smithi029.stdout:1/400: rename d7/d5e/d52/d5f/d12/f81 to d7/d31/d4b/d72/f83 0 2023-12-05T13:26:31.110 INFO:tasks.workunit.client.0.smithi029.stdout:1/401: creat d7/d31/d4b/f84 x:0 0 0 2023-12-05T13:26:31.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/402: rename d7/d56/l26 to d7/d5e/d52/d5f/d12/d60/l85 0 2023-12-05T13:26:31.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/403: truncate d7/d5e/d52/d5f/d12/f2d 4493689 0 2023-12-05T13:26:31.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/404: chown d7/d5e/f28 288764375 1 2023-12-05T13:26:31.112 INFO:tasks.workunit.client.0.smithi029.stdout:1/405: truncate d7/d5e/f50 248225 0 2023-12-05T13:26:31.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/406: fsync d7/d61/f59 0 2023-12-05T13:26:31.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/407: creat d7/d6e/f86 x:0 0 0 2023-12-05T13:26:31.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/408: mknod d7/d5e/d52/d5f/d12/d60/c87 0 2023-12-05T13:26:31.121 INFO:tasks.workunit.client.0.smithi029.stdout:7/488: dwrite d6/f13 [0,4194304] 0 2023-12-05T13:26:31.121 INFO:tasks.workunit.client.0.smithi029.stdout:7/489: getdents d6/d50/d5b/d5f 0 2023-12-05T13:26:31.123 INFO:tasks.workunit.client.0.smithi029.stdout:7/490: mknod d6/d35/d3e/d40/d52/c92 0 2023-12-05T13:26:31.124 INFO:tasks.workunit.client.0.smithi029.stdout:7/491: mkdir d6/d2a/d4f/d93 0 2023-12-05T13:26:31.126 INFO:tasks.workunit.client.0.smithi029.stdout:7/492: rename d6/d50/d5b/f36 to d6/d2a/d71/f94 0 2023-12-05T13:26:31.127 INFO:tasks.workunit.client.0.smithi029.stdout:7/493: fsync d6/d50/d5b/d1a/d26/d6e/f86 0 2023-12-05T13:26:31.127 INFO:tasks.workunit.client.0.smithi029.stdout:7/494: creat d6/d50/d5b/d1a/d26/d6e/f95 x:0 0 0 2023-12-05T13:26:31.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/409: rmdir d7/d5e 39 2023-12-05T13:26:31.137 INFO:tasks.workunit.client.0.smithi029.stdout:7/495: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:31.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/410: truncate d7/d5e/f50 93625 0 2023-12-05T13:26:31.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/411: dread - d7/d5e/f5a zero size 2023-12-05T13:26:31.146 INFO:tasks.workunit.client.0.smithi029.stdout:7/496: dread d6/d50/d46/d4a/d4b/f7f [0,4194304] 0 2023-12-05T13:26:31.152 INFO:tasks.workunit.client.0.smithi029.stdout:1/412: dwrite d7/d5e/f28 [0,4194304] 0 2023-12-05T13:26:31.154 INFO:tasks.workunit.client.0.smithi029.stdout:7/497: dread d6/f11 [0,4194304] 0 2023-12-05T13:26:31.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/498: write d6/f22 [868185,41279] 0 2023-12-05T13:26:31.161 INFO:tasks.workunit.client.0.smithi029.stdout:7/499: dread d6/f11 [0,4194304] 0 2023-12-05T13:26:31.162 INFO:tasks.workunit.client.0.smithi029.stdout:7/500: rmdir d6/d50/d5b/d1a/d26 39 2023-12-05T13:26:31.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/501: truncate d6/d19/f21 158354 0 2023-12-05T13:26:31.163 INFO:tasks.workunit.client.0.smithi029.stdout:7/502: read - d6/d50/d5b/d1a/d26/d6e/f75 zero size 2023-12-05T13:26:31.169 INFO:tasks.workunit.client.0.smithi029.stdout:1/413: dwrite d7/d5e/f50 [0,4194304] 0 2023-12-05T13:26:31.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/503: truncate d6/d19/f21 814488 0 2023-12-05T13:26:31.171 INFO:tasks.workunit.client.0.smithi029.stdout:7/504: fsync d6/d2a/d2f/f6f 0 2023-12-05T13:26:31.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/414: dread d7/d61/f6d [0,4194304] 0 2023-12-05T13:26:31.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/415: dread - d7/d6e/f86 zero size 2023-12-05T13:26:31.173 INFO:tasks.workunit.client.0.smithi029.stdout:1/416: chown d7/d5e/c43 0 1 2023-12-05T13:26:31.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/417: write d7/f53 [894489,73125] 0 2023-12-05T13:26:31.175 INFO:tasks.workunit.client.0.smithi029.stdout:7/505: mkdir d6/d50/d5b/d5f/d7d/d96 0 2023-12-05T13:26:31.179 INFO:tasks.workunit.client.0.smithi029.stdout:7/506: rename d6/d50/d46 to d6/d50/d5b/d5f/d7d/d97 0 2023-12-05T13:26:31.185 INFO:tasks.workunit.client.0.smithi029.stdout:7/507: unlink d6/d2a/d2f/f6f 0 2023-12-05T13:26:31.194 INFO:tasks.workunit.client.0.smithi029.stdout:0/195: sync 2023-12-05T13:26:31.194 INFO:tasks.workunit.client.0.smithi029.stdout:0/196: fsync dc/d13/f1c 0 2023-12-05T13:26:31.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/197: read dc/f35 [825328,550] 0 2023-12-05T13:26:31.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/198: dread - dc/d13/f28 zero size 2023-12-05T13:26:31.195 INFO:tasks.workunit.client.0.smithi029.stdout:0/199: write dc/f2c [832410,84253] 0 2023-12-05T13:26:31.202 INFO:tasks.workunit.client.0.smithi029.stdout:7/508: dwrite d6/d50/d5b/d1a/d26/f2b [0,4194304] 0 2023-12-05T13:26:31.207 INFO:tasks.workunit.client.0.smithi029.stdout:0/200: dread dc/f14 [0,4194304] 0 2023-12-05T13:26:31.210 INFO:tasks.workunit.client.0.smithi029.stdout:7/509: link d6/d50/d5b/d1a/d26/d72/f81 d6/d50/d5b/d5f/f98 0 2023-12-05T13:26:31.211 INFO:tasks.workunit.client.0.smithi029.stdout:0/201: symlink dc/d33/l45 0 2023-12-05T13:26:31.211 INFO:tasks.workunit.client.0.smithi029.stdout:0/202: chown dc/d23/c36 13 1 2023-12-05T13:26:31.213 INFO:tasks.workunit.client.0.smithi029.stdout:0/203: dread dc/ff [0,4194304] 0 2023-12-05T13:26:31.213 INFO:tasks.workunit.client.0.smithi029.stdout:0/204: stat dc/d13/f2d 0 2023-12-05T13:26:31.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/510: creat d6/d2a/d7e/d7b/f99 x:0 0 0 2023-12-05T13:26:31.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/511: chown d6/d2a/d7e/d7b/f99 21068646 1 2023-12-05T13:26:31.216 INFO:tasks.workunit.client.0.smithi029.stdout:7/512: write d6/d50/d5b/d5f/d7d/d97/d51/f77 [3869350,70800] 0 2023-12-05T13:26:31.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/205: dwrite dc/f35 [0,4194304] 0 2023-12-05T13:26:31.233 INFO:tasks.workunit.client.0.smithi029.stdout:0/206: rename f4 to dc/d33/f46 0 2023-12-05T13:26:31.233 INFO:tasks.workunit.client.0.smithi029.stdout:0/207: chown dc/f32 6 1 2023-12-05T13:26:31.234 INFO:tasks.workunit.client.0.smithi029.stdout:0/208: mkdir dc/d33/d47 0 2023-12-05T13:26:31.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/209: truncate dc/d33/f38 272367 0 2023-12-05T13:26:31.238 INFO:tasks.workunit.client.0.smithi029.stdout:0/210: rename dc/c24 to dc/d33/d3d/c48 0 2023-12-05T13:26:31.238 INFO:tasks.workunit.client.0.smithi029.stdout:0/211: fsync dc/d13/f34 0 2023-12-05T13:26:31.238 INFO:tasks.workunit.client.0.smithi029.stdout:0/212: write dc/d13/f2d [1842650,117508] 0 2023-12-05T13:26:31.241 INFO:tasks.workunit.client.0.smithi029.stdout:0/213: rename c8 to dc/d23/d3a/d41/c49 0 2023-12-05T13:26:31.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/214: rename dc/d13/l15 to dc/l4a 0 2023-12-05T13:26:31.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/215: fdatasync dc/d23/f2e 0 2023-12-05T13:26:31.247 INFO:tasks.workunit.client.0.smithi029.stdout:0/216: creat dc/d23/d3a/d41/f4b x:0 0 0 2023-12-05T13:26:31.260 INFO:tasks.workunit.client.0.smithi029.stdout:0/217: dwrite f9 [0,4194304] 0 2023-12-05T13:26:31.261 INFO:tasks.workunit.client.0.smithi029.stdout:0/218: symlink dc/d33/l4c 0 2023-12-05T13:26:31.261 INFO:tasks.workunit.client.0.smithi029.stdout:0/219: write dc/f29 [1368942,17822] 0 2023-12-05T13:26:31.395 INFO:tasks.workunit.client.0.smithi029.stdout:8/473: sync 2023-12-05T13:26:31.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/474: link d5/dc/c31 d5/dc/d56/ca0 0 2023-12-05T13:26:31.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/475: stat d5/d2f/d3a/d3c/l92 0 2023-12-05T13:26:31.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/476: write d5/d2f/d75/f7b [1240927,19790] 0 2023-12-05T13:26:31.397 INFO:tasks.workunit.client.0.smithi029.stdout:8/477: chown d5/d2f/d3a/d3c/c4a 4131 1 2023-12-05T13:26:31.406 INFO:tasks.workunit.client.0.smithi029.stdout:8/478: dread d5/f82 [0,4194304] 0 2023-12-05T13:26:31.419 INFO:tasks.workunit.client.0.smithi029.stdout:8/479: dwrite d5/dc/d17/d1d/f7f [0,4194304] 0 2023-12-05T13:26:31.419 INFO:tasks.workunit.client.0.smithi029.stdout:8/480: chown d5/d2f/d75/c8d 1760 1 2023-12-05T13:26:31.420 INFO:tasks.workunit.client.0.smithi029.stdout:8/481: write d5/d2f/d3a/d3c/f89 [448877,78038] 0 2023-12-05T13:26:31.421 INFO:tasks.workunit.client.0.smithi029.stdout:8/482: symlink d5/dc/d17/d8b/la1 0 2023-12-05T13:26:31.422 INFO:tasks.workunit.client.0.smithi029.stdout:8/483: rename d5/d6/d10/d85/d96 to d5/d2f/d3a/d3c/da2 0 2023-12-05T13:26:31.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/484: read d5/d2f/d3a/f9b [30562,125326] 0 2023-12-05T13:26:31.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/485: fdatasync d5/d6/f1a 0 2023-12-05T13:26:31.423 INFO:tasks.workunit.client.0.smithi029.stdout:8/486: truncate d5/d2f/d75/f25 2972713 0 2023-12-05T13:26:31.426 INFO:tasks.workunit.client.0.smithi029.stdout:8/487: unlink d5/d2f/d75/f25 0 2023-12-05T13:26:31.428 INFO:tasks.workunit.client.0.smithi029.stdout:8/488: getdents d5/d6/d10 0 2023-12-05T13:26:31.430 INFO:tasks.workunit.client.0.smithi029.stdout:8/489: creat d5/d6/fa3 x:0 0 0 2023-12-05T13:26:31.434 INFO:tasks.workunit.client.0.smithi029.stdout:8/490: dread d5/f82 [0,4194304] 0 2023-12-05T13:26:31.434 INFO:tasks.workunit.client.0.smithi029.stdout:8/491: dread - d5/dc/d18/d26/f9f zero size 2023-12-05T13:26:31.453 INFO:tasks.workunit.client.0.smithi029.stdout:8/492: dwrite d5/dc/f32 [0,4194304] 0 2023-12-05T13:26:31.460 INFO:tasks.workunit.client.0.smithi029.stdout:8/493: dread d5/dc/ff [0,4194304] 0 2023-12-05T13:26:31.460 INFO:tasks.workunit.client.0.smithi029.stdout:8/494: creat d5/d2f/d75/fa4 x:0 0 0 2023-12-05T13:26:31.460 INFO:tasks.workunit.client.0.smithi029.stdout:8/495: fdatasync d5/dc/d17/d1d/f2a 0 2023-12-05T13:26:31.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/207: sync 2023-12-05T13:26:31.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/208: write d1/d18/f38 [263995,27023] 0 2023-12-05T13:26:31.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/209: stat d1/d6/f2a 0 2023-12-05T13:26:31.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/210: chown d1/d6/d11/f22 3 1 2023-12-05T13:26:31.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/211: readlink d1/d16/d28/l35 0 2023-12-05T13:26:31.466 INFO:tasks.workunit.client.0.smithi029.stdout:3/212: link d1/f25 d1/f48 0 2023-12-05T13:26:31.466 INFO:tasks.workunit.client.0.smithi029.stdout:3/213: stat d1/d6/d11/c21 0 2023-12-05T13:26:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:30 smithi052 ceph-mon[121072]: pgmap v37: 65 pgs: 65 active+clean; 598 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 315 op/s 2023-12-05T13:26:31.484 INFO:tasks.workunit.client.0.smithi029.stdout:3/214: dwrite d1/d6/f23 [0,4194304] 0 2023-12-05T13:26:31.489 INFO:tasks.workunit.client.0.smithi029.stdout:3/215: rmdir d1/d16/d39 0 2023-12-05T13:26:31.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/216: rename d1/d6/d11/f22 to d1/d16/f49 0 2023-12-05T13:26:31.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/217: mkdir d1/d6/d4a 0 2023-12-05T13:26:31.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/218: readlink d1/d16/d28/l35 0 2023-12-05T13:26:31.494 INFO:tasks.workunit.client.0.smithi029.stdout:3/219: mkdir d1/d16/d36/d4b 0 2023-12-05T13:26:31.494 INFO:tasks.workunit.client.0.smithi029.stdout:3/220: truncate d1/d18/f2e 929934 0 2023-12-05T13:26:31.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/221: getdents d1/d18 0 2023-12-05T13:26:31.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/222: chown d1/d10/c2c 21 1 2023-12-05T13:26:31.497 INFO:tasks.workunit.client.0.smithi029.stdout:3/223: truncate d1/d6/d11/f12 3686282 0 2023-12-05T13:26:31.497 INFO:tasks.workunit.client.0.smithi029.stdout:3/224: chown d1/d6 0 1 2023-12-05T13:26:31.514 INFO:tasks.workunit.client.0.smithi029.stdout:3/225: dwrite d1/f43 [0,4194304] 0 2023-12-05T13:26:31.517 INFO:tasks.workunit.client.0.smithi029.stdout:3/226: mkdir d1/d16/d1f/d4c 0 2023-12-05T13:26:31.518 INFO:tasks.workunit.client.0.smithi029.stdout:3/227: mknod d1/d18/c4d 0 2023-12-05T13:26:31.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/228: dwrite d1/fd [0,4194304] 0 2023-12-05T13:26:31.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/229: fsync d1/d6/f3c 0 2023-12-05T13:26:31.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/230: read d1/d18/f20 [3194352,52609] 0 2023-12-05T13:26:31.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/231: rmdir d1/d16/d1f 39 2023-12-05T13:26:31.532 INFO:tasks.workunit.client.0.smithi029.stdout:3/232: mkdir d1/d6/d11/d4e 0 2023-12-05T13:26:31.534 INFO:tasks.workunit.client.0.smithi029.stdout:3/233: rename d1/d6/f14 to d1/d16/d1f/d4c/f4f 0 2023-12-05T13:26:31.534 INFO:tasks.workunit.client.0.smithi029.stdout:3/234: write d1/d18/f20 [4170454,25780] 0 2023-12-05T13:26:31.536 INFO:tasks.workunit.client.0.smithi029.stdout:3/235: symlink d1/d6/d11/d4e/l50 0 2023-12-05T13:26:31.538 INFO:tasks.workunit.client.0.smithi029.stdout:3/236: dread d1/d16/d1f/d4c/f4f [0,4194304] 0 2023-12-05T13:26:31.539 INFO:tasks.workunit.client.0.smithi029.stdout:3/237: creat d1/d10/f51 x:0 0 0 2023-12-05T13:26:31.540 INFO:tasks.workunit.client.0.smithi029.stdout:3/238: creat d1/d6/f52 x:0 0 0 2023-12-05T13:26:31.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/239: dwrite d1/f48 [0,4194304] 0 2023-12-05T13:26:31.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/240: chown d1/d10/f51 41607 1 2023-12-05T13:26:31.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/241: chown d1/d6/l33 45380 1 2023-12-05T13:26:31.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/242: truncate d1/d6/f52 186793 0 2023-12-05T13:26:31.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/243: chown d1/d6/c17 71 1 2023-12-05T13:26:31.557 INFO:tasks.workunit.client.0.smithi029.stdout:3/244: creat d1/d16/d36/d4b/f53 x:0 0 0 2023-12-05T13:26:31.579 INFO:tasks.workunit.client.0.smithi029.stdout:3/245: dwrite d1/d18/f45 [4194304,4194304] 0 2023-12-05T13:26:31.594 INFO:tasks.workunit.client.0.smithi029.stdout:3/246: dwrite d1/d16/d1f/d4c/f4f [0,4194304] 0 2023-12-05T13:26:31.628 INFO:tasks.workunit.client.0.smithi029.stdout:4/211: sync 2023-12-05T13:26:31.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/212: unlink d0/de/d30/d32/d35/c36 0 2023-12-05T13:26:31.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/213: chown d0/f23 28 1 2023-12-05T13:26:31.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/214: rename d0/d3c/l46 to d0/de/d15/d2b/l48 0 2023-12-05T13:26:31.631 INFO:tasks.workunit.client.0.smithi029.stdout:4/215: dread - d0/de/d15/d2b/f43 zero size 2023-12-05T13:26:31.654 INFO:tasks.workunit.client.0.smithi029.stdout:4/216: dwrite d0/d1/fc [0,4194304] 0 2023-12-05T13:26:31.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/217: dwrite d0/de/f45 [0,4194304] 0 2023-12-05T13:26:31.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/218: chown d0/de/d15/l34 19041157 1 2023-12-05T13:26:31.671 INFO:tasks.workunit.client.0.smithi029.stdout:4/219: readlink d0/d16/d22/l25 0 2023-12-05T13:26:31.673 INFO:tasks.workunit.client.0.smithi029.stdout:4/220: link d0/da/fb d0/de/d15/f49 0 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:7/513: sync 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/496: sync 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:1/418: sync 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/497: readlink d5/d6/d10/d13/l37 0 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:6/300: sync 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:6/301: chown d6/d29 4 1 2023-12-05T13:26:31.780 INFO:tasks.workunit.client.0.smithi029.stdout:6/302: stat d6/d29/c34 0 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:7/514: write d6/d50/d5b/f4e [789560,46969] 0 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/276: sync 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:0/220: sync 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:0/221: chown dc/c25 25229340 1 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/277: read - de/d16/f47 zero size 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:5/206: sync 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/278: truncate de/d16/d43/f46 686624 0 2023-12-05T13:26:31.781 INFO:tasks.workunit.client.0.smithi029.stdout:9/264: sync 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:8/498: read d5/d2f/d3a/f48 [345116,62121] 0 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:5/207: write d1/f20 [560902,109474] 0 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:0/222: write dc/d13/f1c [3295614,101255] 0 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:5/208: write d1/dc/d10/d1e/f47 [363754,7311] 0 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:5/209: read - d1/dc/d25/f3b zero size 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:7/515: mkdir d6/d35/d70/d9a 0 2023-12-05T13:26:31.782 INFO:tasks.workunit.client.0.smithi029.stdout:6/303: write d6/f1c [767499,113194] 0 2023-12-05T13:26:31.783 INFO:tasks.workunit.client.0.smithi029.stdout:2/279: mknod de/c55 0 2023-12-05T13:26:31.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/419: write d7/d31/f51 [2054989,19492] 0 2023-12-05T13:26:31.784 INFO:tasks.workunit.client.0.smithi029.stdout:5/210: dread d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:31.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/265: rmdir d7/d2c/d3a/d52/d53 0 2023-12-05T13:26:31.789 INFO:tasks.workunit.client.0.smithi029.stdout:8/499: rename d5/d2f/d75/f22 to d5/d2f/d75/fa5 0 2023-12-05T13:26:31.791 INFO:tasks.workunit.client.0.smithi029.stdout:0/223: rmdir dc/d33/d3d 39 2023-12-05T13:26:31.793 INFO:tasks.workunit.client.0.smithi029.stdout:7/516: link d6/d35/d5c/l88 d6/d19/l9b 0 2023-12-05T13:26:31.795 INFO:tasks.workunit.client.0.smithi029.stdout:6/304: creat d6/d1d/d36/f69 x:0 0 0 2023-12-05T13:26:31.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/280: mkdir de/d41/d56 0 2023-12-05T13:26:31.798 INFO:tasks.workunit.client.0.smithi029.stdout:1/420: creat d7/d61/d4f/f88 x:0 0 0 2023-12-05T13:26:31.798 INFO:tasks.workunit.client.0.smithi029.stdout:5/211: symlink d1/dc/l48 0 2023-12-05T13:26:31.799 INFO:tasks.workunit.client.0.smithi029.stdout:8/500: symlink d5/dc/d17/la6 0 2023-12-05T13:26:31.800 INFO:tasks.workunit.client.0.smithi029.stdout:0/224: getdents dc/d23 0 2023-12-05T13:26:31.801 INFO:tasks.workunit.client.0.smithi029.stdout:7/517: symlink d6/d35/d3e/d40/d52/l9c 0 2023-12-05T13:26:31.802 INFO:tasks.workunit.client.0.smithi029.stdout:9/266: dwrite d7/d2c/d3a/f3e [0,4194304] 0 2023-12-05T13:26:31.802 INFO:tasks.workunit.client.0.smithi029.stdout:2/281: symlink de/d41/d56/l57 0 2023-12-05T13:26:31.802 INFO:tasks.workunit.client.0.smithi029.stdout:1/421: mknod d7/d61/c89 0 2023-12-05T13:26:31.804 INFO:tasks.workunit.client.0.smithi029.stdout:5/212: rmdir d1/dc/d10/d1e/d37 0 2023-12-05T13:26:31.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/501: symlink d5/dc/la7 0 2023-12-05T13:26:31.806 INFO:tasks.workunit.client.0.smithi029.stdout:6/305: dread d6/fc [0,4194304] 0 2023-12-05T13:26:31.806 INFO:tasks.workunit.client.0.smithi029.stdout:7/518: creat d6/d2a/d7e/f9d x:0 0 0 2023-12-05T13:26:31.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/267: creat d7/d2c/d33/f59 x:0 0 0 2023-12-05T13:26:31.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/268: readlink d7/d19/l57 0 2023-12-05T13:26:31.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/269: fsync d7/d19/d30/d43/f4d 0 2023-12-05T13:26:31.807 INFO:tasks.workunit.client.0.smithi029.stdout:2/282: mkdir de/d41/d56/d58 0 2023-12-05T13:26:31.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/422: creat d7/d61/d4f/f8a x:0 0 0 2023-12-05T13:26:31.809 INFO:tasks.workunit.client.0.smithi029.stdout:5/213: unlink d1/dc/d11/l24 0 2023-12-05T13:26:31.810 INFO:tasks.workunit.client.0.smithi029.stdout:8/502: mkdir d5/d2f/d3a/d86/da8 0 2023-12-05T13:26:31.811 INFO:tasks.workunit.client.0.smithi029.stdout:0/225: mknod dc/c4d 0 2023-12-05T13:26:31.811 INFO:tasks.workunit.client.0.smithi029.stdout:0/226: write dc/f32 [324315,51882] 0 2023-12-05T13:26:31.811 INFO:tasks.workunit.client.0.smithi029.stdout:6/306: truncate d6/fc 4174281 0 2023-12-05T13:26:31.811 INFO:tasks.workunit.client.0.smithi029.stdout:6/307: stat d6/d64/d65/l33 0 2023-12-05T13:26:31.812 INFO:tasks.workunit.client.0.smithi029.stdout:7/519: symlink d6/d50/l9e 0 2023-12-05T13:26:31.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/270: mkdir d7/d5a 0 2023-12-05T13:26:31.813 INFO:tasks.workunit.client.0.smithi029.stdout:2/283: symlink de/d11/l59 0 2023-12-05T13:26:31.815 INFO:tasks.workunit.client.0.smithi029.stdout:1/423: creat d7/d31/f8b x:0 0 0 2023-12-05T13:26:31.816 INFO:tasks.workunit.client.0.smithi029.stdout:5/214: creat d1/dc/d27/f49 x:0 0 0 2023-12-05T13:26:31.818 INFO:tasks.workunit.client.0.smithi029.stdout:8/503: unlink d5/dc/d56/ca0 0 2023-12-05T13:26:31.819 INFO:tasks.workunit.client.0.smithi029.stdout:0/227: mknod dc/d33/c4e 0 2023-12-05T13:26:31.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/520: mknod d6/d35/d3e/d40/c9f 0 2023-12-05T13:26:31.822 INFO:tasks.workunit.client.0.smithi029.stdout:9/271: getdents d7/d19/d30/d40 0 2023-12-05T13:26:31.822 INFO:tasks.workunit.client.0.smithi029.stdout:9/272: getdents d7/d5a 0 2023-12-05T13:26:31.822 INFO:tasks.workunit.client.0.smithi029.stdout:2/284: creat de/d11/d32/f5a x:0 0 0 2023-12-05T13:26:31.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/424: link d7/d61/d4f/f54 d7/d5e/d52/d5f/d12/d60/f8c 0 2023-12-05T13:26:31.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/425: write d7/d5e/d52/d5f/d12/d60/f8c [656051,78249] 0 2023-12-05T13:26:31.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/426: fdatasync d7/d5e/d52/d5f/d12/f2d 0 2023-12-05T13:26:31.825 INFO:tasks.workunit.client.0.smithi029.stdout:2/285: write de/d14/f21 [3490684,42705] 0 2023-12-05T13:26:31.825 INFO:tasks.workunit.client.0.smithi029.stdout:5/215: rmdir d1/dc/d25 39 2023-12-05T13:26:31.826 INFO:tasks.workunit.client.0.smithi029.stdout:2/286: dread - de/d16/f2b zero size 2023-12-05T13:26:31.827 INFO:tasks.workunit.client.0.smithi029.stdout:8/504: rename d5/l9a to d5/d6/d10/d8a/la9 0 2023-12-05T13:26:31.828 INFO:tasks.workunit.client.0.smithi029.stdout:8/505: chown d5/dc/d17/d8b/l8f 15 1 2023-12-05T13:26:31.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/521: creat d6/d2a/d2f/fa0 x:0 0 0 2023-12-05T13:26:31.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/522: dread - d6/d50/d5b/d1a/d26/d72/f76 zero size 2023-12-05T13:26:31.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/523: chown d6/d50/l80 62 1 2023-12-05T13:26:31.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/308: dwrite d6/d64/d65/f5e [0,4194304] 0 2023-12-05T13:26:31.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/309: chown d6/d1d/f55 834674266 1 2023-12-05T13:26:31.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/310: dread - d6/d1d/d36/f42 zero size 2023-12-05T13:26:31.832 INFO:tasks.workunit.client.0.smithi029.stdout:9/273: getdents d7/d19/d1f 0 2023-12-05T13:26:31.835 INFO:tasks.workunit.client.0.smithi029.stdout:1/427: creat d7/d6e/f8d x:0 0 0 2023-12-05T13:26:31.835 INFO:tasks.workunit.client.0.smithi029.stdout:1/428: write d7/d6e/f86 [76382,64555] 0 2023-12-05T13:26:31.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/287: creat de/f5b x:0 0 0 2023-12-05T13:26:31.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/288: stat de/c17 0 2023-12-05T13:26:31.840 INFO:tasks.workunit.client.0.smithi029.stdout:5/216: dwrite d1/dc/d11/f12 [0,4194304] 0 2023-12-05T13:26:31.840 INFO:tasks.workunit.client.0.smithi029.stdout:8/506: truncate d5/fe 1735916 0 2023-12-05T13:26:31.842 INFO:tasks.workunit.client.0.smithi029.stdout:0/228: mkdir dc/d13/d4f 0 2023-12-05T13:26:31.842 INFO:tasks.workunit.client.0.smithi029.stdout:0/229: truncate dc/fd 4264974 0 2023-12-05T13:26:31.843 INFO:tasks.workunit.client.0.smithi029.stdout:7/524: link d6/d50/d5b/l33 d6/d2a/d7e/d7b/la1 0 2023-12-05T13:26:31.844 INFO:tasks.workunit.client.0.smithi029.stdout:7/525: getdents d6/d35/d3e 0 2023-12-05T13:26:31.846 INFO:tasks.workunit.client.0.smithi029.stdout:9/274: truncate d7/fe 3475558 0 2023-12-05T13:26:31.848 INFO:tasks.workunit.client.0.smithi029.stdout:6/311: dwrite d6/fe [0,4194304] 0 2023-12-05T13:26:31.848 INFO:tasks.workunit.client.0.smithi029.stdout:6/312: chown d6/d3f 933 1 2023-12-05T13:26:31.848 INFO:tasks.workunit.client.0.smithi029.stdout:9/275: write d7/d19/d28/f3d [254088,49648] 0 2023-12-05T13:26:31.848 INFO:tasks.workunit.client.0.smithi029.stdout:1/429: symlink d7/d31/d4b/d72/l8e 0 2023-12-05T13:26:31.849 INFO:tasks.workunit.client.0.smithi029.stdout:1/430: write d7/d5e/d52/d5f/d12/f46 [4779990,93324] 0 2023-12-05T13:26:31.849 INFO:tasks.workunit.client.0.smithi029.stdout:2/289: stat de/d14/d24/l23 0 2023-12-05T13:26:31.851 INFO:tasks.workunit.client.0.smithi029.stdout:5/217: getdents d1/dc/d10 0 2023-12-05T13:26:31.852 INFO:tasks.workunit.client.0.smithi029.stdout:8/507: mkdir d5/d6/d10/d85/daa 0 2023-12-05T13:26:31.853 INFO:tasks.workunit.client.0.smithi029.stdout:1/431: dread d7/fb [0,4194304] 0 2023-12-05T13:26:31.854 INFO:tasks.workunit.client.0.smithi029.stdout:0/230: symlink dc/d23/d3a/l50 0 2023-12-05T13:26:31.855 INFO:tasks.workunit.client.0.smithi029.stdout:7/526: rename d6/d2a/d71/l68 to d6/d35/la2 0 2023-12-05T13:26:31.855 INFO:tasks.workunit.client.0.smithi029.stdout:7/527: write d6/d50/d5b/d1a/d26/d6e/f95 [1041451,16717] 0 2023-12-05T13:26:31.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/313: symlink d6/d1d/d39/l6a 0 2023-12-05T13:26:31.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/314: write d6/f1c [4819666,102099] 0 2023-12-05T13:26:31.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/315: chown d6/d64/d65/d40/f66 0 1 2023-12-05T13:26:31.858 INFO:tasks.workunit.client.0.smithi029.stdout:9/276: link d7/ff d7/d2c/d33/f5b 0 2023-12-05T13:26:31.859 INFO:tasks.workunit.client.0.smithi029.stdout:2/290: creat de/d16/f5c x:0 0 0 2023-12-05T13:26:31.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/508: creat d5/d2f/d3a/d86/fab x:0 0 0 2023-12-05T13:26:31.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/509: truncate d5/d2f/d75/f33 2064236 0 2023-12-05T13:26:31.879 INFO:tasks.workunit.client.0.smithi029.stdout:5/218: rename d1/dc/d11/l28 to d1/dc/d10/d1e/d33/l4a 0 2023-12-05T13:26:31.880 INFO:tasks.workunit.client.0.smithi029.stdout:2/291: dwrite f4 [0,4194304] 0 2023-12-05T13:26:31.880 INFO:tasks.workunit.client.0.smithi029.stdout:6/316: creat d6/d64/d65/d40/f6b x:0 0 0 2023-12-05T13:26:31.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/277: symlink d7/d5a/l5c 0 2023-12-05T13:26:31.882 INFO:tasks.workunit.client.0.smithi029.stdout:8/510: getdents d5/dc/d56 0 2023-12-05T13:26:31.883 INFO:tasks.workunit.client.0.smithi029.stdout:8/511: chown d5/dc/d18/l8c 873258 1 2023-12-05T13:26:31.883 INFO:tasks.workunit.client.0.smithi029.stdout:8/512: chown l1 375 1 2023-12-05T13:26:31.883 INFO:tasks.workunit.client.0.smithi029.stdout:8/513: stat d5/dc/d17/d53/f60 0 2023-12-05T13:26:31.884 INFO:tasks.workunit.client.0.smithi029.stdout:0/231: symlink dc/l51 0 2023-12-05T13:26:31.884 INFO:tasks.workunit.client.0.smithi029.stdout:0/232: dread - dc/d23/d3a/d41/f4b zero size 2023-12-05T13:26:31.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/432: rename d7/d5e/d52/d5f/d48/f4a to d7/f8f 0 2023-12-05T13:26:31.886 INFO:tasks.workunit.client.0.smithi029.stdout:5/219: mkdir d1/dc/d38/d4b 0 2023-12-05T13:26:31.887 INFO:tasks.workunit.client.0.smithi029.stdout:2/292: truncate de/f13 532966 0 2023-12-05T13:26:31.889 INFO:tasks.workunit.client.0.smithi029.stdout:6/317: symlink d6/d3f/d47/d52/d5c/l6c 0 2023-12-05T13:26:31.889 INFO:tasks.workunit.client.0.smithi029.stdout:6/318: write d6/d1d/d36/f69 [905631,20446] 0 2023-12-05T13:26:31.890 INFO:tasks.workunit.client.0.smithi029.stdout:8/514: creat d5/d2f/fac x:0 0 0 2023-12-05T13:26:31.891 INFO:tasks.workunit.client.0.smithi029.stdout:0/233: mknod dc/d23/c52 0 2023-12-05T13:26:31.891 INFO:tasks.workunit.client.0.smithi029.stdout:0/234: write dc/d13/f19 [1564257,72599] 0 2023-12-05T13:26:31.891 INFO:tasks.workunit.client.0.smithi029.stdout:0/235: chown dc 40129782 1 2023-12-05T13:26:31.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/515: dread d5/dc/d18/d26/f66 [0,4194304] 0 2023-12-05T13:26:31.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/516: chown d5/d2f/d75/f7b 242579821 1 2023-12-05T13:26:31.894 INFO:tasks.workunit.client.0.smithi029.stdout:7/528: rename d6/d50/d5b/d5f/d7d/d97/d4a/d4b/f7f to d6/d2a/d4f/d93/fa3 0 2023-12-05T13:26:31.895 INFO:tasks.workunit.client.0.smithi029.stdout:1/433: mkdir d7/d5e/d52/d90 0 2023-12-05T13:26:31.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/220: mkdir d1/dc/d25/d4c 0 2023-12-05T13:26:31.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/221: dread - d1/dc/d27/f49 zero size 2023-12-05T13:26:31.896 INFO:tasks.workunit.client.0.smithi029.stdout:5/222: dread - d1/dc/d27/f49 zero size 2023-12-05T13:26:31.897 INFO:tasks.workunit.client.0.smithi029.stdout:6/319: mkdir d6/d64/d6d 0 2023-12-05T13:26:31.898 INFO:tasks.workunit.client.0.smithi029.stdout:8/517: creat d5/d6/d59/fad x:0 0 0 2023-12-05T13:26:31.898 INFO:tasks.workunit.client.0.smithi029.stdout:8/518: fdatasync d5/d6/f51 0 2023-12-05T13:26:31.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/278: rename d7/l17 to d7/d2c/l5d 0 2023-12-05T13:26:31.901 INFO:tasks.workunit.client.0.smithi029.stdout:7/529: mkdir d6/d35/da4 0 2023-12-05T13:26:31.901 INFO:tasks.workunit.client.0.smithi029.stdout:7/530: write d6/d50/d5b/f1f [5282892,42919] 0 2023-12-05T13:26:31.902 INFO:tasks.workunit.client.0.smithi029.stdout:1/434: mknod d7/d61/d4f/c91 0 2023-12-05T13:26:31.903 INFO:tasks.workunit.client.0.smithi029.stdout:5/223: creat d1/dc/d10/d1e/d33/f4d x:0 0 0 2023-12-05T13:26:31.903 INFO:tasks.workunit.client.0.smithi029.stdout:5/224: write d1/dc/d38/f22 [1076276,108752] 0 2023-12-05T13:26:31.905 INFO:tasks.workunit.client.0.smithi029.stdout:6/320: link d6/d1d/c43 d6/d3f/d47/d52/c6e 0 2023-12-05T13:26:31.907 INFO:tasks.workunit.client.0.smithi029.stdout:9/279: mkdir d7/d19/d30/d40/d4e/d5e 0 2023-12-05T13:26:31.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/531: dread d6/d50/d5b/f29 [0,4194304] 0 2023-12-05T13:26:31.909 INFO:tasks.workunit.client.0.smithi029.stdout:0/236: dwrite dc/f1e [0,4194304] 0 2023-12-05T13:26:31.917 INFO:tasks.workunit.client.0.smithi029.stdout:1/435: creat d7/d61/f92 x:0 0 0 2023-12-05T13:26:31.917 INFO:tasks.workunit.client.0.smithi029.stdout:6/321: mkdir d6/d3f/d47/d52/d5c/d6f 0 2023-12-05T13:26:31.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/225: truncate d1/dc/d11/f12 2966780 0 2023-12-05T13:26:31.917 INFO:tasks.workunit.client.0.smithi029.stdout:1/436: write d7/d61/f92 [90164,95429] 0 2023-12-05T13:26:31.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/226: write d1/dc/d10/d1e/f47 [1403827,46635] 0 2023-12-05T13:26:31.917 INFO:tasks.workunit.client.0.smithi029.stdout:5/227: readlink d1/dc/d11/l2c 0 2023-12-05T13:26:31.918 INFO:tasks.workunit.client.0.smithi029.stdout:1/437: write d7/d5e/d52/d5f/d12/d60/f8c [75292,102623] 0 2023-12-05T13:26:31.918 INFO:tasks.workunit.client.0.smithi029.stdout:1/438: fdatasync d7/d61/f59 0 2023-12-05T13:26:31.924 INFO:tasks.workunit.client.0.smithi029.stdout:3/247: sync 2023-12-05T13:26:31.924 INFO:tasks.workunit.client.0.smithi029.stdout:4/221: sync 2023-12-05T13:26:31.924 INFO:tasks.workunit.client.0.smithi029.stdout:3/248: readlink d1/d18/l40 0 2023-12-05T13:26:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/519: symlink d5/d6/lae 0 2023-12-05T13:26:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/520: write d5/dc/f90 [4676218,32295] 0 2023-12-05T13:26:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/521: write d5/dc/f87 [782520,63050] 0 2023-12-05T13:26:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:2/293: write de/f13 [1295392,64796] 0 2023-12-05T13:26:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:4/222: write d0/da/f18 [203472,110353] 0 2023-12-05T13:26:31.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/280: dwrite d7/f18 [4194304,4194304] 0 2023-12-05T13:26:31.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/281: write d7/d19/d1f/f46 [314358,29421] 0 2023-12-05T13:26:31.928 INFO:tasks.workunit.client.0.smithi029.stdout:0/237: creat dc/d23/f53 x:0 0 0 2023-12-05T13:26:31.928 INFO:tasks.workunit.client.0.smithi029.stdout:0/238: readlink lb 0 2023-12-05T13:26:31.929 INFO:tasks.workunit.client.0.smithi029.stdout:4/223: dread d0/da/f20 [0,4194304] 0 2023-12-05T13:26:31.929 INFO:tasks.workunit.client.0.smithi029.stdout:6/322: mknod d6/d1d/d36/c70 0 2023-12-05T13:26:31.930 INFO:tasks.workunit.client.0.smithi029.stdout:5/228: symlink d1/dc/d10/l4e 0 2023-12-05T13:26:31.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/282: write d7/d19/d28/f39 [4111994,38587] 0 2023-12-05T13:26:31.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/283: chown d7/d2c/d3a/f45 1311 1 2023-12-05T13:26:31.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/284: chown d7/d19/d28/f2d 238 1 2023-12-05T13:26:31.931 INFO:tasks.workunit.client.0.smithi029.stdout:9/285: write d7/d19/d1f/f46 [1284264,85708] 0 2023-12-05T13:26:31.933 INFO:tasks.workunit.client.0.smithi029.stdout:8/522: dread d5/d2f/d75/f7b [0,4194304] 0 2023-12-05T13:26:31.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/286: write d7/f38 [1467600,33404] 0 2023-12-05T13:26:31.934 INFO:tasks.workunit.client.0.smithi029.stdout:1/439: truncate d7/d5e/d52/d5f/d12/f2d 399539 0 2023-12-05T13:26:31.944 INFO:tasks.workunit.client.0.smithi029.stdout:2/294: dwrite de/f28 [0,4194304] 0 2023-12-05T13:26:31.945 INFO:tasks.workunit.client.0.smithi029.stdout:3/249: rmdir d1/d6/d11/d4e 39 2023-12-05T13:26:31.947 INFO:tasks.workunit.client.0.smithi029.stdout:0/239: creat dc/d23/d3a/d41/f54 x:0 0 0 2023-12-05T13:26:31.949 INFO:tasks.workunit.client.0.smithi029.stdout:4/224: creat d0/d16/f4a x:0 0 0 2023-12-05T13:26:31.953 INFO:tasks.workunit.client.0.smithi029.stdout:6/323: mkdir d6/d1d/d39/d58/d71 0 2023-12-05T13:26:31.955 INFO:tasks.workunit.client.0.smithi029.stdout:8/523: dwrite d5/d2f/f68 [0,4194304] 0 2023-12-05T13:26:31.955 INFO:tasks.workunit.client.0.smithi029.stdout:5/229: creat d1/dc/d11/d17/d29/f4f x:0 0 0 2023-12-05T13:26:31.956 INFO:tasks.workunit.client.0.smithi029.stdout:9/287: dwrite d7/d19/d28/f2d [0,4194304] 0 2023-12-05T13:26:31.958 INFO:tasks.workunit.client.0.smithi029.stdout:1/440: creat d7/d5e/d52/d5f/d12/f93 x:0 0 0 2023-12-05T13:26:31.964 INFO:tasks.workunit.client.0.smithi029.stdout:2/295: symlink de/d16/d4c/l5d 0 2023-12-05T13:26:31.965 INFO:tasks.workunit.client.0.smithi029.stdout:3/250: dwrite d1/fd [0,4194304] 0 2023-12-05T13:26:31.965 INFO:tasks.workunit.client.0.smithi029.stdout:3/251: chown d1/d16/d1f/l2d 4263 1 2023-12-05T13:26:31.966 INFO:tasks.workunit.client.0.smithi029.stdout:0/240: mknod dc/d23/c55 0 2023-12-05T13:26:31.968 INFO:tasks.workunit.client.0.smithi029.stdout:4/225: unlink d0/d1/l3a 0 2023-12-05T13:26:31.973 INFO:tasks.workunit.client.0.smithi029.stdout:6/324: symlink d6/d29/d60/l72 0 2023-12-05T13:26:31.973 INFO:tasks.workunit.client.0.smithi029.stdout:5/230: unlink d1/dc/l23 0 2023-12-05T13:26:31.975 INFO:tasks.workunit.client.0.smithi029.stdout:2/296: rename de/d16/d43/f49 to de/d41/d56/d58/f5e 0 2023-12-05T13:26:31.976 INFO:tasks.workunit.client.0.smithi029.stdout:5/231: read d1/fb [3377036,4814] 0 2023-12-05T13:26:31.976 INFO:tasks.workunit.client.0.smithi029.stdout:5/232: getdents d1/dc/d25/d4c 0 2023-12-05T13:26:31.978 INFO:tasks.workunit.client.0.smithi029.stdout:1/441: dwrite d7/d61/d4f/f8a [0,4194304] 0 2023-12-05T13:26:31.978 INFO:tasks.workunit.client.0.smithi029.stdout:1/442: readlink d7/d31/l4c 0 2023-12-05T13:26:31.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/325: dread d6/fc [0,4194304] 0 2023-12-05T13:26:31.979 INFO:tasks.workunit.client.0.smithi029.stdout:1/443: readlink d7/d56/l32 0 2023-12-05T13:26:31.979 INFO:tasks.workunit.client.0.smithi029.stdout:8/524: dwrite d5/dc/f7a [0,4194304] 0 2023-12-05T13:26:31.984 INFO:tasks.workunit.client.0.smithi029.stdout:4/226: creat d0/de/d30/f4b x:0 0 0 2023-12-05T13:26:31.984 INFO:tasks.workunit.client.0.smithi029.stdout:4/227: chown d0/d16/f4a 989 1 2023-12-05T13:26:31.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/288: dwrite d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:31.984 INFO:tasks.workunit.client.0.smithi029.stdout:6/326: dread d6/f54 [0,4194304] 0 2023-12-05T13:26:31.985 INFO:tasks.workunit.client.0.smithi029.stdout:6/327: dread - d6/d64/d65/d40/d4d/f57 zero size 2023-12-05T13:26:31.985 INFO:tasks.workunit.client.0.smithi029.stdout:2/297: creat de/d16/d4c/f5f x:0 0 0 2023-12-05T13:26:31.985 INFO:tasks.workunit.client.0.smithi029.stdout:3/252: rename d1/d16/d28 to d1/d16/d36/d54 0 2023-12-05T13:26:31.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/298: read de/d14/d24/f2f [3616255,129599] 0 2023-12-05T13:26:31.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/299: fdatasync de/d14/d24/f40 0 2023-12-05T13:26:31.987 INFO:tasks.workunit.client.0.smithi029.stdout:2/300: fdatasync de/f12 0 2023-12-05T13:26:31.989 INFO:tasks.workunit.client.0.smithi029.stdout:1/444: creat d7/d31/d4b/d72/f94 x:0 0 0 2023-12-05T13:26:31.992 INFO:tasks.workunit.client.0.smithi029.stdout:9/289: dread d7/d19/f1b [0,4194304] 0 2023-12-05T13:26:31.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/525: link d5/d6/d10/d8a/f8e d5/d2f/d3a/d3c/faf 0 2023-12-05T13:26:31.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/526: dread - d5/f98 zero size 2023-12-05T13:26:31.994 INFO:tasks.workunit.client.0.smithi029.stdout:4/228: creat d0/de/d30/f4c x:0 0 0 2023-12-05T13:26:31.994 INFO:tasks.workunit.client.0.smithi029.stdout:5/233: dwrite d1/dc/d27/f49 [0,4194304] 0 2023-12-05T13:26:31.995 INFO:tasks.workunit.client.0.smithi029.stdout:6/328: symlink d6/d64/d65/d40/l73 0 2023-12-05T13:26:31.998 INFO:tasks.workunit.client.0.smithi029.stdout:0/241: rename dc/c39 to dc/d33/d47/c56 0 2023-12-05T13:26:31.999 INFO:tasks.workunit.client.0.smithi029.stdout:3/253: creat d1/d18/f55 x:0 0 0 2023-12-05T13:26:31.999 INFO:tasks.workunit.client.0.smithi029.stdout:3/254: fdatasync d1/f48 0 2023-12-05T13:26:31.999 INFO:tasks.workunit.client.0.smithi029.stdout:3/255: read - d1/d18/f55 zero size 2023-12-05T13:26:32.000 INFO:tasks.workunit.client.0.smithi029.stdout:3/256: write d1/d6/f23 [3663415,23113] 0 2023-12-05T13:26:32.000 INFO:tasks.workunit.client.0.smithi029.stdout:1/445: truncate d7/f49 367487 0 2023-12-05T13:26:32.002 INFO:tasks.workunit.client.0.smithi029.stdout:9/290: creat d7/d19/d30/d40/d4e/f5f x:0 0 0 2023-12-05T13:26:32.002 INFO:tasks.workunit.client.0.smithi029.stdout:9/291: chown d7/d19/d30/d43/f4d 6037 1 2023-12-05T13:26:32.003 INFO:tasks.workunit.client.0.smithi029.stdout:9/292: write d7/fe [1000650,125169] 0 2023-12-05T13:26:32.003 INFO:tasks.workunit.client.0.smithi029.stdout:8/527: creat d5/dc/d18/d26/fb0 x:0 0 0 2023-12-05T13:26:32.005 INFO:tasks.workunit.client.0.smithi029.stdout:4/229: rmdir d0/de/d30/d32 39 2023-12-05T13:26:32.008 INFO:tasks.workunit.client.0.smithi029.stdout:5/234: symlink d1/dc/d11/d17/l50 0 2023-12-05T13:26:32.010 INFO:tasks.workunit.client.0.smithi029.stdout:2/301: dwrite de/d11/f4f [0,4194304] 0 2023-12-05T13:26:32.010 INFO:tasks.workunit.client.0.smithi029.stdout:0/242: rmdir dc/d23/d3a 39 2023-12-05T13:26:32.011 INFO:tasks.workunit.client.0.smithi029.stdout:2/302: write de/d16/f2c [2802124,21779] 0 2023-12-05T13:26:32.012 INFO:tasks.workunit.client.0.smithi029.stdout:2/303: write de/f12 [4068825,40451] 0 2023-12-05T13:26:32.014 INFO:tasks.workunit.client.0.smithi029.stdout:3/257: unlink d1/d6/fb 0 2023-12-05T13:26:32.020 INFO:tasks.workunit.client.0.smithi029.stdout:1/446: rename d7/d31/d4b/f84 to d7/d5e/f95 0 2023-12-05T13:26:32.021 INFO:tasks.workunit.client.0.smithi029.stdout:9/293: symlink d7/d2c/d3a/d52/l60 0 2023-12-05T13:26:32.021 INFO:tasks.workunit.client.0.smithi029.stdout:9/294: truncate d7/f3c 1447649 0 2023-12-05T13:26:32.021 INFO:tasks.workunit.client.0.smithi029.stdout:8/528: creat d5/dc/d17/fb1 x:0 0 0 2023-12-05T13:26:32.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/235: symlink d1/dc/d10/d3f/l51 0 2023-12-05T13:26:32.025 INFO:tasks.workunit.client.0.smithi029.stdout:5/236: chown d1/c2 2911454 1 2023-12-05T13:26:32.026 INFO:tasks.workunit.client.0.smithi029.stdout:4/230: truncate d0/da/f20 534719 0 2023-12-05T13:26:32.029 INFO:tasks.workunit.client.0.smithi029.stdout:0/243: mkdir dc/d23/d3a/d41/d57 0 2023-12-05T13:26:32.029 INFO:tasks.workunit.client.0.smithi029.stdout:0/244: write dc/d13/f2d [2862316,90927] 0 2023-12-05T13:26:32.030 INFO:tasks.workunit.client.0.smithi029.stdout:3/258: mknod d1/d6/c56 0 2023-12-05T13:26:32.030 INFO:tasks.workunit.client.0.smithi029.stdout:3/259: readlink d1/d16/d1f/l2d 0 2023-12-05T13:26:32.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/304: dwrite de/f28 [4194304,4194304] 0 2023-12-05T13:26:32.031 INFO:tasks.workunit.client.0.smithi029.stdout:0/245: write dc/d13/f2d [2800433,2606] 0 2023-12-05T13:26:32.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/447: rename d7/d61/d77/f78 to d7/d5e/d52/d90/f96 0 2023-12-05T13:26:32.034 INFO:tasks.workunit.client.0.smithi029.stdout:9/295: unlink d7/d19/d28/f3d 0 2023-12-05T13:26:32.034 INFO:tasks.workunit.client.0.smithi029.stdout:9/296: dread - d7/d19/d30/d43/f48 zero size 2023-12-05T13:26:32.039 INFO:tasks.workunit.client.0.smithi029.stdout:6/329: write d6/fa [3076342,36197] 0 2023-12-05T13:26:32.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/237: getdents d1/dc/d25 0 2023-12-05T13:26:32.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/238: truncate d1/dc/d11/d17/d29/f4f 1020382 0 2023-12-05T13:26:32.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/239: chown d1/dc/d38/f40 61674567 1 2023-12-05T13:26:32.042 INFO:tasks.workunit.client.0.smithi029.stdout:5/240: write d1/dc/d27/f2a [287688,97933] 0 2023-12-05T13:26:32.043 INFO:tasks.workunit.client.0.smithi029.stdout:9/297: dread d7/f13 [0,4194304] 0 2023-12-05T13:26:32.043 INFO:tasks.workunit.client.0.smithi029.stdout:4/231: link d0/d16/l17 d0/de/d15/d2b/l4d 0 2023-12-05T13:26:32.061 INFO:tasks.workunit.client.0.smithi029.stdout:3/260: link d1/d6/c56 d1/d6/d11/c57 0 2023-12-05T13:26:32.061 INFO:tasks.workunit.client.0.smithi029.stdout:3/261: dread - d1/d16/d36/d4b/f53 zero size 2023-12-05T13:26:32.062 INFO:tasks.workunit.client.0.smithi029.stdout:3/262: write d1/d16/d1f/d4c/f4f [3608492,118431] 0 2023-12-05T13:26:32.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/305: symlink de/d16/l60 0 2023-12-05T13:26:32.062 INFO:tasks.workunit.client.0.smithi029.stdout:3/263: write d1/d6/fa [4793732,14058] 0 2023-12-05T13:26:32.062 INFO:tasks.workunit.client.0.smithi029.stdout:3/264: dread - d1/d6/f3f zero size 2023-12-05T13:26:32.063 INFO:tasks.workunit.client.0.smithi029.stdout:0/246: mkdir dc/d23/d3a/d41/d57/d58 0 2023-12-05T13:26:32.063 INFO:tasks.workunit.client.0.smithi029.stdout:0/247: chown dc/d33/l43 0 1 2023-12-05T13:26:32.065 INFO:tasks.workunit.client.0.smithi029.stdout:6/330: stat d6/d64/d65/l35 0 2023-12-05T13:26:32.065 INFO:tasks.workunit.client.0.smithi029.stdout:6/331: chown d6/d1d/d36/l3c 13189 1 2023-12-05T13:26:32.065 INFO:tasks.workunit.client.0.smithi029.stdout:6/332: stat d6/d64/d65/l35 0 2023-12-05T13:26:32.068 INFO:tasks.workunit.client.0.smithi029.stdout:5/241: creat d1/dc/d25/d4c/f52 x:0 0 0 2023-12-05T13:26:32.071 INFO:tasks.workunit.client.0.smithi029.stdout:4/232: creat d0/de/d15/f4e x:0 0 0 2023-12-05T13:26:32.071 INFO:tasks.workunit.client.0.smithi029.stdout:3/265: creat d1/d16/d36/d4b/f58 x:0 0 0 2023-12-05T13:26:32.071 INFO:tasks.workunit.client.0.smithi029.stdout:4/233: fdatasync d0/de/d30/f3b 0 2023-12-05T13:26:32.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/306: dread de/d14/d24/f1c [0,4194304] 0 2023-12-05T13:26:32.075 INFO:tasks.workunit.client.0.smithi029.stdout:0/248: dread dc/d13/f2d [0,4194304] 0 2023-12-05T13:26:32.075 INFO:tasks.workunit.client.0.smithi029.stdout:8/529: rename d5/d6/d59/c93 to d5/d2f/d3a/d3c/da2/cb2 0 2023-12-05T13:26:32.077 INFO:tasks.workunit.client.0.smithi029.stdout:5/242: creat d1/dc/d38/d4b/f53 x:0 0 0 2023-12-05T13:26:32.078 INFO:tasks.workunit.client.0.smithi029.stdout:4/234: mkdir d0/d16/d22/d4f 0 2023-12-05T13:26:32.083 INFO:tasks.workunit.client.0.smithi029.stdout:1/448: rename d7/d5e/d52/d5f/d12/c69 to d7/c97 0 2023-12-05T13:26:32.084 INFO:tasks.workunit.client.0.smithi029.stdout:5/243: write d1/dc/d27/f49 [3766714,104589] 0 2023-12-05T13:26:32.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/307: dread de/d11/f25 [0,4194304] 0 2023-12-05T13:26:32.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/308: fsync de/d16/f2b 0 2023-12-05T13:26:32.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/309: readlink de/d14/d24/l54 0 2023-12-05T13:26:32.086 INFO:tasks.workunit.client.0.smithi029.stdout:8/530: creat d5/fb3 x:0 0 0 2023-12-05T13:26:32.086 INFO:tasks.workunit.client.0.smithi029.stdout:4/235: symlink d0/de/d15/l50 0 2023-12-05T13:26:32.086 INFO:tasks.workunit.client.0.smithi029.stdout:6/333: dwrite d6/d64/d65/d40/f66 [0,4194304] 0 2023-12-05T13:26:32.086 INFO:tasks.workunit.client.0.smithi029.stdout:6/334: readlink d6/d64/d65/l33 0 2023-12-05T13:26:32.088 INFO:tasks.workunit.client.0.smithi029.stdout:9/298: rename d7/f38 to d7/d19/d1f/f61 0 2023-12-05T13:26:32.088 INFO:tasks.workunit.client.0.smithi029.stdout:9/299: chown d7/d19/f32 172987816 1 2023-12-05T13:26:32.091 INFO:tasks.workunit.client.0.smithi029.stdout:5/244: symlink d1/dc/d38/d3a/l54 0 2023-12-05T13:26:32.093 INFO:tasks.workunit.client.0.smithi029.stdout:2/310: symlink de/d16/d43/l61 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/311: truncate de/d14/f35 500658 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/312: fdatasync fb 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/313: readlink l8 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:2/314: write de/d16/f2b [215154,68476] 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:3/266: dwrite d1/d10/f41 [0,4194304] 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/300: write d7/d2c/d3a/f45 [570710,59234] 0 2023-12-05T13:26:32.094 INFO:tasks.workunit.client.0.smithi029.stdout:9/301: dread - d7/d19/d30/d43/f48 zero size 2023-12-05T13:26:32.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/531: unlink d5/dc/d18/f57 0 2023-12-05T13:26:32.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/236: creat d0/d1/f51 x:0 0 0 2023-12-05T13:26:32.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/237: fdatasync d0/f2e 0 2023-12-05T13:26:32.101 INFO:tasks.workunit.client.0.smithi029.stdout:1/449: dwrite d7/f53 [0,4194304] 0 2023-12-05T13:26:32.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/267: read d1/d6/fa [4498132,28884] 0 2023-12-05T13:26:32.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/268: readlink d1/d10/l46 0 2023-12-05T13:26:32.101 INFO:tasks.workunit.client.0.smithi029.stdout:3/269: write d1/d6/f2a [4595925,80509] 0 2023-12-05T13:26:32.102 INFO:tasks.workunit.client.0.smithi029.stdout:5/245: mkdir d1/dc/d38/d55 0 2023-12-05T13:26:32.103 INFO:tasks.workunit.client.0.smithi029.stdout:3/270: write d1/fd [1329561,19818] 0 2023-12-05T13:26:32.103 INFO:tasks.workunit.client.0.smithi029.stdout:6/335: dwrite d6/d1d/d36/f4c [0,4194304] 0 2023-12-05T13:26:32.103 INFO:tasks.workunit.client.0.smithi029.stdout:2/315: mkdir de/d14/d62 0 2023-12-05T13:26:32.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/316: fdatasync de/d14/d24/f1c 0 2023-12-05T13:26:32.107 INFO:tasks.workunit.client.0.smithi029.stdout:8/532: symlink d5/d6/d10/d8a/lb4 0 2023-12-05T13:26:32.107 INFO:tasks.workunit.client.0.smithi029.stdout:8/533: truncate d5/fb3 1038835 0 2023-12-05T13:26:32.107 INFO:tasks.workunit.client.0.smithi029.stdout:8/534: write d5/d6/fa3 [270008,130401] 0 2023-12-05T13:26:32.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/302: unlink d7/ff 0 2023-12-05T13:26:32.109 INFO:tasks.workunit.client.0.smithi029.stdout:4/238: link d0/d16/l17 d0/de/d30/d32/d35/d3d/l52 0 2023-12-05T13:26:32.114 INFO:tasks.workunit.client.0.smithi029.stdout:5/246: truncate d1/f7 1985709 0 2023-12-05T13:26:32.116 INFO:tasks.workunit.client.0.smithi029.stdout:3/271: dread d1/d18/f20 [0,4194304] 0 2023-12-05T13:26:32.122 INFO:tasks.workunit.client.0.smithi029.stdout:6/336: truncate d6/d1d/d36/f69 210534 0 2023-12-05T13:26:32.122 INFO:tasks.workunit.client.0.smithi029.stdout:8/535: creat d5/d2f/d3a/d3c/da2/fb5 x:0 0 0 2023-12-05T13:26:32.127 INFO:tasks.workunit.client.0.smithi029.stdout:1/450: dwrite d7/d31/d4b/d72/f94 [0,4194304] 0 2023-12-05T13:26:32.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/303: truncate d7/d19/f32 1286598 0 2023-12-05T13:26:32.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/304: fsync d7/fe 0 2023-12-05T13:26:32.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/305: chown d7/d19/d30/l55 29843 1 2023-12-05T13:26:32.127 INFO:tasks.workunit.client.0.smithi029.stdout:9/306: chown d7/d2c 8072878 1 2023-12-05T13:26:32.127 INFO:tasks.workunit.client.0.smithi029.stdout:4/239: link d0/de/d15/f4e d0/d41/f53 0 2023-12-05T13:26:32.129 INFO:tasks.workunit.client.0.smithi029.stdout:9/307: write d7/d2c/d3a/f45 [2042364,57945] 0 2023-12-05T13:26:32.132 INFO:tasks.workunit.client.0.smithi029.stdout:5/247: rename d1/fb to d1/dc/d11/f56 0 2023-12-05T13:26:32.135 INFO:tasks.workunit.client.0.smithi029.stdout:2/317: dwrite de/d16/f47 [0,4194304] 0 2023-12-05T13:26:32.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/240: dread d0/de/d30/d32/d35/f47 [0,4194304] 0 2023-12-05T13:26:32.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/241: readlink d0/de/d30/d32/d35/d3d/l42 0 2023-12-05T13:26:32.137 INFO:tasks.workunit.client.0.smithi029.stdout:4/242: write d0/da/f39 [261589,60647] 0 2023-12-05T13:26:32.139 INFO:tasks.workunit.client.0.smithi029.stdout:8/536: mkdir d5/d6/d10/d8a/db6 0 2023-12-05T13:26:32.142 INFO:tasks.workunit.client.0.smithi029.stdout:2/318: write de/d16/f47 [1983244,37467] 0 2023-12-05T13:26:32.142 INFO:tasks.workunit.client.0.smithi029.stdout:2/319: stat de/c17 0 2023-12-05T13:26:32.146 INFO:tasks.workunit.client.0.smithi029.stdout:0/249: dwrite dc/d13/f28 [0,4194304] 0 2023-12-05T13:26:32.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/250: write dc/d23/f2b [1598364,95097] 0 2023-12-05T13:26:32.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/251: chown dc/d23/d3a/d41/c49 121 1 2023-12-05T13:26:32.152 INFO:tasks.workunit.client.0.smithi029.stdout:0/252: fdatasync dc/d33/f38 0 2023-12-05T13:26:32.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/337: rmdir d6/d1d 39 2023-12-05T13:26:32.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/338: dread - d6/d1d/d36/f42 zero size 2023-12-05T13:26:32.153 INFO:tasks.workunit.client.0.smithi029.stdout:6/339: write d6/d3f/d47/f53 [474107,27926] 0 2023-12-05T13:26:32.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/248: dwrite d1/dc/d38/d4b/f53 [0,4194304] 0 2023-12-05T13:26:32.157 INFO:tasks.workunit.client.0.smithi029.stdout:9/308: dwrite d7/f13 [0,4194304] 0 2023-12-05T13:26:32.158 INFO:tasks.workunit.client.0.smithi029.stdout:5/249: dread d1/dc/d27/f2a [0,4194304] 0 2023-12-05T13:26:32.158 INFO:tasks.workunit.client.0.smithi029.stdout:4/243: symlink d0/d3c/l54 0 2023-12-05T13:26:32.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/244: truncate d0/de/d15/d2b/f43 670864 0 2023-12-05T13:26:32.159 INFO:tasks.workunit.client.0.smithi029.stdout:4/245: chown d0/d1/fc 117 1 2023-12-05T13:26:32.164 INFO:tasks.workunit.client.0.smithi029.stdout:0/253: rename dc/d13/f19 to dc/d23/d3a/d41/d57/f59 0 2023-12-05T13:26:32.166 INFO:tasks.workunit.client.0.smithi029.stdout:9/309: creat d7/d19/d30/d43/f62 x:0 0 0 2023-12-05T13:26:32.167 INFO:tasks.workunit.client.0.smithi029.stdout:8/537: dwrite d5/dc/d18/d26/f66 [0,4194304] 0 2023-12-05T13:26:32.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/246: rmdir d0/de 39 2023-12-05T13:26:32.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/247: readlink d0/d1/l1e 0 2023-12-05T13:26:32.169 INFO:tasks.workunit.client.0.smithi029.stdout:6/340: rename d6/d3f/d47 to d6/d64/d65/d40/d74 0 2023-12-05T13:26:32.170 INFO:tasks.workunit.client.0.smithi029.stdout:8/538: mkdir d5/d6/d10/d13/db7 0 2023-12-05T13:26:32.171 INFO:tasks.workunit.client.0.smithi029.stdout:2/320: dwrite f4 [0,4194304] 0 2023-12-05T13:26:32.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/248: rename d0/de/d15/d2b/f43 to d0/de/d30/d32/d35/f55 0 2023-12-05T13:26:32.174 INFO:tasks.workunit.client.0.smithi029.stdout:8/539: rmdir d5/d2f 39 2023-12-05T13:26:32.174 INFO:tasks.workunit.client.0.smithi029.stdout:8/540: write d5/dc/d18/d26/f64 [1258193,78285] 0 2023-12-05T13:26:32.174 INFO:tasks.workunit.client.0.smithi029.stdout:8/541: fsync d5/d2f/f7d 0 2023-12-05T13:26:32.175 INFO:tasks.workunit.client.0.smithi029.stdout:4/249: mkdir d0/d3c/d56 0 2023-12-05T13:26:32.176 INFO:tasks.workunit.client.0.smithi029.stdout:8/542: dread d5/d6/fa3 [0,4194304] 0 2023-12-05T13:26:32.177 INFO:tasks.workunit.client.0.smithi029.stdout:8/543: read - d5/d6/d59/f72 zero size 2023-12-05T13:26:32.184 INFO:tasks.workunit.client.0.smithi029.stdout:4/250: dread d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:32.184 INFO:tasks.workunit.client.0.smithi029.stdout:4/251: truncate d0/de/d30/d32/d35/f47 4628072 0 2023-12-05T13:26:32.185 INFO:tasks.workunit.client.0.smithi029.stdout:4/252: chown d0/de/d15/d2b 112446 1 2023-12-05T13:26:32.185 INFO:tasks.workunit.client.0.smithi029.stdout:5/250: dwrite d1/dc/d38/f40 [0,4194304] 0 2023-12-05T13:26:32.186 INFO:tasks.workunit.client.0.smithi029.stdout:4/253: creat d0/de/d30/d32/d35/d3d/f57 x:0 0 0 2023-12-05T13:26:32.187 INFO:tasks.workunit.client.0.smithi029.stdout:6/341: dread d6/d64/d65/f28 [0,4194304] 0 2023-12-05T13:26:32.187 INFO:tasks.workunit.client.0.smithi029.stdout:0/254: dwrite dc/d23/d3a/d41/f4b [0,4194304] 0 2023-12-05T13:26:32.190 INFO:tasks.workunit.client.0.smithi029.stdout:9/310: write d7/d2c/d33/f5b [5817492,88804] 0 2023-12-05T13:26:32.191 INFO:tasks.workunit.client.0.smithi029.stdout:2/321: dread f6 [4194304,4194304] 0 2023-12-05T13:26:32.192 INFO:tasks.workunit.client.0.smithi029.stdout:5/251: rmdir d1/dc/d27 39 2023-12-05T13:26:32.193 INFO:tasks.workunit.client.0.smithi029.stdout:4/254: rmdir d0/de/d30/d32 39 2023-12-05T13:26:32.198 INFO:tasks.workunit.client.0.smithi029.stdout:0/255: creat dc/f5a x:0 0 0 2023-12-05T13:26:32.202 INFO:tasks.workunit.client.0.smithi029.stdout:2/322: link de/d16/d4c/l5d de/d41/d56/d58/l63 0 2023-12-05T13:26:32.202 INFO:tasks.workunit.client.0.smithi029.stdout:5/252: mkdir d1/dc/d38/d55/d57 0 2023-12-05T13:26:32.203 INFO:tasks.workunit.client.0.smithi029.stdout:6/342: dwrite d6/fc [0,4194304] 0 2023-12-05T13:26:32.204 INFO:tasks.workunit.client.0.smithi029.stdout:6/343: truncate d6/fe 4494205 0 2023-12-05T13:26:32.204 INFO:tasks.workunit.client.0.smithi029.stdout:2/323: write de/d11/f4f [1684318,40946] 0 2023-12-05T13:26:32.204 INFO:tasks.workunit.client.0.smithi029.stdout:4/255: creat d0/de/d30/d32/d35/f58 x:0 0 0 2023-12-05T13:26:32.206 INFO:tasks.workunit.client.0.smithi029.stdout:0/256: link dc/d33/f38 dc/d23/d3a/d41/d57/f5b 0 2023-12-05T13:26:32.207 INFO:tasks.workunit.client.0.smithi029.stdout:6/344: symlink d6/d64/d65/d40/d74/d52/d5c/d6f/l75 0 2023-12-05T13:26:32.209 INFO:tasks.workunit.client.0.smithi029.stdout:2/324: rename de/d14/l53 to de/d16/d4c/l64 0 2023-12-05T13:26:32.210 INFO:tasks.workunit.client.0.smithi029.stdout:4/256: dread d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:32.211 INFO:tasks.workunit.client.0.smithi029.stdout:0/257: unlink dc/f29 0 2023-12-05T13:26:32.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/257: write d0/de/d30/f3b [2195984,78301] 0 2023-12-05T13:26:32.211 INFO:tasks.workunit.client.0.smithi029.stdout:4/258: dread - d0/de/d15/f4e zero size 2023-12-05T13:26:32.213 INFO:tasks.workunit.client.0.smithi029.stdout:6/345: unlink d6/d1d/c1e 0 2023-12-05T13:26:32.215 INFO:tasks.workunit.client.0.smithi029.stdout:4/259: creat d0/d16/d22/d4f/f59 x:0 0 0 2023-12-05T13:26:32.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/260: creat d0/de/d30/d32/d35/d3d/f5a x:0 0 0 2023-12-05T13:26:32.216 INFO:tasks.workunit.client.0.smithi029.stdout:4/261: write d0/d41/f53 [735658,99715] 0 2023-12-05T13:26:32.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/253: dwrite d1/dc/d11/d17/d29/f4f [0,4194304] 0 2023-12-05T13:26:32.223 INFO:tasks.workunit.client.0.smithi029.stdout:5/254: getdents d1/dc/d25 0 2023-12-05T13:26:32.227 INFO:tasks.workunit.client.0.smithi029.stdout:0/258: dwrite dc/f31 [0,4194304] 0 2023-12-05T13:26:32.228 INFO:tasks.workunit.client.0.smithi029.stdout:6/346: dread d6/f4f [0,4194304] 0 2023-12-05T13:26:32.229 INFO:tasks.workunit.client.0.smithi029.stdout:6/347: fsync d6/f10 0 2023-12-05T13:26:32.229 INFO:tasks.workunit.client.0.smithi029.stdout:5/255: dread d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:32.233 INFO:tasks.workunit.client.0.smithi029.stdout:5/256: truncate d1/dc/d11/d17/d29/f43 142499 0 2023-12-05T13:26:32.235 INFO:tasks.workunit.client.0.smithi029.stdout:5/257: creat d1/dc/d11/d17/d3d/f58 x:0 0 0 2023-12-05T13:26:32.240 INFO:tasks.workunit.client.0.smithi029.stdout:5/258: creat d1/dc/d11/f59 x:0 0 0 2023-12-05T13:26:32.240 INFO:tasks.workunit.client.0.smithi029.stdout:0/259: dread dc/f16 [0,4194304] 0 2023-12-05T13:26:32.240 INFO:tasks.workunit.client.0.smithi029.stdout:5/259: write d1/dc/d38/f1a [4277464,1742] 0 2023-12-05T13:26:32.245 INFO:tasks.workunit.client.0.smithi029.stdout:0/260: link dc/f27 dc/d23/d3a/d41/d57/d58/f5c 0 2023-12-05T13:26:32.246 INFO:tasks.workunit.client.0.smithi029.stdout:6/348: dwrite d6/d64/d65/d40/f41 [0,4194304] 0 2023-12-05T13:26:32.246 INFO:tasks.workunit.client.0.smithi029.stdout:6/349: dread - d6/d5a/f5d zero size 2023-12-05T13:26:32.246 INFO:tasks.workunit.client.0.smithi029.stdout:2/325: dwrite de/d11/f4f [0,4194304] 0 2023-12-05T13:26:32.246 INFO:tasks.workunit.client.0.smithi029.stdout:2/326: fdatasync de/d16/d43/f46 0 2023-12-05T13:26:32.247 INFO:tasks.workunit.client.0.smithi029.stdout:2/327: chown de/d14/d24/f19 6749 1 2023-12-05T13:26:32.247 INFO:tasks.workunit.client.0.smithi029.stdout:0/261: getdents dc/d23/d3a/d41 0 2023-12-05T13:26:32.250 INFO:tasks.workunit.client.0.smithi029.stdout:5/260: dread d1/dc/d38/f40 [0,4194304] 0 2023-12-05T13:26:32.251 INFO:tasks.workunit.client.0.smithi029.stdout:6/350: rename d6/d1d/f2b to d6/f76 0 2023-12-05T13:26:32.252 INFO:tasks.workunit.client.0.smithi029.stdout:2/328: creat de/d14/f65 x:0 0 0 2023-12-05T13:26:32.252 INFO:tasks.workunit.client.0.smithi029.stdout:2/329: chown de/d14/d24/l54 4586 1 2023-12-05T13:26:32.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/262: creat dc/d23/d3a/d41/d57/f5d x:0 0 0 2023-12-05T13:26:32.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/263: fsync dc/f3f 0 2023-12-05T13:26:32.256 INFO:tasks.workunit.client.0.smithi029.stdout:6/351: rmdir d6/d64 39 2023-12-05T13:26:32.262 INFO:tasks.workunit.client.0.smithi029.stdout:0/264: creat dc/d23/d3a/d41/f5e x:0 0 0 2023-12-05T13:26:32.264 INFO:tasks.workunit.client.0.smithi029.stdout:6/352: symlink d6/d29/l77 0 2023-12-05T13:26:32.275 INFO:tasks.workunit.client.0.smithi029.stdout:2/330: dwrite de/d14/f35 [0,4194304] 0 2023-12-05T13:26:32.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/265: dwrite dc/d23/d3a/d41/d57/f5b [0,4194304] 0 2023-12-05T13:26:32.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/353: dwrite d6/d1d/d36/f48 [0,4194304] 0 2023-12-05T13:26:32.291 INFO:tasks.workunit.client.0.smithi029.stdout:6/354: write d6/d5a/f5d [896456,35515] 0 2023-12-05T13:26:32.291 INFO:tasks.workunit.client.0.smithi029.stdout:6/355: dread - d6/d64/d65/d40/d4d/f57 zero size 2023-12-05T13:26:32.291 INFO:tasks.workunit.client.0.smithi029.stdout:2/331: creat de/d14/d62/f66 x:0 0 0 2023-12-05T13:26:32.294 INFO:tasks.workunit.client.0.smithi029.stdout:0/266: unlink dc/d13/f1b 0 2023-12-05T13:26:32.307 INFO:tasks.workunit.client.0.smithi029.stdout:6/356: dwrite d6/d64/d65/d40/f41 [0,4194304] 0 2023-12-05T13:26:32.307 INFO:tasks.workunit.client.0.smithi029.stdout:6/357: stat d6/d1d/d39/l6a 0 2023-12-05T13:26:32.308 INFO:tasks.workunit.client.0.smithi029.stdout:2/332: creat de/d41/d56/f67 x:0 0 0 2023-12-05T13:26:32.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/267: unlink dc/d23/f53 0 2023-12-05T13:26:32.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/268: write dc/f2f [913214,82473] 0 2023-12-05T13:26:32.318 INFO:tasks.workunit.client.0.smithi029.stdout:6/358: link d6/d64/d65/c2d d6/d1d/d39/c78 0 2023-12-05T13:26:32.319 INFO:tasks.workunit.client.0.smithi029.stdout:2/333: creat de/d14/d62/f68 x:0 0 0 2023-12-05T13:26:32.319 INFO:tasks.workunit.client.0.smithi029.stdout:2/334: dread - de/d16/f5c zero size 2023-12-05T13:26:32.319 INFO:tasks.workunit.client.0.smithi029.stdout:2/335: fsync de/d14/d24/f1c 0 2023-12-05T13:26:32.320 INFO:tasks.workunit.client.0.smithi029.stdout:0/269: truncate dc/f2c 711438 0 2023-12-05T13:26:32.320 INFO:tasks.workunit.client.0.smithi029.stdout:6/359: symlink d6/d64/d6d/l79 0 2023-12-05T13:26:32.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/360: rmdir d6/d64/d65/d40/d74/d52/d5c/d6f 39 2023-12-05T13:26:32.323 INFO:tasks.workunit.client.0.smithi029.stdout:0/270: write dc/d13/f28 [640380,22063] 0 2023-12-05T13:26:32.323 INFO:tasks.workunit.client.0.smithi029.stdout:0/271: read - dc/d23/f2e zero size 2023-12-05T13:26:32.323 INFO:tasks.workunit.client.0.smithi029.stdout:0/272: chown dc/d13/f2d 1928403 1 2023-12-05T13:26:32.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/273: read dc/d23/f2b [3113302,102070] 0 2023-12-05T13:26:32.325 INFO:tasks.workunit.client.0.smithi029.stdout:0/274: chown dc/d23/d3a/d41/d57/d58 66194491 1 2023-12-05T13:26:32.325 INFO:tasks.workunit.client.0.smithi029.stdout:6/361: write d6/f10 [2103375,94554] 0 2023-12-05T13:26:32.326 INFO:tasks.workunit.client.0.smithi029.stdout:6/362: symlink d6/d64/d65/d40/d74/d52/l7a 0 2023-12-05T13:26:32.327 INFO:tasks.workunit.client.0.smithi029.stdout:6/363: symlink d6/d3f/l7b 0 2023-12-05T13:26:32.328 INFO:tasks.workunit.client.0.smithi029.stdout:6/364: write d6/d1d/d39/f44 [2920764,10209] 0 2023-12-05T13:26:32.338 INFO:tasks.workunit.client.0.smithi029.stdout:0/275: dwrite dc/ff [0,4194304] 0 2023-12-05T13:26:32.350 INFO:tasks.workunit.client.0.smithi029.stdout:0/276: link dc/d33/l4c dc/l5f 0 2023-12-05T13:26:32.350 INFO:tasks.workunit.client.0.smithi029.stdout:0/277: chown f9 16 1 2023-12-05T13:26:32.350 INFO:tasks.workunit.client.0.smithi029.stdout:0/278: fdatasync dc/d33/f38 0 2023-12-05T13:26:32.351 INFO:tasks.workunit.client.0.smithi029.stdout:0/279: mknod dc/c60 0 2023-12-05T13:26:32.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/280: dwrite dc/d23/d3a/d41/d57/f59 [0,4194304] 0 2023-12-05T13:26:32.365 INFO:tasks.workunit.client.0.smithi029.stdout:0/281: truncate dc/f16 7135978 0 2023-12-05T13:26:32.366 INFO:tasks.workunit.client.0.smithi029.stdout:0/282: rename dc/f1e to dc/d23/d3a/d41/d57/d58/f61 0 2023-12-05T13:26:32.366 INFO:tasks.workunit.client.0.smithi029.stdout:0/283: truncate dc/d23/d3a/d41/d57/d58/f61 4427271 0 2023-12-05T13:26:32.366 INFO:tasks.workunit.client.0.smithi029.stdout:0/284: write dc/d33/f38 [5172445,50119] 0 2023-12-05T13:26:32.368 INFO:tasks.workunit.client.0.smithi029.stdout:0/285: mknod dc/d33/c62 0 2023-12-05T13:26:32.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/286: mkdir dc/d13/d4f/d63 0 2023-12-05T13:26:32.376 INFO:tasks.workunit.client.0.smithi029.stdout:0/287: dread dc/d13/f34 [0,4194304] 0 2023-12-05T13:26:32.392 INFO:tasks.workunit.client.0.smithi029.stdout:0/288: dwrite dc/f14 [0,4194304] 0 2023-12-05T13:26:32.393 INFO:tasks.workunit.client.0.smithi029.stdout:0/289: creat dc/d33/d3d/f64 x:0 0 0 2023-12-05T13:26:32.412 INFO:tasks.workunit.client.0.smithi029.stdout:0/290: dwrite dc/d33/f46 [0,4194304] 0 2023-12-05T13:26:32.412 INFO:tasks.workunit.client.0.smithi029.stdout:0/291: mkdir dc/d33/d3d/d65 0 2023-12-05T13:26:32.414 INFO:tasks.workunit.client.0.smithi029.stdout:0/292: unlink dc/d33/l3c 0 2023-12-05T13:26:32.417 INFO:tasks.workunit.client.0.smithi029.stdout:0/293: getdents dc/d33/d3d 0 2023-12-05T13:26:32.417 INFO:tasks.workunit.client.0.smithi029.stdout:0/294: chown dc/d23/d3a/d41/d57/d58 3 1 2023-12-05T13:26:32.434 INFO:tasks.workunit.client.0.smithi029.stdout:0/295: dwrite dc/d23/d3a/d41/d57/f5d [0,4194304] 0 2023-12-05T13:26:32.435 INFO:tasks.workunit.client.0.smithi029.stdout:0/296: rmdir dc/d23/d3a 39 2023-12-05T13:26:32.435 INFO:tasks.workunit.client.0.smithi029.stdout:0/297: dread - dc/d23/f2e zero size 2023-12-05T13:26:32.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/298: creat dc/d33/d47/f66 x:0 0 0 2023-12-05T13:26:32.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/299: chown dc/f5a 133952473 1 2023-12-05T13:26:32.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/300: dwrite dc/f35 [0,4194304] 0 2023-12-05T13:26:32.452 INFO:tasks.workunit.client.0.smithi029.stdout:0/301: dread dc/d23/d3a/d41/d57/d58/f5c [0,4194304] 0 2023-12-05T13:26:32.453 INFO:tasks.workunit.client.0.smithi029.stdout:0/302: symlink dc/d13/d4f/d63/l67 0 2023-12-05T13:26:32.609 INFO:tasks.workunit.client.0.smithi029.stdout:7/532: sync 2023-12-05T13:26:32.609 INFO:tasks.workunit.client.0.smithi029.stdout:7/533: truncate d6/d2a/d71/f94 385032 0 2023-12-05T13:26:32.610 INFO:tasks.workunit.client.0.smithi029.stdout:7/534: creat d6/d35/d3e/d40/d52/fa5 x:0 0 0 2023-12-05T13:26:32.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/535: mknod d6/d35/ca6 0 2023-12-05T13:26:32.611 INFO:tasks.workunit.client.0.smithi029.stdout:7/536: chown d6/d2a/d66 19 1 2023-12-05T13:26:32.613 INFO:tasks.workunit.client.0.smithi029.stdout:7/537: link d6/d50/d5b/f4e d6/d2a/d2f/fa7 0 2023-12-05T13:26:32.614 INFO:tasks.workunit.client.0.smithi029.stdout:7/538: write d6/d50/d5b/d1a/d26/f5e [523065,22327] 0 2023-12-05T13:26:32.625 INFO:tasks.workunit.client.0.smithi029.stdout:7/539: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:32.627 INFO:tasks.workunit.client.0.smithi029.stdout:7/540: rename d6/d50/d5b/d1a/f27 to d6/d35/d3e/fa8 0 2023-12-05T13:26:32.627 INFO:tasks.workunit.client.0.smithi029.stdout:7/541: chown d6/d50/d5b/d1a/d26/d82 26592 1 2023-12-05T13:26:32.627 INFO:tasks.workunit.client.0.smithi029.stdout:7/542: write d6/d50/d5b/d1a/d26/d6e/f86 [308275,11166] 0 2023-12-05T13:26:32.644 INFO:tasks.workunit.client.0.smithi029.stdout:7/543: dwrite d6/d35/d70/f8c [0,4194304] 0 2023-12-05T13:26:32.644 INFO:tasks.workunit.client.0.smithi029.stdout:7/544: write d6/d50/d5b/d1a/d26/f59 [4819897,85799] 0 2023-12-05T13:26:32.646 INFO:tasks.workunit.client.0.smithi029.stdout:7/545: dread d6/d50/d5b/f4e [0,4194304] 0 2023-12-05T13:26:32.648 INFO:tasks.workunit.client.0.smithi029.stdout:7/546: mkdir d6/d50/d5b/d1a/d26/d6e/d8b/da9 0 2023-12-05T13:26:32.652 INFO:tasks.workunit.client.0.smithi029.stdout:7/547: dread d6/d50/d5b/d1a/d26/f59 [4194304,4194304] 0 2023-12-05T13:26:32.660 INFO:tasks.workunit.client.0.smithi029.stdout:7/548: dread d6/d50/f64 [0,4194304] 0 2023-12-05T13:26:32.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/549: mknod d6/d50/d5b/d5f/d7d/d96/caa 0 2023-12-05T13:26:32.661 INFO:tasks.workunit.client.0.smithi029.stdout:7/550: getdents d6/d50/d5b/d1a/d26/d72 0 2023-12-05T13:26:32.662 INFO:tasks.workunit.client.0.smithi029.stdout:7/551: mknod d6/d50/d5b/d5f/cab 0 2023-12-05T13:26:32.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/552: rmdir d6 39 2023-12-05T13:26:32.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/553: stat d6/d50/c3a 0 2023-12-05T13:26:32.668 INFO:tasks.workunit.client.0.smithi029.stdout:7/554: write d6/d50/f64 [1141528,97687] 0 2023-12-05T13:26:32.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/555: unlink d6/d50/d5b/d1a/d26/f87 0 2023-12-05T13:26:32.670 INFO:tasks.workunit.client.0.smithi029.stdout:7/556: write d6/f15 [1605651,130711] 0 2023-12-05T13:26:32.670 INFO:tasks.workunit.client.0.smithi029.stdout:7/557: chown d6/d2a/d2f/d89 80210601 1 2023-12-05T13:26:32.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/558: unlink d6/d2a/d2f/c79 0 2023-12-05T13:26:32.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/559: symlink d6/d35/d3e/d40/d52/lac 0 2023-12-05T13:26:32.689 INFO:tasks.workunit.client.0.smithi029.stdout:7/560: dwrite d6/d50/d5b/d1a/d26/f59 [0,4194304] 0 2023-12-05T13:26:32.838 INFO:tasks.workunit.client.0.smithi029.stdout:3/272: sync 2023-12-05T13:26:32.861 INFO:tasks.workunit.client.0.smithi029.stdout:3/273: dwrite d1/d18/f38 [0,4194304] 0 2023-12-05T13:26:32.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/274: dread d1/d6/f2a [0,4194304] 0 2023-12-05T13:26:32.869 INFO:tasks.workunit.client.0.smithi029.stdout:3/275: readlink d1/d10/l46 0 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/311: sync 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:2/336: sync 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/451: sync 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/365: sync 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:9/312: getdents d7/d19/d30/d40/d4e/d5e 0 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:4/262: sync 2023-12-05T13:26:32.870 INFO:tasks.workunit.client.0.smithi029.stdout:5/261: sync 2023-12-05T13:26:32.871 INFO:tasks.workunit.client.0.smithi029.stdout:5/262: write d1/dc/d11/f56 [4214678,35765] 0 2023-12-05T13:26:32.871 INFO:tasks.workunit.client.0.smithi029.stdout:3/276: write d1/d16/d1f/d4c/f4f [1132765,83559] 0 2023-12-05T13:26:32.872 INFO:tasks.workunit.client.0.smithi029.stdout:2/337: mknod de/d41/d56/d58/c69 0 2023-12-05T13:26:32.872 INFO:tasks.workunit.client.0.smithi029.stdout:2/338: chown de/d11 514908 1 2023-12-05T13:26:32.872 INFO:tasks.workunit.client.0.smithi029.stdout:6/366: rmdir d6/d64/d65/d40/d74/d52/d5c 39 2023-12-05T13:26:32.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/313: dread d7/f3c [0,4194304] 0 2023-12-05T13:26:32.875 INFO:tasks.workunit.client.0.smithi029.stdout:4/263: mknod d0/de/d30/c5b 0 2023-12-05T13:26:32.877 INFO:tasks.workunit.client.0.smithi029.stdout:5/263: rename d1/f7 to d1/dc/d38/d55/f5a 0 2023-12-05T13:26:32.878 INFO:tasks.workunit.client.0.smithi029.stdout:3/277: symlink d1/d6/d11/d4e/l59 0 2023-12-05T13:26:32.880 INFO:tasks.workunit.client.0.smithi029.stdout:2/339: mkdir de/d6a 0 2023-12-05T13:26:32.880 INFO:tasks.workunit.client.0.smithi029.stdout:2/340: chown de/d11/f25 12197 1 2023-12-05T13:26:32.881 INFO:tasks.workunit.client.0.smithi029.stdout:6/367: mknod d6/d64/d65/d40/d74/c7c 0 2023-12-05T13:26:32.882 INFO:tasks.workunit.client.0.smithi029.stdout:9/314: creat d7/d2c/d33/f63 x:0 0 0 2023-12-05T13:26:32.882 INFO:tasks.workunit.client.0.smithi029.stdout:5/264: creat d1/dc/d11/d17/d3d/f5b x:0 0 0 2023-12-05T13:26:32.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/341: getdents de/d11/d32 0 2023-12-05T13:26:32.885 INFO:tasks.workunit.client.0.smithi029.stdout:2/342: write de/d14/d24/f1c [1108051,62100] 0 2023-12-05T13:26:32.885 INFO:tasks.workunit.client.0.smithi029.stdout:5/265: write d1/dc/d11/f35 [1492129,122124] 0 2023-12-05T13:26:32.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/368: creat d6/d1d/d36/f7d x:0 0 0 2023-12-05T13:26:32.888 INFO:tasks.workunit.client.0.smithi029.stdout:9/315: fsync d7/d2c/d33/f59 0 2023-12-05T13:26:32.890 INFO:tasks.workunit.client.0.smithi029.stdout:8/544: sync 2023-12-05T13:26:32.890 INFO:tasks.workunit.client.0.smithi029.stdout:0/303: sync 2023-12-05T13:26:32.890 INFO:tasks.workunit.client.0.smithi029.stdout:4/264: dread d0/d1/fc [0,4194304] 0 2023-12-05T13:26:32.890 INFO:tasks.workunit.client.0.smithi029.stdout:4/265: readlink d0/de/d30/d32/d35/d3d/l42 0 2023-12-05T13:26:32.891 INFO:tasks.workunit.client.0.smithi029.stdout:0/304: write dc/f5a [524819,25250] 0 2023-12-05T13:26:32.891 INFO:tasks.workunit.client.0.smithi029.stdout:1/452: dwrite d7/d61/f7e [0,4194304] 0 2023-12-05T13:26:32.904 INFO:tasks.workunit.client.0.smithi029.stdout:6/369: mknod d6/d64/d65/d40/d4d/c7e 0 2023-12-05T13:26:32.904 INFO:tasks.workunit.client.0.smithi029.stdout:9/316: mkdir d7/d2c/d3a/d64 0 2023-12-05T13:26:32.904 INFO:tasks.workunit.client.0.smithi029.stdout:0/305: symlink dc/d33/d47/l68 0 2023-12-05T13:26:32.904 INFO:tasks.workunit.client.0.smithi029.stdout:3/278: dwrite d1/d6/f3c [0,4194304] 0 2023-12-05T13:26:32.906 INFO:tasks.workunit.client.0.smithi029.stdout:5/266: rmdir d1 39 2023-12-05T13:26:32.906 INFO:tasks.workunit.client.0.smithi029.stdout:0/306: write dc/d13/f1c [490043,74025] 0 2023-12-05T13:26:32.908 INFO:tasks.workunit.client.0.smithi029.stdout:3/279: write d1/d6/f3c [1685796,67712] 0 2023-12-05T13:26:32.908 INFO:tasks.workunit.client.0.smithi029.stdout:6/370: mkdir d6/d64/d65/d40/d4d/d7f 0 2023-12-05T13:26:32.909 INFO:tasks.workunit.client.0.smithi029.stdout:9/317: mkdir d7/d19/d28/d65 0 2023-12-05T13:26:32.910 INFO:tasks.workunit.client.0.smithi029.stdout:5/267: mkdir d1/dc/d38/d3a/d5c 0 2023-12-05T13:26:32.911 INFO:tasks.workunit.client.0.smithi029.stdout:0/307: rmdir dc/d23/d3a/d41/d57 39 2023-12-05T13:26:32.913 INFO:tasks.workunit.client.0.smithi029.stdout:6/371: mknod d6/d64/d65/d40/d74/d59/c80 0 2023-12-05T13:26:32.913 INFO:tasks.workunit.client.0.smithi029.stdout:6/372: write d6/d64/d65/d40/f6b [5800,20687] 0 2023-12-05T13:26:32.913 INFO:tasks.workunit.client.0.smithi029.stdout:6/373: read d6/d64/d65/d40/f41 [3585342,40361] 0 2023-12-05T13:26:32.913 INFO:tasks.workunit.client.0.smithi029.stdout:5/268: truncate d1/dc/d11/d17/d29/f4f 3163225 0 2023-12-05T13:26:32.915 INFO:tasks.workunit.client.0.smithi029.stdout:0/308: rename dc/d23/c52 to dc/d23/d3a/d41/d57/d58/c69 0 2023-12-05T13:26:32.916 INFO:tasks.workunit.client.0.smithi029.stdout:6/374: unlink d6/d64/d65/f3d 0 2023-12-05T13:26:32.917 INFO:tasks.workunit.client.0.smithi029.stdout:2/343: dwrite de/d14/d24/f40 [0,4194304] 0 2023-12-05T13:26:32.918 INFO:tasks.workunit.client.0.smithi029.stdout:0/309: creat dc/d23/f6a x:0 0 0 2023-12-05T13:26:32.918 INFO:tasks.workunit.client.0.smithi029.stdout:0/310: chown dc/f2a 311700 1 2023-12-05T13:26:32.918 INFO:tasks.workunit.client.0.smithi029.stdout:4/266: dwrite d0/da/f20 [0,4194304] 0 2023-12-05T13:26:32.918 INFO:tasks.workunit.client.0.smithi029.stdout:4/267: write d0/de/d30/f4c [196510,39610] 0 2023-12-05T13:26:32.919 INFO:tasks.workunit.client.0.smithi029.stdout:6/375: link d6/d64/d65/d40/l73 d6/d64/d65/d40/d74/d52/d5c/l81 0 2023-12-05T13:26:32.919 INFO:tasks.workunit.client.0.smithi029.stdout:3/280: dread d1/d16/d36/d3a/f3d [0,4194304] 0 2023-12-05T13:26:32.920 INFO:tasks.workunit.client.0.smithi029.stdout:3/281: chown d1/d6/f23 116843252 1 2023-12-05T13:26:32.920 INFO:tasks.workunit.client.0.smithi029.stdout:3/282: readlink d1/d6/d11/l1c 0 2023-12-05T13:26:32.922 INFO:tasks.workunit.client.0.smithi029.stdout:2/344: symlink de/d11/d32/l6b 0 2023-12-05T13:26:32.924 INFO:tasks.workunit.client.0.smithi029.stdout:0/311: unlink dc/f2a 0 2023-12-05T13:26:32.925 INFO:tasks.workunit.client.0.smithi029.stdout:2/345: write f6 [2087840,124183] 0 2023-12-05T13:26:32.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/346: write de/d16/d4c/f5f [421863,60494] 0 2023-12-05T13:26:32.926 INFO:tasks.workunit.client.0.smithi029.stdout:2/347: chown de/c17 1640949094 1 2023-12-05T13:26:32.927 INFO:tasks.workunit.client.0.smithi029.stdout:4/268: unlink d0/da/c3e 0 2023-12-05T13:26:32.929 INFO:tasks.workunit.client.0.smithi029.stdout:3/283: truncate d1/d6/d11/f12 3772717 0 2023-12-05T13:26:32.929 INFO:tasks.workunit.client.0.smithi029.stdout:3/284: fdatasync d1/d6/f52 0 2023-12-05T13:26:32.931 INFO:tasks.workunit.client.0.smithi029.stdout:0/312: creat dc/d13/d4f/f6b x:0 0 0 2023-12-05T13:26:32.933 INFO:tasks.workunit.client.0.smithi029.stdout:4/269: creat d0/d16/d22/d4f/f5c x:0 0 0 2023-12-05T13:26:32.933 INFO:tasks.workunit.client.0.smithi029.stdout:4/270: readlink d0/de/d15/d2b/l4d 0 2023-12-05T13:26:32.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/318: dwrite d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:32.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/285: symlink d1/d16/d36/d54/l5a 0 2023-12-05T13:26:32.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/286: fdatasync d1/d18/f1d 0 2023-12-05T13:26:32.935 INFO:tasks.workunit.client.0.smithi029.stdout:3/287: chown d1/d16/d1f/l2d 10820 1 2023-12-05T13:26:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:3/288: dread d1/d6/f52 [0,4194304] 0 2023-12-05T13:26:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:4/271: symlink d0/d16/d22/l5d 0 2023-12-05T13:26:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:4/272: chown d0/l13 1416 1 2023-12-05T13:26:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:3/289: dread d1/d6/f52 [0,4194304] 0 2023-12-05T13:26:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:4/273: rename d0/d3c/l54 to d0/d16/d2f/l5e 0 2023-12-05T13:26:32.938 INFO:tasks.workunit.client.0.smithi029.stdout:4/274: truncate d0/d16/d22/d4f/f59 57553 0 2023-12-05T13:26:32.939 INFO:tasks.workunit.client.0.smithi029.stdout:3/290: creat d1/d10/f5b x:0 0 0 2023-12-05T13:26:32.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/291: write d1/d18/f55 [842275,62439] 0 2023-12-05T13:26:32.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/292: chown d1/d10 33253345 1 2023-12-05T13:26:32.942 INFO:tasks.workunit.client.0.smithi029.stdout:5/269: truncate d1/dc/d11/f35 2024054 0 2023-12-05T13:26:32.944 INFO:tasks.workunit.client.0.smithi029.stdout:5/270: mknod d1/dc/d11/c5d 0 2023-12-05T13:26:32.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/376: dwrite d6/f45 [0,4194304] 0 2023-12-05T13:26:32.958 INFO:tasks.workunit.client.0.smithi029.stdout:6/377: write d6/f18 [748276,124725] 0 2023-12-05T13:26:32.962 INFO:tasks.workunit.client.0.smithi029.stdout:0/313: dwrite dc/d13/f28 [4194304,4194304] 0 2023-12-05T13:26:32.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/348: dwrite fa [4194304,4194304] 0 2023-12-05T13:26:32.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/349: write de/d14/d62/f68 [660099,38333] 0 2023-12-05T13:26:32.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/350: readlink de/d11/l44 0 2023-12-05T13:26:32.967 INFO:tasks.workunit.client.0.smithi029.stdout:2/351: write de/d16/f47 [3384419,105292] 0 2023-12-05T13:26:32.967 INFO:tasks.workunit.client.0.smithi029.stdout:0/314: dread f1 [0,4194304] 0 2023-12-05T13:26:32.967 INFO:tasks.workunit.client.0.smithi029.stdout:3/293: dwrite d1/d10/f41 [0,4194304] 0 2023-12-05T13:26:32.967 INFO:tasks.workunit.client.0.smithi029.stdout:3/294: truncate d1/d10/f5b 374381 0 2023-12-05T13:26:32.968 INFO:tasks.workunit.client.0.smithi029.stdout:3/295: chown d1/d16/d1f/d4c 3 1 2023-12-05T13:26:32.968 INFO:tasks.workunit.client.0.smithi029.stdout:9/319: dwrite d7/d19/d30/d43/f62 [0,4194304] 0 2023-12-05T13:26:32.968 INFO:tasks.workunit.client.0.smithi029.stdout:2/352: write de/d14/d24/f2f [311345,117176] 0 2023-12-05T13:26:32.970 INFO:tasks.workunit.client.0.smithi029.stdout:3/296: mknod d1/d6/c5c 0 2023-12-05T13:26:32.978 INFO:tasks.workunit.client.0.smithi029.stdout:3/297: dread d1/d18/f20 [0,4194304] 0 2023-12-05T13:26:32.981 INFO:tasks.workunit.client.0.smithi029.stdout:0/315: dwrite dc/d13/f2d [0,4194304] 0 2023-12-05T13:26:32.981 INFO:tasks.workunit.client.0.smithi029.stdout:2/353: mkdir de/d16/d6c 0 2023-12-05T13:26:32.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/320: rename d7/f9 to d7/d2c/d33/f66 0 2023-12-05T13:26:32.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/321: read - d7/d19/d1f/f4f zero size 2023-12-05T13:26:32.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/322: dread - d7/d19/d30/d40/d4e/f5f zero size 2023-12-05T13:26:32.985 INFO:tasks.workunit.client.0.smithi029.stdout:3/298: getdents d1/d6/d11/d4e 0 2023-12-05T13:26:32.986 INFO:tasks.workunit.client.0.smithi029.stdout:2/354: rename de/d41/d56/l57 to de/d41/l6d 0 2023-12-05T13:26:32.988 INFO:tasks.workunit.client.0.smithi029.stdout:3/299: creat d1/d10/f5d x:0 0 0 2023-12-05T13:26:32.992 INFO:tasks.workunit.client.0.smithi029.stdout:0/316: dread dc/d13/f28 [4194304,4194304] 0 2023-12-05T13:26:32.992 INFO:tasks.workunit.client.0.smithi029.stdout:0/317: fdatasync dc/d13/f34 0 2023-12-05T13:26:32.992 INFO:tasks.workunit.client.0.smithi029.stdout:2/355: fdatasync de/d16/f47 0 2023-12-05T13:26:32.992 INFO:tasks.workunit.client.0.smithi029.stdout:2/356: fdatasync de/d14/f39 0 2023-12-05T13:26:32.992 INFO:tasks.workunit.client.0.smithi029.stdout:2/357: chown de/d6a 131193749 1 2023-12-05T13:26:32.993 INFO:tasks.workunit.client.0.smithi029.stdout:9/323: dread d7/fe [0,4194304] 0 2023-12-05T13:26:32.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/318: symlink dc/d23/d3a/l6c 0 2023-12-05T13:26:32.995 INFO:tasks.workunit.client.0.smithi029.stdout:7/561: sync 2023-12-05T13:26:32.995 INFO:tasks.workunit.client.0.smithi029.stdout:7/562: write d6/d2a/d2f/f91 [315038,71935] 0 2023-12-05T13:26:32.998 INFO:tasks.workunit.client.0.smithi029.stdout:7/563: write d6/d35/d3e/fa8 [2317354,58864] 0 2023-12-05T13:26:32.998 INFO:tasks.workunit.client.0.smithi029.stdout:3/300: dread d1/f25 [0,4194304] 0 2023-12-05T13:26:33.000 INFO:tasks.workunit.client.0.smithi029.stdout:7/564: mkdir d6/d2a/d2f/d89/dad 0 2023-12-05T13:26:33.000 INFO:tasks.workunit.client.0.smithi029.stdout:7/565: readlink d6/d50/d5b/l1d 0 2023-12-05T13:26:33.002 INFO:tasks.workunit.client.0.smithi029.stdout:3/301: dread d1/d18/f2e [0,4194304] 0 2023-12-05T13:26:33.007 INFO:tasks.workunit.client.0.smithi029.stdout:9/324: write d7/d19/d1f/f61 [129872,44501] 0 2023-12-05T13:26:33.009 INFO:tasks.workunit.client.0.smithi029.stdout:9/325: truncate d7/d19/d28/f37 455868 0 2023-12-05T13:26:33.009 INFO:tasks.workunit.client.0.smithi029.stdout:9/326: mkdir d7/d19/d30/d43/d67 0 2023-12-05T13:26:33.010 INFO:tasks.workunit.client.0.smithi029.stdout:9/327: mkdir d7/d2c/d68 0 2023-12-05T13:26:33.011 INFO:tasks.workunit.client.0.smithi029.stdout:9/328: fdatasync d7/f18 0 2023-12-05T13:26:33.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/358: dwrite de/d14/d24/f19 [0,4194304] 0 2023-12-05T13:26:33.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/359: readlink de/d14/l37 0 2023-12-05T13:26:33.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/360: fdatasync de/d11/f30 0 2023-12-05T13:26:33.017 INFO:tasks.workunit.client.0.smithi029.stdout:2/361: rename de/d14/f21 to de/d14/d62/f6e 0 2023-12-05T13:26:33.018 INFO:tasks.workunit.client.0.smithi029.stdout:3/302: dread d1/d16/d36/d3a/f3d [0,4194304] 0 2023-12-05T13:26:33.020 INFO:tasks.workunit.client.0.smithi029.stdout:0/319: dwrite dc/f5a [0,4194304] 0 2023-12-05T13:26:33.020 INFO:tasks.workunit.client.0.smithi029.stdout:0/320: chown dc/d23 140820 1 2023-12-05T13:26:33.020 INFO:tasks.workunit.client.0.smithi029.stdout:2/362: write de/d11/f25 [1933972,28259] 0 2023-12-05T13:26:33.023 INFO:tasks.workunit.client.0.smithi029.stdout:3/303: truncate d1/d10/f5b 43129 0 2023-12-05T13:26:33.023 INFO:tasks.workunit.client.0.smithi029.stdout:3/304: chown d1/d6/d11/d4e/l50 4129964 1 2023-12-05T13:26:33.026 INFO:tasks.workunit.client.0.smithi029.stdout:0/321: dread f1 [0,4194304] 0 2023-12-05T13:26:33.026 INFO:tasks.workunit.client.0.smithi029.stdout:0/322: chown dc/d13/f1c 7156722 1 2023-12-05T13:26:33.027 INFO:tasks.workunit.client.0.smithi029.stdout:9/329: truncate d7/d19/d1f/f61 1550631 0 2023-12-05T13:26:33.030 INFO:tasks.workunit.client.0.smithi029.stdout:9/330: link d7/d19/d1f/f46 d7/d19/d28/d65/f69 0 2023-12-05T13:26:33.031 INFO:tasks.workunit.client.0.smithi029.stdout:7/566: dwrite d6/f63 [0,4194304] 0 2023-12-05T13:26:33.032 INFO:tasks.workunit.client.0.smithi029.stdout:9/331: symlink d7/d19/d30/l6a 0 2023-12-05T13:26:33.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/323: symlink dc/l6d 0 2023-12-05T13:26:33.034 INFO:tasks.workunit.client.0.smithi029.stdout:7/567: dread d6/d50/d5b/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:33.035 INFO:tasks.workunit.client.0.smithi029.stdout:7/568: stat d6/d19/f25 0 2023-12-05T13:26:33.035 INFO:tasks.workunit.client.0.smithi029.stdout:7/569: fsync d6/d19/f34 0 2023-12-05T13:26:33.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/363: dwrite de/d41/d56/f67 [0,4194304] 0 2023-12-05T13:26:33.037 INFO:tasks.workunit.client.0.smithi029.stdout:9/332: mknod d7/d19/d30/d43/c6b 0 2023-12-05T13:26:33.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/324: rename dc/f32 to dc/d23/d3a/d41/f6e 0 2023-12-05T13:26:33.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/570: rmdir d6/d50/d5b/d5f/d7d/d97/d51 39 2023-12-05T13:26:33.040 INFO:tasks.workunit.client.0.smithi029.stdout:0/325: chown dc/d13/f28 1821 1 2023-12-05T13:26:33.043 INFO:tasks.workunit.client.0.smithi029.stdout:9/333: creat d7/d2c/d68/f6c x:0 0 0 2023-12-05T13:26:33.044 INFO:tasks.workunit.client.0.smithi029.stdout:0/326: creat dc/d23/f6f x:0 0 0 2023-12-05T13:26:33.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/305: dwrite d1/d6/d11/f12 [0,4194304] 0 2023-12-05T13:26:33.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/306: truncate d1/d6/f3f 640249 0 2023-12-05T13:26:33.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/307: stat d1/d6/c17 0 2023-12-05T13:26:33.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/308: chown d1/d16/d1f/d4c 14 1 2023-12-05T13:26:33.045 INFO:tasks.workunit.client.0.smithi029.stdout:3/309: write d1/d18/f45 [9109586,5864] 0 2023-12-05T13:26:33.045 INFO:tasks.workunit.client.0.smithi029.stdout:7/571: mknod d6/d35/d5c/cae 0 2023-12-05T13:26:33.049 INFO:tasks.workunit.client.0.smithi029.stdout:7/572: dread d6/d50/f64 [0,4194304] 0 2023-12-05T13:26:33.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/364: dread fa [4194304,4194304] 0 2023-12-05T13:26:33.054 INFO:tasks.workunit.client.0.smithi029.stdout:0/327: rmdir dc/d23/d3a/d41 39 2023-12-05T13:26:33.055 INFO:tasks.workunit.client.0.smithi029.stdout:2/365: creat de/d41/d56/f6f x:0 0 0 2023-12-05T13:26:33.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/366: chown de/d14/l37 32252 1 2023-12-05T13:26:33.056 INFO:tasks.workunit.client.0.smithi029.stdout:2/367: chown de/d16/f2b 9 1 2023-12-05T13:26:33.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/328: mkdir dc/d23/d3a/d41/d70 0 2023-12-05T13:26:33.057 INFO:tasks.workunit.client.0.smithi029.stdout:2/368: symlink de/d16/d4c/l70 0 2023-12-05T13:26:33.057 INFO:tasks.workunit.client.0.smithi029.stdout:2/369: getdents de/d16/d6c 0 2023-12-05T13:26:33.057 INFO:tasks.workunit.client.0.smithi029.stdout:2/370: readlink de/d16/d43/l61 0 2023-12-05T13:26:33.057 INFO:tasks.workunit.client.0.smithi029.stdout:2/371: getdents de/d6a 0 2023-12-05T13:26:33.058 INFO:tasks.workunit.client.0.smithi029.stdout:0/329: creat dc/d23/d3a/f71 x:0 0 0 2023-12-05T13:26:33.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/372: mknod de/d14/d62/c71 0 2023-12-05T13:26:33.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/373: dread - de/d14/f65 zero size 2023-12-05T13:26:33.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/330: mknod dc/d33/d47/c72 0 2023-12-05T13:26:33.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/331: chown dc/d33/l42 1294 1 2023-12-05T13:26:33.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/332: fsync dc/d23/d3a/d41/d57/f5b 0 2023-12-05T13:26:33.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/333: fsync dc/fd 0 2023-12-05T13:26:33.061 INFO:tasks.workunit.client.0.smithi029.stdout:2/374: creat de/d16/d43/f72 x:0 0 0 2023-12-05T13:26:33.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/375: dread de/d16/d43/f46 [0,4194304] 0 2023-12-05T13:26:33.062 INFO:tasks.workunit.client.0.smithi029.stdout:0/334: mkdir dc/d23/d3a/d41/d57/d58/d73 0 2023-12-05T13:26:33.064 INFO:tasks.workunit.client.0.smithi029.stdout:0/335: read dc/f14 [2212858,89260] 0 2023-12-05T13:26:33.064 INFO:tasks.workunit.client.0.smithi029.stdout:0/336: truncate dc/d23/d3a/d41/d57/f59 5000692 0 2023-12-05T13:26:33.064 INFO:tasks.workunit.client.0.smithi029.stdout:0/337: stat dc/d13/d4f 0 2023-12-05T13:26:33.064 INFO:tasks.workunit.client.0.smithi029.stdout:2/376: dread de/d16/f2b [0,4194304] 0 2023-12-05T13:26:33.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/338: write dc/d23/d3a/d41/d57/f5d [1228604,7856] 0 2023-12-05T13:26:33.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/339: chown dc/d33/l3e 0 1 2023-12-05T13:26:33.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/340: fsync dc/d23/d3a/d41/d57/d58/f61 0 2023-12-05T13:26:33.065 INFO:tasks.workunit.client.0.smithi029.stdout:0/341: chown dc/ff 256938 1 2023-12-05T13:26:33.066 INFO:tasks.workunit.client.0.smithi029.stdout:2/377: rename de/d16/d4c/f5f to de/d14/d24/f73 0 2023-12-05T13:26:33.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/378: creat de/d14/d24/f74 x:0 0 0 2023-12-05T13:26:33.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/379: truncate de/d11/f26 1107500 0 2023-12-05T13:26:33.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/380: creat de/d41/d56/f75 x:0 0 0 2023-12-05T13:26:33.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/381: truncate de/d16/d43/f72 72948 0 2023-12-05T13:26:33.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/382: stat de/d11/c1e 0 2023-12-05T13:26:33.070 INFO:tasks.workunit.client.0.smithi029.stdout:2/383: mknod de/d11/c76 0 2023-12-05T13:26:33.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/342: dwrite f0 [4194304,4194304] 0 2023-12-05T13:26:33.085 INFO:tasks.workunit.client.0.smithi029.stdout:2/384: dwrite de/d16/f5c [0,4194304] 0 2023-12-05T13:26:33.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/343: readlink dc/d33/l3e 0 2023-12-05T13:26:33.085 INFO:tasks.workunit.client.0.smithi029.stdout:0/344: chown dc/d23/d3a/l6c 886 1 2023-12-05T13:26:33.087 INFO:tasks.workunit.client.0.smithi029.stdout:0/345: creat dc/d23/d3a/f74 x:0 0 0 2023-12-05T13:26:33.088 INFO:tasks.workunit.client.0.smithi029.stdout:0/346: link dc/l51 dc/d23/d3a/d41/d57/l75 0 2023-12-05T13:26:33.089 INFO:tasks.workunit.client.0.smithi029.stdout:0/347: creat dc/d13/f76 x:0 0 0 2023-12-05T13:26:33.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/348: truncate dc/d23/d3a/d41/f4b 2276608 0 2023-12-05T13:26:33.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/349: dread - dc/d33/d3d/f64 zero size 2023-12-05T13:26:33.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/350: dread - dc/d23/f6a zero size 2023-12-05T13:26:33.090 INFO:tasks.workunit.client.0.smithi029.stdout:2/385: dread fa [4194304,4194304] 0 2023-12-05T13:26:33.090 INFO:tasks.workunit.client.0.smithi029.stdout:0/351: getdents dc/d13/d4f 0 2023-12-05T13:26:33.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/386: truncate fa 5403579 0 2023-12-05T13:26:33.098 INFO:tasks.workunit.client.0.smithi029.stdout:0/352: dread dc/fe [0,4194304] 0 2023-12-05T13:26:33.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/353: getdents dc/d13 0 2023-12-05T13:26:33.100 INFO:tasks.workunit.client.0.smithi029.stdout:0/354: readlink dc/d33/l3e 0 2023-12-05T13:26:33.101 INFO:tasks.workunit.client.0.smithi029.stdout:2/387: dread de/d16/f2c [0,4194304] 0 2023-12-05T13:26:33.101 INFO:tasks.workunit.client.0.smithi029.stdout:0/355: dread f6 [0,4194304] 0 2023-12-05T13:26:33.102 INFO:tasks.workunit.client.0.smithi029.stdout:2/388: write f4 [5383506,100328] 0 2023-12-05T13:26:33.103 INFO:tasks.workunit.client.0.smithi029.stdout:0/356: getdents dc 0 2023-12-05T13:26:33.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/389: unlink de/d16/d4c/l70 0 2023-12-05T13:26:33.106 INFO:tasks.workunit.client.0.smithi029.stdout:0/357: creat dc/d23/d3a/d41/d57/f77 x:0 0 0 2023-12-05T13:26:33.106 INFO:tasks.workunit.client.0.smithi029.stdout:0/358: truncate dc/d23/f2e 564849 0 2023-12-05T13:26:33.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/390: link de/d11/d32/c4a de/c77 0 2023-12-05T13:26:33.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/391: chown de/l4d 6945864 1 2023-12-05T13:26:33.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/392: creat de/d41/f78 x:0 0 0 2023-12-05T13:26:33.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/393: write de/d41/f51 [1760716,2414] 0 2023-12-05T13:26:33.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/394: mknod de/d41/d56/d58/c79 0 2023-12-05T13:26:33.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/395: creat de/d14/d62/f7a x:0 0 0 2023-12-05T13:26:33.113 INFO:tasks.workunit.client.0.smithi029.stdout:2/396: mknod de/d6a/c7b 0 2023-12-05T13:26:33.114 INFO:tasks.workunit.client.0.smithi029.stdout:2/397: write de/d41/d56/f67 [2847671,123992] 0 2023-12-05T13:26:33.116 INFO:tasks.workunit.client.0.smithi029.stdout:2/398: creat de/d16/d6c/f7c x:0 0 0 2023-12-05T13:26:33.116 INFO:tasks.workunit.client.0.smithi029.stdout:2/399: read - de/d11/d32/f5a zero size 2023-12-05T13:26:33.118 INFO:tasks.workunit.client.0.smithi029.stdout:0/359: dread dc/fd [0,4194304] 0 2023-12-05T13:26:33.132 INFO:tasks.workunit.client.0.smithi029.stdout:1/453: sync 2023-12-05T13:26:33.133 INFO:tasks.workunit.client.0.smithi029.stdout:1/454: write d7/d5e/d52/d5f/d12/f44 [921044,95731] 0 2023-12-05T13:26:33.133 INFO:tasks.workunit.client.0.smithi029.stdout:1/455: write d7/f13 [1305541,126012] 0 2023-12-05T13:26:33.133 INFO:tasks.workunit.client.0.smithi029.stdout:0/360: dwrite dc/f14 [0,4194304] 0 2023-12-05T13:26:33.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/456: write d7/f8f [3053537,106254] 0 2023-12-05T13:26:33.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/457: truncate d7/d31/d4b/d72/f83 1038138 0 2023-12-05T13:26:33.134 INFO:tasks.workunit.client.0.smithi029.stdout:0/361: mknod dc/d23/d3a/d41/c78 0 2023-12-05T13:26:33.135 INFO:tasks.workunit.client.0.smithi029.stdout:1/458: dread d7/d6e/f86 [0,4194304] 0 2023-12-05T13:26:33.137 INFO:tasks.workunit.client.0.smithi029.stdout:0/362: link dc/c25 dc/d23/d3a/d41/c79 0 2023-12-05T13:26:33.138 INFO:tasks.workunit.client.0.smithi029.stdout:1/459: creat d7/d5e/d52/d5f/d48/f98 x:0 0 0 2023-12-05T13:26:33.142 INFO:tasks.workunit.client.0.smithi029.stdout:1/460: dread d7/d61/d4f/f6c [0,4194304] 0 2023-12-05T13:26:33.142 INFO:tasks.workunit.client.0.smithi029.stdout:1/461: fdatasync d7/f53 0 2023-12-05T13:26:33.142 INFO:tasks.workunit.client.0.smithi029.stdout:1/462: mknod d7/d5e/c99 0 2023-12-05T13:26:33.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/363: dread f1 [0,4194304] 0 2023-12-05T13:26:33.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/364: write f0 [9170337,13448] 0 2023-12-05T13:26:33.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/365: readlink dc/d13/l30 0 2023-12-05T13:26:33.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/366: read - dc/d23/d3a/f74 zero size 2023-12-05T13:26:33.143 INFO:tasks.workunit.client.0.smithi029.stdout:0/367: mkdir dc/d33/d3d/d7a 0 2023-12-05T13:26:33.145 INFO:tasks.workunit.client.0.smithi029.stdout:0/368: unlink dc/d13/f76 0 2023-12-05T13:26:33.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/463: dwrite d7/d5e/d52/d5f/d12/f74 [0,4194304] 0 2023-12-05T13:26:33.162 INFO:tasks.workunit.client.0.smithi029.stdout:0/369: dwrite dc/d33/d3d/f64 [0,4194304] 0 2023-12-05T13:26:33.162 INFO:tasks.workunit.client.0.smithi029.stdout:0/370: write dc/d33/d3d/f64 [3791654,125230] 0 2023-12-05T13:26:33.166 INFO:tasks.workunit.client.0.smithi029.stdout:0/371: mknod dc/d23/d3a/d41/d57/d58/c7b 0 2023-12-05T13:26:33.167 INFO:tasks.workunit.client.0.smithi029.stdout:0/372: mknod dc/d33/d3d/c7c 0 2023-12-05T13:26:33.169 INFO:tasks.workunit.client.0.smithi029.stdout:0/373: creat dc/d23/d3a/d41/d57/d58/f7d x:0 0 0 2023-12-05T13:26:33.170 INFO:tasks.workunit.client.0.smithi029.stdout:1/464: dread d7/d31/f3d [0,4194304] 0 2023-12-05T13:26:33.170 INFO:tasks.workunit.client.0.smithi029.stdout:1/465: truncate d7/d31/f8b 947553 0 2023-12-05T13:26:33.172 INFO:tasks.workunit.client.0.smithi029.stdout:0/374: unlink dc/d33/d47/f66 0 2023-12-05T13:26:33.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/466: symlink d7/d6e/l9a 0 2023-12-05T13:26:33.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/375: mkdir dc/d33/d3d/d7e 0 2023-12-05T13:26:33.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/376: readlink dc/l6d 0 2023-12-05T13:26:33.176 INFO:tasks.workunit.client.0.smithi029.stdout:0/377: truncate dc/d23/d3a/d41/f4b 3003340 0 2023-12-05T13:26:33.177 INFO:tasks.workunit.client.0.smithi029.stdout:0/378: write dc/d13/f2d [1989410,93732] 0 2023-12-05T13:26:33.179 INFO:tasks.workunit.client.0.smithi029.stdout:0/379: symlink dc/d23/d3a/d41/d57/d58/l7f 0 2023-12-05T13:26:33.181 INFO:tasks.workunit.client.0.smithi029.stdout:0/380: creat dc/f80 x:0 0 0 2023-12-05T13:26:33.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/381: creat dc/d23/d3a/d41/d70/f81 x:0 0 0 2023-12-05T13:26:33.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/382: dwrite dc/d13/d4f/f6b [0,4194304] 0 2023-12-05T13:26:33.200 INFO:tasks.workunit.client.0.smithi029.stdout:0/383: write f6 [943477,106811] 0 2023-12-05T13:26:33.215 INFO:tasks.workunit.client.0.smithi029.stdout:0/384: dwrite dc/d13/f28 [4194304,4194304] 0 2023-12-05T13:26:33.230 INFO:tasks.workunit.client.0.smithi029.stdout:0/385: dwrite dc/d23/f2b [0,4194304] 0 2023-12-05T13:26:33.231 INFO:tasks.workunit.client.0.smithi029.stdout:0/386: read dc/d13/d4f/f6b [527544,61831] 0 2023-12-05T13:26:33.232 INFO:tasks.workunit.client.0.smithi029.stdout:0/387: creat dc/d23/d3a/d41/d70/f82 x:0 0 0 2023-12-05T13:26:33.235 INFO:tasks.workunit.client.0.smithi029.stdout:0/388: getdents dc/d23/d3a/d41/d70 0 2023-12-05T13:26:33.236 INFO:tasks.workunit.client.0.smithi029.stdout:0/389: fsync dc/d23/d3a/d41/d57/f59 0 2023-12-05T13:26:33.237 INFO:tasks.workunit.client.0.smithi029.stdout:0/390: getdents dc/d23 0 2023-12-05T13:26:33.237 INFO:tasks.workunit.client.0.smithi029.stdout:0/391: dread - dc/d23/d3a/d41/d70/f81 zero size 2023-12-05T13:26:33.253 INFO:tasks.workunit.client.0.smithi029.stdout:0/392: dwrite dc/fd [0,4194304] 0 2023-12-05T13:26:33.254 INFO:tasks.workunit.client.0.smithi029.stdout:0/393: unlink dc/d33/f46 0 2023-12-05T13:26:33.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/394: dwrite dc/d23/d3a/f74 [0,4194304] 0 2023-12-05T13:26:33.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/395: read - dc/d23/d3a/d41/f5e zero size 2023-12-05T13:26:33.270 INFO:tasks.workunit.client.0.smithi029.stdout:0/396: getdents dc/d23 0 2023-12-05T13:26:33.272 INFO:tasks.workunit.client.0.smithi029.stdout:0/397: mkdir dc/d13/d4f/d83 0 2023-12-05T13:26:33.274 INFO:tasks.workunit.client.0.smithi029.stdout:0/398: fdatasync dc/d23/d3a/d41/d57/d58/f5c 0 2023-12-05T13:26:33.279 INFO:tasks.workunit.client.0.smithi029.stdout:0/399: rmdir dc/d23 39 2023-12-05T13:26:33.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/400: mkdir dc/d33/d3d/d7a/d84 0 2023-12-05T13:26:33.281 INFO:tasks.workunit.client.0.smithi029.stdout:0/401: readlink dc/d13/l30 0 2023-12-05T13:26:33.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/402: write dc/d23/d3a/d41/d57/d58/f61 [335616,101785] 0 2023-12-05T13:26:33.284 INFO:tasks.workunit.client.0.smithi029.stdout:0/403: mkdir dc/d33/d3d/d65/d85 0 2023-12-05T13:26:33.284 INFO:tasks.workunit.client.0.smithi029.stdout:0/404: stat dc/d23/d3a/d41 0 2023-12-05T13:26:33.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/405: dwrite dc/d23/d3a/d41/f54 [0,4194304] 0 2023-12-05T13:26:33.313 INFO:tasks.workunit.client.0.smithi029.stdout:0/406: write dc/fe [23422,58574] 0 2023-12-05T13:26:33.314 INFO:tasks.workunit.client.0.smithi029.stdout:0/407: dread - dc/d23/d3a/f71 zero size 2023-12-05T13:26:33.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/408: mkdir dc/d23/d3a/d41/d57/d58/d73/d86 0 2023-12-05T13:26:33.317 INFO:tasks.workunit.client.0.smithi029.stdout:0/409: creat dc/d13/d4f/d63/f87 x:0 0 0 2023-12-05T13:26:33.317 INFO:tasks.workunit.client.0.smithi029.stdout:0/410: chown dc/d33/c4e 3990327 1 2023-12-05T13:26:33.317 INFO:tasks.workunit.client.0.smithi029.stdout:0/411: write dc/d13/f2d [2050154,114797] 0 2023-12-05T13:26:33.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/412: mkdir dc/d13/d4f/d88 0 2023-12-05T13:26:33.327 INFO:tasks.workunit.client.0.smithi029.stdout:0/413: dread dc/d13/f1c [0,4194304] 0 2023-12-05T13:26:33.327 INFO:tasks.workunit.client.0.smithi029.stdout:0/414: stat dc/ff 0 2023-12-05T13:26:33.327 INFO:tasks.workunit.client.0.smithi029.stdout:0/415: rmdir dc/d33/d3d/d65 39 2023-12-05T13:26:33.328 INFO:tasks.workunit.client.0.smithi029.stdout:0/416: symlink dc/d23/d3a/d41/d57/d58/d73/l89 0 2023-12-05T13:26:33.328 INFO:tasks.workunit.client.0.smithi029.stdout:0/417: chown dc/d33/d47/c72 38869061 1 2023-12-05T13:26:33.328 INFO:tasks.workunit.client.0.smithi029.stdout:0/418: chown dc/d33/l3e 1328719 1 2023-12-05T13:26:33.329 INFO:tasks.workunit.client.0.smithi029.stdout:0/419: link dc/d33/c62 dc/d23/d3a/d41/d57/d58/d73/c8a 0 2023-12-05T13:26:33.349 INFO:tasks.workunit.client.0.smithi029.stdout:0/420: dwrite dc/f5a [0,4194304] 0 2023-12-05T13:26:33.349 INFO:tasks.workunit.client.0.smithi029.stdout:0/421: dread - dc/d23/d3a/d41/d70/f81 zero size 2023-12-05T13:26:33.349 INFO:tasks.workunit.client.0.smithi029.stdout:0/422: write dc/d23/d3a/d41/d57/d58/f7d [527449,62783] 0 2023-12-05T13:26:33.354 INFO:tasks.workunit.client.0.smithi029.stdout:0/423: rename dc/d13/f28 to dc/d13/d4f/f8b 0 2023-12-05T13:26:33.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/424: dwrite dc/d23/d3a/d41/f6e [0,4194304] 0 2023-12-05T13:26:33.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/425: chown f9 0 1 2023-12-05T13:26:33.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/426: chown dc/l1d 719 1 2023-12-05T13:26:33.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/427: stat dc/c20 0 2023-12-05T13:26:33.367 INFO:tasks.workunit.client.0.smithi029.stdout:0/428: stat dc/d13 0 2023-12-05T13:26:33.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/429: creat dc/d13/d4f/f8c x:0 0 0 2023-12-05T13:26:33.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/430: fsync f0 0 2023-12-05T13:26:33.369 INFO:tasks.workunit.client.0.smithi029.stdout:0/431: mkdir dc/d33/d3d/d7a/d84/d8d 0 2023-12-05T13:26:33.372 INFO:tasks.workunit.client.0.smithi029.stdout:0/432: rmdir dc/d33/d3d/d7a/d84 39 2023-12-05T13:26:33.372 INFO:tasks.workunit.client.0.smithi029.stdout:0/433: read f1 [7942209,43042] 0 2023-12-05T13:26:33.373 INFO:tasks.workunit.client.0.smithi029.stdout:0/434: rename dc/f31 to dc/d33/d3d/d65/d85/f8e 0 2023-12-05T13:26:33.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/435: rename dc/d23 to dc/d23/d3a/d8f 22 2023-12-05T13:26:33.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/436: getdents dc/d13/d4f/d63 0 2023-12-05T13:26:33.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/437: truncate dc/d13/d4f/f6b 916689 0 2023-12-05T13:26:33.375 INFO:tasks.workunit.client.0.smithi029.stdout:0/438: stat dc/d33/d47/l68 0 2023-12-05T13:26:33.375 INFO:tasks.workunit.client.0.smithi029.stdout:0/439: mknod dc/d33/d3d/d65/c90 0 2023-12-05T13:26:33.376 INFO:tasks.workunit.client.0.smithi029.stdout:0/440: mkdir dc/d13/d4f/d91 0 2023-12-05T13:26:33.378 INFO:tasks.workunit.client.0.smithi029.stdout:0/441: dread f6 [0,4194304] 0 2023-12-05T13:26:33.379 INFO:tasks.workunit.client.0.smithi029.stdout:0/442: rmdir dc/d23/d3a/d41 39 2023-12-05T13:26:33.379 INFO:tasks.workunit.client.0.smithi029.stdout:0/443: getdents dc/d13/d4f/d63 0 2023-12-05T13:26:33.379 INFO:tasks.workunit.client.0.smithi029.stdout:0/444: stat dc/d13/l17 0 2023-12-05T13:26:33.385 INFO:tasks.workunit.client.0.smithi029.stdout:0/445: dread dc/d23/d3a/d41/f4b [0,4194304] 0 2023-12-05T13:26:33.386 INFO:tasks.workunit.client.0.smithi029.stdout:0/446: write dc/d23/d3a/d41/d57/f5d [3768366,103687] 0 2023-12-05T13:26:33.387 INFO:tasks.workunit.client.0.smithi029.stdout:0/447: mknod dc/d13/c92 0 2023-12-05T13:26:33.402 INFO:tasks.workunit.client.0.smithi029.stdout:0/448: dwrite dc/d13/f1c [0,4194304] 0 2023-12-05T13:26:33.403 INFO:tasks.workunit.client.0.smithi029.stdout:0/449: mknod dc/d33/d3d/d7a/c93 0 2023-12-05T13:26:33.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/450: rename dc/d13/c18 to dc/d33/d47/c94 0 2023-12-05T13:26:33.405 INFO:tasks.workunit.client.0.smithi029.stdout:0/451: truncate dc/fe 2297754 0 2023-12-05T13:26:33.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/452: dread f9 [0,4194304] 0 2023-12-05T13:26:33.414 INFO:tasks.workunit.client.0.smithi029.stdout:0/453: link dc/d33/d3d/c48 dc/d33/c95 0 2023-12-05T13:26:33.415 INFO:tasks.workunit.client.0.smithi029.stdout:0/454: write f6 [888041,53216] 0 2023-12-05T13:26:33.415 INFO:tasks.workunit.client.0.smithi029.stdout:0/455: dread - dc/d23/d3a/d41/d70/f82 zero size 2023-12-05T13:26:33.416 INFO:tasks.workunit.client.0.smithi029.stdout:0/456: rename dc/d23/l3b to dc/d13/d4f/d63/l96 0 2023-12-05T13:26:33.416 INFO:tasks.workunit.client.0.smithi029.stdout:0/457: stat dc/d13/d4f 0 2023-12-05T13:26:33.417 INFO:tasks.workunit.client.0.smithi029.stdout:0/458: mkdir dc/d33/d3d/d7a/d84/d8d/d97 0 2023-12-05T13:26:33.418 INFO:tasks.workunit.client.0.smithi029.stdout:0/459: read dc/d13/d4f/f8b [8291454,9311] 0 2023-12-05T13:26:33.418 INFO:tasks.workunit.client.0.smithi029.stdout:0/460: truncate dc/ff 4230136 0 2023-12-05T13:26:33.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/461: mkdir dc/d33/d3d/d7a/d84/d8d/d97/d98 0 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/275: sync 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/276: fsync d0/de/d30/f4c 0 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/545: sync 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/546: chown d5/d6/d59/fad 60860 1 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/547: fsync d5/d2f/d3a/d86/fab 0 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/548: write d5/dc/d18/d26/f94 [824386,22533] 0 2023-12-05T13:26:33.438 INFO:tasks.workunit.client.0.smithi029.stdout:8/549: write d5/d2f/d75/fa4 [248227,56037] 0 2023-12-05T13:26:33.440 INFO:tasks.workunit.client.0.smithi029.stdout:4/277: mkdir d0/d16/d22/d5f 0 2023-12-05T13:26:33.441 INFO:tasks.workunit.client.0.smithi029.stdout:0/462: dwrite dc/d23/d3a/f74 [4194304,4194304] 0 2023-12-05T13:26:33.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/278: creat d0/de/d30/d32/d35/d3d/f60 x:0 0 0 2023-12-05T13:26:33.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/279: fdatasync d0/d16/f4a 0 2023-12-05T13:26:33.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/280: dread - d0/de/d30/d32/d35/d3d/f5a zero size 2023-12-05T13:26:33.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/281: fsync d0/f23 0 2023-12-05T13:26:33.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/282: chown d0/d16/d22 59282557 1 2023-12-05T13:26:33.443 INFO:tasks.workunit.client.0.smithi029.stdout:0/463: write dc/fe [1557698,82625] 0 2023-12-05T13:26:33.449 INFO:tasks.workunit.client.0.smithi029.stdout:4/283: creat d0/d16/d22/f61 x:0 0 0 2023-12-05T13:26:33.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/464: link dc/d23/d3a/f71 dc/d13/d4f/d88/f99 0 2023-12-05T13:26:33.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/465: truncate dc/d33/d3d/f64 4338785 0 2023-12-05T13:26:33.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/466: readlink dc/d33/d47/l68 0 2023-12-05T13:26:33.450 INFO:tasks.workunit.client.0.smithi029.stdout:0/467: write dc/d23/d3a/d41/d70/f82 [337228,76088] 0 2023-12-05T13:26:33.452 INFO:tasks.workunit.client.0.smithi029.stdout:0/468: read dc/d13/f2d [3589182,77219] 0 2023-12-05T13:26:33.452 INFO:tasks.workunit.client.0.smithi029.stdout:0/469: truncate dc/ff 5241787 0 2023-12-05T13:26:33.453 INFO:tasks.workunit.client.0.smithi029.stdout:0/470: write dc/f14 [2926139,66640] 0 2023-12-05T13:26:33.454 INFO:tasks.workunit.client.0.smithi029.stdout:0/471: getdents dc/d33/d3d/d65/d85 0 2023-12-05T13:26:33.454 INFO:tasks.workunit.client.0.smithi029.stdout:0/472: stat dc/c25 0 2023-12-05T13:26:33.454 INFO:tasks.workunit.client.0.smithi029.stdout:0/473: chown dc/d33/d47/l68 27978 1 2023-12-05T13:26:33.455 INFO:tasks.workunit.client.0.smithi029.stdout:0/474: rmdir dc/d23 39 2023-12-05T13:26:33.455 INFO:tasks.workunit.client.0.smithi029.stdout:0/475: chown dc/d23/d3a/d41/d57/d58/f7d 24927707 1 2023-12-05T13:26:33.456 INFO:tasks.workunit.client.0.smithi029.stdout:0/476: creat dc/d33/d3d/d7a/d84/d8d/d97/f9a x:0 0 0 2023-12-05T13:26:33.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/477: write dc/d13/f1c [1280740,43531] 0 2023-12-05T13:26:33.463 INFO:tasks.workunit.client.0.smithi029.stdout:0/478: fsync dc/f14 0 2023-12-05T13:26:33.463 INFO:tasks.workunit.client.0.smithi029.stdout:4/284: dwrite d0/da/f39 [0,4194304] 0 2023-12-05T13:26:33.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/479: symlink dc/d33/l9b 0 2023-12-05T13:26:33.492 INFO:tasks.workunit.client.0.smithi029.stdout:4/285: symlink d0/d1/d37/l62 0 2023-12-05T13:26:33.495 INFO:tasks.workunit.client.0.smithi029.stdout:0/480: getdents dc/d13/d4f/d88 0 2023-12-05T13:26:33.496 INFO:tasks.workunit.client.0.smithi029.stdout:0/481: write dc/f16 [2253328,11828] 0 2023-12-05T13:26:33.497 INFO:tasks.workunit.client.0.smithi029.stdout:0/482: readlink dc/l6d 0 2023-12-05T13:26:33.498 INFO:tasks.workunit.client.0.smithi029.stdout:5/271: sync 2023-12-05T13:26:33.498 INFO:tasks.workunit.client.0.smithi029.stdout:6/378: sync 2023-12-05T13:26:33.500 INFO:tasks.workunit.client.0.smithi029.stdout:5/272: rename d1/dc/d11/f59 to d1/dc/d25/f5e 0 2023-12-05T13:26:33.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/379: truncate d6/f45 1326245 0 2023-12-05T13:26:33.502 INFO:tasks.workunit.client.0.smithi029.stdout:4/286: dread d0/da/f39 [0,4194304] 0 2023-12-05T13:26:33.502 INFO:tasks.workunit.client.0.smithi029.stdout:4/287: dread - d0/de/d30/d32/d35/f58 zero size 2023-12-05T13:26:33.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/288: dread d0/de/d15/f4e [0,4194304] 0 2023-12-05T13:26:33.509 INFO:tasks.workunit.client.0.smithi029.stdout:4/289: link d0/de/d30/c5b d0/de/d30/d32/d35/d3d/c63 0 2023-12-05T13:26:33.512 INFO:tasks.workunit.client.0.smithi029.stdout:4/290: unlink d0/de/d30/d32/d35/f55 0 2023-12-05T13:26:33.512 INFO:tasks.workunit.client.0.smithi029.stdout:4/291: readlink d0/de/d30/d32/d35/d3d/l52 0 2023-12-05T13:26:33.512 INFO:tasks.workunit.client.0.smithi029.stdout:4/292: write d0/de/d30/d32/d35/d3d/f57 [816154,114041] 0 2023-12-05T13:26:33.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/293: creat d0/de/d15/f64 x:0 0 0 2023-12-05T13:26:33.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/294: symlink d0/d3c/l65 0 2023-12-05T13:26:33.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/295: dread - d0/de/d30/d32/d35/f58 zero size 2023-12-05T13:26:33.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/296: chown d0/de/d30/f4b 1 1 2023-12-05T13:26:33.519 INFO:tasks.workunit.client.0.smithi029.stdout:4/297: mknod d0/d1/c66 0 2023-12-05T13:26:33.520 INFO:tasks.workunit.client.0.smithi029.stdout:0/483: dwrite dc/d13/f34 [0,4194304] 0 2023-12-05T13:26:33.520 INFO:tasks.workunit.client.0.smithi029.stdout:0/484: readlink dc/l22 0 2023-12-05T13:26:33.520 INFO:tasks.workunit.client.0.smithi029.stdout:0/485: fsync dc/d23/d3a/f71 0 2023-12-05T13:26:33.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/298: creat d0/d3c/d56/f67 x:0 0 0 2023-12-05T13:26:33.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/299: write d0/de/d15/f49 [4323410,62815] 0 2023-12-05T13:26:33.521 INFO:tasks.workunit.client.0.smithi029.stdout:4/300: readlink d0/de/l3f 0 2023-12-05T13:26:33.521 INFO:tasks.workunit.client.0.smithi029.stdout:5/273: dwrite d1/dc/d25/d4c/f52 [0,4194304] 0 2023-12-05T13:26:33.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/486: rmdir dc/d33/d3d/d65 39 2023-12-05T13:26:33.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/380: dwrite d6/d64/d65/d40/f6b [0,4194304] 0 2023-12-05T13:26:33.524 INFO:tasks.workunit.client.0.smithi029.stdout:4/301: rmdir d0/d16/d22 39 2023-12-05T13:26:33.529 INFO:tasks.workunit.client.0.smithi029.stdout:5/274: creat d1/dc/d10/d1e/f5f x:0 0 0 2023-12-05T13:26:33.531 INFO:tasks.workunit.client.0.smithi029.stdout:6/381: dread d6/fa [0,4194304] 0 2023-12-05T13:26:33.531 INFO:tasks.workunit.client.0.smithi029.stdout:6/382: fdatasync d6/d64/d65/f5e 0 2023-12-05T13:26:33.531 INFO:tasks.workunit.client.0.smithi029.stdout:0/487: mknod dc/c9c 0 2023-12-05T13:26:33.531 INFO:tasks.workunit.client.0.smithi029.stdout:0/488: chown dc/d13/l21 8120704 1 2023-12-05T13:26:33.534 INFO:tasks.workunit.client.0.smithi029.stdout:4/302: creat d0/de/d30/f68 x:0 0 0 2023-12-05T13:26:33.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/303: fsync d0/da/f20 0 2023-12-05T13:26:33.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/304: dread - d0/de/d30/f4b zero size 2023-12-05T13:26:33.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/305: write d0/de/d30/d32/d35/d3d/f60 [814980,44620] 0 2023-12-05T13:26:33.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/306: write d0/da/fb [2143067,66781] 0 2023-12-05T13:26:33.536 INFO:tasks.workunit.client.0.smithi029.stdout:5/275: creat d1/f60 x:0 0 0 2023-12-05T13:26:33.538 INFO:tasks.workunit.client.0.smithi029.stdout:0/489: link dc/d33/l42 dc/d23/d3a/d41/d57/l9d 0 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:4/307: unlink d0/de/d30/f4b 0 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/276: getdents d1/dc/d25 0 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/277: dread - d1/dc/d11/d17/d3d/f5b zero size 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/278: fsync d1/dc/d38/f40 0 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/279: readlink d1/dc/d10/l31 0 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/280: dread - d1/dc/d25/f5e zero size 2023-12-05T13:26:33.543 INFO:tasks.workunit.client.0.smithi029.stdout:5/281: read d1/dc/d27/f2a [251528,7759] 0 2023-12-05T13:26:33.544 INFO:tasks.workunit.client.0.smithi029.stdout:0/490: mknod dc/d23/d3a/d41/d57/d58/d73/c9e 0 2023-12-05T13:26:33.545 INFO:tasks.workunit.client.0.smithi029.stdout:4/308: mkdir d0/d16/d2f/d69 0 2023-12-05T13:26:33.546 INFO:tasks.workunit.client.0.smithi029.stdout:5/282: getdents d1/dc 0 2023-12-05T13:26:33.547 INFO:tasks.workunit.client.0.smithi029.stdout:6/383: dwrite d6/f10 [0,4194304] 0 2023-12-05T13:26:33.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/309: rename d0/d1/d37/l62 to d0/d3c/d56/l6a 0 2023-12-05T13:26:33.551 INFO:tasks.workunit.client.0.smithi029.stdout:6/384: mkdir d6/d1d/d39/d58/d82 0 2023-12-05T13:26:33.553 INFO:tasks.workunit.client.0.smithi029.stdout:6/385: write d6/f4f [623322,52121] 0 2023-12-05T13:26:33.555 INFO:tasks.workunit.client.0.smithi029.stdout:6/386: rmdir d6/d64/d6d 39 2023-12-05T13:26:33.570 INFO:tasks.workunit.client.0.smithi029.stdout:0/491: dwrite dc/d23/d3a/d41/f54 [0,4194304] 0 2023-12-05T13:26:33.571 INFO:tasks.workunit.client.0.smithi029.stdout:0/492: creat dc/d33/d3d/d7e/f9f x:0 0 0 2023-12-05T13:26:33.571 INFO:tasks.workunit.client.0.smithi029.stdout:4/310: dwrite d0/de/d30/f3b [4194304,4194304] 0 2023-12-05T13:26:33.573 INFO:tasks.workunit.client.0.smithi029.stdout:0/493: rename dc/d23/d3a/f74 to dc/d33/d3d/d65/d85/fa0 0 2023-12-05T13:26:33.573 INFO:tasks.workunit.client.0.smithi029.stdout:0/494: chown dc/f2f 0 1 2023-12-05T13:26:33.574 INFO:tasks.workunit.client.0.smithi029.stdout:4/311: symlink d0/de/d15/l6b 0 2023-12-05T13:26:33.574 INFO:tasks.workunit.client.0.smithi029.stdout:4/312: readlink d0/l13 0 2023-12-05T13:26:33.574 INFO:tasks.workunit.client.0.smithi029.stdout:5/283: dwrite d1/dc/d10/d1e/d33/f4d [0,4194304] 0 2023-12-05T13:26:33.574 INFO:tasks.workunit.client.0.smithi029.stdout:5/284: dread - d1/dc/d11/d17/d3d/f58 zero size 2023-12-05T13:26:33.576 INFO:tasks.workunit.client.0.smithi029.stdout:6/387: dwrite d6/d64/d65/d40/d74/f53 [0,4194304] 0 2023-12-05T13:26:33.576 INFO:tasks.workunit.client.0.smithi029.stdout:4/313: mknod d0/de/d30/d32/d35/c6c 0 2023-12-05T13:26:33.576 INFO:tasks.workunit.client.0.smithi029.stdout:5/285: write d1/dc/d25/d4c/f52 [3447842,6569] 0 2023-12-05T13:26:33.583 INFO:tasks.workunit.client.0.smithi029.stdout:4/314: unlink d0/d1/fc 0 2023-12-05T13:26:33.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/286: mkdir d1/dc/d25/d4c/d61 0 2023-12-05T13:26:33.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/287: dread - d1/dc/d38/f44 zero size 2023-12-05T13:26:33.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/288: rename d1/dc/d38/d55/f5a to d1/dc/d11/d17/d3d/f62 0 2023-12-05T13:26:33.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/495: dwrite dc/d23/d3a/d41/f5e [0,4194304] 0 2023-12-05T13:26:33.593 INFO:tasks.workunit.client.0.smithi029.stdout:6/388: dwrite d6/fc [4194304,4194304] 0 2023-12-05T13:26:33.597 INFO:tasks.workunit.client.0.smithi029.stdout:6/389: creat d6/d1d/d39/d58/f83 x:0 0 0 2023-12-05T13:26:33.598 INFO:tasks.workunit.client.0.smithi029.stdout:5/289: truncate d1/dc/d10/d1e/d33/f4d 2461701 0 2023-12-05T13:26:33.600 INFO:tasks.workunit.client.0.smithi029.stdout:5/290: dread d1/dc/d27/f2a [0,4194304] 0 2023-12-05T13:26:33.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/291: creat d1/dc/d38/d3a/d5c/f63 x:0 0 0 2023-12-05T13:26:33.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:33 smithi029 ceph-mon[112128]: pgmap v38: 65 pgs: 65 active+clean; 598 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 282 op/s 2023-12-05T13:26:33.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/315: dread d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:33.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/316: chown d0/de/d30/d32/d35 9819510 1 2023-12-05T13:26:33.606 INFO:tasks.workunit.client.0.smithi029.stdout:0/496: dread dc/d23/d3a/d41/f54 [0,4194304] 0 2023-12-05T13:26:33.606 INFO:tasks.workunit.client.0.smithi029.stdout:0/497: truncate dc/d23/d3a/d41/f4b 4044289 0 2023-12-05T13:26:33.607 INFO:tasks.workunit.client.0.smithi029.stdout:5/292: read d1/f20 [1508271,89007] 0 2023-12-05T13:26:33.609 INFO:tasks.workunit.client.0.smithi029.stdout:5/293: creat d1/dc/d11/d17/f64 x:0 0 0 2023-12-05T13:26:33.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/294: unlink d1/dc/d10/l39 0 2023-12-05T13:26:33.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/295: write d1/dc/d11/d17/d29/f4f [3782992,73830] 0 2023-12-05T13:26:33.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/296: fsync d1/dc/d38/f22 0 2023-12-05T13:26:33.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/297: stat d1/dc/d25/f46 0 2023-12-05T13:26:33.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/298: getdents d1/dc/d38 0 2023-12-05T13:26:33.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/299: read d1/f20 [332673,120091] 0 2023-12-05T13:26:33.614 INFO:tasks.workunit.client.0.smithi029.stdout:4/317: dread d0/de/f45 [0,4194304] 0 2023-12-05T13:26:33.615 INFO:tasks.workunit.client.0.smithi029.stdout:5/300: creat d1/dc/d10/d1e/f65 x:0 0 0 2023-12-05T13:26:33.619 INFO:tasks.workunit.client.0.smithi029.stdout:6/390: dwrite d6/d1d/d36/f69 [0,4194304] 0 2023-12-05T13:26:33.621 INFO:tasks.workunit.client.0.smithi029.stdout:4/318: rmdir d0 39 2023-12-05T13:26:33.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/301: mknod d1/dc/d27/c66 0 2023-12-05T13:26:33.625 INFO:tasks.workunit.client.0.smithi029.stdout:0/498: dwrite dc/d23/d3a/d41/d57/d58/f5c [0,4194304] 0 2023-12-05T13:26:33.625 INFO:tasks.workunit.client.0.smithi029.stdout:0/499: fsync dc/d33/f38 0 2023-12-05T13:26:33.628 INFO:tasks.workunit.client.0.smithi029.stdout:4/319: getdents d0/d16/d22/d4f 0 2023-12-05T13:26:33.629 INFO:tasks.workunit.client.0.smithi029.stdout:6/391: dread d6/d64/d65/d40/f6b [0,4194304] 0 2023-12-05T13:26:33.631 INFO:tasks.workunit.client.0.smithi029.stdout:5/302: mknod d1/c67 0 2023-12-05T13:26:33.631 INFO:tasks.workunit.client.0.smithi029.stdout:5/303: write d1/dc/d10/d1e/f47 [1391702,104081] 0 2023-12-05T13:26:33.636 INFO:tasks.workunit.client.0.smithi029.stdout:4/320: dread d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:33.636 INFO:tasks.workunit.client.0.smithi029.stdout:4/321: chown d0/de/d30/d32/d35/f58 0 1 2023-12-05T13:26:33.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/392: creat d6/d1d/f84 x:0 0 0 2023-12-05T13:26:33.639 INFO:tasks.workunit.client.0.smithi029.stdout:5/304: mknod d1/dc/d11/d17/d29/c68 0 2023-12-05T13:26:33.639 INFO:tasks.workunit.client.0.smithi029.stdout:5/305: truncate d1/dc/d11/d17/f64 1006163 0 2023-12-05T13:26:33.640 INFO:tasks.workunit.client.0.smithi029.stdout:5/306: creat d1/dc/d38/d3a/d5c/f69 x:0 0 0 2023-12-05T13:26:33.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/307: mkdir d1/dc/d38/d6a 0 2023-12-05T13:26:33.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/308: creat d1/dc/d10/d1e/d33/f6b x:0 0 0 2023-12-05T13:26:33.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/309: chown d1/dc/d10/d1e 335509 1 2023-12-05T13:26:33.645 INFO:tasks.workunit.client.0.smithi029.stdout:5/310: creat d1/dc/d38/f6c x:0 0 0 2023-12-05T13:26:33.647 INFO:tasks.workunit.client.0.smithi029.stdout:0/500: dwrite dc/d13/f34 [0,4194304] 0 2023-12-05T13:26:33.647 INFO:tasks.workunit.client.0.smithi029.stdout:0/501: truncate dc/f3f 724268 0 2023-12-05T13:26:33.647 INFO:tasks.workunit.client.0.smithi029.stdout:0/502: dread - dc/d13/d4f/d88/f99 zero size 2023-12-05T13:26:33.647 INFO:tasks.workunit.client.0.smithi029.stdout:6/393: read d6/d1d/d36/f69 [1609954,13394] 0 2023-12-05T13:26:33.647 INFO:tasks.workunit.client.0.smithi029.stdout:5/311: link d1/dc/d27/l3e d1/dc/d10/d1e/l6d 0 2023-12-05T13:26:33.648 INFO:tasks.workunit.client.0.smithi029.stdout:6/394: write d6/d29/f50 [251627,17263] 0 2023-12-05T13:26:33.648 INFO:tasks.workunit.client.0.smithi029.stdout:5/312: write d1/dc/d38/f22 [674502,26487] 0 2023-12-05T13:26:33.650 INFO:tasks.workunit.client.0.smithi029.stdout:0/503: unlink dc/f2f 0 2023-12-05T13:26:33.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/504: write dc/d23/f6f [663078,117283] 0 2023-12-05T13:26:33.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/505: chown dc/d33/l9b 5 1 2023-12-05T13:26:33.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/506: chown dc/c4d 64482 1 2023-12-05T13:26:33.651 INFO:tasks.workunit.client.0.smithi029.stdout:6/395: rmdir d6/d64/d65/d40/d74 39 2023-12-05T13:26:33.652 INFO:tasks.workunit.client.0.smithi029.stdout:4/322: dwrite d0/d16/d22/d4f/f5c [0,4194304] 0 2023-12-05T13:26:33.652 INFO:tasks.workunit.client.0.smithi029.stdout:5/313: creat d1/dc/d38/d55/f6e x:0 0 0 2023-12-05T13:26:33.654 INFO:tasks.workunit.client.0.smithi029.stdout:0/507: rename dc/d23/d3a/l6c to dc/d23/d3a/d41/d70/la1 0 2023-12-05T13:26:33.654 INFO:tasks.workunit.client.0.smithi029.stdout:0/508: chown dc/c20 1 1 2023-12-05T13:26:33.655 INFO:tasks.workunit.client.0.smithi029.stdout:6/396: mkdir d6/d64/d6d/d85 0 2023-12-05T13:26:33.658 INFO:tasks.workunit.client.0.smithi029.stdout:4/323: link d0/f1d d0/d16/d22/d4f/f6d 0 2023-12-05T13:26:33.658 INFO:tasks.workunit.client.0.smithi029.stdout:4/324: stat d0/f2e 0 2023-12-05T13:26:33.658 INFO:tasks.workunit.client.0.smithi029.stdout:4/325: chown d0/d16/f4a 63380282 1 2023-12-05T13:26:33.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/314: creat d1/dc/d25/d4c/f6f x:0 0 0 2023-12-05T13:26:33.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/315: dread - d1/dc/d11/d17/d3d/f5b zero size 2023-12-05T13:26:33.661 INFO:tasks.workunit.client.0.smithi029.stdout:6/397: write d6/d1d/d39/f44 [99482,14398] 0 2023-12-05T13:26:33.664 INFO:tasks.workunit.client.0.smithi029.stdout:6/398: link d6/d1d/d36/c70 d6/d29/d60/c86 0 2023-12-05T13:26:33.666 INFO:tasks.workunit.client.0.smithi029.stdout:6/399: unlink d6/d1d/d39/f44 0 2023-12-05T13:26:33.668 INFO:tasks.workunit.client.0.smithi029.stdout:5/316: write d1/dc/d27/f2a [231502,7712] 0 2023-12-05T13:26:33.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/400: creat d6/d1d/d39/f87 x:0 0 0 2023-12-05T13:26:33.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/401: dread - d6/d1d/d39/f87 zero size 2023-12-05T13:26:33.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/317: rename d1/l9 to d1/dc/d25/l70 0 2023-12-05T13:26:33.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/318: readlink d1/dc/d25/l70 0 2023-12-05T13:26:33.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/319: truncate d1/dc/d10/d1e/f65 408500 0 2023-12-05T13:26:33.672 INFO:tasks.workunit.client.0.smithi029.stdout:6/402: rename d6/d1d/f24 to d6/d64/d65/d40/d74/d52/d5c/d6f/f88 0 2023-12-05T13:26:33.672 INFO:tasks.workunit.client.0.smithi029.stdout:6/403: write d6/d1d/f55 [473441,121517] 0 2023-12-05T13:26:33.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/320: symlink d1/dc/d10/d1e/d33/l71 0 2023-12-05T13:26:33.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/321: write d1/dc/d11/f12 [1564017,57248] 0 2023-12-05T13:26:33.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/322: stat d1/dc/d38/f40 0 2023-12-05T13:26:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/323: readlink d1/dc/d10/d3f/l51 0 2023-12-05T13:26:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/324: chown d1/dc/d11/d17/d3d/f62 12409 1 2023-12-05T13:26:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/325: dread - d1/dc/d25/f3b zero size 2023-12-05T13:26:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:4/326: dwrite d0/da/f20 [0,4194304] 0 2023-12-05T13:26:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:6/404: mknod d6/d1d/d39/c89 0 2023-12-05T13:26:33.675 INFO:tasks.workunit.client.0.smithi029.stdout:0/509: dwrite dc/d23/d3a/d41/d57/d58/f7d [0,4194304] 0 2023-12-05T13:26:33.676 INFO:tasks.workunit.client.0.smithi029.stdout:0/510: read dc/d13/d4f/f6b [646669,84262] 0 2023-12-05T13:26:33.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/326: mknod d1/dc/d25/d4c/d61/c72 0 2023-12-05T13:26:33.677 INFO:tasks.workunit.client.0.smithi029.stdout:4/327: symlink d0/da/l6e 0 2023-12-05T13:26:33.677 INFO:tasks.workunit.client.0.smithi029.stdout:4/328: write d0/d16/f4a [657091,31766] 0 2023-12-05T13:26:33.677 INFO:tasks.workunit.client.0.smithi029.stdout:4/329: readlink d0/de/d15/l1f 0 2023-12-05T13:26:33.678 INFO:tasks.workunit.client.0.smithi029.stdout:6/405: symlink d6/d64/d65/d40/d4d/d7f/l8a 0 2023-12-05T13:26:33.680 INFO:tasks.workunit.client.0.smithi029.stdout:5/327: rmdir d1/dc/d38/d6a 0 2023-12-05T13:26:33.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/406: link d6/d1d/f55 d6/d1d/d39/d58/f8b 0 2023-12-05T13:26:33.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/407: chown d6/d5a 153 1 2023-12-05T13:26:33.682 INFO:tasks.workunit.client.0.smithi029.stdout:5/328: creat d1/dc/d10/d1e/d33/f73 x:0 0 0 2023-12-05T13:26:33.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/408: getdents d6/d29 0 2023-12-05T13:26:33.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/409: fdatasync d6/d64/d65/d40/d74/f53 0 2023-12-05T13:26:33.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/329: symlink d1/dc/d10/d1e/d33/l74 0 2023-12-05T13:26:33.688 INFO:tasks.workunit.client.0.smithi029.stdout:4/330: read d0/d16/d22/d4f/f59 [56735,24612] 0 2023-12-05T13:26:33.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/331: truncate d0/d16/d22/d4f/f6d 3021837 0 2023-12-05T13:26:33.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/332: chown d0/d16/d2f/d69 0 1 2023-12-05T13:26:33.692 INFO:tasks.workunit.client.0.smithi029.stdout:0/511: dwrite dc/ff [4194304,4194304] 0 2023-12-05T13:26:33.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/333: mknod d0/d16/d22/d4f/c6f 0 2023-12-05T13:26:33.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/334: chown d0/de/d30/d32/d35/c6c 789043 1 2023-12-05T13:26:33.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/335: dread - d0/de/d30/f68 zero size 2023-12-05T13:26:33.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/336: chown d0/d16/d2f 30331772 1 2023-12-05T13:26:33.694 INFO:tasks.workunit.client.0.smithi029.stdout:0/512: mknod dc/d33/d3d/ca2 0 2023-12-05T13:26:33.694 INFO:tasks.workunit.client.0.smithi029.stdout:0/513: fdatasync dc/d33/d3d/d7e/f9f 0 2023-12-05T13:26:33.695 INFO:tasks.workunit.client.0.smithi029.stdout:4/337: symlink d0/de/d30/d32/d35/d3d/l70 0 2023-12-05T13:26:33.697 INFO:tasks.workunit.client.0.smithi029.stdout:4/338: rename d0/de/d30/f3b to d0/d16/d22/d4f/f71 0 2023-12-05T13:26:33.701 INFO:tasks.workunit.client.0.smithi029.stdout:6/410: write d6/d64/d65/d40/d74/d52/d5c/d6f/f88 [4289645,92640] 0 2023-12-05T13:26:33.703 INFO:tasks.workunit.client.0.smithi029.stdout:5/330: dwrite d1/dc/d10/d1e/d33/f4d [0,4194304] 0 2023-12-05T13:26:33.716 INFO:tasks.workunit.client.0.smithi029.stdout:0/514: dwrite dc/d23/d3a/d41/d57/d58/f61 [0,4194304] 0 2023-12-05T13:26:33.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/339: dread d0/da/f18 [0,4194304] 0 2023-12-05T13:26:33.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/340: getdents d0/d16/d22/d5f 0 2023-12-05T13:26:33.718 INFO:tasks.workunit.client.0.smithi029.stdout:4/341: write d0/f1d [2250793,127945] 0 2023-12-05T13:26:33.722 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:33 smithi052 ceph-mon[121072]: pgmap v38: 65 pgs: 65 active+clean; 598 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 17 MiB/s rd, 43 MiB/s wr, 282 op/s 2023-12-05T13:26:33.818 INFO:tasks.workunit.client.0.smithi029.stdout:6/411: dwrite d6/f10 [4194304,4194304] 0 2023-12-05T13:26:33.818 INFO:tasks.workunit.client.0.smithi029.stdout:6/412: fdatasync d6/d1d/d36/f69 0 2023-12-05T13:26:33.818 INFO:tasks.workunit.client.0.smithi029.stdout:4/342: mknod d0/da/c72 0 2023-12-05T13:26:33.823 INFO:tasks.workunit.client.0.smithi029.stdout:0/515: dwrite dc/d33/f38 [0,4194304] 0 2023-12-05T13:26:33.824 INFO:tasks.workunit.client.0.smithi029.stdout:0/516: write dc/d23/d3a/d41/f5e [3261900,14966] 0 2023-12-05T13:26:33.828 INFO:tasks.workunit.client.0.smithi029.stdout:4/343: rename d0/de/d30/d32/d35/d3d/f60 to d0/da/f73 0 2023-12-05T13:26:33.829 INFO:tasks.workunit.client.0.smithi029.stdout:0/517: creat dc/d33/d3d/d7a/d84/d8d/d97/fa3 x:0 0 0 2023-12-05T13:26:33.830 INFO:tasks.workunit.client.0.smithi029.stdout:0/518: mkdir dc/d33/d3d/d7a/d84/da4 0 2023-12-05T13:26:33.836 INFO:tasks.workunit.client.0.smithi029.stdout:0/519: truncate f1 1169512 0 2023-12-05T13:26:33.836 INFO:tasks.workunit.client.0.smithi029.stdout:6/413: dwrite d6/d64/d65/d40/f41 [4194304,4194304] 0 2023-12-05T13:26:33.840 INFO:tasks.workunit.client.0.smithi029.stdout:6/414: truncate d6/f10 7016084 0 2023-12-05T13:26:33.855 INFO:tasks.workunit.client.0.smithi029.stdout:4/344: dwrite d0/d41/f53 [0,4194304] 0 2023-12-05T13:26:33.855 INFO:tasks.workunit.client.0.smithi029.stdout:0/520: dwrite dc/d13/f1c [4194304,4194304] 0 2023-12-05T13:26:33.856 INFO:tasks.workunit.client.0.smithi029.stdout:0/521: chown dc/d23/d3a/d41/d57/d58 17 1 2023-12-05T13:26:33.858 INFO:tasks.workunit.client.0.smithi029.stdout:4/345: write d0/f2e [1517408,36371] 0 2023-12-05T13:26:33.858 INFO:tasks.workunit.client.0.smithi029.stdout:4/346: fsync d0/de/d15/f49 0 2023-12-05T13:26:33.859 INFO:tasks.workunit.client.0.smithi029.stdout:6/415: dwrite d6/d64/d65/f28 [4194304,4194304] 0 2023-12-05T13:26:33.859 INFO:tasks.workunit.client.0.smithi029.stdout:6/416: chown d6/d1d/d36/f42 495290190 1 2023-12-05T13:26:33.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/347: truncate d0/de/d30/d32/d35/f47 2635459 0 2023-12-05T13:26:33.862 INFO:tasks.workunit.client.0.smithi029.stdout:6/417: rename d6/d1d/c26 to d6/d1d/d36/c8c 0 2023-12-05T13:26:33.871 INFO:tasks.workunit.client.0.smithi029.stdout:0/522: dwrite dc/f35 [0,4194304] 0 2023-12-05T13:26:33.872 INFO:tasks.workunit.client.0.smithi029.stdout:0/523: mknod dc/d33/d3d/d7a/d84/da4/ca5 0 2023-12-05T13:26:33.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/524: dread dc/d33/d3d/f64 [0,4194304] 0 2023-12-05T13:26:33.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/525: dread - dc/f80 zero size 2023-12-05T13:26:33.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/526: chown dc/d13/l30 2426318 1 2023-12-05T13:26:33.879 INFO:tasks.workunit.client.0.smithi029.stdout:4/348: dwrite d0/d1/f51 [0,4194304] 0 2023-12-05T13:26:33.879 INFO:tasks.workunit.client.0.smithi029.stdout:0/527: creat dc/d33/d3d/d7e/fa6 x:0 0 0 2023-12-05T13:26:33.881 INFO:tasks.workunit.client.0.smithi029.stdout:4/349: creat d0/d3c/d56/f74 x:0 0 0 2023-12-05T13:26:33.882 INFO:tasks.workunit.client.0.smithi029.stdout:4/350: symlink d0/d16/d22/d5f/l75 0 2023-12-05T13:26:33.883 INFO:tasks.workunit.client.0.smithi029.stdout:4/351: chown d0/de/l3f 3203033 1 2023-12-05T13:26:33.884 INFO:tasks.workunit.client.0.smithi029.stdout:4/352: dread d0/de/d30/f4c [0,4194304] 0 2023-12-05T13:26:33.894 INFO:tasks.workunit.client.0.smithi029.stdout:0/528: dwrite dc/d23/d3a/d41/d57/f77 [0,4194304] 0 2023-12-05T13:26:33.910 INFO:tasks.workunit.client.0.smithi029.stdout:0/529: dwrite dc/d13/d4f/f6b [0,4194304] 0 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:7/573: sync 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/334: sync 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:3/310: sync 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:2/400: sync 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/335: readlink d7/l12 0 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:1/467: sync 2023-12-05T13:26:33.927 INFO:tasks.workunit.client.0.smithi029.stdout:2/401: fsync de/f28 0 2023-12-05T13:26:33.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/468: write d7/d5e/d52/d5f/d12/f74 [2709162,114931] 0 2023-12-05T13:26:33.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/469: truncate d7/d61/d4f/f88 115240 0 2023-12-05T13:26:33.929 INFO:tasks.workunit.client.0.smithi029.stdout:3/311: mkdir d1/d5e 0 2023-12-05T13:26:33.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/402: unlink de/c10 0 2023-12-05T13:26:33.931 INFO:tasks.workunit.client.0.smithi029.stdout:1/470: creat d7/d5e/d52/d90/f9b x:0 0 0 2023-12-05T13:26:33.932 INFO:tasks.workunit.client.0.smithi029.stdout:1/471: write d7/d5e/f95 [39117,89688] 0 2023-12-05T13:26:33.932 INFO:tasks.workunit.client.0.smithi029.stdout:7/574: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:33.933 INFO:tasks.workunit.client.0.smithi029.stdout:1/472: write d7/d31/f51 [729036,30379] 0 2023-12-05T13:26:33.933 INFO:tasks.workunit.client.0.smithi029.stdout:1/473: truncate d7/d6e/f8d 812735 0 2023-12-05T13:26:33.934 INFO:tasks.workunit.client.0.smithi029.stdout:3/312: unlink d1/l29 0 2023-12-05T13:26:33.934 INFO:tasks.workunit.client.0.smithi029.stdout:1/474: write d7/fb [2331000,104787] 0 2023-12-05T13:26:33.934 INFO:tasks.workunit.client.0.smithi029.stdout:2/403: creat de/d16/d6c/f7d x:0 0 0 2023-12-05T13:26:33.934 INFO:tasks.workunit.client.0.smithi029.stdout:2/404: fsync de/f28 0 2023-12-05T13:26:33.934 INFO:tasks.workunit.client.0.smithi029.stdout:2/405: dread - de/f5b zero size 2023-12-05T13:26:33.936 INFO:tasks.workunit.client.0.smithi029.stdout:3/313: creat d1/d16/d1f/d4c/f5f x:0 0 0 2023-12-05T13:26:33.937 INFO:tasks.workunit.client.0.smithi029.stdout:2/406: link de/d14/f35 de/d14/f7e 0 2023-12-05T13:26:33.937 INFO:tasks.workunit.client.0.smithi029.stdout:3/314: dread d1/d10/f5b [0,4194304] 0 2023-12-05T13:26:33.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/475: read d7/f53 [3146228,21138] 0 2023-12-05T13:26:33.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/476: stat d7/d5e/d52/d5f/d12 0 2023-12-05T13:26:33.937 INFO:tasks.workunit.client.0.smithi029.stdout:1/477: write d7/d5e/f95 [615925,65479] 0 2023-12-05T13:26:33.938 INFO:tasks.workunit.client.0.smithi029.stdout:2/407: mknod de/d41/d56/c7f 0 2023-12-05T13:26:33.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/478: dread d7/d5e/d52/f57 [0,4194304] 0 2023-12-05T13:26:33.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/479: truncate d7/d5e/d52/d5f/d12/f76 286707 0 2023-12-05T13:26:33.939 INFO:tasks.workunit.client.0.smithi029.stdout:3/315: symlink d1/d16/d1f/l60 0 2023-12-05T13:26:33.940 INFO:tasks.workunit.client.0.smithi029.stdout:1/480: symlink d7/d5b/l9c 0 2023-12-05T13:26:33.941 INFO:tasks.workunit.client.0.smithi029.stdout:3/316: read d1/fd [1421307,116696] 0 2023-12-05T13:26:33.942 INFO:tasks.workunit.client.0.smithi029.stdout:3/317: fdatasync d1/d10/f41 0 2023-12-05T13:26:33.943 INFO:tasks.workunit.client.0.smithi029.stdout:3/318: truncate d1/d18/f1d 2873469 0 2023-12-05T13:26:33.945 INFO:tasks.workunit.client.0.smithi029.stdout:3/319: truncate d1/f2 2223815 0 2023-12-05T13:26:33.946 INFO:tasks.workunit.client.0.smithi029.stdout:7/575: dread d6/d50/d5b/d1a/d26/f2b [0,4194304] 0 2023-12-05T13:26:33.952 INFO:tasks.workunit.client.0.smithi029.stdout:7/576: symlink d6/d50/d5b/d5f/d7d/d97/d4a/laf 0 2023-12-05T13:26:33.954 INFO:tasks.workunit.client.0.smithi029.stdout:7/577: creat d6/d35/d70/fb0 x:0 0 0 2023-12-05T13:26:33.957 INFO:tasks.workunit.client.0.smithi029.stdout:2/408: dwrite de/d16/f31 [0,4194304] 0 2023-12-05T13:26:33.957 INFO:tasks.workunit.client.0.smithi029.stdout:2/409: chown f6 6 1 2023-12-05T13:26:33.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/336: dwrite d7/d2c/d33/f5b [0,4194304] 0 2023-12-05T13:26:33.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/337: write d7/f18 [1797528,105839] 0 2023-12-05T13:26:33.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/410: getdents de/d41/d56/d58 0 2023-12-05T13:26:33.962 INFO:tasks.workunit.client.0.smithi029.stdout:2/411: link de/d16/d4c/l64 de/d14/d62/l80 0 2023-12-05T13:26:33.963 INFO:tasks.workunit.client.0.smithi029.stdout:1/481: dwrite d7/d61/f59 [0,4194304] 0 2023-12-05T13:26:33.963 INFO:tasks.workunit.client.0.smithi029.stdout:9/338: dread d7/fe [0,4194304] 0 2023-12-05T13:26:33.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/339: symlink d7/d2c/d68/l6d 0 2023-12-05T13:26:33.968 INFO:tasks.workunit.client.0.smithi029.stdout:1/482: write d7/d31/f3d [915677,76030] 0 2023-12-05T13:26:33.968 INFO:tasks.workunit.client.0.smithi029.stdout:9/340: creat d7/d2c/d3a/d52/f6e x:0 0 0 2023-12-05T13:26:33.971 INFO:tasks.workunit.client.0.smithi029.stdout:9/341: mknod d7/d19/d30/d43/d67/c6f 0 2023-12-05T13:26:33.971 INFO:tasks.workunit.client.0.smithi029.stdout:9/342: dread - d7/d2c/d68/f6c zero size 2023-12-05T13:26:33.974 INFO:tasks.workunit.client.0.smithi029.stdout:9/343: creat d7/d19/d28/f70 x:0 0 0 2023-12-05T13:26:33.974 INFO:tasks.workunit.client.0.smithi029.stdout:3/320: dwrite d1/d16/f49 [0,4194304] 0 2023-12-05T13:26:33.975 INFO:tasks.workunit.client.0.smithi029.stdout:9/344: link l6 d7/d19/d30/d43/d67/l71 0 2023-12-05T13:26:33.976 INFO:tasks.workunit.client.0.smithi029.stdout:7/578: dwrite d6/d50/d5b/d5f/f84 [0,4194304] 0 2023-12-05T13:26:33.978 INFO:tasks.workunit.client.0.smithi029.stdout:3/321: mknod d1/d16/d36/d54/c61 0 2023-12-05T13:26:33.979 INFO:tasks.workunit.client.0.smithi029.stdout:3/322: readlink d1/d6/d11/l1c 0 2023-12-05T13:26:33.979 INFO:tasks.workunit.client.0.smithi029.stdout:9/345: creat d7/f72 x:0 0 0 2023-12-05T13:26:33.979 INFO:tasks.workunit.client.0.smithi029.stdout:9/346: fdatasync d7/f3c 0 2023-12-05T13:26:33.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/579: dread d6/d2a/d2f/fa7 [0,4194304] 0 2023-12-05T13:26:33.982 INFO:tasks.workunit.client.0.smithi029.stdout:9/347: mkdir d7/d19/d28/d65/d73 0 2023-12-05T13:26:33.982 INFO:tasks.workunit.client.0.smithi029.stdout:9/348: fsync d7/d19/d30/d43/f48 0 2023-12-05T13:26:33.982 INFO:tasks.workunit.client.0.smithi029.stdout:9/349: write d7/d19/d28/f37 [1362681,27184] 0 2023-12-05T13:26:33.983 INFO:tasks.workunit.client.0.smithi029.stdout:9/350: creat d7/d19/d30/d40/d4e/f74 x:0 0 0 2023-12-05T13:26:33.983 INFO:tasks.workunit.client.0.smithi029.stdout:9/351: write d7/d19/d1f/f4f [785939,100852] 0 2023-12-05T13:26:33.983 INFO:tasks.workunit.client.0.smithi029.stdout:1/483: dwrite d7/d61/d4f/f88 [0,4194304] 0 2023-12-05T13:26:33.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/352: mknod d7/d19/d30/d43/c75 0 2023-12-05T13:26:33.987 INFO:tasks.workunit.client.0.smithi029.stdout:1/484: write d7/d5e/f95 [512542,103149] 0 2023-12-05T13:26:33.988 INFO:tasks.workunit.client.0.smithi029.stdout:2/412: dwrite de/d16/f47 [4194304,4194304] 0 2023-12-05T13:26:33.992 INFO:tasks.workunit.client.0.smithi029.stdout:2/413: truncate de/d16/f1b 2464073 0 2023-12-05T13:26:33.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/353: getdents d7/d19/d28 0 2023-12-05T13:26:33.997 INFO:tasks.workunit.client.0.smithi029.stdout:7/580: dwrite d6/d35/d5c/f6c [0,4194304] 0 2023-12-05T13:26:34.004 INFO:tasks.workunit.client.0.smithi029.stdout:3/323: dwrite d1/d18/f38 [0,4194304] 0 2023-12-05T13:26:34.004 INFO:tasks.workunit.client.0.smithi029.stdout:7/581: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/fb1 x:0 0 0 2023-12-05T13:26:34.012 INFO:tasks.workunit.client.0.smithi029.stdout:2/414: dwrite de/d14/d24/f73 [0,4194304] 0 2023-12-05T13:26:34.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/415: chown de/l3a 0 1 2023-12-05T13:26:34.013 INFO:tasks.workunit.client.0.smithi029.stdout:1/485: dwrite d7/d6e/f8d [0,4194304] 0 2023-12-05T13:26:34.015 INFO:tasks.workunit.client.0.smithi029.stdout:9/354: dwrite d7/d19/d1f/f29 [0,4194304] 0 2023-12-05T13:26:34.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/416: truncate de/d14/f39 63807 0 2023-12-05T13:26:34.018 INFO:tasks.workunit.client.0.smithi029.stdout:1/486: creat d7/d31/d4b/d72/f9d x:0 0 0 2023-12-05T13:26:34.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/355: dread d7/d19/f32 [0,4194304] 0 2023-12-05T13:26:34.025 INFO:tasks.workunit.client.0.smithi029.stdout:7/582: dwrite d6/d50/d5b/f1f [0,4194304] 0 2023-12-05T13:26:34.028 INFO:tasks.workunit.client.0.smithi029.stdout:3/324: truncate d1/d18/f38 1646804 0 2023-12-05T13:26:34.029 INFO:tasks.workunit.client.0.smithi029.stdout:3/325: truncate d1/d10/f5b 766247 0 2023-12-05T13:26:34.030 INFO:tasks.workunit.client.0.smithi029.stdout:3/326: dread d1/d10/f2f [0,4194304] 0 2023-12-05T13:26:34.030 INFO:tasks.workunit.client.0.smithi029.stdout:3/327: read - d1/d10/f51 zero size 2023-12-05T13:26:34.038 INFO:tasks.workunit.client.0.smithi029.stdout:2/417: rmdir de 39 2023-12-05T13:26:34.039 INFO:tasks.workunit.client.0.smithi029.stdout:1/487: stat d7/c30 0 2023-12-05T13:26:34.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/583: mkdir d6/d50/d5b/d5f/d7d/d97/db2 0 2023-12-05T13:26:34.043 INFO:tasks.workunit.client.0.smithi029.stdout:3/328: rename d1/f25 to d1/d6/d4a/f62 0 2023-12-05T13:26:34.043 INFO:tasks.workunit.client.0.smithi029.stdout:2/418: getdents de/d6a 0 2023-12-05T13:26:34.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/488: mknod d7/d31/d4b/c9e 0 2023-12-05T13:26:34.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/489: write d7/d5e/d52/d5f/d48/f98 [270309,6993] 0 2023-12-05T13:26:34.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/490: readlink d7/d5e/l27 0 2023-12-05T13:26:34.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/491: write d7/d5e/d52/d5f/d12/f44 [854230,101094] 0 2023-12-05T13:26:34.046 INFO:tasks.workunit.client.0.smithi029.stdout:1/492: truncate d7/d31/d4b/d72/f79 988572 0 2023-12-05T13:26:34.046 INFO:tasks.workunit.client.0.smithi029.stdout:7/584: truncate d6/d50/d5b/d1a/d26/f74 2483116 0 2023-12-05T13:26:34.047 INFO:tasks.workunit.client.0.smithi029.stdout:3/329: symlink d1/d6/d4a/l63 0 2023-12-05T13:26:34.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/419: rename de/d11/l20 to de/d16/d4c/l81 0 2023-12-05T13:26:34.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/420: fdatasync de/d16/f2c 0 2023-12-05T13:26:34.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/421: stat de/d41/d56/f75 0 2023-12-05T13:26:34.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/493: mkdir d7/d61/d77/d9f 0 2023-12-05T13:26:34.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/330: symlink d1/d10/l64 0 2023-12-05T13:26:34.052 INFO:tasks.workunit.client.0.smithi029.stdout:3/331: fdatasync d1/d10/f51 0 2023-12-05T13:26:34.053 INFO:tasks.workunit.client.0.smithi029.stdout:1/494: mkdir d7/d61/da0 0 2023-12-05T13:26:34.054 INFO:tasks.workunit.client.0.smithi029.stdout:7/585: dread d6/d19/f34 [0,4194304] 0 2023-12-05T13:26:34.056 INFO:tasks.workunit.client.0.smithi029.stdout:1/495: mknod d7/d5e/d52/d5f/d12/d60/ca1 0 2023-12-05T13:26:34.057 INFO:tasks.workunit.client.0.smithi029.stdout:7/586: write d6/d50/d5b/d1a/d26/f39 [465460,3154] 0 2023-12-05T13:26:34.059 INFO:tasks.workunit.client.0.smithi029.stdout:7/587: creat d6/d35/da4/fb3 x:0 0 0 2023-12-05T13:26:34.062 INFO:tasks.workunit.client.0.smithi029.stdout:7/588: truncate d6/d35/d3e/d40/f42 2807326 0 2023-12-05T13:26:34.063 INFO:tasks.workunit.client.0.smithi029.stdout:7/589: write d6/f9 [5335911,90854] 0 2023-12-05T13:26:34.064 INFO:tasks.workunit.client.0.smithi029.stdout:1/496: dread d7/d5e/d52/d5f/d12/f74 [0,4194304] 0 2023-12-05T13:26:34.064 INFO:tasks.workunit.client.0.smithi029.stdout:1/497: fdatasync d7/d31/d4b/d72/f83 0 2023-12-05T13:26:34.065 INFO:tasks.workunit.client.0.smithi029.stdout:2/422: dwrite de/d14/f7e [0,4194304] 0 2023-12-05T13:26:34.065 INFO:tasks.workunit.client.0.smithi029.stdout:7/590: mkdir d6/d35/d3e/d40/d52/db4 0 2023-12-05T13:26:34.065 INFO:tasks.workunit.client.0.smithi029.stdout:7/591: readlink d6/d50/d5b/d5f/d7d/d97/d4a/l62 0 2023-12-05T13:26:34.065 INFO:tasks.workunit.client.0.smithi029.stdout:7/592: truncate d6/d50/d5b/d1a/d26/f31 1430785 0 2023-12-05T13:26:34.066 INFO:tasks.workunit.client.0.smithi029.stdout:1/498: getdents d7/d5e/d52/d5f/d48 0 2023-12-05T13:26:34.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/423: link de/d16/f29 de/d16/d43/f82 0 2023-12-05T13:26:34.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/424: write de/d11/f30 [930020,130019] 0 2023-12-05T13:26:34.070 INFO:tasks.workunit.client.0.smithi029.stdout:3/332: getdents d1/d6/d4a 0 2023-12-05T13:26:34.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/593: symlink d6/d50/d5b/d5f/d7d/d97/lb5 0 2023-12-05T13:26:34.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/594: write d6/d50/d5b/d1a/d26/d6e/f86 [94442,37882] 0 2023-12-05T13:26:34.073 INFO:tasks.workunit.client.0.smithi029.stdout:1/499: creat d7/d6e/fa2 x:0 0 0 2023-12-05T13:26:34.073 INFO:tasks.workunit.client.0.smithi029.stdout:1/500: read d7/d61/f59 [838572,13863] 0 2023-12-05T13:26:34.074 INFO:tasks.workunit.client.0.smithi029.stdout:2/425: symlink de/d16/l83 0 2023-12-05T13:26:34.076 INFO:tasks.workunit.client.0.smithi029.stdout:7/595: mknod d6/d50/d5b/d5f/d7d/cb6 0 2023-12-05T13:26:34.077 INFO:tasks.workunit.client.0.smithi029.stdout:1/501: mknod d7/d5e/ca3 0 2023-12-05T13:26:34.079 INFO:tasks.workunit.client.0.smithi029.stdout:1/502: write d7/d61/f59 [3826811,53413] 0 2023-12-05T13:26:34.086 INFO:tasks.workunit.client.0.smithi029.stdout:7/596: truncate d6/d19/f25 1567617 0 2023-12-05T13:26:34.094 INFO:tasks.workunit.client.0.smithi029.stdout:8/550: sync 2023-12-05T13:26:34.096 INFO:tasks.workunit.client.0.smithi029.stdout:8/551: link d5/d2f/d75/f33 d5/d6/d10/d13/db7/fb8 0 2023-12-05T13:26:34.096 INFO:tasks.workunit.client.0.smithi029.stdout:3/333: dwrite d1/d18/f38 [0,4194304] 0 2023-12-05T13:26:34.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/426: dwrite de/d11/f26 [0,4194304] 0 2023-12-05T13:26:34.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/427: chown de/d16/f29 1474 1 2023-12-05T13:26:34.100 INFO:tasks.workunit.client.0.smithi029.stdout:2/428: dread - de/d16/d6c/f7d zero size 2023-12-05T13:26:34.100 INFO:tasks.workunit.client.0.smithi029.stdout:7/597: dwrite d6/d50/d5b/d1a/d26/f5e [0,4194304] 0 2023-12-05T13:26:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:8/552: rename d5/dc/d17/d53/f60 to d5/d2f/d3a/d3c/da2/fb9 0 2023-12-05T13:26:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:3/334: truncate d1/d10/f2f 62642 0 2023-12-05T13:26:34.107 INFO:tasks.workunit.client.0.smithi029.stdout:2/429: link de/c55 de/d6a/c84 0 2023-12-05T13:26:34.111 INFO:tasks.workunit.client.0.smithi029.stdout:7/598: symlink d6/d50/d5b/d5f/d7d/d97/db2/lb7 0 2023-12-05T13:26:34.113 INFO:tasks.workunit.client.0.smithi029.stdout:3/335: symlink d1/d16/d36/l65 0 2023-12-05T13:26:34.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/430: mknod de/d14/d24/c85 0 2023-12-05T13:26:34.116 INFO:tasks.workunit.client.0.smithi029.stdout:7/599: getdents d6/d35/d5c 0 2023-12-05T13:26:34.117 INFO:tasks.workunit.client.0.smithi029.stdout:3/336: creat d1/d16/d36/f66 x:0 0 0 2023-12-05T13:26:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/431: write de/d16/f47 [6598635,103153] 0 2023-12-05T13:26:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/600: rmdir d6/d50/d5b/d5f 39 2023-12-05T13:26:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/601: chown l5 73148 1 2023-12-05T13:26:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/602: truncate d6/d50/d5b/d1a/d26/d72/f81 675745 0 2023-12-05T13:26:34.118 INFO:tasks.workunit.client.0.smithi029.stdout:7/603: fsync d6/d50/d5b/f4e 0 2023-12-05T13:26:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/604: chown d6/d35/ca6 428244 1 2023-12-05T13:26:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:2/432: write de/f13 [420667,67472] 0 2023-12-05T13:26:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:7/605: write d6/d19/f25 [53164,8835] 0 2023-12-05T13:26:34.119 INFO:tasks.workunit.client.0.smithi029.stdout:8/553: dwrite d5/f98 [0,4194304] 0 2023-12-05T13:26:34.120 INFO:tasks.workunit.client.0.smithi029.stdout:3/337: creat d1/d5e/f67 x:0 0 0 2023-12-05T13:26:34.120 INFO:tasks.workunit.client.0.smithi029.stdout:3/338: write d1/d6/f3c [1995133,44793] 0 2023-12-05T13:26:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/433: dread de/d41/f51 [0,4194304] 0 2023-12-05T13:26:34.122 INFO:tasks.workunit.client.0.smithi029.stdout:7/606: truncate d6/d50/d5b/d5f/f84 22894 0 2023-12-05T13:26:34.127 INFO:tasks.workunit.client.0.smithi029.stdout:3/339: creat d1/d16/d36/d54/f68 x:0 0 0 2023-12-05T13:26:34.128 INFO:tasks.workunit.client.0.smithi029.stdout:2/434: mknod de/d14/d62/c86 0 2023-12-05T13:26:34.129 INFO:tasks.workunit.client.0.smithi029.stdout:7/607: mkdir d6/d35/d70/d9a/db8 0 2023-12-05T13:26:34.131 INFO:tasks.workunit.client.0.smithi029.stdout:8/554: link d5/dc/f32 d5/d6/d59/fba 0 2023-12-05T13:26:34.134 INFO:tasks.workunit.client.0.smithi029.stdout:3/340: rename d1/d6/d11/c57 to d1/d6/d11/d4e/c69 0 2023-12-05T13:26:34.138 INFO:tasks.workunit.client.0.smithi029.stdout:2/435: unlink de/d14/d24/f2f 0 2023-12-05T13:26:34.138 INFO:tasks.workunit.client.0.smithi029.stdout:2/436: truncate de/d16/f2b 995607 0 2023-12-05T13:26:34.138 INFO:tasks.workunit.client.0.smithi029.stdout:2/437: write de/d14/d62/f68 [935704,131006] 0 2023-12-05T13:26:34.138 INFO:tasks.workunit.client.0.smithi029.stdout:8/555: mknod d5/dc/cbb 0 2023-12-05T13:26:34.141 INFO:tasks.workunit.client.0.smithi029.stdout:3/341: truncate d1/d10/f41 2452028 0 2023-12-05T13:26:34.147 INFO:tasks.workunit.client.0.smithi029.stdout:8/556: dread d5/d6/d59/fba [0,4194304] 0 2023-12-05T13:26:34.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/342: rmdir d1 39 2023-12-05T13:26:34.152 INFO:tasks.workunit.client.0.smithi029.stdout:3/343: mknod d1/d16/d36/d54/c6a 0 2023-12-05T13:26:34.153 INFO:tasks.workunit.client.0.smithi029.stdout:2/438: dwrite de/d41/d56/f75 [0,4194304] 0 2023-12-05T13:26:34.154 INFO:tasks.workunit.client.0.smithi029.stdout:3/344: unlink d1/d16/c30 0 2023-12-05T13:26:34.156 INFO:tasks.workunit.client.0.smithi029.stdout:2/439: mknod de/d14/d62/c87 0 2023-12-05T13:26:34.156 INFO:tasks.workunit.client.0.smithi029.stdout:3/345: rmdir d1 39 2023-12-05T13:26:34.157 INFO:tasks.workunit.client.0.smithi029.stdout:3/346: creat d1/d16/d36/d4b/f6b x:0 0 0 2023-12-05T13:26:34.158 INFO:tasks.workunit.client.0.smithi029.stdout:3/347: read d1/d18/f2e [768893,36014] 0 2023-12-05T13:26:34.158 INFO:tasks.workunit.client.0.smithi029.stdout:3/348: chown d1/fd 6 1 2023-12-05T13:26:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:2/440: dread de/d16/d43/f82 [4194304,4194304] 0 2023-12-05T13:26:34.166 INFO:tasks.workunit.client.0.smithi029.stdout:2/441: symlink de/d14/l88 0 2023-12-05T13:26:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:2/442: write de/d41/d56/f6f [858454,56117] 0 2023-12-05T13:26:34.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/349: dwrite d1/d6/d4a/f62 [0,4194304] 0 2023-12-05T13:26:34.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/350: mkdir d1/d16/d36/d3a/d6c 0 2023-12-05T13:26:34.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/351: truncate d1/f48 4918057 0 2023-12-05T13:26:34.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/352: chown d1/d16/d1f/l60 6184 1 2023-12-05T13:26:34.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/353: creat d1/d5e/f6d x:0 0 0 2023-12-05T13:26:34.177 INFO:tasks.workunit.client.0.smithi029.stdout:3/354: getdents d1/d6/d11 0 2023-12-05T13:26:34.177 INFO:tasks.workunit.client.0.smithi029.stdout:3/355: read d1/fd [3947226,87035] 0 2023-12-05T13:26:34.179 INFO:tasks.workunit.client.0.smithi029.stdout:3/356: unlink d1/d16/d36/d54/c6a 0 2023-12-05T13:26:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:3/357: link d1/d6/d11/f1e d1/d10/f6e 0 2023-12-05T13:26:34.180 INFO:tasks.workunit.client.0.smithi029.stdout:2/443: dwrite de/d16/d43/f82 [0,4194304] 0 2023-12-05T13:26:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:2/444: fsync de/d14/d24/f73 0 2023-12-05T13:26:34.181 INFO:tasks.workunit.client.0.smithi029.stdout:2/445: write de/f12 [2335690,87156] 0 2023-12-05T13:26:34.182 INFO:tasks.workunit.client.0.smithi029.stdout:2/446: creat de/d14/d24/f89 x:0 0 0 2023-12-05T13:26:34.200 INFO:tasks.workunit.client.0.smithi029.stdout:3/358: dwrite d1/d18/f45 [0,4194304] 0 2023-12-05T13:26:34.201 INFO:tasks.workunit.client.0.smithi029.stdout:3/359: mknod d1/d6/c6f 0 2023-12-05T13:26:34.201 INFO:tasks.workunit.client.0.smithi029.stdout:3/360: symlink d1/d16/d36/d54/l70 0 2023-12-05T13:26:34.202 INFO:tasks.workunit.client.0.smithi029.stdout:3/361: truncate d1/d16/d36/d54/f68 798307 0 2023-12-05T13:26:34.203 INFO:tasks.workunit.client.0.smithi029.stdout:3/362: rename d1/d6/d11/f12 to d1/d10/f71 0 2023-12-05T13:26:34.204 INFO:tasks.workunit.client.0.smithi029.stdout:3/363: mkdir d1/d6/d11/d4e/d72 0 2023-12-05T13:26:34.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/364: dwrite d1/d6/f3c [0,4194304] 0 2023-12-05T13:26:34.217 INFO:tasks.workunit.client.0.smithi029.stdout:3/365: stat d1/d10/f2f 0 2023-12-05T13:26:34.218 INFO:tasks.workunit.client.0.smithi029.stdout:3/366: rename d1/d6/fa to d1/f73 0 2023-12-05T13:26:34.219 INFO:tasks.workunit.client.0.smithi029.stdout:3/367: dread - d1/d10/f5d zero size 2023-12-05T13:26:34.219 INFO:tasks.workunit.client.0.smithi029.stdout:3/368: fdatasync d1/d16/d36/d54/f68 0 2023-12-05T13:26:34.220 INFO:tasks.workunit.client.0.smithi029.stdout:3/369: dread d1/d6/f52 [0,4194304] 0 2023-12-05T13:26:34.220 INFO:tasks.workunit.client.0.smithi029.stdout:3/370: stat d1/d10/c24 0 2023-12-05T13:26:34.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/371: unlink d1/d6/d11/d4e/c69 0 2023-12-05T13:26:34.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/372: chown d1/d16/d36/d4b/f6b 108238 1 2023-12-05T13:26:34.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/373: chown d1/d18/c4d 1028749889 1 2023-12-05T13:26:34.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/374: chown d1/d16/d36/d54/l5a 11974231 1 2023-12-05T13:26:34.221 INFO:tasks.workunit.client.0.smithi029.stdout:3/375: mkdir d1/d5e/d74 0 2023-12-05T13:26:34.222 INFO:tasks.workunit.client.0.smithi029.stdout:3/376: dread d1/d6/f3f [0,4194304] 0 2023-12-05T13:26:34.223 INFO:tasks.workunit.client.0.smithi029.stdout:3/377: symlink d1/d16/l75 0 2023-12-05T13:26:34.224 INFO:tasks.workunit.client.0.smithi029.stdout:3/378: chown d1/d10/l46 10 1 2023-12-05T13:26:34.224 INFO:tasks.workunit.client.0.smithi029.stdout:3/379: mknod d1/d16/d36/d3a/c76 0 2023-12-05T13:26:34.225 INFO:tasks.workunit.client.0.smithi029.stdout:3/380: write d1/d18/f45 [186357,66640] 0 2023-12-05T13:26:34.225 INFO:tasks.workunit.client.0.smithi029.stdout:3/381: fsync d1/d16/d1f/d4c/f4f 0 2023-12-05T13:26:34.225 INFO:tasks.workunit.client.0.smithi029.stdout:3/382: fdatasync d1/f73 0 2023-12-05T13:26:34.226 INFO:tasks.workunit.client.0.smithi029.stdout:3/383: symlink d1/d6/d11/d4e/d72/l77 0 2023-12-05T13:26:34.226 INFO:tasks.workunit.client.0.smithi029.stdout:3/384: dread - d1/d5e/f67 zero size 2023-12-05T13:26:34.227 INFO:tasks.workunit.client.0.smithi029.stdout:3/385: link d1/d18/f55 d1/d5e/d74/f78 0 2023-12-05T13:26:34.234 INFO:tasks.workunit.client.0.smithi029.stdout:3/386: fsync d1/d6/f2a 0 2023-12-05T13:26:34.248 INFO:tasks.workunit.client.0.smithi029.stdout:3/387: dwrite d1/d16/f49 [0,4194304] 0 2023-12-05T13:26:34.249 INFO:tasks.workunit.client.0.smithi029.stdout:3/388: creat d1/d16/d1f/d4c/f79 x:0 0 0 2023-12-05T13:26:34.249 INFO:tasks.workunit.client.0.smithi029.stdout:3/389: mknod d1/d5e/d74/c7a 0 2023-12-05T13:26:34.249 INFO:tasks.workunit.client.0.smithi029.stdout:3/390: chown d1/d18 0 1 2023-12-05T13:26:34.261 INFO:tasks.workunit.client.0.smithi029.stdout:3/391: dwrite d1/d6/f2a [4194304,4194304] 0 2023-12-05T13:26:34.273 INFO:tasks.workunit.client.0.smithi029.stdout:3/392: dwrite d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:34.274 INFO:tasks.workunit.client.0.smithi029.stdout:3/393: symlink d1/d10/l7b 0 2023-12-05T13:26:34.276 INFO:tasks.workunit.client.0.smithi029.stdout:3/394: write d1/d16/f49 [573496,107427] 0 2023-12-05T13:26:34.276 INFO:tasks.workunit.client.0.smithi029.stdout:3/395: symlink d1/d6/d11/l7c 0 2023-12-05T13:26:34.277 INFO:tasks.workunit.client.0.smithi029.stdout:3/396: read d1/d18/f20 [1906060,121072] 0 2023-12-05T13:26:34.286 INFO:tasks.workunit.client.0.smithi029.stdout:3/397: dread d1/d18/f45 [0,4194304] 0 2023-12-05T13:26:34.287 INFO:tasks.workunit.client.0.smithi029.stdout:3/398: truncate d1/d10/f41 627407 0 2023-12-05T13:26:34.287 INFO:tasks.workunit.client.0.smithi029.stdout:3/399: truncate d1/d10/f5b 588184 0 2023-12-05T13:26:34.302 INFO:tasks.workunit.client.0.smithi029.stdout:3/400: dwrite d1/d6/f2a [4194304,4194304] 0 2023-12-05T13:26:34.305 INFO:tasks.workunit.client.0.smithi029.stdout:3/401: mkdir d1/d16/d36/d3a/d6c/d7d 0 2023-12-05T13:26:34.308 INFO:tasks.workunit.client.0.smithi029.stdout:5/331: sync 2023-12-05T13:26:34.309 INFO:tasks.workunit.client.0.smithi029.stdout:5/332: mkdir d1/dc/d10/d1e/d75 0 2023-12-05T13:26:34.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/333: stat d1/c67 0 2023-12-05T13:26:34.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/334: creat d1/dc/d38/d55/d57/f76 x:0 0 0 2023-12-05T13:26:34.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/335: truncate d1/dc/d11/f12 2379861 0 2023-12-05T13:26:34.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/336: mknod d1/dc/d38/d4b/c77 0 2023-12-05T13:26:34.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/337: readlink d1/dc/d10/l4e 0 2023-12-05T13:26:34.313 INFO:tasks.workunit.client.0.smithi029.stdout:5/338: write d1/dc/d38/f22 [90810,42846] 0 2023-12-05T13:26:34.313 INFO:tasks.workunit.client.0.smithi029.stdout:5/339: chown d1/dc/d38/d55/f6e 2 1 2023-12-05T13:26:34.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/340: read d1/dc/d11/d17/d29/f4f [397124,69293] 0 2023-12-05T13:26:34.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/341: creat d1/dc/d38/f78 x:0 0 0 2023-12-05T13:26:34.318 INFO:tasks.workunit.client.0.smithi029.stdout:5/342: link d1/dc/d10/d1e/f65 d1/dc/d11/f79 0 2023-12-05T13:26:34.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/343: dread - d1/f60 zero size 2023-12-05T13:26:34.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/344: write d1/dc/d11/d17/d29/f43 [956124,123720] 0 2023-12-05T13:26:34.319 INFO:tasks.workunit.client.0.smithi029.stdout:3/402: dwrite d1/fd [0,4194304] 0 2023-12-05T13:26:34.319 INFO:tasks.workunit.client.0.smithi029.stdout:5/345: write d1/dc/d27/f49 [126675,58427] 0 2023-12-05T13:26:34.322 INFO:tasks.workunit.client.0.smithi029.stdout:3/403: link d1/d16/d1f/d4c/f79 d1/d16/d36/d54/f7e 0 2023-12-05T13:26:34.324 INFO:tasks.workunit.client.0.smithi029.stdout:3/404: mknod d1/d16/d1f/d4c/c7f 0 2023-12-05T13:26:34.325 INFO:tasks.workunit.client.0.smithi029.stdout:3/405: rmdir d1/d6/d4a 39 2023-12-05T13:26:34.325 INFO:tasks.workunit.client.0.smithi029.stdout:3/406: write d1/d18/f20 [82972,48353] 0 2023-12-05T13:26:34.326 INFO:tasks.workunit.client.0.smithi029.stdout:3/407: fdatasync d1/d16/d36/d4b/f6b 0 2023-12-05T13:26:34.327 INFO:tasks.workunit.client.0.smithi029.stdout:3/408: truncate d1/d6/d11/f1e 515375 0 2023-12-05T13:26:34.327 INFO:tasks.workunit.client.0.smithi029.stdout:3/409: chown d1/d6/d11/f1e 0 1 2023-12-05T13:26:34.328 INFO:tasks.workunit.client.0.smithi029.stdout:3/410: mknod d1/d16/d1f/c80 0 2023-12-05T13:26:34.329 INFO:tasks.workunit.client.0.smithi029.stdout:3/411: creat d1/d5e/d74/f81 x:0 0 0 2023-12-05T13:26:34.330 INFO:tasks.workunit.client.0.smithi029.stdout:3/412: creat d1/d6/d11/d4e/d72/f82 x:0 0 0 2023-12-05T13:26:34.332 INFO:tasks.workunit.client.0.smithi029.stdout:3/413: write d1/f73 [1759283,96566] 0 2023-12-05T13:26:34.333 INFO:tasks.workunit.client.0.smithi029.stdout:3/414: unlink d1/f73 0 2023-12-05T13:26:34.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/415: dwrite d1/d10/f41 [0,4194304] 0 2023-12-05T13:26:34.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/416: chown d1/d16/d36/d54/f7e 233295 1 2023-12-05T13:26:34.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/417: truncate d1/d18/f55 807850 0 2023-12-05T13:26:34.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/418: mknod d1/d16/d1f/d4c/c83 0 2023-12-05T13:26:34.354 INFO:tasks.workunit.client.0.smithi029.stdout:3/419: link d1/d6/f23 d1/d16/d36/d54/f84 0 2023-12-05T13:26:34.355 INFO:tasks.workunit.client.0.smithi029.stdout:3/420: symlink d1/d16/d36/d3a/d6c/d7d/l85 0 2023-12-05T13:26:34.364 INFO:tasks.workunit.client.0.smithi029.stdout:3/421: dread d1/d18/f20 [0,4194304] 0 2023-12-05T13:26:34.365 INFO:tasks.workunit.client.0.smithi029.stdout:3/422: truncate d1/d10/f5d 661161 0 2023-12-05T13:26:34.368 INFO:tasks.workunit.client.0.smithi029.stdout:3/423: dread d1/d10/f6e [0,4194304] 0 2023-12-05T13:26:34.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/424: symlink d1/d16/l86 0 2023-12-05T13:26:34.370 INFO:tasks.workunit.client.0.smithi029.stdout:3/425: rename d1/d6/f3f to d1/d10/f87 0 2023-12-05T13:26:34.370 INFO:tasks.workunit.client.0.smithi029.stdout:3/426: chown d1/d10/f41 469191 1 2023-12-05T13:26:34.371 INFO:tasks.workunit.client.0.smithi029.stdout:3/427: symlink d1/d5e/l88 0 2023-12-05T13:26:34.375 INFO:tasks.workunit.client.0.smithi029.stdout:3/428: getdents d1/d5e 0 2023-12-05T13:26:34.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/429: unlink d1/d6/d4a/f62 0 2023-12-05T13:26:34.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/430: mknod d1/d5e/d74/c89 0 2023-12-05T13:26:34.377 INFO:tasks.workunit.client.0.smithi029.stdout:3/431: dread - d1/d16/d36/f66 zero size 2023-12-05T13:26:34.377 INFO:tasks.workunit.client.0.smithi029.stdout:3/432: mkdir d1/d6/d4a/d8a 0 2023-12-05T13:26:34.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/433: rmdir d1/d18 39 2023-12-05T13:26:34.379 INFO:tasks.workunit.client.0.smithi029.stdout:3/434: dread d1/d10/f5b [0,4194304] 0 2023-12-05T13:26:34.379 INFO:tasks.workunit.client.0.smithi029.stdout:3/435: readlink d1/d6/d11/l1c 0 2023-12-05T13:26:34.380 INFO:tasks.workunit.client.0.smithi029.stdout:3/436: truncate d1/f43 1306664 0 2023-12-05T13:26:34.380 INFO:tasks.workunit.client.0.smithi029.stdout:3/437: chown d1/d6/d11/d4e/d72/l77 27 1 2023-12-05T13:26:34.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/438: write d1/d10/f6e [578203,74329] 0 2023-12-05T13:26:34.385 INFO:tasks.workunit.client.0.smithi029.stdout:3/439: getdents d1/d10 0 2023-12-05T13:26:34.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/440: mknod d1/d6/d11/d4e/d72/c8b 0 2023-12-05T13:26:34.387 INFO:tasks.workunit.client.0.smithi029.stdout:3/441: creat d1/d10/f8c x:0 0 0 2023-12-05T13:26:34.391 INFO:tasks.workunit.client.0.smithi029.stdout:3/442: dread d1/f2 [0,4194304] 0 2023-12-05T13:26:34.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/443: dwrite d1/d16/f49 [0,4194304] 0 2023-12-05T13:26:34.405 INFO:tasks.workunit.client.0.smithi029.stdout:3/444: write d1/d16/d36/d4b/f58 [694572,30279] 0 2023-12-05T13:26:34.406 INFO:tasks.workunit.client.0.smithi029.stdout:3/445: mkdir d1/d16/d36/d8d 0 2023-12-05T13:26:34.406 INFO:tasks.workunit.client.0.smithi029.stdout:3/446: chown d1/d16/d36/d54/l5a 1827058 1 2023-12-05T13:26:34.413 INFO:tasks.workunit.client.0.smithi029.stdout:3/447: dread d1/d16/f49 [0,4194304] 0 2023-12-05T13:26:34.414 INFO:tasks.workunit.client.0.smithi029.stdout:3/448: mknod d1/d16/d36/c8e 0 2023-12-05T13:26:34.414 INFO:tasks.workunit.client.0.smithi029.stdout:3/449: readlink d1/d10/l7b 0 2023-12-05T13:26:34.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/450: dread d1/d16/d1f/d4c/f4f [4194304,4194304] 0 2023-12-05T13:26:34.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/451: fsync d1/f43 0 2023-12-05T13:26:34.416 INFO:tasks.workunit.client.0.smithi029.stdout:3/452: creat d1/d16/d36/d3a/d6c/f8f x:0 0 0 2023-12-05T13:26:34.438 INFO:tasks.workunit.client.0.smithi029.stdout:3/453: dwrite d1/d16/d36/d4b/f58 [0,4194304] 0 2023-12-05T13:26:34.439 INFO:tasks.workunit.client.0.smithi029.stdout:3/454: symlink d1/d10/l90 0 2023-12-05T13:26:34.440 INFO:tasks.workunit.client.0.smithi029.stdout:3/455: rename d1/d16/d36/d54 to d1/d10/d91 0 2023-12-05T13:26:34.453 INFO:tasks.workunit.client.0.smithi029.stdout:3/456: dwrite d1/d6/f2a [0,4194304] 0 2023-12-05T13:26:34.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/457: creat d1/d16/d36/d8d/f92 x:0 0 0 2023-12-05T13:26:34.456 INFO:tasks.workunit.client.0.smithi029.stdout:3/458: rename d1/d6/f23 to d1/d5e/d74/f93 0 2023-12-05T13:26:34.456 INFO:tasks.workunit.client.0.smithi029.stdout:3/459: truncate d1/f2 1112776 0 2023-12-05T13:26:34.457 INFO:tasks.workunit.client.0.smithi029.stdout:3/460: symlink d1/d5e/d74/l94 0 2023-12-05T13:26:34.473 INFO:tasks.workunit.client.0.smithi029.stdout:3/461: dwrite d1/d16/d36/f66 [0,4194304] 0 2023-12-05T13:26:34.475 INFO:tasks.workunit.client.0.smithi029.stdout:3/462: mkdir d1/d16/d36/d3a/d6c/d7d/d95 0 2023-12-05T13:26:34.476 INFO:tasks.workunit.client.0.smithi029.stdout:3/463: creat d1/d10/d91/f96 x:0 0 0 2023-12-05T13:26:34.477 INFO:tasks.workunit.client.0.smithi029.stdout:3/464: creat d1/d6/d4a/f97 x:0 0 0 2023-12-05T13:26:34.477 INFO:tasks.workunit.client.0.smithi029.stdout:3/465: write d1/d18/f20 [3674166,16855] 0 2023-12-05T13:26:34.492 INFO:tasks.workunit.client.0.smithi029.stdout:3/466: dwrite d1/d10/f5d [0,4194304] 0 2023-12-05T13:26:34.492 INFO:tasks.workunit.client.0.smithi029.stdout:3/467: chown d1/d6/d11/l7c 1179066780 1 2023-12-05T13:26:34.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/468: dwrite d1/d10/f5d [4194304,4194304] 0 2023-12-05T13:26:34.510 INFO:tasks.workunit.client.0.smithi029.stdout:3/469: symlink d1/d16/d36/d8d/l98 0 2023-12-05T13:26:34.510 INFO:tasks.workunit.client.0.smithi029.stdout:3/470: write d1/d16/d36/d8d/f92 [573132,1045] 0 2023-12-05T13:26:34.511 INFO:tasks.workunit.client.0.smithi029.stdout:3/471: getdents d1/d16 0 2023-12-05T13:26:34.512 INFO:tasks.workunit.client.0.smithi029.stdout:3/472: rename d1/d6/d4a/l63 to d1/d16/d36/d3a/d6c/l99 0 2023-12-05T13:26:34.514 INFO:tasks.workunit.client.0.smithi029.stdout:3/473: unlink d1/d16/d1f/d4c/c7f 0 2023-12-05T13:26:34.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/474: symlink d1/d16/d36/d3a/d6c/l9a 0 2023-12-05T13:26:34.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/475: creat d1/d6/d4a/f9b x:0 0 0 2023-12-05T13:26:34.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/476: fsync d1/d18/f38 0 2023-12-05T13:26:34.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/477: chown d1/d10/d91 76 1 2023-12-05T13:26:34.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/478: mkdir d1/d16/d9c 0 2023-12-05T13:26:34.517 INFO:tasks.workunit.client.0.smithi029.stdout:3/479: mknod d1/d6/d11/d4e/c9d 0 2023-12-05T13:26:34.530 INFO:tasks.workunit.client.0.smithi029.stdout:3/480: dwrite d1/d6/f3c [0,4194304] 0 2023-12-05T13:26:34.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/481: write d1/f2 [814501,45242] 0 2023-12-05T13:26:34.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/482: chown d1/d5e/d74/f93 1836 1 2023-12-05T13:26:34.531 INFO:tasks.workunit.client.0.smithi029.stdout:3/483: mknod d1/d10/c9e 0 2023-12-05T13:26:34.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/484: unlink d1/d10/l46 0 2023-12-05T13:26:34.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/485: read d1/d18/f55 [553465,11687] 0 2023-12-05T13:26:34.533 INFO:tasks.workunit.client.0.smithi029.stdout:3/486: readlink d1/d18/l40 0 2023-12-05T13:26:34.534 INFO:tasks.workunit.client.0.smithi029.stdout:3/487: unlink d1/d18/c27 0 2023-12-05T13:26:34.534 INFO:tasks.workunit.client.0.smithi029.stdout:3/488: chown d1/f2 13694455 1 2023-12-05T13:26:34.534 INFO:tasks.workunit.client.0.smithi029.stdout:3/489: write d1/d16/d36/d4b/f53 [419667,102499] 0 2023-12-05T13:26:34.535 INFO:tasks.workunit.client.0.smithi029.stdout:3/490: unlink d1/f43 0 2023-12-05T13:26:34.540 INFO:tasks.workunit.client.0.smithi029.stdout:4/353: sync 2023-12-05T13:26:34.540 INFO:tasks.workunit.client.0.smithi029.stdout:4/354: chown d0/de/d30/d32/d35/d3d/f57 16823281 1 2023-12-05T13:26:34.540 INFO:tasks.workunit.client.0.smithi029.stdout:6/418: sync 2023-12-05T13:26:34.540 INFO:tasks.workunit.client.0.smithi029.stdout:4/355: chown d0/de/d30/d32/d35/d3d/l52 134764261 1 2023-12-05T13:26:34.541 INFO:tasks.workunit.client.0.smithi029.stdout:4/356: creat d0/d16/d2f/f76 x:0 0 0 2023-12-05T13:26:34.542 INFO:tasks.workunit.client.0.smithi029.stdout:3/491: getdents d1/d16/d36/d3a/d6c 0 2023-12-05T13:26:34.543 INFO:tasks.workunit.client.0.smithi029.stdout:6/419: creat d6/d64/d65/d40/f8d x:0 0 0 2023-12-05T13:26:34.543 INFO:tasks.workunit.client.0.smithi029.stdout:6/420: dread - d6/d1d/d39/f87 zero size 2023-12-05T13:26:34.549 INFO:tasks.workunit.client.0.smithi029.stdout:3/492: dread d1/d18/f1d [0,4194304] 0 2023-12-05T13:26:34.550 INFO:tasks.workunit.client.0.smithi029.stdout:4/357: dread d0/f1d [0,4194304] 0 2023-12-05T13:26:34.550 INFO:tasks.workunit.client.0.smithi029.stdout:3/493: rename d1/d6/d11/c26 to d1/d16/d1f/c9f 0 2023-12-05T13:26:34.550 INFO:tasks.workunit.client.0.smithi029.stdout:3/494: chown d1/d6/f3c 122798426 1 2023-12-05T13:26:34.551 INFO:tasks.workunit.client.0.smithi029.stdout:6/421: dread d6/d64/d65/d40/f66 [0,4194304] 0 2023-12-05T13:26:34.552 INFO:tasks.workunit.client.0.smithi029.stdout:3/495: creat d1/d18/fa0 x:0 0 0 2023-12-05T13:26:34.552 INFO:tasks.workunit.client.0.smithi029.stdout:3/496: stat d1/d16/d36/d3a/f3d 0 2023-12-05T13:26:34.552 INFO:tasks.workunit.client.0.smithi029.stdout:6/422: write d6/d64/d65/d40/f66 [3177765,15197] 0 2023-12-05T13:26:34.552 INFO:tasks.workunit.client.0.smithi029.stdout:6/423: write d6/f45 [1391568,77381] 0 2023-12-05T13:26:34.554 INFO:tasks.workunit.client.0.smithi029.stdout:3/497: unlink d1/d6/d11/d4e/d72/f82 0 2023-12-05T13:26:34.554 INFO:tasks.workunit.client.0.smithi029.stdout:6/424: dread d6/d1d/f55 [0,4194304] 0 2023-12-05T13:26:34.554 INFO:tasks.workunit.client.0.smithi029.stdout:6/425: fsync d6/f10 0 2023-12-05T13:26:34.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/498: creat d1/d16/d36/d3a/d6c/d7d/fa1 x:0 0 0 2023-12-05T13:26:34.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/499: write d1/d5e/d74/f81 [907654,121991] 0 2023-12-05T13:26:34.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/500: rename d1/d16 to d1/d16/d9c/da2 22 2023-12-05T13:26:34.556 INFO:tasks.workunit.client.0.smithi029.stdout:3/501: write d1/d16/d36/d8d/f92 [722104,83533] 0 2023-12-05T13:26:34.556 INFO:tasks.workunit.client.0.smithi029.stdout:6/426: mknod d6/d64/d6d/c8e 0 2023-12-05T13:26:34.557 INFO:tasks.workunit.client.0.smithi029.stdout:3/502: dread d1/d10/d91/f68 [0,4194304] 0 2023-12-05T13:26:34.557 INFO:tasks.workunit.client.0.smithi029.stdout:3/503: fsync d1/d10/f71 0 2023-12-05T13:26:34.558 INFO:tasks.workunit.client.0.smithi029.stdout:3/504: mkdir d1/d6/d11/da3 0 2023-12-05T13:26:34.560 INFO:tasks.workunit.client.0.smithi029.stdout:3/505: rmdir d1/d6/d4a/d8a 0 2023-12-05T13:26:34.560 INFO:tasks.workunit.client.0.smithi029.stdout:3/506: write d1/d5e/f67 [263906,88174] 0 2023-12-05T13:26:34.567 INFO:tasks.workunit.client.0.smithi029.stdout:6/427: dread d6/d64/d65/d40/d74/d52/d5c/d6f/f88 [0,4194304] 0 2023-12-05T13:26:34.567 INFO:tasks.workunit.client.0.smithi029.stdout:6/428: chown d6/d1d/d36/f42 979907572 1 2023-12-05T13:26:34.578 INFO:tasks.workunit.client.0.smithi029.stdout:4/358: dwrite d0/d41/f53 [0,4194304] 0 2023-12-05T13:26:34.578 INFO:tasks.workunit.client.0.smithi029.stdout:4/359: readlink d0/d1/l1e 0 2023-12-05T13:26:34.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/360: write d0/d16/d22/f61 [436864,3688] 0 2023-12-05T13:26:34.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/361: chown d0/d16/d22/d4f/f59 5813857 1 2023-12-05T13:26:34.582 INFO:tasks.workunit.client.0.smithi029.stdout:6/429: dwrite d6/d64/d65/d40/f8d [0,4194304] 0 2023-12-05T13:26:34.582 INFO:tasks.workunit.client.0.smithi029.stdout:6/430: fdatasync d6/f4f 0 2023-12-05T13:26:34.584 INFO:tasks.workunit.client.0.smithi029.stdout:6/431: mkdir d6/d64/d65/d40/d4d/d8f 0 2023-12-05T13:26:34.584 INFO:tasks.workunit.client.0.smithi029.stdout:6/432: fdatasync d6/d64/d65/d40/f6b 0 2023-12-05T13:26:34.585 INFO:tasks.workunit.client.0.smithi029.stdout:6/433: creat d6/d1d/d39/d58/f90 x:0 0 0 2023-12-05T13:26:34.585 INFO:tasks.workunit.client.0.smithi029.stdout:6/434: mknod d6/d3f/c91 0 2023-12-05T13:26:34.586 INFO:tasks.workunit.client.0.smithi029.stdout:6/435: symlink d6/d1d/d39/d58/l92 0 2023-12-05T13:26:34.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/436: dread d6/d64/d65/d40/d74/f53 [0,4194304] 0 2023-12-05T13:26:34.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/437: truncate d6/d1d/d36/f69 3831009 0 2023-12-05T13:26:34.596 INFO:tasks.workunit.client.0.smithi029.stdout:6/438: mkdir d6/d93 0 2023-12-05T13:26:34.597 INFO:tasks.workunit.client.0.smithi029.stdout:6/439: rmdir d6/d64/d65/d40/d74/d59 39 2023-12-05T13:26:34.598 INFO:tasks.workunit.client.0.smithi029.stdout:6/440: write d6/d64/d65/d40/f6b [4182637,8873] 0 2023-12-05T13:26:34.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/441: symlink d6/d1d/d39/d58/d71/l94 0 2023-12-05T13:26:34.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/442: truncate d6/d1d/d39/f87 725134 0 2023-12-05T13:26:34.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/443: stat d6/d1d/d39/d58 0 2023-12-05T13:26:34.613 INFO:tasks.workunit.client.0.smithi029.stdout:6/444: dwrite d6/d1d/d36/f7d [0,4194304] 0 2023-12-05T13:26:34.616 INFO:tasks.workunit.client.0.smithi029.stdout:6/445: rmdir d6/d64/d65/d40/d4d 39 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/356: sync 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:0/530: sync 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:2/447: sync 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:7/608: sync 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:1/503: sync 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:0/531: chown dc/f3f 0 1 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:2/448: chown de/f13 222 1 2023-12-05T13:26:34.617 INFO:tasks.workunit.client.0.smithi029.stdout:1/504: fsync d7/d61/d4f/f8a 0 2023-12-05T13:26:34.618 INFO:tasks.workunit.client.0.smithi029.stdout:8/557: sync 2023-12-05T13:26:34.635 INFO:tasks.workunit.client.0.smithi029.stdout:9/357: link l6 d7/d2c/l76 0 2023-12-05T13:26:34.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/532: mknod dc/d23/d3a/d41/d57/d58/ca7 0 2023-12-05T13:26:34.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/533: fdatasync f0 0 2023-12-05T13:26:34.637 INFO:tasks.workunit.client.0.smithi029.stdout:7/609: creat d6/d50/d5b/d5f/d7d/d97/d4a/fb9 x:0 0 0 2023-12-05T13:26:34.639 INFO:tasks.workunit.client.0.smithi029.stdout:2/449: symlink de/l8a 0 2023-12-05T13:26:34.640 INFO:tasks.workunit.client.0.smithi029.stdout:6/446: dwrite d6/d64/d65/f5e [0,4194304] 0 2023-12-05T13:26:34.640 INFO:tasks.workunit.client.0.smithi029.stdout:1/505: link d7/d5e/d52/f57 d7/d31/fa4 0 2023-12-05T13:26:34.642 INFO:tasks.workunit.client.0.smithi029.stdout:0/534: rmdir dc/d33/d3d/d7e 39 2023-12-05T13:26:34.649 INFO:tasks.workunit.client.0.smithi029.stdout:7/610: mknod d6/d2a/d2f/cba 0 2023-12-05T13:26:34.649 INFO:tasks.workunit.client.0.smithi029.stdout:6/447: creat d6/d1d/d39/f95 x:0 0 0 2023-12-05T13:26:34.649 INFO:tasks.workunit.client.0.smithi029.stdout:6/448: write d6/f54 [1804620,117887] 0 2023-12-05T13:26:34.651 INFO:tasks.workunit.client.0.smithi029.stdout:8/558: rename d5/dc/d17 to d5/dbc 0 2023-12-05T13:26:34.651 INFO:tasks.workunit.client.0.smithi029.stdout:8/559: stat d5/dc/d18 0 2023-12-05T13:26:34.651 INFO:tasks.workunit.client.0.smithi029.stdout:2/450: dread de/f27 [0,4194304] 0 2023-12-05T13:26:34.652 INFO:tasks.workunit.client.0.smithi029.stdout:0/535: symlink dc/d13/d4f/d88/la8 0 2023-12-05T13:26:34.653 INFO:tasks.workunit.client.0.smithi029.stdout:8/560: rename d5/d6/d10/d13/f55 to d5/dbc/fbd 0 2023-12-05T13:26:34.654 INFO:tasks.workunit.client.0.smithi029.stdout:2/451: symlink de/d14/d24/l8b 0 2023-12-05T13:26:34.657 INFO:tasks.workunit.client.0.smithi029.stdout:8/561: creat d5/d2f/d3a/d3c/da2/fbe x:0 0 0 2023-12-05T13:26:34.659 INFO:tasks.workunit.client.0.smithi029.stdout:1/506: dwrite d7/d5e/f47 [0,4194304] 0 2023-12-05T13:26:34.659 INFO:tasks.workunit.client.0.smithi029.stdout:9/358: dwrite d7/d19/d30/d43/f62 [0,4194304] 0 2023-12-05T13:26:34.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/452: symlink de/d14/d24/l8c 0 2023-12-05T13:26:34.659 INFO:tasks.workunit.client.0.smithi029.stdout:2/453: chown de/d14/d24/f40 57212908 1 2023-12-05T13:26:34.661 INFO:tasks.workunit.client.0.smithi029.stdout:8/562: creat d5/dc/d18/fbf x:0 0 0 2023-12-05T13:26:34.667 INFO:tasks.workunit.client.0.smithi029.stdout:9/359: mknod d7/c77 0 2023-12-05T13:26:34.668 INFO:tasks.workunit.client.0.smithi029.stdout:6/449: dwrite d6/fa [0,4194304] 0 2023-12-05T13:26:34.668 INFO:tasks.workunit.client.0.smithi029.stdout:2/454: link de/d11/d32/f5a de/d14/f8d 0 2023-12-05T13:26:34.669 INFO:tasks.workunit.client.0.smithi029.stdout:2/455: stat de/d16/d43/f72 0 2023-12-05T13:26:34.670 INFO:tasks.workunit.client.0.smithi029.stdout:9/360: mknod d7/d19/d28/d65/d73/c78 0 2023-12-05T13:26:34.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/450: creat d6/d64/d65/d40/d4d/f96 x:0 0 0 2023-12-05T13:26:34.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/451: chown d6/d1d/d39/d58/d82 883 1 2023-12-05T13:26:34.671 INFO:tasks.workunit.client.0.smithi029.stdout:6/452: getdents d6/d93 0 2023-12-05T13:26:34.673 INFO:tasks.workunit.client.0.smithi029.stdout:2/456: mkdir de/d16/d6c/d8e 0 2023-12-05T13:26:34.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/453: write d6/fe [2426815,124860] 0 2023-12-05T13:26:34.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/454: write d6/d64/d65/d40/d4d/f57 [760228,129558] 0 2023-12-05T13:26:34.674 INFO:tasks.workunit.client.0.smithi029.stdout:9/361: mknod d7/c79 0 2023-12-05T13:26:34.675 INFO:tasks.workunit.client.0.smithi029.stdout:2/457: creat de/d41/d56/f8f x:0 0 0 2023-12-05T13:26:34.677 INFO:tasks.workunit.client.0.smithi029.stdout:6/455: symlink d6/d29/l97 0 2023-12-05T13:26:34.678 INFO:tasks.workunit.client.0.smithi029.stdout:9/362: mknod d7/d19/d30/d43/d67/c7a 0 2023-12-05T13:26:34.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/563: dread d5/d6/f4b [0,4194304] 0 2023-12-05T13:26:34.678 INFO:tasks.workunit.client.0.smithi029.stdout:1/507: dwrite d7/d5e/d52/d5f/d48/f66 [0,4194304] 0 2023-12-05T13:26:34.679 INFO:tasks.workunit.client.0.smithi029.stdout:6/456: link d6/d64/d65/d40/d74/d59/c67 d6/d1d/d39/d58/d82/c98 0 2023-12-05T13:26:34.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/508: dread d7/d61/f92 [0,4194304] 0 2023-12-05T13:26:34.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/509: read d7/d5e/f95 [656970,127336] 0 2023-12-05T13:26:34.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/510: fsync d7/d5e/d52/d5f/d12/d60/f8c 0 2023-12-05T13:26:34.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/511: chown d7/d31/d4b/l82 9992550 1 2023-12-05T13:26:34.681 INFO:tasks.workunit.client.0.smithi029.stdout:9/363: dread d7/d19/d1f/f46 [0,4194304] 0 2023-12-05T13:26:34.681 INFO:tasks.workunit.client.0.smithi029.stdout:8/564: rmdir d5/d2f/d3a/d86 39 2023-12-05T13:26:34.683 INFO:tasks.workunit.client.0.smithi029.stdout:6/457: creat d6/d64/d65/f99 x:0 0 0 2023-12-05T13:26:34.685 INFO:tasks.workunit.client.0.smithi029.stdout:2/458: dread de/d14/f35 [0,4194304] 0 2023-12-05T13:26:34.685 INFO:tasks.workunit.client.0.smithi029.stdout:1/512: getdents d7/d61/d4f 0 2023-12-05T13:26:34.687 INFO:tasks.workunit.client.0.smithi029.stdout:8/565: mkdir d5/dc/d18/d26/dc0 0 2023-12-05T13:26:34.689 INFO:tasks.workunit.client.0.smithi029.stdout:6/458: creat d6/d3f/f9a x:0 0 0 2023-12-05T13:26:34.689 INFO:tasks.workunit.client.0.smithi029.stdout:6/459: chown d6/d1d/d39 1 1 2023-12-05T13:26:34.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/459: mkdir de/d16/d6c/d90 0 2023-12-05T13:26:34.693 INFO:tasks.workunit.client.0.smithi029.stdout:1/513: mkdir d7/d5e/d52/d5f/d12/da5 0 2023-12-05T13:26:34.695 INFO:tasks.workunit.client.0.smithi029.stdout:8/566: mknod d5/d2f/d75/cc1 0 2023-12-05T13:26:34.697 INFO:tasks.workunit.client.0.smithi029.stdout:9/364: dwrite d7/d19/f41 [0,4194304] 0 2023-12-05T13:26:34.697 INFO:tasks.workunit.client.0.smithi029.stdout:6/460: mknod d6/d64/d6d/d85/c9b 0 2023-12-05T13:26:34.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/460: rename de/d41/d56/d58/c69 to de/d16/c91 0 2023-12-05T13:26:34.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/461: read fa [1630511,8185] 0 2023-12-05T13:26:34.703 INFO:tasks.workunit.client.0.smithi029.stdout:2/462: write de/d14/d24/f73 [2490700,19472] 0 2023-12-05T13:26:34.704 INFO:tasks.workunit.client.0.smithi029.stdout:6/461: mkdir d6/d29/d9c 0 2023-12-05T13:26:34.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/514: rename d7/d5e/d52/d5f/l7a to d7/d31/la6 0 2023-12-05T13:26:34.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/463: link de/d14/d62/f6e de/d16/d43/f92 0 2023-12-05T13:26:34.710 INFO:tasks.workunit.client.0.smithi029.stdout:2/464: chown de/c3b 15976 1 2023-12-05T13:26:34.711 INFO:tasks.workunit.client.0.smithi029.stdout:1/515: creat d7/d61/d77/fa7 x:0 0 0 2023-12-05T13:26:34.712 INFO:tasks.workunit.client.0.smithi029.stdout:1/516: mkdir d7/d56/da8 0 2023-12-05T13:26:34.714 INFO:tasks.workunit.client.0.smithi029.stdout:2/465: dread de/f27 [0,4194304] 0 2023-12-05T13:26:34.716 INFO:tasks.workunit.client.0.smithi029.stdout:8/567: dwrite d5/dc/d18/d26/f66 [4194304,4194304] 0 2023-12-05T13:26:34.717 INFO:tasks.workunit.client.0.smithi029.stdout:9/365: dwrite d7/f3c [0,4194304] 0 2023-12-05T13:26:34.718 INFO:tasks.workunit.client.0.smithi029.stdout:2/466: mkdir de/d14/d24/d93 0 2023-12-05T13:26:34.718 INFO:tasks.workunit.client.0.smithi029.stdout:6/462: dread d6/fa [0,4194304] 0 2023-12-05T13:26:34.718 INFO:tasks.workunit.client.0.smithi029.stdout:2/467: write de/d14/d24/f89 [46815,5128] 0 2023-12-05T13:26:34.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/366: symlink d7/d19/d30/d43/l7b 0 2023-12-05T13:26:34.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/468: symlink de/d14/d24/l94 0 2023-12-05T13:26:34.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/469: fdatasync fb 0 2023-12-05T13:26:34.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/367: truncate d7/d19/d30/d43/f4d 1132494 0 2023-12-05T13:26:34.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/368: chown d7/d19/d28/f2d 35134 1 2023-12-05T13:26:34.726 INFO:tasks.workunit.client.0.smithi029.stdout:1/517: rename d7/d31 to d7/d6e/da9 0 2023-12-05T13:26:34.726 INFO:tasks.workunit.client.0.smithi029.stdout:1/518: write d7/d61/f39 [4388609,12404] 0 2023-12-05T13:26:34.727 INFO:tasks.workunit.client.0.smithi029.stdout:6/463: dread d6/d64/d65/d40/d4d/f57 [0,4194304] 0 2023-12-05T13:26:34.727 INFO:tasks.workunit.client.0.smithi029.stdout:2/470: rmdir de/d16/d4c 39 2023-12-05T13:26:34.728 INFO:tasks.workunit.client.0.smithi029.stdout:6/464: dread d6/d1d/d39/f87 [0,4194304] 0 2023-12-05T13:26:34.730 INFO:tasks.workunit.client.0.smithi029.stdout:1/519: mkdir d7/d6e/da9/daa 0 2023-12-05T13:26:34.731 INFO:tasks.workunit.client.0.smithi029.stdout:2/471: symlink de/d16/d6c/d8e/l95 0 2023-12-05T13:26:34.733 INFO:tasks.workunit.client.0.smithi029.stdout:6/465: creat d6/d3f/f9d x:0 0 0 2023-12-05T13:26:34.737 INFO:tasks.workunit.client.0.smithi029.stdout:8/568: dwrite d5/dbc/d53/f7e [0,4194304] 0 2023-12-05T13:26:34.737 INFO:tasks.workunit.client.0.smithi029.stdout:9/369: dread d7/d19/d30/d43/f62 [0,4194304] 0 2023-12-05T13:26:34.737 INFO:tasks.workunit.client.0.smithi029.stdout:9/370: fsync d7/d19/d1f/f4f 0 2023-12-05T13:26:34.737 INFO:tasks.workunit.client.0.smithi029.stdout:6/466: dread d6/d1d/f55 [0,4194304] 0 2023-12-05T13:26:34.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/520: mknod d7/d5e/d52/d5f/d48/cab 0 2023-12-05T13:26:34.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/521: fdatasync d7/d6e/da9/f8b 0 2023-12-05T13:26:34.739 INFO:tasks.workunit.client.0.smithi029.stdout:2/472: stat de/d16/d4c/l5d 0 2023-12-05T13:26:34.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/522: mkdir d7/d5e/d52/d5f/d12/d60/dac 0 2023-12-05T13:26:34.745 INFO:tasks.workunit.client.0.smithi029.stdout:8/569: mkdir d5/d6/d10/d13/db7/dc2 0 2023-12-05T13:26:34.745 INFO:tasks.workunit.client.0.smithi029.stdout:1/523: write d7/d5e/f47 [4665461,113048] 0 2023-12-05T13:26:34.748 INFO:tasks.workunit.client.0.smithi029.stdout:2/473: write de/d11/f25 [3031228,39140] 0 2023-12-05T13:26:34.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/570: mkdir d5/d2f/d3a/d86/dc3 0 2023-12-05T13:26:34.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/571: stat d5/dc/f69 0 2023-12-05T13:26:34.750 INFO:tasks.workunit.client.0.smithi029.stdout:1/524: link d7/d5e/d52/d5f/d12/f76 d7/d56/da8/fad 0 2023-12-05T13:26:34.760 INFO:tasks.workunit.client.0.smithi029.stdout:8/572: symlink d5/d6/d10/d85/lc4 0 2023-12-05T13:26:34.762 INFO:tasks.workunit.client.0.smithi029.stdout:1/525: creat d7/d5e/d52/d5f/d48/fae x:0 0 0 2023-12-05T13:26:34.763 INFO:tasks.workunit.client.0.smithi029.stdout:2/474: dwrite de/f27 [4194304,4194304] 0 2023-12-05T13:26:34.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/467: dwrite d6/fc [0,4194304] 0 2023-12-05T13:26:34.764 INFO:tasks.workunit.client.0.smithi029.stdout:2/475: write de/d11/d32/f3e [712740,111795] 0 2023-12-05T13:26:34.764 INFO:tasks.workunit.client.0.smithi029.stdout:8/573: dread d5/d2f/d3a/d3c/f89 [0,4194304] 0 2023-12-05T13:26:34.764 INFO:tasks.workunit.client.0.smithi029.stdout:1/526: mknod d7/d5e/d52/d5f/d48/caf 0 2023-12-05T13:26:34.765 INFO:tasks.workunit.client.0.smithi029.stdout:9/371: dwrite d7/d2c/f4c [0,4194304] 0 2023-12-05T13:26:34.766 INFO:tasks.workunit.client.0.smithi029.stdout:6/468: getdents d6/d64/d65 0 2023-12-05T13:26:34.766 INFO:tasks.workunit.client.0.smithi029.stdout:6/469: chown d6/cb 56 1 2023-12-05T13:26:34.767 INFO:tasks.workunit.client.0.smithi029.stdout:2/476: symlink de/d14/d24/l96 0 2023-12-05T13:26:34.767 INFO:tasks.workunit.client.0.smithi029.stdout:2/477: stat de/d16/d6c/d90 0 2023-12-05T13:26:34.773 INFO:tasks.workunit.client.0.smithi029.stdout:8/574: rmdir d5/d6/d10/d13/db7 39 2023-12-05T13:26:34.777 INFO:tasks.workunit.client.0.smithi029.stdout:1/527: mkdir d7/d61/d4f/db0 0 2023-12-05T13:26:34.778 INFO:tasks.workunit.client.0.smithi029.stdout:9/372: creat d7/d19/d28/d50/f7c x:0 0 0 2023-12-05T13:26:34.778 INFO:tasks.workunit.client.0.smithi029.stdout:2/478: mknod de/d6a/c97 0 2023-12-05T13:26:34.779 INFO:tasks.workunit.client.0.smithi029.stdout:8/575: link d5/dbc/d8b/la1 d5/d2f/d3a/lc5 0 2023-12-05T13:26:34.785 INFO:tasks.workunit.client.0.smithi029.stdout:6/470: dwrite d6/d1d/d39/d58/f90 [0,4194304] 0 2023-12-05T13:26:34.798 INFO:tasks.workunit.client.0.smithi029.stdout:6/471: dwrite d6/d3f/f9d [0,4194304] 0 2023-12-05T13:26:34.805 INFO:tasks.workunit.client.0.smithi029.stdout:1/528: mkdir d7/d6e/da9/d4b/db1 0 2023-12-05T13:26:34.805 INFO:tasks.workunit.client.0.smithi029.stdout:1/529: fsync d7/d5e/f28 0 2023-12-05T13:26:34.805 INFO:tasks.workunit.client.0.smithi029.stdout:1/530: truncate d7/d5e/f5a 342181 0 2023-12-05T13:26:34.807 INFO:tasks.workunit.client.0.smithi029.stdout:8/576: symlink d5/d6/d10/d85/daa/lc6 0 2023-12-05T13:26:34.809 INFO:tasks.workunit.client.0.smithi029.stdout:8/577: dread d5/fe [0,4194304] 0 2023-12-05T13:26:34.812 INFO:tasks.workunit.client.0.smithi029.stdout:9/373: dwrite d7/d19/f32 [0,4194304] 0 2023-12-05T13:26:34.814 INFO:tasks.workunit.client.0.smithi029.stdout:6/472: symlink d6/d64/d65/d40/d74/d52/l9e 0 2023-12-05T13:26:34.817 INFO:tasks.workunit.client.0.smithi029.stdout:1/531: rename d7/d5e/d52/d5f/d12/d60/c87 to d7/d6e/da9/daa/cb2 0 2023-12-05T13:26:34.817 INFO:tasks.workunit.client.0.smithi029.stdout:1/532: write d7/d6e/f86 [731756,84405] 0 2023-12-05T13:26:34.817 INFO:tasks.workunit.client.0.smithi029.stdout:1/533: readlink d7/d6e/da9/l4c 0 2023-12-05T13:26:34.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/578: mknod d5/d2f/cc7 0 2023-12-05T13:26:34.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/473: write d6/d64/d65/d40/f6b [1816946,80852] 0 2023-12-05T13:26:34.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/474: write d6/d3f/f9a [946691,12245] 0 2023-12-05T13:26:34.821 INFO:tasks.workunit.client.0.smithi029.stdout:6/475: chown d6/d1d/c5b 747795643 1 2023-12-05T13:26:34.822 INFO:tasks.workunit.client.0.smithi029.stdout:2/479: dwrite f6 [0,4194304] 0 2023-12-05T13:26:34.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/476: write d6/d3f/f9d [4042524,73190] 0 2023-12-05T13:26:34.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/477: chown d6/d64/d65/d40/d4d/c7e 62196 1 2023-12-05T13:26:34.824 INFO:tasks.workunit.client.0.smithi029.stdout:1/534: mknod d7/d5e/cb3 0 2023-12-05T13:26:34.824 INFO:tasks.workunit.client.0.smithi029.stdout:2/480: write de/f13 [402025,47831] 0 2023-12-05T13:26:34.824 INFO:tasks.workunit.client.0.smithi029.stdout:2/481: chown de/d14/d62/f68 7058 1 2023-12-05T13:26:34.825 INFO:tasks.workunit.client.0.smithi029.stdout:1/535: read d7/d6e/da9/f3d [2029181,123243] 0 2023-12-05T13:26:34.826 INFO:tasks.workunit.client.0.smithi029.stdout:8/579: mkdir d5/dc/d18/dc8 0 2023-12-05T13:26:34.827 INFO:tasks.workunit.client.0.smithi029.stdout:5/346: sync 2023-12-05T13:26:34.827 INFO:tasks.workunit.client.0.smithi029.stdout:5/347: chown d1/dc/d10/d3f/l51 1522 1 2023-12-05T13:26:34.829 INFO:tasks.workunit.client.0.smithi029.stdout:8/580: write d5/dc/d18/d26/f94 [324780,129814] 0 2023-12-05T13:26:34.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/478: link d6/f76 d6/d64/d65/f9f 0 2023-12-05T13:26:34.838 INFO:tasks.workunit.client.0.smithi029.stdout:9/374: dwrite d7/d19/d1f/f61 [0,4194304] 0 2023-12-05T13:26:34.839 INFO:tasks.workunit.client.0.smithi029.stdout:5/348: mknod d1/dc/c7a 0 2023-12-05T13:26:34.840 INFO:tasks.workunit.client.0.smithi029.stdout:6/479: getdents d6/d1d/d39/d58/d82 0 2023-12-05T13:26:34.844 INFO:tasks.workunit.client.0.smithi029.stdout:2/482: dwrite de/d16/f5c [4194304,4194304] 0 2023-12-05T13:26:34.844 INFO:tasks.workunit.client.0.smithi029.stdout:2/483: stat de/d14/d24/f89 0 2023-12-05T13:26:34.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/349: mkdir d1/dc/d38/d3a/d7b 0 2023-12-05T13:26:34.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/350: readlink d1/dc/d27/l30 0 2023-12-05T13:26:34.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/480: dread d6/d64/d65/d40/d74/d52/d5c/d6f/f88 [0,4194304] 0 2023-12-05T13:26:34.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/481: truncate d6/d1d/d36/f48 4549216 0 2023-12-05T13:26:34.846 INFO:tasks.workunit.client.0.smithi029.stdout:6/482: chown d6/d3f/c91 36 1 2023-12-05T13:26:34.848 INFO:tasks.workunit.client.0.smithi029.stdout:5/351: symlink d1/dc/d10/l7c 0 2023-12-05T13:26:34.848 INFO:tasks.workunit.client.0.smithi029.stdout:1/536: dwrite d7/d61/d4f/f5d [0,4194304] 0 2023-12-05T13:26:34.849 INFO:tasks.workunit.client.0.smithi029.stdout:5/352: dread - d1/dc/d25/d4c/f6f zero size 2023-12-05T13:26:34.849 INFO:tasks.workunit.client.0.smithi029.stdout:9/375: dread d7/d19/f41 [0,4194304] 0 2023-12-05T13:26:34.850 INFO:tasks.workunit.client.0.smithi029.stdout:8/581: dwrite d5/d2f/d75/f84 [0,4194304] 0 2023-12-05T13:26:34.850 INFO:tasks.workunit.client.0.smithi029.stdout:2/484: dread de/d11/d32/f3e [0,4194304] 0 2023-12-05T13:26:34.850 INFO:tasks.workunit.client.0.smithi029.stdout:6/483: creat d6/d29/fa0 x:0 0 0 2023-12-05T13:26:34.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/537: rmdir d7/d5e/d52/d90 39 2023-12-05T13:26:34.851 INFO:tasks.workunit.client.0.smithi029.stdout:1/538: chown d7/c10 8 1 2023-12-05T13:26:34.853 INFO:tasks.workunit.client.0.smithi029.stdout:5/353: creat d1/dc/d11/f7d x:0 0 0 2023-12-05T13:26:34.853 INFO:tasks.workunit.client.0.smithi029.stdout:8/582: dread d5/d6/d10/d13/f41 [0,4194304] 0 2023-12-05T13:26:34.854 INFO:tasks.workunit.client.0.smithi029.stdout:8/583: chown d5/d6/d10/d8a/db6 58713 1 2023-12-05T13:26:34.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/376: creat d7/d19/d30/d43/d67/f7d x:0 0 0 2023-12-05T13:26:34.856 INFO:tasks.workunit.client.0.smithi029.stdout:2/485: getdents de/d16/d6c 0 2023-12-05T13:26:34.858 INFO:tasks.workunit.client.0.smithi029.stdout:6/484: creat d6/d64/d65/d40/d4d/d8f/fa1 x:0 0 0 2023-12-05T13:26:34.858 INFO:tasks.workunit.client.0.smithi029.stdout:6/485: stat d6/d1d/c5b 0 2023-12-05T13:26:34.859 INFO:tasks.workunit.client.0.smithi029.stdout:1/539: mkdir d7/d61/d77/d9f/db4 0 2023-12-05T13:26:34.861 INFO:tasks.workunit.client.0.smithi029.stdout:5/354: link d1/dc/d25/f5e d1/dc/d25/d4c/f7e 0 2023-12-05T13:26:34.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/377: creat d7/d19/d30/d40/f7e x:0 0 0 2023-12-05T13:26:34.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/378: stat d7/d19/l25 0 2023-12-05T13:26:34.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/379: dread - d7/d19/d30/d40/d4e/f74 zero size 2023-12-05T13:26:34.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/380: chown d7/f18 41652155 1 2023-12-05T13:26:34.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/486: truncate de/d16/d43/f92 1665288 0 2023-12-05T13:26:34.864 INFO:tasks.workunit.client.0.smithi029.stdout:2/487: chown de/d14/l37 212654 1 2023-12-05T13:26:34.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/486: creat d6/d64/d65/d40/d4d/fa2 x:0 0 0 2023-12-05T13:26:34.866 INFO:tasks.workunit.client.0.smithi029.stdout:1/540: symlink d7/d6e/da9/daa/lb5 0 2023-12-05T13:26:34.866 INFO:tasks.workunit.client.0.smithi029.stdout:5/355: mkdir d1/dc/d10/d1e/d75/d7f 0 2023-12-05T13:26:34.867 INFO:tasks.workunit.client.0.smithi029.stdout:8/584: mknod d5/d6/cc9 0 2023-12-05T13:26:34.868 INFO:tasks.workunit.client.0.smithi029.stdout:2/488: rename de/cf to de/c98 0 2023-12-05T13:26:34.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/487: mkdir d6/d64/d6d/da3 0 2023-12-05T13:26:34.870 INFO:tasks.workunit.client.0.smithi029.stdout:6/488: stat d6/d64/d6d/d85 0 2023-12-05T13:26:34.875 INFO:tasks.workunit.client.0.smithi029.stdout:1/541: rename d7/d5e/d52/f57 to d7/d5e/d52/d5f/d48/fb6 0 2023-12-05T13:26:34.879 INFO:tasks.workunit.client.0.smithi029.stdout:8/585: creat d5/dbc/d1d/fca x:0 0 0 2023-12-05T13:26:34.879 INFO:tasks.workunit.client.0.smithi029.stdout:8/586: fsync d5/f27 0 2023-12-05T13:26:34.881 INFO:tasks.workunit.client.0.smithi029.stdout:2/489: creat de/d14/f99 x:0 0 0 2023-12-05T13:26:34.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/542: rename d7/d6e/da9/f3d to d7/d5e/d52/d5f/d48/fb7 0 2023-12-05T13:26:34.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/543: chown d7/d61/l3e 83808767 1 2023-12-05T13:26:34.888 INFO:tasks.workunit.client.0.smithi029.stdout:2/490: truncate de/d41/d56/f75 2132450 0 2023-12-05T13:26:34.889 INFO:tasks.workunit.client.0.smithi029.stdout:2/491: mknod de/d6a/c9a 0 2023-12-05T13:26:34.894 INFO:tasks.workunit.client.0.smithi029.stdout:9/381: dwrite d7/d19/d30/d40/d4e/f74 [0,4194304] 0 2023-12-05T13:26:34.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/489: dwrite d6/d1d/d39/d58/f83 [0,4194304] 0 2023-12-05T13:26:34.896 INFO:tasks.workunit.client.0.smithi029.stdout:6/490: dread - d6/d64/d65/d40/d4d/fa2 zero size 2023-12-05T13:26:34.898 INFO:tasks.workunit.client.0.smithi029.stdout:9/382: mkdir d7/d2c/d68/d7f 0 2023-12-05T13:26:34.900 INFO:tasks.workunit.client.0.smithi029.stdout:5/356: dwrite d1/f60 [0,4194304] 0 2023-12-05T13:26:34.900 INFO:tasks.workunit.client.0.smithi029.stdout:6/491: mkdir d6/d29/da4 0 2023-12-05T13:26:34.900 INFO:tasks.workunit.client.0.smithi029.stdout:6/492: chown d6/d29/l97 2 1 2023-12-05T13:26:34.900 INFO:tasks.workunit.client.0.smithi029.stdout:6/493: fsync d6/d29/fa0 0 2023-12-05T13:26:34.902 INFO:tasks.workunit.client.0.smithi029.stdout:9/383: stat d7/d2c/d33/c54 0 2023-12-05T13:26:34.902 INFO:tasks.workunit.client.0.smithi029.stdout:9/384: getdents d7/d19/d30/d40/d4e/d5e 0 2023-12-05T13:26:34.903 INFO:tasks.workunit.client.0.smithi029.stdout:8/587: dwrite d5/d2f/d75/f33 [0,4194304] 0 2023-12-05T13:26:34.908 INFO:tasks.workunit.client.0.smithi029.stdout:5/357: creat d1/dc/d25/d4c/d61/f80 x:0 0 0 2023-12-05T13:26:34.908 INFO:tasks.workunit.client.0.smithi029.stdout:5/358: write d1/dc/d10/d1e/d33/f6b [902876,58752] 0 2023-12-05T13:26:34.908 INFO:tasks.workunit.client.0.smithi029.stdout:5/359: dread - d1/dc/d38/d3a/d5c/f63 zero size 2023-12-05T13:26:34.908 INFO:tasks.workunit.client.0.smithi029.stdout:1/544: dwrite d7/d5e/f95 [0,4194304] 0 2023-12-05T13:26:34.908 INFO:tasks.workunit.client.0.smithi029.stdout:6/494: dread d6/d1d/d36/f48 [0,4194304] 0 2023-12-05T13:26:34.909 INFO:tasks.workunit.client.0.smithi029.stdout:9/385: mknod d7/d19/d28/d65/c80 0 2023-12-05T13:26:34.912 INFO:tasks.workunit.client.0.smithi029.stdout:8/588: getdents d5/dc/d18/d26 0 2023-12-05T13:26:34.915 INFO:tasks.workunit.client.0.smithi029.stdout:5/360: dread d1/dc/d38/d4b/f53 [0,4194304] 0 2023-12-05T13:26:34.918 INFO:tasks.workunit.client.0.smithi029.stdout:1/545: mknod d7/d61/d77/cb8 0 2023-12-05T13:26:34.918 INFO:tasks.workunit.client.0.smithi029.stdout:1/546: chown d7/d5e/d52/d5f/d12/d60/l85 56 1 2023-12-05T13:26:34.918 INFO:tasks.workunit.client.0.smithi029.stdout:1/547: fdatasync d7/d5e/d52/d90/f96 0 2023-12-05T13:26:34.920 INFO:tasks.workunit.client.0.smithi029.stdout:6/495: mknod d6/d64/d65/d40/d74/ca5 0 2023-12-05T13:26:34.923 INFO:tasks.workunit.client.0.smithi029.stdout:9/386: creat d7/d2c/d3a/d52/f81 x:0 0 0 2023-12-05T13:26:34.925 INFO:tasks.workunit.client.0.smithi029.stdout:8/589: creat d5/dc/d18/d26/dc0/fcb x:0 0 0 2023-12-05T13:26:34.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/387: write d7/f3c [3512859,87877] 0 2023-12-05T13:26:34.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/388: chown d7/d19/d30/d43/d67 185371 1 2023-12-05T13:26:34.928 INFO:tasks.workunit.client.0.smithi029.stdout:5/361: rename d1/dc/d38/d4b/f53 to d1/dc/d38/d55/f81 0 2023-12-05T13:26:34.928 INFO:tasks.workunit.client.0.smithi029.stdout:5/362: readlink d1/dc/d10/d3f/l51 0 2023-12-05T13:26:34.931 INFO:tasks.workunit.client.0.smithi029.stdout:6/496: stat d6/d1d/d39/c78 0 2023-12-05T13:26:34.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/548: dwrite d7/fd [4194304,4194304] 0 2023-12-05T13:26:34.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/549: write d7/d5e/d52/d5f/f6f [909311,55389] 0 2023-12-05T13:26:34.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/550: chown d7/d61/d77/cb8 220869978 1 2023-12-05T13:26:34.938 INFO:tasks.workunit.client.0.smithi029.stdout:5/363: symlink d1/l82 0 2023-12-05T13:26:34.938 INFO:tasks.workunit.client.0.smithi029.stdout:1/551: chown d7/c36 1267453 1 2023-12-05T13:26:34.938 INFO:tasks.workunit.client.0.smithi029.stdout:6/497: rename d6/d64/d65/d40/d4d/f57 to d6/d64/d65/d40/d74/d52/d5c/fa6 0 2023-12-05T13:26:34.940 INFO:tasks.workunit.client.0.smithi029.stdout:6/498: write d6/d1d/d39/d58/f8b [315972,1672] 0 2023-12-05T13:26:34.942 INFO:tasks.workunit.client.0.smithi029.stdout:8/590: dwrite d5/d2f/d75/fa4 [0,4194304] 0 2023-12-05T13:26:34.943 INFO:tasks.workunit.client.0.smithi029.stdout:5/364: symlink d1/dc/d38/d3a/l83 0 2023-12-05T13:26:34.943 INFO:tasks.workunit.client.0.smithi029.stdout:5/365: chown d1/dc/d10/l7c 1301714845 1 2023-12-05T13:26:34.949 INFO:tasks.workunit.client.0.smithi029.stdout:5/366: link d1/dc/d38/d3a/l54 d1/dc/l84 0 2023-12-05T13:26:34.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/389: dwrite d7/d2c/f4c [0,4194304] 0 2023-12-05T13:26:34.949 INFO:tasks.workunit.client.0.smithi029.stdout:6/499: dread d6/d64/d65/f5e [0,4194304] 0 2023-12-05T13:26:34.953 INFO:tasks.workunit.client.0.smithi029.stdout:8/591: dread d5/f98 [0,4194304] 0 2023-12-05T13:26:34.953 INFO:tasks.workunit.client.0.smithi029.stdout:5/367: read d1/dc/d11/f56 [2454252,116825] 0 2023-12-05T13:26:34.955 INFO:tasks.workunit.client.0.smithi029.stdout:8/592: dread d5/fe [0,4194304] 0 2023-12-05T13:26:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:6/500: rename d6/d64/d65/d40/d4d/c7e to d6/d5a/ca7 0 2023-12-05T13:26:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:6/501: fdatasync d6/d64/d65/d40/f6b 0 2023-12-05T13:26:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:9/390: creat d7/d19/d30/d43/d67/f82 x:0 0 0 2023-12-05T13:26:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:6/502: write d6/d64/d65/d40/f8d [2344406,56668] 0 2023-12-05T13:26:34.961 INFO:tasks.workunit.client.0.smithi029.stdout:9/391: dread - d7/d19/d30/d40/f7e zero size 2023-12-05T13:26:34.962 INFO:tasks.workunit.client.0.smithi029.stdout:5/368: creat d1/dc/d25/d4c/d61/f85 x:0 0 0 2023-12-05T13:26:34.962 INFO:tasks.workunit.client.0.smithi029.stdout:5/369: chown d1/dc/d38/f1a 403 1 2023-12-05T13:26:34.964 INFO:tasks.workunit.client.0.smithi029.stdout:6/503: rename d6/d29/c4a to d6/d64/d65/d40/d4d/ca8 0 2023-12-05T13:26:34.964 INFO:tasks.workunit.client.0.smithi029.stdout:6/504: fsync d6/d64/d65/d40/d4d/f96 0 2023-12-05T13:26:34.966 INFO:tasks.workunit.client.0.smithi029.stdout:1/552: write d7/f49 [307921,15870] 0 2023-12-05T13:26:34.966 INFO:tasks.workunit.client.0.smithi029.stdout:5/370: mknod d1/dc/d10/d1e/d33/c86 0 2023-12-05T13:26:34.968 INFO:tasks.workunit.client.0.smithi029.stdout:9/392: unlink c4 0 2023-12-05T13:26:34.971 INFO:tasks.workunit.client.0.smithi029.stdout:9/393: write d7/d2c/f4c [4619819,46379] 0 2023-12-05T13:26:34.971 INFO:tasks.workunit.client.0.smithi029.stdout:6/505: creat d6/d1d/d39/d58/fa9 x:0 0 0 2023-12-05T13:26:34.972 INFO:tasks.workunit.client.0.smithi029.stdout:1/553: unlink f3 0 2023-12-05T13:26:34.972 INFO:tasks.workunit.client.0.smithi029.stdout:6/506: creat d6/d64/d65/d40/d74/d59/faa x:0 0 0 2023-12-05T13:26:34.974 INFO:tasks.workunit.client.0.smithi029.stdout:8/593: dwrite d5/dc/f90 [0,4194304] 0 2023-12-05T13:26:34.976 INFO:tasks.workunit.client.0.smithi029.stdout:1/554: creat d7/d5e/d52/d90/fb9 x:0 0 0 2023-12-05T13:26:34.976 INFO:tasks.workunit.client.0.smithi029.stdout:1/555: chown d7/d6e/da9/l4c 120272 1 2023-12-05T13:26:34.977 INFO:tasks.workunit.client.0.smithi029.stdout:1/556: write d7/fd [4336865,38400] 0 2023-12-05T13:26:34.977 INFO:tasks.workunit.client.0.smithi029.stdout:6/507: rename d6/fe to d6/d64/d6d/da3/fab 0 2023-12-05T13:26:34.978 INFO:tasks.workunit.client.0.smithi029.stdout:6/508: read - d6/d1d/f84 zero size 2023-12-05T13:26:34.979 INFO:tasks.workunit.client.0.smithi029.stdout:8/594: symlink d5/d6/d10/d13/db7/dc2/lcc 0 2023-12-05T13:26:34.979 INFO:tasks.workunit.client.0.smithi029.stdout:8/595: rename d5/d6/d10 to d5/d6/d10/d85/daa/dcd 22 2023-12-05T13:26:34.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/509: creat d6/d1d/fac x:0 0 0 2023-12-05T13:26:34.989 INFO:tasks.workunit.client.0.smithi029.stdout:6/510: write d6/d64/d65/f28 [8204752,96264] 0 2023-12-05T13:26:34.989 INFO:tasks.workunit.client.0.smithi029.stdout:6/511: dread d6/d1d/d39/f87 [0,4194304] 0 2023-12-05T13:26:34.991 INFO:tasks.workunit.client.0.smithi029.stdout:5/371: dwrite d1/f20 [0,4194304] 0 2023-12-05T13:26:34.993 INFO:tasks.workunit.client.0.smithi029.stdout:5/372: write d1/dc/d27/f2a [63052,56062] 0 2023-12-05T13:26:34.994 INFO:tasks.workunit.client.0.smithi029.stdout:5/373: read - d1/dc/d38/d55/f6e zero size 2023-12-05T13:26:34.995 INFO:tasks.workunit.client.0.smithi029.stdout:9/394: dwrite d7/d2c/d3a/f45 [0,4194304] 0 2023-12-05T13:26:35.008 INFO:tasks.workunit.client.0.smithi029.stdout:9/395: dwrite d7/d2c/d3a/f3e [4194304,4194304] 0 2023-12-05T13:26:35.021 INFO:tasks.workunit.client.0.smithi029.stdout:9/396: dwrite d7/d19/d1f/f29 [0,4194304] 0 2023-12-05T13:26:35.071 INFO:tasks.workunit.client.0.smithi029.stdout:6/512: symlink d6/d64/d65/d40/lad 0 2023-12-05T13:26:35.071 INFO:tasks.workunit.client.0.smithi029.stdout:6/513: read - d6/d1d/d36/f42 zero size 2023-12-05T13:26:35.071 INFO:tasks.workunit.client.0.smithi029.stdout:6/514: readlink d6/d64/d65/d40/d74/d52/d5c/l6c 0 2023-12-05T13:26:35.071 INFO:tasks.workunit.client.0.smithi029.stdout:5/374: truncate d1/dc/d11/f35 1281486 0 2023-12-05T13:26:35.071 INFO:tasks.workunit.client.0.smithi029.stdout:5/375: readlink d1/dc/d38/d3a/l83 0 2023-12-05T13:26:35.072 INFO:tasks.workunit.client.0.smithi029.stdout:6/515: write d6/d1d/d36/f48 [1085511,113964] 0 2023-12-05T13:26:35.072 INFO:tasks.workunit.client.0.smithi029.stdout:9/397: creat d7/d19/f83 x:0 0 0 2023-12-05T13:26:35.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/398: write d7/d19/d30/d43/f62 [2924198,75953] 0 2023-12-05T13:26:35.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/399: stat d7/d19/d1f/f46 0 2023-12-05T13:26:35.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/376: rename d1/dc/d38/d3a/d7b to d1/dc/d38/d3a/d5c/d87 0 2023-12-05T13:26:35.074 INFO:tasks.workunit.client.0.smithi029.stdout:5/377: fdatasync d1/dc/d11/f79 0 2023-12-05T13:26:35.075 INFO:tasks.workunit.client.0.smithi029.stdout:6/516: symlink d6/d64/d6d/lae 0 2023-12-05T13:26:35.077 INFO:tasks.workunit.client.0.smithi029.stdout:9/400: symlink d7/d2c/d3a/l84 0 2023-12-05T13:26:35.077 INFO:tasks.workunit.client.0.smithi029.stdout:5/378: getdents d1/dc/d10/d1e/d75 0 2023-12-05T13:26:35.079 INFO:tasks.workunit.client.0.smithi029.stdout:6/517: link d6/d64/d65/l33 d6/d1d/d39/laf 0 2023-12-05T13:26:35.079 INFO:tasks.workunit.client.0.smithi029.stdout:6/518: dread - d6/f76 zero size 2023-12-05T13:26:35.079 INFO:tasks.workunit.client.0.smithi029.stdout:6/519: dread - d6/d1d/f84 zero size 2023-12-05T13:26:35.080 INFO:tasks.workunit.client.0.smithi029.stdout:9/401: truncate d7/d19/d30/d43/f4d 872498 0 2023-12-05T13:26:35.081 INFO:tasks.workunit.client.0.smithi029.stdout:5/379: creat d1/dc/d10/d3f/f88 x:0 0 0 2023-12-05T13:26:35.083 INFO:tasks.workunit.client.0.smithi029.stdout:6/520: creat d6/d29/d60/fb0 x:0 0 0 2023-12-05T13:26:35.084 INFO:tasks.workunit.client.0.smithi029.stdout:9/402: mknod d7/d2c/d3a/d64/c85 0 2023-12-05T13:26:35.084 INFO:tasks.workunit.client.0.smithi029.stdout:9/403: chown d7/d19/d30/l55 55 1 2023-12-05T13:26:35.086 INFO:tasks.workunit.client.0.smithi029.stdout:5/380: truncate d1/dc/d38/f1a 109895 0 2023-12-05T13:26:35.090 INFO:tasks.workunit.client.0.smithi029.stdout:9/404: mknod d7/d2c/d3a/d64/c86 0 2023-12-05T13:26:35.092 INFO:tasks.workunit.client.0.smithi029.stdout:5/381: creat d1/dc/f89 x:0 0 0 2023-12-05T13:26:35.094 INFO:tasks.workunit.client.0.smithi029.stdout:5/382: mkdir d1/dc/d10/d1e/d75/d7f/d8a 0 2023-12-05T13:26:35.094 INFO:tasks.workunit.client.0.smithi029.stdout:5/383: fdatasync d1/dc/d11/d17/d3d/f58 0 2023-12-05T13:26:35.096 INFO:tasks.workunit.client.0.smithi029.stdout:5/384: mknod d1/dc/d10/d1e/d75/d7f/c8b 0 2023-12-05T13:26:35.098 INFO:tasks.workunit.client.0.smithi029.stdout:6/521: dwrite d6/f45 [0,4194304] 0 2023-12-05T13:26:35.102 INFO:tasks.workunit.client.0.smithi029.stdout:6/522: rmdir d6/d64/d65/d40/d74/d59 39 2023-12-05T13:26:35.105 INFO:tasks.workunit.client.0.smithi029.stdout:6/523: truncate d6/d64/d65/d40/d74/d52/d5c/d6f/f88 4342452 0 2023-12-05T13:26:35.107 INFO:tasks.workunit.client.0.smithi029.stdout:6/524: symlink d6/d64/d6d/d85/lb1 0 2023-12-05T13:26:35.108 INFO:tasks.workunit.client.0.smithi029.stdout:6/525: rmdir d6/d1d/d39/d58/d82 39 2023-12-05T13:26:35.111 INFO:tasks.workunit.client.0.smithi029.stdout:6/526: rename d6/d64/d6d/d85/c9b to d6/d1d/d36/cb2 0 2023-12-05T13:26:35.111 INFO:tasks.workunit.client.0.smithi029.stdout:6/527: fsync d6/d1d/f55 0 2023-12-05T13:26:35.113 INFO:tasks.workunit.client.0.smithi029.stdout:6/528: symlink d6/d64/d6d/d85/lb3 0 2023-12-05T13:26:35.114 INFO:tasks.workunit.client.0.smithi029.stdout:6/529: rename d6/l13 to d6/d64/lb4 0 2023-12-05T13:26:35.115 INFO:tasks.workunit.client.0.smithi029.stdout:6/530: read d6/d64/d65/d40/f8d [1392854,5711] 0 2023-12-05T13:26:35.118 INFO:tasks.workunit.client.0.smithi029.stdout:5/385: dwrite d1/dc/d11/f79 [0,4194304] 0 2023-12-05T13:26:35.119 INFO:tasks.workunit.client.0.smithi029.stdout:6/531: rename d6/d1d/d39/d58/d82 to d6/d64/d65/d40/db5 0 2023-12-05T13:26:35.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/532: link d6/c1b d6/d1d/d36/cb6 0 2023-12-05T13:26:35.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/533: chown d6/d64/d6d/da3 240 1 2023-12-05T13:26:35.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/534: stat d6/d64/d65/d40/d74/d52/d5c/fa6 0 2023-12-05T13:26:35.123 INFO:tasks.workunit.client.0.smithi029.stdout:6/535: write d6/f4f [5004118,115613] 0 2023-12-05T13:26:35.125 INFO:tasks.workunit.client.0.smithi029.stdout:6/536: mkdir d6/d3f/db7 0 2023-12-05T13:26:35.126 INFO:tasks.workunit.client.0.smithi029.stdout:6/537: symlink d6/d29/d60/lb8 0 2023-12-05T13:26:35.127 INFO:tasks.workunit.client.0.smithi029.stdout:6/538: mknod d6/d64/d65/d40/d74/cb9 0 2023-12-05T13:26:35.129 INFO:tasks.workunit.client.0.smithi029.stdout:6/539: rename d6/d3f/l7b to d6/d64/d6d/d85/lba 0 2023-12-05T13:26:35.131 INFO:tasks.workunit.client.0.smithi029.stdout:6/540: symlink d6/d64/d65/d40/lbb 0 2023-12-05T13:26:35.137 INFO:tasks.workunit.client.0.smithi029.stdout:5/386: truncate d1/f20 2230837 0 2023-12-05T13:26:35.137 INFO:tasks.workunit.client.0.smithi029.stdout:5/387: write d1/dc/d11/d17/d29/f43 [1154121,52869] 0 2023-12-05T13:26:35.137 INFO:tasks.workunit.client.0.smithi029.stdout:5/388: fsync d1/dc/d25/d4c/f7e 0 2023-12-05T13:26:35.142 INFO:tasks.workunit.client.0.smithi029.stdout:6/541: dread d6/fc [4194304,4194304] 0 2023-12-05T13:26:35.143 INFO:tasks.workunit.client.0.smithi029.stdout:6/542: mkdir d6/d29/d60/dbc 0 2023-12-05T13:26:35.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/362: sync 2023-12-05T13:26:35.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/363: fdatasync d0/d16/d22/d4f/f6d 0 2023-12-05T13:26:35.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/364: chown d0/da/f1b 26 1 2023-12-05T13:26:35.145 INFO:tasks.workunit.client.0.smithi029.stdout:4/365: truncate d0/d3c/d56/f74 159396 0 2023-12-05T13:26:35.145 INFO:tasks.workunit.client.0.smithi029.stdout:6/543: getdents d6/d1d/d39/d58/d71 0 2023-12-05T13:26:35.146 INFO:tasks.workunit.client.0.smithi029.stdout:4/366: mkdir d0/d16/d2f/d69/d77 0 2023-12-05T13:26:35.147 INFO:tasks.workunit.client.0.smithi029.stdout:4/367: chown d0/de/c1c 5503 1 2023-12-05T13:26:35.147 INFO:tasks.workunit.client.0.smithi029.stdout:4/368: chown d0/de/d15/d2b 0 1 2023-12-05T13:26:35.147 INFO:tasks.workunit.client.0.smithi029.stdout:5/389: dread d1/f60 [0,4194304] 0 2023-12-05T13:26:35.147 INFO:tasks.workunit.client.0.smithi029.stdout:5/390: chown d1/dc/d10/d1e/d33 123473940 1 2023-12-05T13:26:35.147 INFO:tasks.workunit.client.0.smithi029.stdout:5/391: chown d1/dc/d38/d3a/d5c/f63 0 1 2023-12-05T13:26:35.147 INFO:tasks.workunit.client.0.smithi029.stdout:3/507: sync 2023-12-05T13:26:35.152 INFO:tasks.workunit.client.0.smithi029.stdout:4/369: rmdir d0/d41 39 2023-12-05T13:26:35.152 INFO:tasks.workunit.client.0.smithi029.stdout:4/370: stat d0/da/f20 0 2023-12-05T13:26:35.152 INFO:tasks.workunit.client.0.smithi029.stdout:4/371: dread - d0/de/d30/f68 zero size 2023-12-05T13:26:35.153 INFO:tasks.workunit.client.0.smithi029.stdout:4/372: write d0/d16/f4a [61839,114815] 0 2023-12-05T13:26:35.153 INFO:tasks.workunit.client.0.smithi029.stdout:4/373: chown d0/de/d15/l50 5703145 1 2023-12-05T13:26:35.153 INFO:tasks.workunit.client.0.smithi029.stdout:5/392: symlink d1/dc/d38/l8c 0 2023-12-05T13:26:35.153 INFO:tasks.workunit.client.0.smithi029.stdout:0/536: sync 2023-12-05T13:26:35.153 INFO:tasks.workunit.client.0.smithi029.stdout:7/611: sync 2023-12-05T13:26:35.154 INFO:tasks.workunit.client.0.smithi029.stdout:7/612: readlink d6/d50/d5b/d1a/l8f 0 2023-12-05T13:26:35.155 INFO:tasks.workunit.client.0.smithi029.stdout:3/508: symlink d1/d16/d36/d3a/d6c/d7d/d95/la4 0 2023-12-05T13:26:35.157 INFO:tasks.workunit.client.0.smithi029.stdout:6/544: rmdir d6 39 2023-12-05T13:26:35.167 INFO:tasks.workunit.client.0.smithi029.stdout:6/545: dread d6/fa [0,4194304] 0 2023-12-05T13:26:35.167 INFO:tasks.workunit.client.0.smithi029.stdout:6/546: chown d6/f45 591346572 1 2023-12-05T13:26:35.168 INFO:tasks.workunit.client.0.smithi029.stdout:3/509: dread d1/fd [0,4194304] 0 2023-12-05T13:26:35.170 INFO:tasks.workunit.client.0.smithi029.stdout:0/537: dwrite dc/d23/d3a/d41/d57/f59 [0,4194304] 0 2023-12-05T13:26:35.171 INFO:tasks.workunit.client.0.smithi029.stdout:4/374: dread d0/f2e [0,4194304] 0 2023-12-05T13:26:35.171 INFO:tasks.workunit.client.0.smithi029.stdout:5/393: rename d1/dc/d10/d1e/d33/l71 to d1/dc/d25/d4c/d61/l8d 0 2023-12-05T13:26:35.172 INFO:tasks.workunit.client.0.smithi029.stdout:6/547: creat d6/d64/d65/d40/d4d/fbd x:0 0 0 2023-12-05T13:26:35.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/510: creat d1/d18/fa5 x:0 0 0 2023-12-05T13:26:35.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/511: dread - d1/d16/d36/d3a/d6c/d7d/fa1 zero size 2023-12-05T13:26:35.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/512: write d1/d5e/d74/f78 [1711389,106031] 0 2023-12-05T13:26:35.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/513: chown d1/f48 956409 1 2023-12-05T13:26:35.174 INFO:tasks.workunit.client.0.smithi029.stdout:3/514: fdatasync d1/d5e/f67 0 2023-12-05T13:26:35.175 INFO:tasks.workunit.client.0.smithi029.stdout:3/515: readlink d1/d16/d36/d3a/d6c/d7d/d95/la4 0 2023-12-05T13:26:35.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/613: dwrite d6/d50/d5b/d1a/d26/d6e/f95 [0,4194304] 0 2023-12-05T13:26:35.178 INFO:tasks.workunit.client.0.smithi029.stdout:7/614: truncate d6/d2a/d7e/f9d 166618 0 2023-12-05T13:26:35.178 INFO:tasks.workunit.client.0.smithi029.stdout:4/375: link d0/de/d15/l1f d0/d16/d2f/d69/d77/l78 0 2023-12-05T13:26:35.181 INFO:tasks.workunit.client.0.smithi029.stdout:5/394: rename d1/dc/d11/c5d to d1/dc/d38/d3a/d5c/c8e 0 2023-12-05T13:26:35.182 INFO:tasks.workunit.client.0.smithi029.stdout:3/516: mknod d1/d10/d91/ca6 0 2023-12-05T13:26:35.183 INFO:tasks.workunit.client.0.smithi029.stdout:0/538: dwrite dc/f80 [0,4194304] 0 2023-12-05T13:26:35.187 INFO:tasks.workunit.client.0.smithi029.stdout:7/615: mkdir d6/d2a/d4f/d93/dbb 0 2023-12-05T13:26:35.188 INFO:tasks.workunit.client.0.smithi029.stdout:4/376: mkdir d0/d16/d22/d5f/d79 0 2023-12-05T13:26:35.194 INFO:tasks.workunit.client.0.smithi029.stdout:6/548: rename d6/d29/d60/l72 to d6/d1d/d39/lbe 0 2023-12-05T13:26:35.194 INFO:tasks.workunit.client.0.smithi029.stdout:6/549: chown d6/d64/d65/d40/d4d/fa2 130149778 1 2023-12-05T13:26:35.194 INFO:tasks.workunit.client.0.smithi029.stdout:6/550: dread - d6/d64/d65/f99 zero size 2023-12-05T13:26:35.194 INFO:tasks.workunit.client.0.smithi029.stdout:5/395: mkdir d1/dc/d10/d1e/d75/d7f/d8f 0 2023-12-05T13:26:35.198 INFO:tasks.workunit.client.0.smithi029.stdout:3/517: dwrite d1/d6/d4a/f97 [0,4194304] 0 2023-12-05T13:26:35.200 INFO:tasks.workunit.client.0.smithi029.stdout:7/616: mknod d6/d35/d70/cbc 0 2023-12-05T13:26:35.200 INFO:tasks.workunit.client.0.smithi029.stdout:7/617: readlink d6/d35/d3e/d40/d52/lac 0 2023-12-05T13:26:35.202 INFO:tasks.workunit.client.0.smithi029.stdout:4/377: mknod d0/de/d30/c7a 0 2023-12-05T13:26:35.202 INFO:tasks.workunit.client.0.smithi029.stdout:4/378: chown d0/d16/d22/d4f 285398795 1 2023-12-05T13:26:35.205 INFO:tasks.workunit.client.0.smithi029.stdout:0/539: rename dc/f3f to dc/d33/d3d/d7a/d84/da4/fa9 0 2023-12-05T13:26:35.205 INFO:tasks.workunit.client.0.smithi029.stdout:0/540: write dc/d33/d3d/d65/d85/f8e [2723040,25838] 0 2023-12-05T13:26:35.206 INFO:tasks.workunit.client.0.smithi029.stdout:3/518: dread d1/fd [4194304,4194304] 0 2023-12-05T13:26:35.206 INFO:tasks.workunit.client.0.smithi029.stdout:6/551: rmdir d6/d1d/d39/d58 39 2023-12-05T13:26:35.208 INFO:tasks.workunit.client.0.smithi029.stdout:6/552: write d6/d64/d6d/da3/fab [23327,96989] 0 2023-12-05T13:26:35.208 INFO:tasks.workunit.client.0.smithi029.stdout:6/553: truncate d6/d64/d65/d40/f66 4412927 0 2023-12-05T13:26:35.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/396: creat d1/dc/d25/d4c/d61/f90 x:0 0 0 2023-12-05T13:26:35.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/397: chown d1/dc/c13 15 1 2023-12-05T13:26:35.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/398: write d1/dc/d11/d17/f64 [1493431,29072] 0 2023-12-05T13:26:35.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/399: write d1/dc/d25/d4c/f6f [996974,119941] 0 2023-12-05T13:26:35.209 INFO:tasks.workunit.client.0.smithi029.stdout:5/400: truncate d1/dc/d25/f46 466325 0 2023-12-05T13:26:35.212 INFO:tasks.workunit.client.0.smithi029.stdout:7/618: mknod d6/d35/d6a/cbd 0 2023-12-05T13:26:35.212 INFO:tasks.workunit.client.0.smithi029.stdout:7/619: readlink d6/d35/d5c/l88 0 2023-12-05T13:26:35.213 INFO:tasks.workunit.client.0.smithi029.stdout:7/620: write d6/d2a/d4f/d93/fa3 [2747293,70965] 0 2023-12-05T13:26:35.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/621: write d6/d50/d5b/d1a/d26/f2b [4430799,15302] 0 2023-12-05T13:26:35.214 INFO:tasks.workunit.client.0.smithi029.stdout:7/622: stat d6/d19/c2d 0 2023-12-05T13:26:35.214 INFO:tasks.workunit.client.0.smithi029.stdout:3/519: dread d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:35.214 INFO:tasks.workunit.client.0.smithi029.stdout:4/379: symlink d0/d1/d37/l7b 0 2023-12-05T13:26:35.217 INFO:tasks.workunit.client.0.smithi029.stdout:4/380: write d0/de/d15/f4e [4863376,126706] 0 2023-12-05T13:26:35.217 INFO:tasks.workunit.client.0.smithi029.stdout:0/541: rmdir dc/d23/d3a/d41/d57/d58 39 2023-12-05T13:26:35.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/401: dread d1/dc/d10/d1e/d33/f4d [0,4194304] 0 2023-12-05T13:26:35.221 INFO:tasks.workunit.client.0.smithi029.stdout:5/402: read d1/dc/d25/d4c/f52 [969544,24403] 0 2023-12-05T13:26:35.221 INFO:tasks.workunit.client.0.smithi029.stdout:6/554: mkdir d6/d1d/d39/d58/d71/dbf 0 2023-12-05T13:26:35.222 INFO:tasks.workunit.client.0.smithi029.stdout:5/403: dread d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:35.223 INFO:tasks.workunit.client.0.smithi029.stdout:7/623: rename d6/l16 to d6/d35/d6a/lbe 0 2023-12-05T13:26:35.223 INFO:tasks.workunit.client.0.smithi029.stdout:7/624: chown d6/d50/d5b/d5f/d7d/d97/f57 23188131 1 2023-12-05T13:26:35.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/404: dread d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:35.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/405: chown d1/dc/d38 15 1 2023-12-05T13:26:35.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/406: chown d1/dc/d10/d1e/d75/d7f/d8a 3241618 1 2023-12-05T13:26:35.225 INFO:tasks.workunit.client.0.smithi029.stdout:5/407: write d1/dc/d38/f22 [1935228,27977] 0 2023-12-05T13:26:35.228 INFO:tasks.workunit.client.0.smithi029.stdout:0/542: rmdir dc/d23/d3a 39 2023-12-05T13:26:35.233 INFO:tasks.workunit.client.0.smithi029.stdout:3/520: dwrite d1/d16/d36/d4b/f6b [0,4194304] 0 2023-12-05T13:26:35.235 INFO:tasks.workunit.client.0.smithi029.stdout:6/555: mknod d6/d64/d6d/d85/cc0 0 2023-12-05T13:26:35.235 INFO:tasks.workunit.client.0.smithi029.stdout:6/556: write d6/d1d/f55 [1198420,113311] 0 2023-12-05T13:26:35.238 INFO:tasks.workunit.client.0.smithi029.stdout:5/408: creat d1/dc/d38/d3a/d5c/d87/f91 x:0 0 0 2023-12-05T13:26:35.243 INFO:tasks.workunit.client.0.smithi029.stdout:7/625: dwrite d6/d50/d5b/d1a/d26/d6e/f95 [0,4194304] 0 2023-12-05T13:26:35.244 INFO:tasks.workunit.client.0.smithi029.stdout:3/521: rename d1/d16/d36/d4b/f53 to d1/d5e/fa7 0 2023-12-05T13:26:35.245 INFO:tasks.workunit.client.0.smithi029.stdout:6/557: creat d6/d1d/d39/d58/fc1 x:0 0 0 2023-12-05T13:26:35.246 INFO:tasks.workunit.client.0.smithi029.stdout:0/543: dwrite dc/d23/d3a/d41/d57/d58/f7d [4194304,4194304] 0 2023-12-05T13:26:35.246 INFO:tasks.workunit.client.0.smithi029.stdout:5/409: truncate d1/dc/d38/d55/f81 1824504 0 2023-12-05T13:26:35.248 INFO:tasks.workunit.client.0.smithi029.stdout:3/522: creat d1/d16/d36/d8d/fa8 x:0 0 0 2023-12-05T13:26:35.250 INFO:tasks.workunit.client.0.smithi029.stdout:0/544: creat dc/d33/d3d/d7a/d84/d8d/d97/faa x:0 0 0 2023-12-05T13:26:35.252 INFO:tasks.workunit.client.0.smithi029.stdout:3/523: rename d1/d6/d11/d4e/l50 to d1/d5e/d74/la9 0 2023-12-05T13:26:35.253 INFO:tasks.workunit.client.0.smithi029.stdout:0/545: creat dc/d13/d4f/d88/fab x:0 0 0 2023-12-05T13:26:35.255 INFO:tasks.workunit.client.0.smithi029.stdout:3/524: getdents d1/d16/d1f/d4c 0 2023-12-05T13:26:35.256 INFO:tasks.workunit.client.0.smithi029.stdout:7/626: dread d6/d2a/d4f/d93/fa3 [0,4194304] 0 2023-12-05T13:26:35.257 INFO:tasks.workunit.client.0.smithi029.stdout:3/525: unlink d1/d6/d11/d4e/c9d 0 2023-12-05T13:26:35.259 INFO:tasks.workunit.client.0.smithi029.stdout:7/627: truncate d6/d2a/d2f/fa7 215319 0 2023-12-05T13:26:35.262 INFO:tasks.workunit.client.0.smithi029.stdout:3/526: unlink d1/d6/d11/f1e 0 2023-12-05T13:26:35.263 INFO:tasks.workunit.client.0.smithi029.stdout:5/410: dread d1/f60 [0,4194304] 0 2023-12-05T13:26:35.264 INFO:tasks.workunit.client.0.smithi029.stdout:3/527: mknod d1/d16/caa 0 2023-12-05T13:26:35.264 INFO:tasks.workunit.client.0.smithi029.stdout:3/528: stat d1/d18/f1d 0 2023-12-05T13:26:35.265 INFO:tasks.workunit.client.0.smithi029.stdout:6/558: dwrite d6/d1d/d39/d58/fc1 [0,4194304] 0 2023-12-05T13:26:35.266 INFO:tasks.workunit.client.0.smithi029.stdout:5/411: creat d1/dc/d25/f92 x:0 0 0 2023-12-05T13:26:35.266 INFO:tasks.workunit.client.0.smithi029.stdout:6/559: write d6/d1d/d36/f48 [803477,18588] 0 2023-12-05T13:26:35.267 INFO:tasks.workunit.client.0.smithi029.stdout:3/529: mkdir d1/d5e/d74/dab 0 2023-12-05T13:26:35.271 INFO:tasks.workunit.client.0.smithi029.stdout:5/412: mkdir d1/dc/d10/d1e/d33/d93 0 2023-12-05T13:26:35.272 INFO:tasks.workunit.client.0.smithi029.stdout:0/546: dwrite dc/f2c [0,4194304] 0 2023-12-05T13:26:35.272 INFO:tasks.workunit.client.0.smithi029.stdout:0/547: fdatasync dc/d23/f2b 0 2023-12-05T13:26:35.274 INFO:tasks.workunit.client.0.smithi029.stdout:6/560: rename d6/d29/l77 to d6/d64/d65/lc2 0 2023-12-05T13:26:35.277 INFO:tasks.workunit.client.0.smithi029.stdout:3/530: getdents d1/d6/d11/d4e 0 2023-12-05T13:26:35.278 INFO:tasks.workunit.client.0.smithi029.stdout:7/628: write d6/f15 [660564,118324] 0 2023-12-05T13:26:35.280 INFO:tasks.workunit.client.0.smithi029.stdout:0/548: dread dc/d33/f38 [0,4194304] 0 2023-12-05T13:26:35.281 INFO:tasks.workunit.client.0.smithi029.stdout:5/413: rename d1/dc/d38/d3a/c45 to d1/dc/c94 0 2023-12-05T13:26:35.286 INFO:tasks.workunit.client.0.smithi029.stdout:6/561: creat d6/d1d/d36/fc3 x:0 0 0 2023-12-05T13:26:35.288 INFO:tasks.workunit.client.0.smithi029.stdout:7/629: creat d6/d50/d5b/d1a/d26/d72/fbf x:0 0 0 2023-12-05T13:26:35.289 INFO:tasks.workunit.client.0.smithi029.stdout:5/414: symlink d1/dc/d11/d17/l95 0 2023-12-05T13:26:35.289 INFO:tasks.workunit.client.0.smithi029.stdout:5/415: dread - d1/dc/d25/d4c/d61/f85 zero size 2023-12-05T13:26:35.294 INFO:tasks.workunit.client.0.smithi029.stdout:3/531: dwrite d1/d16/d36/d3a/f3d [0,4194304] 0 2023-12-05T13:26:35.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/562: rename d6/d64/d65 to d6/d29/dc4 0 2023-12-05T13:26:35.298 INFO:tasks.workunit.client.0.smithi029.stdout:6/563: write d6/d29/dc4/d40/d4d/fa2 [59525,76666] 0 2023-12-05T13:26:35.301 INFO:tasks.workunit.client.0.smithi029.stdout:7/630: unlink d6/d50/d5b/d1a/d26/f39 0 2023-12-05T13:26:35.302 INFO:tasks.workunit.client.0.smithi029.stdout:5/416: rename d1/dc/d25/d4c/f6f to d1/dc/d38/d55/f96 0 2023-12-05T13:26:35.305 INFO:tasks.workunit.client.0.smithi029.stdout:6/564: unlink d6/d29/dc4/d40/lad 0 2023-12-05T13:26:35.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/565: unlink d6/d1d/d39/d58/fa9 0 2023-12-05T13:26:35.317 INFO:tasks.workunit.client.0.smithi029.stdout:5/417: dwrite d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:35.322 INFO:tasks.workunit.client.0.smithi029.stdout:6/566: dread d6/f10 [0,4194304] 0 2023-12-05T13:26:35.322 INFO:tasks.workunit.client.0.smithi029.stdout:7/631: dwrite d6/d50/d5b/d5f/f84 [0,4194304] 0 2023-12-05T13:26:35.331 INFO:tasks.workunit.client.0.smithi029.stdout:5/418: dwrite d1/dc/d25/f3b [0,4194304] 0 2023-12-05T13:26:35.331 INFO:tasks.workunit.client.0.smithi029.stdout:6/567: dread d6/d64/d6d/da3/fab [0,4194304] 0 2023-12-05T13:26:35.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/632: symlink d6/d50/d5b/d5f/d7d/d96/lc0 0 2023-12-05T13:26:35.333 INFO:tasks.workunit.client.0.smithi029.stdout:5/419: truncate d1/dc/d10/d1e/d33/f6b 916607 0 2023-12-05T13:26:35.335 INFO:tasks.workunit.client.0.smithi029.stdout:6/568: truncate d6/d1d/f55 406690 0 2023-12-05T13:26:35.348 INFO:tasks.workunit.client.0.smithi029.stdout:5/420: write d1/dc/d11/d17/d3d/f62 [1358171,21816] 0 2023-12-05T13:26:35.359 INFO:tasks.workunit.client.0.smithi029.stdout:6/569: dwrite d6/f18 [0,4194304] 0 2023-12-05T13:26:35.360 INFO:tasks.workunit.client.0.smithi029.stdout:6/570: creat d6/d29/dc4/d40/d74/d52/d5c/d6f/fc5 x:0 0 0 2023-12-05T13:26:35.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/571: creat d6/d93/fc6 x:0 0 0 2023-12-05T13:26:35.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/572: write d6/d29/dc4/d40/d4d/d8f/fa1 [1009469,42451] 0 2023-12-05T13:26:35.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/573: chown d6/d1d/f84 0 1 2023-12-05T13:26:35.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/574: write d6/d1d/f55 [1092504,38455] 0 2023-12-05T13:26:35.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/575: dread - d6/d1d/f84 zero size 2023-12-05T13:26:35.361 INFO:tasks.workunit.client.0.smithi029.stdout:6/576: stat d6/d5a 0 2023-12-05T13:26:35.368 INFO:tasks.workunit.client.0.smithi029.stdout:5/421: dwrite d1/dc/d38/f22 [0,4194304] 0 2023-12-05T13:26:35.370 INFO:tasks.workunit.client.0.smithi029.stdout:5/422: unlink d1/dc/c94 0 2023-12-05T13:26:35.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/423: dwrite d1/dc/d11/f56 [4194304,4194304] 0 2023-12-05T13:26:35.384 INFO:tasks.workunit.client.0.smithi029.stdout:5/424: rename d1/dc/d27/c66 to d1/dc/c97 0 2023-12-05T13:26:35.384 INFO:tasks.workunit.client.0.smithi029.stdout:5/425: write d1/dc/d25/f46 [1336086,48779] 0 2023-12-05T13:26:35.384 INFO:tasks.workunit.client.0.smithi029.stdout:5/426: mkdir d1/dc/d38/d55/d57/d98 0 2023-12-05T13:26:35.385 INFO:tasks.workunit.client.0.smithi029.stdout:5/427: read d1/dc/d38/f1a [47190,120629] 0 2023-12-05T13:26:35.400 INFO:tasks.workunit.client.0.smithi029.stdout:5/428: dwrite d1/f20 [0,4194304] 0 2023-12-05T13:26:35.401 INFO:tasks.workunit.client.0.smithi029.stdout:5/429: mknod d1/dc/d38/c99 0 2023-12-05T13:26:35.416 INFO:tasks.workunit.client.0.smithi029.stdout:5/430: dwrite d1/dc/d25/f92 [0,4194304] 0 2023-12-05T13:26:35.419 INFO:tasks.workunit.client.0.smithi029.stdout:5/431: rename d1/dc/d10/d3f to d1/dc/d10/d1e/d75/d7f/d8f/d9a 0 2023-12-05T13:26:35.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/432: unlink d1/dc/d25/f46 0 2023-12-05T13:26:35.422 INFO:tasks.workunit.client.0.smithi029.stdout:5/433: read d1/dc/d11/f56 [7420871,61987] 0 2023-12-05T13:26:35.429 INFO:tasks.workunit.client.0.smithi029.stdout:5/434: rename d1/dc/d10/d1e/d75/d7f/d8f to d1/dc/d25/d4c/d9b 0 2023-12-05T13:26:35.430 INFO:tasks.workunit.client.0.smithi029.stdout:5/435: truncate d1/dc/d11/f12 1155264 0 2023-12-05T13:26:35.432 INFO:tasks.workunit.client.0.smithi029.stdout:5/436: mkdir d1/dc/d10/d1e/d9c 0 2023-12-05T13:26:35.433 INFO:tasks.workunit.client.0.smithi029.stdout:5/437: symlink d1/dc/d25/d4c/l9d 0 2023-12-05T13:26:35.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/438: rename d1/dc/d10/l7c to d1/dc/d10/d1e/l9e 0 2023-12-05T13:26:35.435 INFO:tasks.workunit.client.0.smithi029.stdout:5/439: readlink d1/dc/d38/d3a/l54 0 2023-12-05T13:26:35.437 INFO:tasks.workunit.client.0.smithi029.stdout:5/440: rename d1/dc/d11/d17/d3d/f5b to d1/dc/d11/d17/f9f 0 2023-12-05T13:26:35.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/441: getdents d1/dc/d10/d1e 0 2023-12-05T13:26:35.443 INFO:tasks.workunit.client.0.smithi029.stdout:5/442: mknod d1/dc/d10/d1e/d9c/ca0 0 2023-12-05T13:26:35.446 INFO:tasks.workunit.client.0.smithi029.stdout:5/443: link d1/dc/d38/d4b/c77 d1/dc/d11/d17/d3d/ca1 0 2023-12-05T13:26:35.447 INFO:tasks.workunit.client.0.smithi029.stdout:5/444: stat d1/dc/d10/c1c 0 2023-12-05T13:26:35.452 INFO:tasks.workunit.client.0.smithi029.stdout:5/445: dread d1/dc/d11/d17/d3d/f62 [0,4194304] 0 2023-12-05T13:26:35.454 INFO:tasks.workunit.client.0.smithi029.stdout:5/446: link d1/c6 d1/dc/d10/d1e/d75/d7f/d8a/ca2 0 2023-12-05T13:26:35.456 INFO:tasks.workunit.client.0.smithi029.stdout:5/447: rename d1/cd to d1/dc/d11/d17/d3d/ca3 0 2023-12-05T13:26:35.456 INFO:tasks.workunit.client.0.smithi029.stdout:5/448: fdatasync d1/dc/d10/d1e/d33/f4d 0 2023-12-05T13:26:35.456 INFO:tasks.workunit.client.0.smithi029.stdout:5/449: write d1/dc/d25/d4c/d9b/d9a/f88 [1001802,21890] 0 2023-12-05T13:26:35.458 INFO:tasks.workunit.client.0.smithi029.stdout:5/450: symlink d1/dc/d38/d55/d57/la4 0 2023-12-05T13:26:35.477 INFO:tasks.workunit.client.0.smithi029.stdout:5/451: dwrite d1/dc/d27/f49 [0,4194304] 0 2023-12-05T13:26:35.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/452: dwrite d1/dc/d25/d4c/f7e [0,4194304] 0 2023-12-05T13:26:35.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/453: fdatasync d1/dc/f89 0 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 -- 172.21.15.29:0/175659152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fcd00 msgr2=0x7f93f40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 --2- 172.21.15.29:0/175659152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fcd00 0x7f93f40fd150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93e8004940 tx=0x7f93e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 -- 172.21.15.29:0/175659152 shutdown_connections 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 --2- 172.21.15.29:0/175659152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fcd00 0x7f93f40fd150 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 --2- 172.21.15.29:0/175659152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fbaf0 0x7f93f40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 -- 172.21.15.29:0/175659152 >> 172.21.15.29:0/175659152 conn(0x7f93f40f7190 msgr2=0x7f93f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 -- 172.21.15.29:0/175659152 shutdown_connections 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.557+0000 7f93f8c27700 1 -- 172.21.15.29:0/175659152 wait complete. 2023-12-05T13:26:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f8c27700 1 Processor -- start 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f8c27700 1 -- start start 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f8c27700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 0x7f93f410c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f8c27700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fcd00 0x7f93f410c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f8c27700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f410d040 con 0x7f93f40fbaf0 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f8c27700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f410d880 con 0x7f93f40fcd00 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 0x7f93f410c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 0x7f93f410c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34760/0 (socket says 172.21.15.29:34760) 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.558+0000 7f93f259c700 1 -- 172.21.15.29:0/4052486823 learned_addr learned my addr 172.21.15.29:0/4052486823 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f1d9b700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fcd00 0x7f93f410c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f259c700 1 -- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fcd00 msgr2=0x7f93f410c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f259c700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fcd00 0x7f93f410c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f259c700 1 -- 172.21.15.29:0/4052486823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e8005040 con 0x7f93f40fbaf0 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f1d9b700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fcd00 0x7f93f410c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:26:35.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f259c700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 0x7f93f410c470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93e400b790 tx=0x7f93e4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e400f6f0 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f410db60 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93e400fd00 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e40103a0 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.559+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f410e0a0 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.560+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f404bb80 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.561+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f93e400f850 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.562+0000 7f93e2ffd700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f93dc06ae40 0x7f93dc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.562+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f93e408a0a0 con 0x7f93f40fbaf0 2023-12-05T13:26:35.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.562+0000 7f93f1d9b700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f93dc06ae40 0x7f93dc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.563+0000 7f93f1d9b700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f93dc06ae40 0x7f93dc06d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93e8004f90 tx=0x7f93e8009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:35.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.566+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f93e4057fd0 con 0x7f93f40fbaf0 2023-12-05T13:26:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:35 smithi052 ceph-mon[121072]: pgmap v39: 65 pgs: 65 active+clean; 1023 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 61 MiB/s rd, 120 MiB/s wr, 417 op/s 2023-12-05T13:26:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:35 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:35 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:35.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.813+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93f410e5e0 con 0x7f93dc06ae40 2023-12-05T13:26:35.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.815+0000 7f93e2ffd700 1 -- 172.21.15.29:0/4052486823 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f93f410e5e0 con 0x7f93dc06ae40 2023-12-05T13:26:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f93dc06ae40 msgr2=0x7f93dc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f93dc06ae40 0x7f93dc06d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93e8004f90 tx=0x7f93e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:35.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 msgr2=0x7f93f410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 0x7f93f410c470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93e400b790 tx=0x7f93e4009220 comp rx=0 tx=0).stop 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 shutdown_connections 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f93dc06ae40 0x7f93dc06d2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93f40fbaf0 0x7f93f410c470 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 --2- 172.21.15.29:0/4052486823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93f40fcd00 0x7f93f410c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 >> 172.21.15.29:0/4052486823 conn(0x7f93f40f7190 msgr2=0x7f93f40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 shutdown_connections 2023-12-05T13:26:35.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.817+0000 7f93f8c27700 1 -- 172.21.15.29:0/4052486823 wait complete. 2023-12-05T13:26:35.830 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:26:35.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:35 smithi029 ceph-mon[112128]: pgmap v39: 65 pgs: 65 active+clean; 1023 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 61 MiB/s rd, 120 MiB/s wr, 417 op/s 2023-12-05T13:26:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:35 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:35.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:35 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:35.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 -- 172.21.15.29:0/1306146576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb00fd730 msgr2=0x7f0cb00ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:35.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/1306146576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb00fd730 0x7f0cb00ffb10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4004940 tx=0x7f0ca4009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:35.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 -- 172.21.15.29:0/1306146576 shutdown_connections 2023-12-05T13:26:35.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/1306146576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb0100050 0x7f0cb0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/1306146576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb00fd730 0x7f0cb00ffb10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 -- 172.21.15.29:0/1306146576 >> 172.21.15.29:0/1306146576 conn(0x7f0cb00f71b0 msgr2=0x7f0cb00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 -- 172.21.15.29:0/1306146576 shutdown_connections 2023-12-05T13:26:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.932+0000 7f0cb6e98700 1 -- 172.21.15.29:0/1306146576 wait complete. 2023-12-05T13:26:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0cb6e98700 1 Processor -- start 2023-12-05T13:26:35.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0cb6e98700 1 -- start start 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0cb6e98700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb00fd730 0x7f0cb010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0cb6e98700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 0x7f0cb010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0cb6e98700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb010dfd0 con 0x7f0cb0100050 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0cb6e98700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb010e870 con 0x7f0cb00fd730 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0caffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 0x7f0cb010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0caffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 0x7f0cb010d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34774/0 (socket says 172.21.15.29:34774) 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.933+0000 7f0caffff700 1 -- 172.21.15.29:0/125283384 learned_addr learned my addr 172.21.15.29:0/125283384 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:35.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cb4c34700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb00fd730 0x7f0cb010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0caffff700 1 -- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb00fd730 msgr2=0x7f0cb010d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0caffff700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb00fd730 0x7f0cb010d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0caffff700 1 -- 172.21.15.29:0/125283384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4005040 con 0x7f0cb0100050 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cb4c34700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb00fd730 0x7f0cb010d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0caffff700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 0x7f0cb010d9d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00eb70 tx=0x7f0c9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9c007cc0 con 0x7f0cb0100050 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb010eaf0 con 0x7f0cb0100050 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c9c00f040 con 0x7f0cb0100050 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9c0095f0 con 0x7f0cb0100050 2023-12-05T13:26:35.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.934+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb010f030 con 0x7f0cb0100050 2023-12-05T13:26:35.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.935+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb004bb80 con 0x7f0cb0100050 2023-12-05T13:26:35.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.936+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f0c9c009750 con 0x7f0cb0100050 2023-12-05T13:26:35.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.936+0000 7f0cad7fa700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0ca006ae40 0x7f0ca006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:35.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.936+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0c9c089490 con 0x7f0cb0100050 2023-12-05T13:26:35.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.936+0000 7f0cb4c34700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0ca006ae40 0x7f0ca006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:35.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.937+0000 7f0cb4c34700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0ca006ae40 0x7f0ca006d2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4004560 tx=0x7f0ca4009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:35.941+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0c9c057210 con 0x7f0cb0100050 2023-12-05T13:26:36.177 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.176+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cb010f480 con 0x7f0ca006ae40 2023-12-05T13:26:36.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.177+0000 7f0cad7fa700 1 -- 172.21.15.29:0/125283384 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0cb010f480 con 0x7f0ca006ae40 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0ca006ae40 msgr2=0x7f0ca006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0ca006ae40 0x7f0ca006d2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4004560 tx=0x7f0ca4009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 msgr2=0x7f0cb010d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 0x7f0cb010d9d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00eb70 tx=0x7f0c9c00b040 comp rx=0 tx=0).stop 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 shutdown_connections 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0ca006ae40 0x7f0ca006d2f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cb00fd730 0x7f0cb010d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 --2- 172.21.15.29:0/125283384 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0cb0100050 0x7f0cb010d9d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 >> 172.21.15.29:0/125283384 conn(0x7f0cb00f71b0 msgr2=0x7f0cb00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 shutdown_connections 2023-12-05T13:26:36.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.180+0000 7f0cb6e98700 1 -- 172.21.15.29:0/125283384 wait complete. 2023-12-05T13:26:36.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 -- 172.21.15.29:0/1371694928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fbaf0 msgr2=0x7f19180fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 --2- 172.21.15.29:0/1371694928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fbaf0 0x7f19180fbf00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1914004940 tx=0x7f1914009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 -- 172.21.15.29:0/1371694928 shutdown_connections 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 --2- 172.21.15.29:0/1371694928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19180fcd00 0x7f19180fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 --2- 172.21.15.29:0/1371694928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fbaf0 0x7f19180fbf00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 -- 172.21.15.29:0/1371694928 >> 172.21.15.29:0/1371694928 conn(0x7f19180f71b0 msgr2=0x7f19180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 -- 172.21.15.29:0/1371694928 shutdown_connections 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.297+0000 7f19204c3700 1 -- 172.21.15.29:0/1371694928 wait complete. 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f19204c3700 1 Processor -- start 2023-12-05T13:26:36.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f19204c3700 1 -- start start 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f19204c3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19180fbaf0 0x7f19180ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f19204c3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 0x7f19180fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f19204c3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918111190 con 0x7f19180fcd00 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f19204c3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918111300 con 0x7f19180fbaf0 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f191da5e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 0x7f19180fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f191da5e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 0x7f19180fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34790/0 (socket says 172.21.15.29:34790) 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f191da5e700 1 -- 172.21.15.29:0/3153965604 learned_addr learned my addr 172.21.15.29:0/3153965604 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:36.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.298+0000 7f191e25f700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19180fbaf0 0x7f19180ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f191da5e700 1 -- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19180fbaf0 msgr2=0x7f19180ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f191da5e700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19180fbaf0 0x7f19180ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f191da5e700 1 -- 172.21.15.29:0/3153965604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914005040 con 0x7f19180fcd00 2023-12-05T13:26:36.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f191da5e700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 0x7f19180fe040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f190800eb40 tx=0x7f190800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1908007cc0 con 0x7f19180fcd00 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f190800f040 con 0x7f19180fcd00 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19180fe640 con 0x7f19180fcd00 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190800c990 con 0x7f19180fcd00 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.299+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19180feb80 con 0x7f19180fcd00 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.300+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191804bb80 con 0x7f19180fcd00 2023-12-05T13:26:36.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.301+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f190800cc00 con 0x7f19180fcd00 2023-12-05T13:26:36.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.301+0000 7f190effd700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f190406ae40 0x7f190406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:36.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.302+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f1908089480 con 0x7f19180fcd00 2023-12-05T13:26:36.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.302+0000 7f191e25f700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f190406ae40 0x7f190406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:36.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.302+0000 7f191e25f700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f190406ae40 0x7f190406d2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1914009fd0 tx=0x7f1914009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:36.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.307+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f190804ece0 con 0x7f19180fcd00 2023-12-05T13:26:36.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.539+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19180662f0 con 0x7f190406ae40 2023-12-05T13:26:36.554 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.553+0000 7f190effd700 1 -- 172.21.15.29:0/3153965604 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f19180662f0 con 0x7f190406ae40 2023-12-05T13:26:36.554 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (6m) 1s ago 7m 26.6M - 0.25.0 c8568f914cd2 9e55cdf02d5f 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (7m) 1s ago 7m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (7m) 63s ago 7m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (6m) 1s ago 7m 91.1M - 9.4.7 2c41d148cca3 1708882ad53e 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (3m) 1s ago 3m 3820M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (3m) 1s ago 3m 16.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (3m) 63s ago 3m 16.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (3m) 63s ago 3m 16.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:9283 running (8m) 1s ago 8m 425M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 3db6293d6f93 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (82s) 63s ago 6m 490M - 19.0.0-13-ge6605fb8 104f332cd0a9 33d25b025398 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (8m) 1s ago 9m 82.6M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (6m) 63s ago 6m 57.4M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (7m) 1s ago 7m 18.1M - 1.5.0 0da6a335fe13 4c05c939fa62 2023-12-05T13:26:36.555 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (7m) 63s ago 7m 18.0M - 1.5.0 0da6a335fe13 11d1242fdbe3 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (6m) 1s ago 6m 435M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (6m) 1s ago 6m 449M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (5m) 1s ago 5m 354M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (5m) 63s ago 5m 560M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (5m) 63s ago 5m 440M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (4m) 63s ago 4m 537M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:26:36.556 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (6m) 1s ago 7m 58.5M - 2.43.0 a07b618ecd1d 667e42c91d53 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f190406ae40 msgr2=0x7f190406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f190406ae40 0x7f190406d2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1914009fd0 tx=0x7f1914009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 msgr2=0x7f19180fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 0x7f19180fe040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f190800eb40 tx=0x7f190800b040 comp rx=0 tx=0).stop 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 shutdown_connections 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f190406ae40 0x7f190406d2f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19180fbaf0 0x7f19180ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 --2- 172.21.15.29:0/3153965604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19180fcd00 0x7f19180fe040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 >> 172.21.15.29:0/3153965604 conn(0x7f19180f71b0 msgr2=0x7f1918065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 shutdown_connections 2023-12-05T13:26:36.557 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.555+0000 7f19204c3700 1 -- 172.21.15.29:0/3153965604 wait complete. 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 -- 172.21.15.29:0/3887490578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 msgr2=0x7f76bc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 --2- 172.21.15.29:0/3887490578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc0fd150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f76ac004940 tx=0x7f76ac009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 -- 172.21.15.29:0/3887490578 shutdown_connections 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 --2- 172.21.15.29:0/3887490578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc0fd150 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 --2- 172.21.15.29:0/3887490578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 0x7f76bc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 -- 172.21.15.29:0/3887490578 >> 172.21.15.29:0/3887490578 conn(0x7f76bc0f71b0 msgr2=0x7f76bc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 -- 172.21.15.29:0/3887490578 shutdown_connections 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 -- 172.21.15.29:0/3887490578 wait complete. 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.671+0000 7f76c42bd700 1 Processor -- start 2023-12-05T13:26:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c42bd700 1 -- start start 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c42bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 0x7f76bc10d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c42bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c42bd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc10dfd0 con 0x7f76bc0fcd00 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c42bd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc10e870 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c1858700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c2059700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 0x7f76bc10d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c1858700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc10d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34806/0 (socket says 172.21.15.29:34806) 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c1858700 1 -- 172.21.15.29:0/828426440 learned_addr learned my addr 172.21.15.29:0/828426440 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c2059700 1 -- 172.21.15.29:0/828426440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 msgr2=0x7f76bc10d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c2059700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc10d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c2059700 1 -- 172.21.15.29:0/828426440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac005040 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.672+0000 7f76c1858700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc10d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:26:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.673+0000 7f76c2059700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 0x7f76bc10d490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0fcb60 tx=0x7f76b800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.673+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b8004e90 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.673+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc10eaf0 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.673+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc10f030 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.673+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76b800f040 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.673+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b800c850 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.674+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a00052e0 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.675+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f76b8007cc0 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.675+0000 7f76b2ffd700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f76a806ae40 0x7f76a806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:36.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.675+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f76b8089140 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.675+0000 7f76c1858700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f76a806ae40 0x7f76a806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:36.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.676+0000 7f76c1858700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f76a806ae40 0x7f76a806d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0135e0 tx=0x7f76ac009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:36.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.683+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f76b804ece0 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:36.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:26:36.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:36 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:26:36.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:36.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:26:36.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:36 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:26:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.982+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76a0005860 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.983+0000 7f76b2ffd700 1 -- 172.21.15.29:0/828426440 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f76b8056ce0 con 0x7f76bc0fbaf0 2023-12-05T13:26:36.984 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:26:36.984 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:26:36.985 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:26:36.986 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:26:36.986 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T13:26:36.986 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:26:36.986 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:26:36.986 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:26:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f76a806ae40 msgr2=0x7f76a806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f76a806ae40 0x7f76a806d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0135e0 tx=0x7f76ac009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 msgr2=0x7f76bc10d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 0x7f76bc10d490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0fcb60 tx=0x7f76b800b040 comp rx=0 tx=0).stop 2023-12-05T13:26:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 shutdown_connections 2023-12-05T13:26:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f76a806ae40 0x7f76a806d2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76bc0fbaf0 0x7f76bc10d490 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 --2- 172.21.15.29:0/828426440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76bc0fcd00 0x7f76bc10d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 >> 172.21.15.29:0/828426440 conn(0x7f76bc0f71b0 msgr2=0x7f76bc065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 shutdown_connections 2023-12-05T13:26:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:36.985+0000 7f76c42bd700 1 -- 172.21.15.29:0/828426440 wait complete. 2023-12-05T13:26:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.101+0000 7f0a518b3700 1 -- 172.21.15.29:0/3953003052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c066900 msgr2=0x7f0a4c101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.101+0000 7f0a518b3700 1 --2- 172.21.15.29:0/3953003052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c066900 0x7f0a4c101bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c004940 tx=0x7f0a3c009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 -- 172.21.15.29:0/3953003052 shutdown_connections 2023-12-05T13:26:37.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 --2- 172.21.15.29:0/3953003052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c102100 0x7f0a4c1044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:37.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 --2- 172.21.15.29:0/3953003052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c066900 0x7f0a4c101bc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:37.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 -- 172.21.15.29:0/3953003052 >> 172.21.15.29:0/3953003052 conn(0x7f0a4c0f71d0 msgr2=0x7f0a4c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:37.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 -- 172.21.15.29:0/3953003052 shutdown_connections 2023-12-05T13:26:37.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 -- 172.21.15.29:0/3953003052 wait complete. 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 Processor -- start 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.102+0000 7f0a518b3700 1 -- start start 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a518b3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c066900 0x7f0a4c10f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a518b3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 0x7f0a4c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a518b3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c110240 con 0x7f0a4c102100 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a518b3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c110ae0 con 0x7f0a4c066900 2023-12-05T13:26:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 0x7f0a4c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c066900 0x7f0a4c10f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 0x7f0a4c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34818/0 (socket says 172.21.15.29:34818) 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 -- 172.21.15.29:0/1498381661 learned_addr learned my addr 172.21.15.29:0/1498381661 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 -- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c066900 msgr2=0x7f0a4c10f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c066900 0x7f0a4c10f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 -- 172.21.15.29:0/1498381661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c005040 con 0x7f0a4c102100 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4affd700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c066900 0x7f0a4c10f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a4a7fc700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 0x7f0a4c10fc40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000eb40 tx=0x7f0a4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a40007cc0 con 0x7f0a4c102100 2023-12-05T13:26:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.103+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c110d60 con 0x7f0a4c102100 2023-12-05T13:26:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.104+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c1112a0 con 0x7f0a4c102100 2023-12-05T13:26:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.104+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a4000f040 con 0x7f0a4c102100 2023-12-05T13:26:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.104+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a4000c910 con 0x7f0a4c102100 2023-12-05T13:26:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.105+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a380052e0 con 0x7f0a4c102100 2023-12-05T13:26:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.105+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 25) v1 ==== 88724+0+0 (secure 0 0 0) 0x7f0a4000ca70 con 0x7f0a4c102100 2023-12-05T13:26:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.106+0000 7f0a337fe700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a3406ae40 0x7f0a3406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:26:37.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.106+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0a40089230 con 0x7f0a4c102100 2023-12-05T13:26:37.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.106+0000 7f0a4affd700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a3406ae40 0x7f0a3406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:26:37.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.106+0000 7f0a4affd700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a3406ae40 0x7f0a3406d2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00b0d0 tx=0x7f0a3c009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:26:37.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.110+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0a4004ece0 con 0x7f0a4c102100 2023-12-05T13:26:37.353 INFO:tasks.workunit.client.0.smithi029.stdout:7/633: sync 2023-12-05T13:26:37.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/532: sync 2023-12-05T13:26:37.353 INFO:tasks.workunit.client.0.smithi029.stdout:8/596: sync 2023-12-05T13:26:37.354 INFO:tasks.workunit.client.0.smithi029.stdout:6/577: sync 2023-12-05T13:26:37.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/454: sync 2023-12-05T13:26:37.354 INFO:tasks.workunit.client.0.smithi029.stdout:5/455: write d1/dc/d25/d4c/f52 [4762796,98053] 0 2023-12-05T13:26:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/549: sync 2023-12-05T13:26:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:1/557: sync 2023-12-05T13:26:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/405: sync 2023-12-05T13:26:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:1/558: chown d7/d5e/d52/d90 3188 1 2023-12-05T13:26:37.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/550: fsync dc/d23/d3a/d41/f4b 0 2023-12-05T13:26:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:7/634: symlink d6/d35/d70/d9a/lc1 0 2023-12-05T13:26:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:4/381: sync 2023-12-05T13:26:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:2/492: sync 2023-12-05T13:26:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:4/382: truncate d0/d16/f4a 1585361 0 2023-12-05T13:26:37.356 INFO:tasks.workunit.client.0.smithi029.stdout:8/597: dread d5/d6/fa3 [0,4194304] 0 2023-12-05T13:26:37.364 INFO:tasks.workunit.client.0.smithi029.stdout:2/493: creat de/d14/d24/d93/f9b x:0 0 0 2023-12-05T13:26:37.366 INFO:tasks.workunit.client.0.smithi029.stdout:4/383: mkdir d0/d16/d2f/d7c 0 2023-12-05T13:26:37.366 INFO:tasks.workunit.client.0.smithi029.stdout:7/635: write d6/d50/d5b/d5f/f84 [1794155,108000] 0 2023-12-05T13:26:37.367 INFO:tasks.workunit.client.0.smithi029.stdout:7/636: write d6/d50/d5b/f1f [5054531,40796] 0 2023-12-05T13:26:37.367 INFO:tasks.workunit.client.0.smithi029.stdout:7/637: chown d6/d50/d5b/d1a/d26/d72 0 1 2023-12-05T13:26:37.367 INFO:tasks.workunit.client.0.smithi029.stdout:7/638: write d6/d50/d5b/d5f/d7d/d97/d4a/fb9 [369232,26404] 0 2023-12-05T13:26:37.369 INFO:tasks.workunit.client.0.smithi029.stdout:8/598: creat d5/d6/d10/d13/fce x:0 0 0 2023-12-05T13:26:37.370 INFO:tasks.workunit.client.0.smithi029.stdout:8/599: chown d5/d2f/d3a/d3c/da2/fbe 2229 1 2023-12-05T13:26:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.369+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a38000bf0 con 0x7f0a3406ae40 2023-12-05T13:26:37.371 INFO:tasks.workunit.client.0.smithi029.stdout:0/551: dread dc/fd [0,4194304] 0 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.371+0000 7f0a337fe700 1 -- 172.21.15.29:0/1498381661 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0a38000bf0 con 0x7f0a3406ae40 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [], 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "1/2 daemons upgraded", 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "", 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:26:37.373 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:26:37.374 INFO:tasks.workunit.client.0.smithi029.stdout:4/384: mknod d0/d3c/d56/c7d 0 2023-12-05T13:26:37.378 INFO:tasks.workunit.client.0.smithi029.stdout:7/639: mkdir d6/d2a/d7e/d7b/dc2 0 2023-12-05T13:26:37.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/456: dwrite d1/dc/d38/d55/f96 [0,4194304] 0 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a3406ae40 msgr2=0x7f0a3406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a3406ae40 0x7f0a3406d2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00b0d0 tx=0x7f0a3c009e30 comp rx=0 tx=0).stop 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 msgr2=0x7f0a4c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 0x7f0a4c10fc40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000eb40 tx=0x7f0a4000b040 comp rx=0 tx=0).stop 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 shutdown_connections 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f0a3406ae40 0x7f0a3406d2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a4c066900 0x7f0a4c10f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 --2- 172.21.15.29:0/1498381661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c102100 0x7f0a4c10fc40 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000eb40 tx=0x7f0a4000b040 comp rx=0 tx=0).stop 2023-12-05T13:26:37.380 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.377+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 >> 172.21.15.29:0/1498381661 conn(0x7f0a4c0f71d0 msgr2=0x7f0a4c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:26:37.381 INFO:tasks.workunit.client.0.smithi029.stdout:9/406: dwrite d7/d19/d28/d50/f7c [0,4194304] 0 2023-12-05T13:26:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.378+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 shutdown_connections 2023-12-05T13:26:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:26:37.379+0000 7f0a518b3700 1 -- 172.21.15.29:0/1498381661 wait complete. 2023-12-05T13:26:37.381 INFO:tasks.workunit.client.0.smithi029.stdout:8/600: mknod d5/dc/d56/ccf 0 2023-12-05T13:26:37.381 INFO:tasks.workunit.client.0.smithi029.stdout:4/385: symlink d0/d1/d37/l7e 0 2023-12-05T13:26:37.384 INFO:tasks.workunit.client.0.smithi029.stdout:4/386: dread d0/d16/f4a [0,4194304] 0 2023-12-05T13:26:37.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/640: mkdir d6/d2a/d66/dc3 0 2023-12-05T13:26:37.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/641: truncate d6/d50/d5b/d1a/d26/f59 5827165 0 2023-12-05T13:26:37.388 INFO:tasks.workunit.client.0.smithi029.stdout:0/552: dwrite dc/d33/d3d/d7a/d84/d8d/d97/fa3 [0,4194304] 0 2023-12-05T13:26:37.394 INFO:tasks.workunit.client.0.smithi029.stdout:5/457: mkdir d1/dc/d10/d1e/d33/d93/da5 0 2023-12-05T13:26:37.400 INFO:tasks.workunit.client.0.smithi029.stdout:9/407: getdents d7 0 2023-12-05T13:26:37.400 INFO:tasks.workunit.client.0.smithi029.stdout:9/408: dread - d7/d2c/d3a/d52/f6e zero size 2023-12-05T13:26:37.401 INFO:tasks.workunit.client.0.smithi029.stdout:8/601: read d5/d6/d59/f6f [4081769,24503] 0 2023-12-05T13:26:37.406 INFO:tasks.workunit.client.0.smithi029.stdout:7/642: dwrite d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:37.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/387: dwrite d0/d3c/d56/f74 [0,4194304] 0 2023-12-05T13:26:37.407 INFO:tasks.workunit.client.0.smithi029.stdout:0/553: unlink dc/d33/d3d/d7a/d84/da4/fa9 0 2023-12-05T13:26:37.409 INFO:tasks.workunit.client.0.smithi029.stdout:4/388: dread d0/de/d30/d32/d35/d3d/f57 [0,4194304] 0 2023-12-05T13:26:37.412 INFO:tasks.workunit.client.0.smithi029.stdout:5/458: mkdir d1/dc/d11/d17/d29/da6 0 2023-12-05T13:26:37.414 INFO:tasks.workunit.client.0.smithi029.stdout:9/409: symlink d7/d2c/d3a/d52/l87 0 2023-12-05T13:26:37.415 INFO:tasks.workunit.client.0.smithi029.stdout:4/389: dread d0/d16/d22/d4f/f71 [0,4194304] 0 2023-12-05T13:26:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/390: fdatasync d0/da/f20 0 2023-12-05T13:26:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/391: readlink d0/de/d15/d2b/l48 0 2023-12-05T13:26:37.416 INFO:tasks.workunit.client.0.smithi029.stdout:4/392: truncate d0/de/d30/d32/d35/d3d/f5a 469924 0 2023-12-05T13:26:37.419 INFO:tasks.workunit.client.0.smithi029.stdout:7/643: creat d6/d50/d5b/d1a/fc4 x:0 0 0 2023-12-05T13:26:37.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/554: creat dc/d13/d4f/d88/fac x:0 0 0 2023-12-05T13:26:37.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/410: dread d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:37.428 INFO:tasks.workunit.client.0.smithi029.stdout:9/411: chown d7/d2c/d33/f66 459270 1 2023-12-05T13:26:37.430 INFO:tasks.workunit.client.0.smithi029.stdout:9/412: link d7/d19/d1f/f61 d7/d19/d30/d40/d4e/d5e/f88 0 2023-12-05T13:26:37.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/644: dread d6/d50/d5b/d1a/d26/f74 [0,4194304] 0 2023-12-05T13:26:37.436 INFO:tasks.workunit.client.0.smithi029.stdout:5/459: dwrite d1/dc/d25/f92 [0,4194304] 0 2023-12-05T13:26:37.438 INFO:tasks.workunit.client.0.smithi029.stdout:5/460: symlink d1/dc/d38/d3a/d5c/d87/la7 0 2023-12-05T13:26:37.439 INFO:tasks.workunit.client.0.smithi029.stdout:1/559: creat d7/d6e/da9/d4b/fba x:0 0 0 2023-12-05T13:26:37.441 INFO:tasks.workunit.client.0.smithi029.stdout:1/560: getdents d7/d6e/da9 0 2023-12-05T13:26:37.443 INFO:tasks.workunit.client.0.smithi029.stdout:1/561: truncate d7/fc 1992090 0 2023-12-05T13:26:37.443 INFO:tasks.workunit.client.0.smithi029.stdout:4/393: dwrite d0/de/d15/f4e [4194304,4194304] 0 2023-12-05T13:26:37.446 INFO:tasks.workunit.client.0.smithi029.stdout:7/645: dread d6/d50/d5b/d1a/d26/f5e [0,4194304] 0 2023-12-05T13:26:37.446 INFO:tasks.workunit.client.0.smithi029.stdout:1/562: truncate d7/d5e/d52/d5f/d48/f66 1068300 0 2023-12-05T13:26:37.462 INFO:tasks.workunit.client.0.smithi029.stdout:4/394: dwrite d0/d1/f51 [0,4194304] 0 2023-12-05T13:26:37.506 INFO:tasks.workunit.client.0.smithi029.stdout:1/563: unlink d7/d5e/d52/d90/fb9 0 2023-12-05T13:26:37.508 INFO:tasks.workunit.client.0.smithi029.stdout:1/564: truncate d7/d5e/f38 1096174 0 2023-12-05T13:26:37.510 INFO:tasks.workunit.client.0.smithi029.stdout:1/565: dread d7/d5e/d52/d5f/d48/f98 [0,4194304] 0 2023-12-05T13:26:37.550 INFO:tasks.workunit.client.0.smithi029.stdout:1/566: creat d7/d5e/d52/d90/fbb x:0 0 0 2023-12-05T13:26:37.553 INFO:tasks.workunit.client.0.smithi029.stdout:1/567: symlink d7/d5e/d52/d90/lbc 0 2023-12-05T13:26:37.554 INFO:tasks.workunit.client.0.smithi029.stdout:1/568: write d7/d61/d4f/f8a [543199,57020] 0 2023-12-05T13:26:37.557 INFO:tasks.workunit.client.0.smithi029.stdout:1/569: creat d7/d61/d77/fbd x:0 0 0 2023-12-05T13:26:37.560 INFO:tasks.workunit.client.0.smithi029.stdout:1/570: unlink d7/d5e/c2a 0 2023-12-05T13:26:37.561 INFO:tasks.workunit.client.0.smithi029.stdout:1/571: rmdir d7/d6e/da9/d4b/d72 39 2023-12-05T13:26:37.563 INFO:tasks.workunit.client.0.smithi029.stdout:1/572: creat d7/d6e/da9/d4b/d72/fbe x:0 0 0 2023-12-05T13:26:37.565 INFO:tasks.workunit.client.0.smithi029.stdout:1/573: mknod d7/d5e/d52/d5f/d12/d60/cbf 0 2023-12-05T13:26:37.566 INFO:tasks.workunit.client.0.smithi029.stdout:1/574: mknod d7/d5b/cc0 0 2023-12-05T13:26:37.582 INFO:tasks.workunit.client.0.smithi029.stdout:6/578: mknod d6/cc7 0 2023-12-05T13:26:37.582 INFO:tasks.workunit.client.0.smithi029.stdout:6/579: readlink d6/d64/d6d/d85/lb3 0 2023-12-05T13:26:37.584 INFO:tasks.workunit.client.0.smithi029.stdout:6/580: creat d6/d64/d6d/d85/fc8 x:0 0 0 2023-12-05T13:26:37.585 INFO:tasks.workunit.client.0.smithi029.stdout:6/581: unlink d6/d3f/c91 0 2023-12-05T13:26:37.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/582: creat d6/d1d/fc9 x:0 0 0 2023-12-05T13:26:37.595 INFO:tasks.workunit.client.0.smithi029.stdout:6/583: truncate d6/d29/fa0 45872 0 2023-12-05T13:26:37.617 INFO:tasks.workunit.client.0.smithi029.stdout:3/533: rmdir d1/d18 39 2023-12-05T13:26:37.619 INFO:tasks.workunit.client.0.smithi029.stdout:6/584: dwrite d6/d1d/d39/f87 [0,4194304] 0 2023-12-05T13:26:37.619 INFO:tasks.workunit.client.0.smithi029.stdout:6/585: write d6/d29/dc4/f28 [198487,56257] 0 2023-12-05T13:26:37.619 INFO:tasks.workunit.client.0.smithi029.stdout:6/586: dread - d6/d1d/d39/f95 zero size 2023-12-05T13:26:37.620 INFO:tasks.workunit.client.0.smithi029.stdout:3/534: unlink d1/d5e/d74/c89 0 2023-12-05T13:26:37.623 INFO:tasks.workunit.client.0.smithi029.stdout:6/587: symlink d6/d29/dc4/lca 0 2023-12-05T13:26:37.624 INFO:tasks.workunit.client.0.smithi029.stdout:3/535: write d1/d10/f87 [804079,33262] 0 2023-12-05T13:26:37.626 INFO:tasks.workunit.client.0.smithi029.stdout:9/413: rename d7/d2c/d3a/d64/c86 to d7/d2c/c89 0 2023-12-05T13:26:37.626 INFO:tasks.workunit.client.0.smithi029.stdout:9/414: dread - d7/d2c/d3a/d52/f6e zero size 2023-12-05T13:26:37.626 INFO:tasks.workunit.client.0.smithi029.stdout:6/588: mknod d6/d64/d6d/d85/ccb 0 2023-12-05T13:26:37.627 INFO:tasks.workunit.client.0.smithi029.stdout:3/536: creat d1/d16/d36/d4b/fac x:0 0 0 2023-12-05T13:26:37.628 INFO:tasks.workunit.client.0.smithi029.stdout:3/537: chown d1/d6/d11/l31 4 1 2023-12-05T13:26:37.629 INFO:tasks.workunit.client.0.smithi029.stdout:6/589: dread d6/d3f/f9a [0,4194304] 0 2023-12-05T13:26:37.630 INFO:tasks.workunit.client.0.smithi029.stdout:7/646: rename d6/d35/d3e/d40 to d6/d2a/d4f/dc5 0 2023-12-05T13:26:37.631 INFO:tasks.workunit.client.0.smithi029.stdout:9/415: creat d7/d2c/d33/f8a x:0 0 0 2023-12-05T13:26:37.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/590: symlink d6/d64/lcc 0 2023-12-05T13:26:37.635 INFO:tasks.workunit.client.0.smithi029.stdout:4/395: rename d0/de/d15/d2b/l4d to d0/d16/d22/d4f/l7f 0 2023-12-05T13:26:37.637 INFO:tasks.workunit.client.0.smithi029.stdout:7/647: mknod d6/d50/d5b/d5f/d7d/d97/d4a/d4b/cc6 0 2023-12-05T13:26:37.637 INFO:tasks.workunit.client.0.smithi029.stdout:3/538: dread d1/d5e/d74/f93 [0,4194304] 0 2023-12-05T13:26:37.638 INFO:tasks.workunit.client.0.smithi029.stdout:2/494: mknod de/d14/c9c 0 2023-12-05T13:26:37.639 INFO:tasks.workunit.client.0.smithi029.stdout:2/495: write de/d11/d32/f3e [64157,118059] 0 2023-12-05T13:26:37.640 INFO:tasks.workunit.client.0.smithi029.stdout:9/416: symlink d7/d19/d30/d43/d67/l8b 0 2023-12-05T13:26:37.643 INFO:tasks.workunit.client.0.smithi029.stdout:1/575: rename d7/d5e/d52/d5f/d12/d60/f8c to d7/d5b/fc1 0 2023-12-05T13:26:37.644 INFO:tasks.workunit.client.0.smithi029.stdout:4/396: mknod d0/d1/d37/c80 0 2023-12-05T13:26:37.646 INFO:tasks.workunit.client.0.smithi029.stdout:3/539: read d1/d10/f5d [1536452,87520] 0 2023-12-05T13:26:37.648 INFO:tasks.workunit.client.0.smithi029.stdout:5/461: creat d1/dc/d25/fa8 x:0 0 0 2023-12-05T13:26:37.649 INFO:tasks.workunit.client.0.smithi029.stdout:2/496: truncate de/d16/f5c 6678212 0 2023-12-05T13:26:37.651 INFO:tasks.workunit.client.0.smithi029.stdout:9/417: mknod d7/d2c/d68/d7f/c8c 0 2023-12-05T13:26:37.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/648: dwrite d6/d50/d5b/d1a/d26/d6e/f86 [0,4194304] 0 2023-12-05T13:26:37.651 INFO:tasks.workunit.client.0.smithi029.stdout:7/649: fdatasync d6/d2a/d4f/dc5/d52/fa5 0 2023-12-05T13:26:37.653 INFO:tasks.workunit.client.0.smithi029.stdout:6/591: rename d6/d5a/f5d to d6/d29/d60/dbc/fcd 0 2023-12-05T13:26:37.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/418: dread d7/d19/d1f/f46 [0,4194304] 0 2023-12-05T13:26:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/576: mknod d7/d5e/d52/d5f/d12/d60/cc2 0 2023-12-05T13:26:37.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/577: truncate d7/d6e/da9/d4b/d72/f79 1343564 0 2023-12-05T13:26:37.655 INFO:tasks.workunit.client.0.smithi029.stdout:4/397: symlink d0/d16/d22/d5f/l81 0 2023-12-05T13:26:37.656 INFO:tasks.workunit.client.0.smithi029.stdout:3/540: rmdir d1/d10 39 2023-12-05T13:26:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:5/462: stat d1/dc/d11/l2d 0 2023-12-05T13:26:37.658 INFO:tasks.workunit.client.0.smithi029.stdout:2/497: dread de/d11/f4f [0,4194304] 0 2023-12-05T13:26:37.663 INFO:tasks.workunit.client.0.smithi029.stdout:7/650: link d6/f22 d6/d50/d5b/d5f/d7d/d97/d4a/fc7 0 2023-12-05T13:26:37.663 INFO:tasks.workunit.client.0.smithi029.stdout:7/651: chown d6/d2a/d2f/d89/dad 248 1 2023-12-05T13:26:37.665 INFO:tasks.workunit.client.0.smithi029.stdout:6/592: symlink d6/d64/d6d/lce 0 2023-12-05T13:26:37.666 INFO:tasks.workunit.client.0.smithi029.stdout:9/419: mkdir d7/d19/d30/d43/d67/d8d 0 2023-12-05T13:26:37.669 INFO:tasks.workunit.client.0.smithi029.stdout:1/578: mkdir d7/d5b/dc3 0 2023-12-05T13:26:37.670 INFO:tasks.workunit.client.0.smithi029.stdout:4/398: symlink d0/d16/d2f/d7c/l82 0 2023-12-05T13:26:37.670 INFO:tasks.workunit.client.0.smithi029.stdout:2/498: dread de/d14/f7e [0,4194304] 0 2023-12-05T13:26:37.672 INFO:tasks.workunit.client.0.smithi029.stdout:3/541: rmdir d1/d16/d36/d8d 39 2023-12-05T13:26:37.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/499: read de/d14/d24/f2e [375113,44746] 0 2023-12-05T13:26:37.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/500: chown de/d16/f2b 15721804 1 2023-12-05T13:26:37.674 INFO:tasks.workunit.client.0.smithi029.stdout:7/652: symlink d6/d35/d6a/lc8 0 2023-12-05T13:26:37.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/463: dwrite d1/dc/d25/f92 [0,4194304] 0 2023-12-05T13:26:37.676 INFO:tasks.workunit.client.0.smithi029.stdout:6/593: truncate d6/d1d/f55 168957 0 2023-12-05T13:26:37.680 INFO:tasks.workunit.client.0.smithi029.stdout:1/579: unlink d7/d5e/d52/d5f/d48/c58 0 2023-12-05T13:26:37.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/464: dread d1/dc/d10/d1e/f47 [0,4194304] 0 2023-12-05T13:26:37.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/465: fdatasync d1/dc/d25/d4c/f52 0 2023-12-05T13:26:37.682 INFO:tasks.workunit.client.0.smithi029.stdout:1/580: write d7/d5e/d52/d5f/d12/f74 [2361002,33694] 0 2023-12-05T13:26:37.684 INFO:tasks.workunit.client.0.smithi029.stdout:4/399: mkdir d0/de/d83 0 2023-12-05T13:26:37.688 INFO:tasks.workunit.client.0.smithi029.stdout:6/594: mkdir d6/d64/d6d/da3/dcf 0 2023-12-05T13:26:37.693 INFO:tasks.workunit.client.0.smithi029.stdout:5/466: mknod d1/dc/d10/d1e/d75/d7f/ca9 0 2023-12-05T13:26:37.693 INFO:tasks.workunit.client.0.smithi029.stdout:9/420: dwrite d7/d19/d30/d40/d4e/d5e/f88 [0,4194304] 0 2023-12-05T13:26:37.693 INFO:tasks.workunit.client.0.smithi029.stdout:9/421: read - d7/d2c/d68/f6c zero size 2023-12-05T13:26:37.696 INFO:tasks.workunit.client.0.smithi029.stdout:7/653: dwrite d6/d50/d5b/d1a/d26/f59 [4194304,4194304] 0 2023-12-05T13:26:37.696 INFO:tasks.workunit.client.0.smithi029.stdout:2/501: dwrite de/d41/f78 [0,4194304] 0 2023-12-05T13:26:37.696 INFO:tasks.workunit.client.0.smithi029.stdout:4/400: rmdir d0 39 2023-12-05T13:26:37.696 INFO:tasks.workunit.client.0.smithi029.stdout:1/581: creat d7/d6e/da9/d4b/db1/fc4 x:0 0 0 2023-12-05T13:26:37.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/502: write de/d16/d43/f72 [51712,92868] 0 2023-12-05T13:26:37.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/503: stat de/f12 0 2023-12-05T13:26:37.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/542: link d1/d16/d36/d3a/d6c/d7d/fa1 d1/d10/d91/fad 0 2023-12-05T13:26:37.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/654: dread d6/d2a/d71/f94 [0,4194304] 0 2023-12-05T13:26:37.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/655: write d6/d2a/d4f/dc5/d52/fa5 [778167,23192] 0 2023-12-05T13:26:37.699 INFO:tasks.workunit.client.0.smithi029.stdout:7/656: fsync d6/d35/d70/f8c 0 2023-12-05T13:26:37.706 INFO:tasks.workunit.client.0.smithi029.stdout:6/595: dwrite d6/d29/dc4/d40/f8d [0,4194304] 0 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Adjusting osd_memory_target on smithi029 to 1570M 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: pgmap v40: 65 pgs: 65 active+clean; 1023 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 53 MiB/s rd, 101 MiB/s wr, 282 op/s 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:26:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:26:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/828426440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:26:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:37.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:37 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:37.737 INFO:tasks.workunit.client.0.smithi029.stdout:9/422: truncate d7/d2c/d3a/f3e 7882501 0 2023-12-05T13:26:37.741 INFO:tasks.workunit.client.0.smithi029.stdout:4/401: getdents d0/d3c 0 2023-12-05T13:26:37.742 INFO:tasks.workunit.client.0.smithi029.stdout:1/582: creat d7/d6e/da9/d4b/db1/fc5 x:0 0 0 2023-12-05T13:26:37.744 INFO:tasks.workunit.client.0.smithi029.stdout:2/504: truncate de/d41/d56/f75 1179312 0 2023-12-05T13:26:37.746 INFO:tasks.workunit.client.0.smithi029.stdout:2/505: write de/d14/d24/f40 [46965,33224] 0 2023-12-05T13:26:37.747 INFO:tasks.workunit.client.0.smithi029.stdout:3/543: truncate d1/d16/d36/d4b/f58 2742067 0 2023-12-05T13:26:37.750 INFO:tasks.workunit.client.0.smithi029.stdout:7/657: mkdir d6/d50/d5b/d1a/d26/dc9 0 2023-12-05T13:26:37.751 INFO:tasks.workunit.client.0.smithi029.stdout:6/596: creat d6/d1d/d39/d58/d71/fd0 x:0 0 0 2023-12-05T13:26:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/423: symlink d7/d19/d30/d43/d67/d8d/l8e 0 2023-12-05T13:26:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/424: fdatasync d7/d2c/d3a/d52/f81 0 2023-12-05T13:26:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/425: chown d7/d19/d28/d50 12 1 2023-12-05T13:26:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/426: fdatasync d7/d19/f32 0 2023-12-05T13:26:37.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/427: chown d7/d19/d30/d43/c36 0 1 2023-12-05T13:26:37.754 INFO:tasks.workunit.client.0.smithi029.stdout:4/402: getdents d0/de/d15 0 2023-12-05T13:26:37.754 INFO:tasks.workunit.client.0.smithi029.stdout:4/403: chown d0/d41 353105450 1 2023-12-05T13:26:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/583: symlink d7/d6e/da9/d4b/d72/lc6 0 2023-12-05T13:26:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:4/404: read d0/f1d [1702093,50482] 0 2023-12-05T13:26:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/584: write d7/d61/d4f/f6c [1541550,65361] 0 2023-12-05T13:26:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/585: getdents d7/d6e/da9 0 2023-12-05T13:26:37.757 INFO:tasks.workunit.client.0.smithi029.stdout:1/586: truncate d7/d6e/da9/d4b/fba 963402 0 2023-12-05T13:26:37.758 INFO:tasks.workunit.client.0.smithi029.stdout:2/506: mkdir de/d6a/d9d 0 2023-12-05T13:26:37.760 INFO:tasks.workunit.client.0.smithi029.stdout:3/544: mkdir d1/d16/d1f/d4c/dae 0 2023-12-05T13:26:37.760 INFO:tasks.workunit.client.0.smithi029.stdout:3/545: fsync d1/d16/d36/d3a/f3d 0 2023-12-05T13:26:37.760 INFO:tasks.workunit.client.0.smithi029.stdout:3/546: chown d1/d5e/d74/f78 9013025 1 2023-12-05T13:26:37.761 INFO:tasks.workunit.client.0.smithi029.stdout:7/658: mkdir d6/d35/dca 0 2023-12-05T13:26:37.764 INFO:tasks.workunit.client.0.smithi029.stdout:6/597: symlink d6/d29/dc4/d40/d74/d52/ld1 0 2023-12-05T13:26:37.767 INFO:tasks.workunit.client.0.smithi029.stdout:9/428: mknod d7/d19/d30/c8f 0 2023-12-05T13:26:37.769 INFO:tasks.workunit.client.0.smithi029.stdout:1/587: creat d7/d6e/da9/d4b/db1/fc7 x:0 0 0 2023-12-05T13:26:37.769 INFO:tasks.workunit.client.0.smithi029.stdout:1/588: stat d7/d56/l32 0 2023-12-05T13:26:37.771 INFO:tasks.workunit.client.0.smithi029.stdout:3/547: mkdir d1/d16/d36/d4b/daf 0 2023-12-05T13:26:37.772 INFO:tasks.workunit.client.0.smithi029.stdout:7/659: dread d6/d50/d5b/d1a/d26/f59 [4194304,4194304] 0 2023-12-05T13:26:37.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/598: getdents d6 0 2023-12-05T13:26:37.775 INFO:tasks.workunit.client.0.smithi029.stdout:3/548: write d1/d18/f20 [1796666,4348] 0 2023-12-05T13:26:37.775 INFO:tasks.workunit.client.0.smithi029.stdout:9/429: getdents d7/d19/d30/d40/d4e/d5e 0 2023-12-05T13:26:37.778 INFO:tasks.workunit.client.0.smithi029.stdout:1/589: symlink d7/d5e/d52/lc8 0 2023-12-05T13:26:37.781 INFO:tasks.workunit.client.0.smithi029.stdout:7/660: rename d6/d50/d5b/d5f/cab to d6/d50/d5b/d1a/d26/d82/ccb 0 2023-12-05T13:26:37.783 INFO:tasks.workunit.client.0.smithi029.stdout:3/549: creat d1/fb0 x:0 0 0 2023-12-05T13:26:37.784 INFO:tasks.workunit.client.0.smithi029.stdout:3/550: write d1/d18/f55 [2042790,129123] 0 2023-12-05T13:26:37.784 INFO:tasks.workunit.client.0.smithi029.stdout:6/599: dread d6/f54 [0,4194304] 0 2023-12-05T13:26:37.784 INFO:tasks.workunit.client.0.smithi029.stdout:2/507: dwrite de/d11/d32/f3e [0,4194304] 0 2023-12-05T13:26:37.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/430: chown d7/d2c/d33/l58 7654 1 2023-12-05T13:26:37.785 INFO:tasks.workunit.client.0.smithi029.stdout:4/405: dwrite d0/de/d15/f4e [0,4194304] 0 2023-12-05T13:26:37.786 INFO:tasks.workunit.client.0.smithi029.stdout:1/590: creat d7/d5e/d52/d5f/d12/d60/fc9 x:0 0 0 2023-12-05T13:26:37.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/600: creat d6/d29/dc4/d40/fd2 x:0 0 0 2023-12-05T13:26:37.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/601: read - d6/d29/dc4/d40/d4d/f96 zero size 2023-12-05T13:26:37.791 INFO:tasks.workunit.client.0.smithi029.stdout:7/661: dread d6/d50/d5b/f1f [0,4194304] 0 2023-12-05T13:26:37.794 INFO:tasks.workunit.client.0.smithi029.stdout:3/551: dread d1/d10/f71 [0,4194304] 0 2023-12-05T13:26:37.795 INFO:tasks.workunit.client.0.smithi029.stdout:3/552: read d1/d5e/f67 [72870,121075] 0 2023-12-05T13:26:37.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/508: rename de/d11/d32/l6b to de/d11/d32/l9e 0 2023-12-05T13:26:37.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/509: stat de/d14/d62/f68 0 2023-12-05T13:26:37.797 INFO:tasks.workunit.client.0.smithi029.stdout:9/431: mkdir d7/d90 0 2023-12-05T13:26:37.800 INFO:tasks.workunit.client.0.smithi029.stdout:4/406: getdents d0/de 0 2023-12-05T13:26:37.802 INFO:tasks.workunit.client.0.smithi029.stdout:1/591: rename d7/d5e/c99 to d7/d6e/cca 0 2023-12-05T13:26:37.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/662: creat d6/d2a/d2f/d89/dad/fcc x:0 0 0 2023-12-05T13:26:37.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/663: stat d6/d50/d5b/d5f/d7d/cb6 0 2023-12-05T13:26:37.808 INFO:tasks.workunit.client.0.smithi029.stdout:2/510: link de/d14/f99 de/d11/f9f 0 2023-12-05T13:26:37.808 INFO:tasks.workunit.client.0.smithi029.stdout:9/432: dread d7/d19/f41 [0,4194304] 0 2023-12-05T13:26:37.808 INFO:tasks.workunit.client.0.smithi029.stdout:9/433: fsync d7/d19/d1f/f21 0 2023-12-05T13:26:37.808 INFO:tasks.workunit.client.0.smithi029.stdout:6/602: dwrite d6/d29/dc4/f99 [0,4194304] 0 2023-12-05T13:26:37.811 INFO:tasks.workunit.client.0.smithi029.stdout:3/553: dread d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:37.811 INFO:tasks.workunit.client.0.smithi029.stdout:4/407: unlink d0/d1/d37/l7e 0 2023-12-05T13:26:37.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/434: read d7/d19/d28/f2d [2134081,131069] 0 2023-12-05T13:26:37.812 INFO:tasks.workunit.client.0.smithi029.stdout:1/592: symlink d7/d6e/da9/lcb 0 2023-12-05T13:26:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/664: rename d6/d2a/d71/f94 to d6/d50/d5b/d5f/d7d/fcd 0 2023-12-05T13:26:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/665: read - d6/d50/d5b/d1a/d26/d6e/d8b/da9/fb1 zero size 2023-12-05T13:26:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/666: chown d6/d50/d5b/d1a/c3b 0 1 2023-12-05T13:26:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/667: read d6/d50/d5b/d1a/d26/d72/f81 [483448,4147] 0 2023-12-05T13:26:37.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/668: truncate d6/d35/d70/f8c 4482973 0 2023-12-05T13:26:37.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/603: link d6/d29/dc4/d40/d74/c7c d6/d1d/cd3 0 2023-12-05T13:26:37.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/604: write d6/d29/dc4/d40/d74/d59/faa [636266,20780] 0 2023-12-05T13:26:37.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/605: dread - d6/d93/fc6 zero size 2023-12-05T13:26:37.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/606: write d6/f76 [580540,14528] 0 2023-12-05T13:26:37.820 INFO:tasks.workunit.client.0.smithi029.stdout:6/607: getdents d6/d3f/db7 0 2023-12-05T13:26:37.821 INFO:tasks.workunit.client.0.smithi029.stdout:3/554: mknod d1/d5e/cb1 0 2023-12-05T13:26:37.823 INFO:tasks.workunit.client.0.smithi029.stdout:3/555: write d1/d18/f45 [6482152,119970] 0 2023-12-05T13:26:37.824 INFO:tasks.workunit.client.0.smithi029.stdout:4/408: mknod d0/d16/d2f/c84 0 2023-12-05T13:26:37.826 INFO:tasks.workunit.client.0.smithi029.stdout:9/435: link d7/d19/d1f/f46 d7/d5a/f91 0 2023-12-05T13:26:37.828 INFO:tasks.workunit.client.0.smithi029.stdout:1/593: truncate d7/d6e/f86 598200 0 2023-12-05T13:26:37.829 INFO:tasks.workunit.client.0.smithi029.stdout:2/511: dwrite de/d14/f35 [0,4194304] 0 2023-12-05T13:26:37.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/669: link d6/d50/d5b/d1a/d26/f2b d6/d2a/d4f/dc5/fce 0 2023-12-05T13:26:37.831 INFO:tasks.workunit.client.0.smithi029.stdout:7/670: write d6/d50/d5b/f4e [1323673,18548] 0 2023-12-05T13:26:37.834 INFO:tasks.workunit.client.0.smithi029.stdout:4/409: rename d0/d16/d2f/d7c to d0/d3c/d85 0 2023-12-05T13:26:37.835 INFO:tasks.workunit.client.0.smithi029.stdout:4/410: write d0/d16/f4a [440579,97828] 0 2023-12-05T13:26:37.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/608: dwrite d6/d29/d60/fb0 [0,4194304] 0 2023-12-05T13:26:37.835 INFO:tasks.workunit.client.0.smithi029.stdout:6/609: chown d6/d29/dc4/d40 1320 1 2023-12-05T13:26:37.836 INFO:tasks.workunit.client.0.smithi029.stdout:9/436: truncate d7/d19/d30/d43/f62 1064946 0 2023-12-05T13:26:37.836 INFO:tasks.workunit.client.0.smithi029.stdout:9/437: stat d7/d19/l1a 0 2023-12-05T13:26:37.840 INFO:tasks.workunit.client.0.smithi029.stdout:1/594: creat d7/d5e/fcc x:0 0 0 2023-12-05T13:26:37.840 INFO:tasks.workunit.client.0.smithi029.stdout:1/595: chown d7/d5e/fcc 2474 1 2023-12-05T13:26:37.840 INFO:tasks.workunit.client.0.smithi029.stdout:1/596: readlink d7/d56/l75 0 2023-12-05T13:26:37.844 INFO:tasks.workunit.client.0.smithi029.stdout:3/556: dread d1/d10/f41 [0,4194304] 0 2023-12-05T13:26:37.850 INFO:tasks.workunit.client.0.smithi029.stdout:7/671: dwrite d6/d50/d5b/d1a/d26/d6e/f75 [0,4194304] 0 2023-12-05T13:26:37.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Adjusting osd_memory_target on smithi029 to 1570M 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: pgmap v40: 65 pgs: 65 active+clean; 1023 MiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 53 MiB/s rd, 101 MiB/s wr, 282 op/s 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/828426440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:37.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:37 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:37.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/512: rename de/d11/l44 to de/d11/d32/la0 0 2023-12-05T13:26:37.862 INFO:tasks.workunit.client.0.smithi029.stdout:9/438: rename d7/d2c to d7/d2c/d3a/d92 22 2023-12-05T13:26:37.862 INFO:tasks.workunit.client.0.smithi029.stdout:2/513: chown de/d16/d4c/l64 5 1 2023-12-05T13:26:37.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/411: link d0/de/d30/d32/d35/c44 d0/d41/c86 0 2023-12-05T13:26:37.869 INFO:tasks.workunit.client.0.smithi029.stdout:6/610: mkdir d6/d64/d6d/da3/dcf/dd4 0 2023-12-05T13:26:37.870 INFO:tasks.workunit.client.0.smithi029.stdout:1/597: creat d7/fcd x:0 0 0 2023-12-05T13:26:37.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/598: write d7/d61/d77/fa7 [725084,4636] 0 2023-12-05T13:26:37.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/599: chown d7/d56 10008853 1 2023-12-05T13:26:37.871 INFO:tasks.workunit.client.0.smithi029.stdout:1/600: chown d7/d6e/da9/d4b/d72/fbe 32506 1 2023-12-05T13:26:37.871 INFO:tasks.workunit.client.0.smithi029.stdout:3/557: readlink d1/d10/l7b 0 2023-12-05T13:26:37.871 INFO:tasks.workunit.client.0.smithi029.stdout:4/412: dread d0/d16/d22/d4f/f6d [0,4194304] 0 2023-12-05T13:26:37.878 INFO:tasks.workunit.client.0.smithi029.stdout:7/672: mknod d6/d2a/d4f/dc5/ccf 0 2023-12-05T13:26:37.878 INFO:tasks.workunit.client.0.smithi029.stdout:7/673: fdatasync d6/d2a/d2f/fa0 0 2023-12-05T13:26:37.878 INFO:tasks.workunit.client.0.smithi029.stdout:7/674: chown d6/d2a/d4f/d93/dbb 15508676 1 2023-12-05T13:26:37.880 INFO:tasks.workunit.client.0.smithi029.stdout:9/439: link d7/l16 d7/d19/d28/d65/d73/l93 0 2023-12-05T13:26:37.884 INFO:tasks.workunit.client.0.smithi029.stdout:2/514: mknod de/d16/d6c/d8e/ca1 0 2023-12-05T13:26:37.884 INFO:tasks.workunit.client.0.smithi029.stdout:9/440: write d7/d19/f41 [669807,118550] 0 2023-12-05T13:26:37.885 INFO:tasks.workunit.client.0.smithi029.stdout:1/601: dwrite d7/d5e/d52/d5f/d12/f2d [0,4194304] 0 2023-12-05T13:26:37.887 INFO:tasks.workunit.client.0.smithi029.stdout:6/611: creat d6/d1d/d39/fd5 x:0 0 0 2023-12-05T13:26:37.889 INFO:tasks.workunit.client.0.smithi029.stdout:3/558: unlink d1/d10/d91/fad 0 2023-12-05T13:26:37.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/441: read d7/d2c/d3a/f3e [2538892,51166] 0 2023-12-05T13:26:37.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/442: write d7/d2c/d33/f63 [497179,115940] 0 2023-12-05T13:26:37.892 INFO:tasks.workunit.client.0.smithi029.stdout:4/413: mknod d0/d16/c87 0 2023-12-05T13:26:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/414: readlink d0/l13 0 2023-12-05T13:26:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/415: fsync d0/d16/d22/d4f/f6d 0 2023-12-05T13:26:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/443: dread d7/d5a/f91 [0,4194304] 0 2023-12-05T13:26:37.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/444: truncate d7/d19/d30/d43/f48 29934 0 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/675: dwrite d6/d50/d5b/d5f/d7d/d97/f57 [0,4194304] 0 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:6/612: creat d6/d64/d6d/da3/dcf/fd6 x:0 0 0 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/676: readlink d6/lb 0 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:6/613: chown d6/d29/c32 1 1 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/677: dread - d6/d2a/d7e/d7b/f99 zero size 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:9/445: write d7/d19/f1b [7107046,47212] 0 2023-12-05T13:26:37.895 INFO:tasks.workunit.client.0.smithi029.stdout:7/678: write d6/d2a/d7e/f9d [218544,25970] 0 2023-12-05T13:26:37.897 INFO:tasks.workunit.client.0.smithi029.stdout:3/559: creat d1/d16/fb2 x:0 0 0 2023-12-05T13:26:37.897 INFO:tasks.workunit.client.0.smithi029.stdout:3/560: write d1/d16/d36/d8d/fa8 [685010,20901] 0 2023-12-05T13:26:37.899 INFO:tasks.workunit.client.0.smithi029.stdout:4/416: creat d0/de/d30/d32/f88 x:0 0 0 2023-12-05T13:26:37.899 INFO:tasks.workunit.client.0.smithi029.stdout:4/417: readlink d0/d16/d22/d4f/l7f 0 2023-12-05T13:26:37.899 INFO:tasks.workunit.client.0.smithi029.stdout:4/418: chown d0/de/d30/f68 8141 1 2023-12-05T13:26:37.900 INFO:tasks.workunit.client.0.smithi029.stdout:7/679: dread d6/d19/f25 [0,4194304] 0 2023-12-05T13:26:37.902 INFO:tasks.workunit.client.0.smithi029.stdout:2/515: dwrite de/d14/f35 [0,4194304] 0 2023-12-05T13:26:37.903 INFO:tasks.workunit.client.0.smithi029.stdout:6/614: unlink d6/d29/dc4/d40/f8d 0 2023-12-05T13:26:37.908 INFO:tasks.workunit.client.0.smithi029.stdout:7/680: dread d6/d35/d5c/f6c [0,4194304] 0 2023-12-05T13:26:37.909 INFO:tasks.workunit.client.0.smithi029.stdout:9/446: mknod d7/d19/d30/d43/d67/c94 0 2023-12-05T13:26:37.913 INFO:tasks.workunit.client.0.smithi029.stdout:3/561: rename d1/d6/d11/d4e to d1/db3 0 2023-12-05T13:26:37.913 INFO:tasks.workunit.client.0.smithi029.stdout:3/562: readlink d1/d16/d36/l65 0 2023-12-05T13:26:37.915 INFO:tasks.workunit.client.0.smithi029.stdout:4/419: creat d0/d16/d22/d5f/f89 x:0 0 0 2023-12-05T13:26:37.918 INFO:tasks.workunit.client.0.smithi029.stdout:2/516: symlink de/d6a/d9d/la2 0 2023-12-05T13:26:37.918 INFO:tasks.workunit.client.0.smithi029.stdout:2/517: write de/d16/f5c [6760877,44826] 0 2023-12-05T13:26:37.920 INFO:tasks.workunit.client.0.smithi029.stdout:7/681: creat d6/d2a/d66/fd0 x:0 0 0 2023-12-05T13:26:37.923 INFO:tasks.workunit.client.0.smithi029.stdout:9/447: unlink d7/l16 0 2023-12-05T13:26:37.925 INFO:tasks.workunit.client.0.smithi029.stdout:6/615: rename d6/d64/d6d/d85/lb3 to d6/d1d/d39/d58/d71/dbf/ld7 0 2023-12-05T13:26:37.927 INFO:tasks.workunit.client.0.smithi029.stdout:3/563: creat d1/d16/d36/d3a/fb4 x:0 0 0 2023-12-05T13:26:37.927 INFO:tasks.workunit.client.0.smithi029.stdout:3/564: fdatasync d1/d16/d36/d3a/fb4 0 2023-12-05T13:26:37.930 INFO:tasks.workunit.client.0.smithi029.stdout:2/518: unlink de/f12 0 2023-12-05T13:26:37.930 INFO:tasks.workunit.client.0.smithi029.stdout:3/565: dread d1/d10/f87 [0,4194304] 0 2023-12-05T13:26:37.931 INFO:tasks.workunit.client.0.smithi029.stdout:7/682: link d6/d2a/d4f/dc5/l43 d6/d35/d6a/ld1 0 2023-12-05T13:26:37.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/448: creat d7/d19/d30/d40/d4e/f95 x:0 0 0 2023-12-05T13:26:37.936 INFO:tasks.workunit.client.0.smithi029.stdout:4/420: dwrite d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:37.936 INFO:tasks.workunit.client.0.smithi029.stdout:3/566: rmdir d1/db3/d72 39 2023-12-05T13:26:37.938 INFO:tasks.workunit.client.0.smithi029.stdout:3/567: read d1/d18/f38 [2197656,51700] 0 2023-12-05T13:26:37.939 INFO:tasks.workunit.client.0.smithi029.stdout:7/683: symlink d6/d19/ld2 0 2023-12-05T13:26:37.939 INFO:tasks.workunit.client.0.smithi029.stdout:7/684: fdatasync d6/d50/d5b/d1a/d26/d6e/f75 0 2023-12-05T13:26:37.940 INFO:tasks.workunit.client.0.smithi029.stdout:3/568: dread d1/d10/f87 [0,4194304] 0 2023-12-05T13:26:37.940 INFO:tasks.workunit.client.0.smithi029.stdout:9/449: truncate d7/d2c/d33/f5b 2695859 0 2023-12-05T13:26:37.941 INFO:tasks.workunit.client.0.smithi029.stdout:4/421: symlink d0/de/l8a 0 2023-12-05T13:26:37.941 INFO:tasks.workunit.client.0.smithi029.stdout:4/422: fsync d0/de/d15/f64 0 2023-12-05T13:26:37.943 INFO:tasks.workunit.client.0.smithi029.stdout:7/685: mkdir d6/d35/d5c/dd3 0 2023-12-05T13:26:37.946 INFO:tasks.workunit.client.0.smithi029.stdout:6/616: dwrite d6/d29/dc4/d40/f66 [4194304,4194304] 0 2023-12-05T13:26:37.963 INFO:tasks.workunit.client.0.smithi029.stdout:2/519: getdents de 0 2023-12-05T13:26:37.967 INFO:tasks.workunit.client.0.smithi029.stdout:2/520: mkdir de/d14/da3 0 2023-12-05T13:26:37.971 INFO:tasks.workunit.client.0.smithi029.stdout:4/423: dwrite d0/da/f20 [0,4194304] 0 2023-12-05T13:26:37.971 INFO:tasks.workunit.client.0.smithi029.stdout:3/569: dwrite d1/d10/f8c [0,4194304] 0 2023-12-05T13:26:37.971 INFO:tasks.workunit.client.0.smithi029.stdout:3/570: chown d1/d16/caa 0 1 2023-12-05T13:26:37.975 INFO:tasks.workunit.client.0.smithi029.stdout:7/686: dwrite d6/d50/f64 [0,4194304] 0 2023-12-05T13:26:37.975 INFO:tasks.workunit.client.0.smithi029.stdout:3/571: mkdir d1/db5 0 2023-12-05T13:26:37.976 INFO:tasks.workunit.client.0.smithi029.stdout:6/617: dwrite d6/fc [0,4194304] 0 2023-12-05T13:26:37.976 INFO:tasks.workunit.client.0.smithi029.stdout:6/618: dread - d6/d93/fc6 zero size 2023-12-05T13:26:37.977 INFO:tasks.workunit.client.0.smithi029.stdout:7/687: mknod d6/d50/cd4 0 2023-12-05T13:26:37.977 INFO:tasks.workunit.client.0.smithi029.stdout:7/688: chown d6/d50/d5b/d1a/d26 3149 1 2023-12-05T13:26:37.979 INFO:tasks.workunit.client.0.smithi029.stdout:3/572: dread d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:37.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/619: symlink d6/d64/ld8 0 2023-12-05T13:26:37.983 INFO:tasks.workunit.client.0.smithi029.stdout:7/689: mknod d6/d19/cd5 0 2023-12-05T13:26:37.984 INFO:tasks.workunit.client.0.smithi029.stdout:7/690: write f1 [8848786,101873] 0 2023-12-05T13:26:37.985 INFO:tasks.workunit.client.0.smithi029.stdout:2/521: getdents de/d14 0 2023-12-05T13:26:37.985 INFO:tasks.workunit.client.0.smithi029.stdout:2/522: write de/f13 [2405612,75589] 0 2023-12-05T13:26:37.987 INFO:tasks.workunit.client.0.smithi029.stdout:3/573: mkdir d1/d6/d4a/db6 0 2023-12-05T13:26:37.988 INFO:tasks.workunit.client.0.smithi029.stdout:6/620: rmdir d6/d29/dc4/d40/d4d 39 2023-12-05T13:26:37.988 INFO:tasks.workunit.client.0.smithi029.stdout:6/621: fdatasync d6/d29/dc4/f99 0 2023-12-05T13:26:37.989 INFO:tasks.workunit.client.0.smithi029.stdout:2/523: symlink de/d6a/la4 0 2023-12-05T13:26:37.993 INFO:tasks.workunit.client.0.smithi029.stdout:3/574: symlink d1/d16/d36/d3a/d6c/lb7 0 2023-12-05T13:26:37.994 INFO:tasks.workunit.client.0.smithi029.stdout:6/622: rename d6/d64/d6d/d85/cc0 to d6/d29/dc4/d40/d4d/d7f/cd9 0 2023-12-05T13:26:37.996 INFO:tasks.workunit.client.0.smithi029.stdout:6/623: rename d6/c2f to d6/d29/dc4/d40/db5/cda 0 2023-12-05T13:26:37.998 INFO:tasks.workunit.client.0.smithi029.stdout:6/624: mkdir d6/d29/dc4/d40/d74/d52/d5c/d6f/ddb 0 2023-12-05T13:26:37.999 INFO:tasks.workunit.client.0.smithi029.stdout:6/625: mknod d6/d29/dc4/d40/db5/cdc 0 2023-12-05T13:26:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:6/626: write d6/d3f/f9d [153083,73219] 0 2023-12-05T13:26:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:6/627: write d6/d3f/f9a [1630427,92603] 0 2023-12-05T13:26:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:6/628: write d6/f54 [4412625,123198] 0 2023-12-05T13:26:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:6/629: fsync d6/d1d/f55 0 2023-12-05T13:26:38.001 INFO:tasks.workunit.client.0.smithi029.stdout:6/630: write d6/d29/dc4/d40/fd2 [827397,27642] 0 2023-12-05T13:26:38.002 INFO:tasks.workunit.client.0.smithi029.stdout:6/631: write d6/d1d/d36/f42 [191279,116683] 0 2023-12-05T13:26:38.002 INFO:tasks.workunit.client.0.smithi029.stdout:0/555: sync 2023-12-05T13:26:38.002 INFO:tasks.workunit.client.0.smithi029.stdout:8/602: sync 2023-12-05T13:26:38.008 INFO:tasks.workunit.client.0.smithi029.stdout:0/556: write dc/f27 [1623440,18602] 0 2023-12-05T13:26:38.011 INFO:tasks.workunit.client.0.smithi029.stdout:2/524: dwrite de/d11/f25 [0,4194304] 0 2023-12-05T13:26:38.013 INFO:tasks.workunit.client.0.smithi029.stdout:6/632: dread d6/d1d/d39/f87 [0,4194304] 0 2023-12-05T13:26:38.013 INFO:tasks.workunit.client.0.smithi029.stdout:7/691: dwrite d6/d35/d70/f8c [0,4194304] 0 2023-12-05T13:26:38.014 INFO:tasks.workunit.client.0.smithi029.stdout:3/575: dwrite d1/d5e/fa7 [0,4194304] 0 2023-12-05T13:26:38.017 INFO:tasks.workunit.client.0.smithi029.stdout:7/692: write d6/d19/f21 [1811391,124283] 0 2023-12-05T13:26:38.021 INFO:tasks.workunit.client.0.smithi029.stdout:6/633: mknod d6/d1d/d36/cdd 0 2023-12-05T13:26:38.022 INFO:tasks.workunit.client.0.smithi029.stdout:3/576: getdents d1/d16/d36/d3a 0 2023-12-05T13:26:38.025 INFO:tasks.workunit.client.0.smithi029.stdout:3/577: rename d1/db5 to d1/d6/d4a/db8 0 2023-12-05T13:26:38.026 INFO:tasks.workunit.client.0.smithi029.stdout:2/525: dwrite de/f5b [0,4194304] 0 2023-12-05T13:26:38.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/526: chown de/d11/d32/c4a 1828772840 1 2023-12-05T13:26:38.027 INFO:tasks.workunit.client.0.smithi029.stdout:2/527: write de/d14/d62/f66 [39085,14239] 0 2023-12-05T13:26:38.027 INFO:tasks.workunit.client.0.smithi029.stdout:3/578: rmdir d1/d5e/d74 39 2023-12-05T13:26:38.034 INFO:tasks.workunit.client.0.smithi029.stdout:2/528: unlink l8 0 2023-12-05T13:26:38.035 INFO:tasks.workunit.client.0.smithi029.stdout:3/579: write d1/d10/f5b [177011,116773] 0 2023-12-05T13:26:38.036 INFO:tasks.workunit.client.0.smithi029.stdout:7/693: dwrite d6/d19/f25 [0,4194304] 0 2023-12-05T13:26:38.036 INFO:tasks.workunit.client.0.smithi029.stdout:2/529: unlink de/l3a 0 2023-12-05T13:26:38.038 INFO:tasks.workunit.client.0.smithi029.stdout:3/580: mkdir d1/d16/d36/d4b/db9 0 2023-12-05T13:26:38.038 INFO:tasks.workunit.client.0.smithi029.stdout:3/581: chown d1/d16/d36/d3a/d6c/d7d/fa1 41248 1 2023-12-05T13:26:38.039 INFO:tasks.workunit.client.0.smithi029.stdout:7/694: mknod d6/d50/d5b/d1a/d26/d72/cd6 0 2023-12-05T13:26:38.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/695: write d6/d50/d5b/d1a/d26/d6e/f75 [549785,124640] 0 2023-12-05T13:26:38.040 INFO:tasks.workunit.client.0.smithi029.stdout:7/696: chown d6/d35/d5c/cae 169248 1 2023-12-05T13:26:38.041 INFO:tasks.workunit.client.0.smithi029.stdout:7/697: fdatasync d6/d2a/d2f/d89/dad/fcc 0 2023-12-05T13:26:38.042 INFO:tasks.workunit.client.0.smithi029.stdout:2/530: creat de/d16/d43/fa5 x:0 0 0 2023-12-05T13:26:38.042 INFO:tasks.workunit.client.0.smithi029.stdout:3/582: dread d1/d18/f55 [0,4194304] 0 2023-12-05T13:26:38.042 INFO:tasks.workunit.client.0.smithi029.stdout:3/583: truncate d1/d10/d91/f7e 757942 0 2023-12-05T13:26:38.046 INFO:tasks.workunit.client.0.smithi029.stdout:2/531: rename de/d16/d4c/l64 to de/d14/d24/d93/la6 0 2023-12-05T13:26:38.048 INFO:tasks.workunit.client.0.smithi029.stdout:3/584: creat d1/d16/d36/d3a/fba x:0 0 0 2023-12-05T13:26:38.048 INFO:tasks.workunit.client.0.smithi029.stdout:7/698: dread d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:38.049 INFO:tasks.workunit.client.0.smithi029.stdout:2/532: creat de/d6a/fa7 x:0 0 0 2023-12-05T13:26:38.050 INFO:tasks.workunit.client.0.smithi029.stdout:3/585: creat d1/d16/d36/fbb x:0 0 0 2023-12-05T13:26:38.050 INFO:tasks.workunit.client.0.smithi029.stdout:3/586: chown d1/d10/f41 13 1 2023-12-05T13:26:38.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/699: creat d6/d50/d5b/d5f/d7d/d97/fd7 x:0 0 0 2023-12-05T13:26:38.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/700: write d6/d35/d70/fb0 [304075,15458] 0 2023-12-05T13:26:38.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/701: chown d6/d50/d5b/f29 5 1 2023-12-05T13:26:38.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/702: readlink d6/d50/d5b/l1d 0 2023-12-05T13:26:38.055 INFO:tasks.workunit.client.0.smithi029.stdout:2/533: link de/d14/d24/f19 de/d14/d24/d93/fa8 0 2023-12-05T13:26:38.057 INFO:tasks.workunit.client.0.smithi029.stdout:3/587: unlink d1/d16/d36/c8e 0 2023-12-05T13:26:38.059 INFO:tasks.workunit.client.0.smithi029.stdout:3/588: dread d1/d16/d1f/d4c/f79 [0,4194304] 0 2023-12-05T13:26:38.059 INFO:tasks.workunit.client.0.smithi029.stdout:2/534: mkdir de/d41/d56/da9 0 2023-12-05T13:26:38.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/589: chown d1/d10/c2c 50 1 2023-12-05T13:26:38.060 INFO:tasks.workunit.client.0.smithi029.stdout:3/590: write d1/d6/d4a/f9b [511372,5943] 0 2023-12-05T13:26:38.061 INFO:tasks.workunit.client.0.smithi029.stdout:2/535: mkdir de/d16/daa 0 2023-12-05T13:26:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/536: read de/d11/d32/f3e [1374449,23897] 0 2023-12-05T13:26:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:2/537: chown de/d6a/d9d 48888 1 2023-12-05T13:26:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:3/591: mkdir d1/d16/d36/d3a/d6c/dbc 0 2023-12-05T13:26:38.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/592: rmdir d1/d5e 39 2023-12-05T13:26:38.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/593: chown d1/d18/f38 0 1 2023-12-05T13:26:38.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/594: dread - d1/d10/d91/f96 zero size 2023-12-05T13:26:38.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/595: fdatasync d1/d5e/d74/f93 0 2023-12-05T13:26:38.063 INFO:tasks.workunit.client.0.smithi029.stdout:3/596: chown d1/d16/d1f/d4c/c83 21 1 2023-12-05T13:26:38.073 INFO:tasks.workunit.client.0.smithi029.stdout:7/703: dwrite d6/d2a/d7e/d7b/f99 [0,4194304] 0 2023-12-05T13:26:38.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/538: dread de/d16/f2c [0,4194304] 0 2023-12-05T13:26:38.077 INFO:tasks.workunit.client.0.smithi029.stdout:2/539: chown de/d41 140329082 1 2023-12-05T13:26:38.079 INFO:tasks.workunit.client.0.smithi029.stdout:2/540: write de/d14/d24/f73 [647995,46250] 0 2023-12-05T13:26:38.080 INFO:tasks.workunit.client.0.smithi029.stdout:7/704: dread d6/d50/f64 [0,4194304] 0 2023-12-05T13:26:38.081 INFO:tasks.workunit.client.0.smithi029.stdout:2/541: creat de/d11/fab x:0 0 0 2023-12-05T13:26:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/542: dwrite de/d16/f2b [0,4194304] 0 2023-12-05T13:26:38.096 INFO:tasks.workunit.client.0.smithi029.stdout:2/543: fdatasync de/d16/d43/f82 0 2023-12-05T13:26:38.098 INFO:tasks.workunit.client.0.smithi029.stdout:2/544: mkdir de/d6a/d9d/dac 0 2023-12-05T13:26:38.099 INFO:tasks.workunit.client.0.smithi029.stdout:2/545: mkdir de/d11/dad 0 2023-12-05T13:26:38.104 INFO:tasks.workunit.client.0.smithi029.stdout:2/546: write de/d11/d32/f3e [371655,127377] 0 2023-12-05T13:26:38.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/547: rmdir de/d16/daa 0 2023-12-05T13:26:38.108 INFO:tasks.workunit.client.0.smithi029.stdout:2/548: unlink de/d14/d24/d93/fa8 0 2023-12-05T13:26:38.109 INFO:tasks.workunit.client.0.smithi029.stdout:2/549: mknod de/d14/d24/cae 0 2023-12-05T13:26:38.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/550: dwrite de/d14/f39 [0,4194304] 0 2023-12-05T13:26:38.141 INFO:tasks.workunit.client.0.smithi029.stdout:2/551: dwrite de/d16/f2b [0,4194304] 0 2023-12-05T13:26:38.143 INFO:tasks.workunit.client.0.smithi029.stdout:2/552: mknod de/d11/d32/caf 0 2023-12-05T13:26:38.145 INFO:tasks.workunit.client.0.smithi029.stdout:2/553: rename de/d14/f39 to de/d16/d6c/d8e/fb0 0 2023-12-05T13:26:38.147 INFO:tasks.workunit.client.0.smithi029.stdout:2/554: unlink de/d14/d62/f66 0 2023-12-05T13:26:38.148 INFO:tasks.workunit.client.0.smithi029.stdout:2/555: write de/d14/f7e [2124480,50569] 0 2023-12-05T13:26:38.150 INFO:tasks.workunit.client.0.smithi029.stdout:2/556: creat de/d11/d32/fb1 x:0 0 0 2023-12-05T13:26:38.150 INFO:tasks.workunit.client.0.smithi029.stdout:2/557: write de/d16/d43/f46 [327446,78642] 0 2023-12-05T13:26:38.151 INFO:tasks.workunit.client.0.smithi029.stdout:2/558: creat de/d14/d24/d93/fb2 x:0 0 0 2023-12-05T13:26:38.155 INFO:tasks.workunit.client.0.smithi029.stdout:2/559: dread de/d41/f51 [0,4194304] 0 2023-12-05T13:26:38.156 INFO:tasks.workunit.client.0.smithi029.stdout:2/560: creat de/d6a/fb3 x:0 0 0 2023-12-05T13:26:38.173 INFO:tasks.workunit.client.0.smithi029.stdout:2/561: dwrite de/d11/f26 [0,4194304] 0 2023-12-05T13:26:38.174 INFO:tasks.workunit.client.0.smithi029.stdout:2/562: mknod de/d16/d6c/d8e/cb4 0 2023-12-05T13:26:38.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/563: dread de/d14/d62/f68 [0,4194304] 0 2023-12-05T13:26:38.177 INFO:tasks.workunit.client.0.smithi029.stdout:2/564: dread - de/d14/f65 zero size 2023-12-05T13:26:38.185 INFO:tasks.workunit.client.0.smithi029.stdout:2/565: dread de/d16/f31 [0,4194304] 0 2023-12-05T13:26:38.186 INFO:tasks.workunit.client.0.smithi029.stdout:2/566: write de/d16/f29 [4099130,69189] 0 2023-12-05T13:26:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:2/567: rename de/d41/d56/f8f to de/d14/d24/d93/fb5 0 2023-12-05T13:26:38.189 INFO:tasks.workunit.client.0.smithi029.stdout:2/568: write de/d16/f2b [4983207,90298] 0 2023-12-05T13:26:38.191 INFO:tasks.workunit.client.0.smithi029.stdout:2/569: creat de/d16/d6c/d8e/fb6 x:0 0 0 2023-12-05T13:26:38.193 INFO:tasks.workunit.client.0.smithi029.stdout:2/570: mkdir de/d14/d24/db7 0 2023-12-05T13:26:38.193 INFO:tasks.workunit.client.0.smithi029.stdout:2/571: chown de/d11 1166 1 2023-12-05T13:26:38.207 INFO:tasks.workunit.client.0.smithi029.stdout:2/572: dwrite de/f27 [4194304,4194304] 0 2023-12-05T13:26:38.207 INFO:tasks.workunit.client.0.smithi029.stdout:2/573: chown de/d14/c2d 3557974 1 2023-12-05T13:26:38.208 INFO:tasks.workunit.client.0.smithi029.stdout:2/574: mkdir de/db8 0 2023-12-05T13:26:38.221 INFO:tasks.workunit.client.0.smithi029.stdout:2/575: dwrite de/d14/d24/d93/f9b [0,4194304] 0 2023-12-05T13:26:38.222 INFO:tasks.workunit.client.0.smithi029.stdout:2/576: truncate de/d11/d32/f3e 1163255 0 2023-12-05T13:26:38.227 INFO:tasks.workunit.client.0.smithi029.stdout:2/577: dread de/d16/d43/f92 [0,4194304] 0 2023-12-05T13:26:38.227 INFO:tasks.workunit.client.0.smithi029.stdout:2/578: dread - de/d16/d6c/f7c zero size 2023-12-05T13:26:38.227 INFO:tasks.workunit.client.0.smithi029.stdout:2/579: getdents de/d6a/d9d/dac 0 2023-12-05T13:26:38.228 INFO:tasks.workunit.client.0.smithi029.stdout:2/580: link de/d41/f78 de/d41/d56/fb9 0 2023-12-05T13:26:38.229 INFO:tasks.workunit.client.0.smithi029.stdout:2/581: getdents de/d16/d43 0 2023-12-05T13:26:38.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/582: stat de/l8a 0 2023-12-05T13:26:38.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/583: truncate de/d16/d6c/f7c 885026 0 2023-12-05T13:26:38.230 INFO:tasks.workunit.client.0.smithi029.stdout:2/584: dread - de/d14/f65 zero size 2023-12-05T13:26:38.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/467: sync 2023-12-05T13:26:38.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/468: write d1/dc/f89 [389266,21425] 0 2023-12-05T13:26:38.438 INFO:tasks.workunit.client.0.smithi029.stdout:5/469: dwrite d1/dc/d25/d4c/d9b/d9a/f88 [0,4194304] 0 2023-12-05T13:26:38.438 INFO:tasks.workunit.client.0.smithi029.stdout:5/470: fdatasync d1/dc/d10/d1e/d33/f4d 0 2023-12-05T13:26:38.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/471: mknod d1/dc/d27/caa 0 2023-12-05T13:26:38.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/472: read d1/dc/d10/d1e/f65 [2979226,11632] 0 2023-12-05T13:26:38.442 INFO:tasks.workunit.client.0.smithi029.stdout:5/473: stat d1/dc/d11/f56 0 2023-12-05T13:26:38.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/474: dwrite d1/dc/d38/d3a/d5c/f63 [0,4194304] 0 2023-12-05T13:26:38.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/475: chown d1/dc/d11/d17/d29 532989856 1 2023-12-05T13:26:38.467 INFO:tasks.workunit.client.0.smithi029.stdout:5/476: creat d1/dc/d25/d4c/d9b/d9a/fab x:0 0 0 2023-12-05T13:26:38.468 INFO:tasks.workunit.client.0.smithi029.stdout:5/477: mknod d1/dc/d10/cac 0 2023-12-05T13:26:38.468 INFO:tasks.workunit.client.0.smithi029.stdout:5/478: stat d1/dc/d11/d17/d3d 0 2023-12-05T13:26:38.468 INFO:tasks.workunit.client.0.smithi029.stdout:5/479: truncate d1/dc/d10/d1e/d33/f6b 1669722 0 2023-12-05T13:26:38.470 INFO:tasks.workunit.client.0.smithi029.stdout:5/480: symlink d1/dc/d38/lad 0 2023-12-05T13:26:38.490 INFO:tasks.workunit.client.0.smithi029.stdout:5/481: dwrite d1/dc/d25/d4c/d9b/d9a/f88 [0,4194304] 0 2023-12-05T13:26:38.491 INFO:tasks.workunit.client.0.smithi029.stdout:5/482: symlink d1/dc/d10/d1e/d75/lae 0 2023-12-05T13:26:38.492 INFO:tasks.workunit.client.0.smithi029.stdout:5/483: mknod d1/dc/caf 0 2023-12-05T13:26:38.493 INFO:tasks.workunit.client.0.smithi029.stdout:5/484: link d1/dc/d38/d55/f81 d1/dc/d38/d3a/d5c/d87/fb0 0 2023-12-05T13:26:38.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/485: creat d1/dc/d10/d1e/d75/d7f/fb1 x:0 0 0 2023-12-05T13:26:38.494 INFO:tasks.workunit.client.0.smithi029.stdout:5/486: write d1/dc/d11/f12 [1945564,119440] 0 2023-12-05T13:26:38.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/602: sync 2023-12-05T13:26:38.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/603: rmdir d7/d5e/d52/d5f/d12/da5 0 2023-12-05T13:26:38.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/604: write d7/d6e/da9/f51 [2850783,33848] 0 2023-12-05T13:26:38.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/605: getdents d7/d5b/dc3 0 2023-12-05T13:26:38.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/606: chown d7/c30 8770 1 2023-12-05T13:26:38.628 INFO:tasks.workunit.client.0.smithi029.stdout:1/607: unlink d7/d5e/d52/d5f/d12/f74 0 2023-12-05T13:26:38.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/608: symlink d7/d56/lce 0 2023-12-05T13:26:38.631 INFO:tasks.workunit.client.0.smithi029.stdout:1/609: mknod d7/d5e/d52/d5f/d48/ccf 0 2023-12-05T13:26:38.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/610: rename d7/d5e/d52/d5f/d12/d60/l7c to d7/d61/d77/d9f/ld0 0 2023-12-05T13:26:38.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/611: chown d7/d5e/d52/d5f/l45 210857777 1 2023-12-05T13:26:38.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/612: chown d7/d5e/d52/d5f/d48/fb6 570311 1 2023-12-05T13:26:38.634 INFO:tasks.workunit.client.0.smithi029.stdout:1/613: truncate d7/d56/da8/fad 57586 0 2023-12-05T13:26:38.635 INFO:tasks.workunit.client.0.smithi029.stdout:1/614: chown d7/d61 15 1 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:38.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: Reconfiguring node-exporter.smithi029 (dependencies changed)... 2023-12-05T13:26:38.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:38 smithi052 ceph-mon[121072]: Reconfiguring daemon node-exporter.smithi029 on smithi029 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: Reconfiguring node-exporter.smithi029 (dependencies changed)... 2023-12-05T13:26:38.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:38 smithi029 ceph-mon[112128]: Reconfiguring daemon node-exporter.smithi029 on smithi029 2023-12-05T13:26:39.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:39 smithi052 ceph-mon[121072]: pgmap v41: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 80 MiB/s rd, 159 MiB/s wr, 378 op/s 2023-12-05T13:26:40.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:39 smithi029 ceph-mon[112128]: pgmap v41: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 80 MiB/s rd, 159 MiB/s wr, 378 op/s 2023-12-05T13:26:40.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:40 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:40.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:40 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:40.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:40 smithi052 ceph-mon[121072]: Reconfiguring alertmanager.smithi029 (dependencies changed)... 2023-12-05T13:26:40.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:40 smithi052 ceph-mon[121072]: Reconfiguring daemon alertmanager.smithi029 on smithi029 2023-12-05T13:26:40.997 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:40 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:40.997 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:40 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:40.998 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:40 smithi029 ceph-mon[112128]: Reconfiguring alertmanager.smithi029 (dependencies changed)... 2023-12-05T13:26:40.998 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:40 smithi029 ceph-mon[112128]: Reconfiguring daemon alertmanager.smithi029 on smithi029 2023-12-05T13:26:41.968 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:41 smithi029 ceph-mon[112128]: pgmap v42: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 135 MiB/s wr, 230 op/s 2023-12-05T13:26:41.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:41 smithi052 ceph-mon[121072]: pgmap v42: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 135 MiB/s wr, 230 op/s 2023-12-05T13:26:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:8/603: sync 2023-12-05T13:26:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/487: sync 2023-12-05T13:26:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:7/705: sync 2023-12-05T13:26:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/488: chown d1/dc/d10/d1e/d75/d7f 421 1 2023-12-05T13:26:42.352 INFO:tasks.workunit.client.0.smithi029.stdout:5/489: chown d1/dc/d38/f78 1980565543 1 2023-12-05T13:26:42.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/634: sync 2023-12-05T13:26:42.353 INFO:tasks.workunit.client.0.smithi029.stdout:1/615: sync 2023-12-05T13:26:42.353 INFO:tasks.workunit.client.0.smithi029.stdout:9/450: sync 2023-12-05T13:26:42.353 INFO:tasks.workunit.client.0.smithi029.stdout:2/585: sync 2023-12-05T13:26:42.354 INFO:tasks.workunit.client.0.smithi029.stdout:0/557: sync 2023-12-05T13:26:42.355 INFO:tasks.workunit.client.0.smithi029.stdout:3/597: sync 2023-12-05T13:26:42.355 INFO:tasks.workunit.client.0.smithi029.stdout:4/424: sync 2023-12-05T13:26:42.357 INFO:tasks.workunit.client.0.smithi029.stdout:7/706: mkdir d6/d50/d5b/d1a/d26/dd8 0 2023-12-05T13:26:42.357 INFO:tasks.workunit.client.0.smithi029.stdout:0/558: read dc/d23/d3a/d41/d57/f5d [3484528,93122] 0 2023-12-05T13:26:42.357 INFO:tasks.workunit.client.0.smithi029.stdout:0/559: chown dc/d23/f2e 4928709 1 2023-12-05T13:26:42.362 INFO:tasks.workunit.client.0.smithi029.stdout:5/490: rename d1/dc/d11/d17/d29 to d1/dc/d10/d1e/d33/d93/da5/db2 0 2023-12-05T13:26:42.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/707: dread d6/d35/d5c/f6c [0,4194304] 0 2023-12-05T13:26:42.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/635: dread d6/d1d/d36/f69 [0,4194304] 0 2023-12-05T13:26:42.365 INFO:tasks.workunit.client.0.smithi029.stdout:6/636: write d6/d1d/d36/f69 [4061161,36215] 0 2023-12-05T13:26:42.365 INFO:tasks.workunit.client.0.smithi029.stdout:2/586: creat de/d41/d56/fba x:0 0 0 2023-12-05T13:26:42.365 INFO:tasks.workunit.client.0.smithi029.stdout:1/616: dread d7/d61/d4f/f8a [0,4194304] 0 2023-12-05T13:26:42.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/598: link d1/db3/d72/c8b d1/d16/d36/d4b/db9/cbd 0 2023-12-05T13:26:42.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/599: stat d1/d16/d36/d3a/d6c/d7d/l85 0 2023-12-05T13:26:42.377 INFO:tasks.workunit.client.0.smithi029.stdout:4/425: dread d0/da/f39 [0,4194304] 0 2023-12-05T13:26:42.377 INFO:tasks.workunit.client.0.smithi029.stdout:4/426: truncate d0/de/d15/f49 5417361 0 2023-12-05T13:26:42.377 INFO:tasks.workunit.client.0.smithi029.stdout:7/708: symlink d6/d35/d5c/dd3/ld9 0 2023-12-05T13:26:42.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/600: write d1/d5e/d74/f81 [745425,21080] 0 2023-12-05T13:26:42.378 INFO:tasks.workunit.client.0.smithi029.stdout:3/601: chown d1/d16/d36/d4b/db9 142 1 2023-12-05T13:26:42.381 INFO:tasks.workunit.client.0.smithi029.stdout:2/587: mknod de/d16/d4c/cbb 0 2023-12-05T13:26:42.383 INFO:tasks.workunit.client.0.smithi029.stdout:0/560: dwrite dc/d23/d3a/d41/d57/d58/f7d [4194304,4194304] 0 2023-12-05T13:26:42.383 INFO:tasks.workunit.client.0.smithi029.stdout:0/561: dread - dc/d13/d4f/d88/fab zero size 2023-12-05T13:26:42.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/604: dwrite d5/dc/d18/d26/dc0/fcb [0,4194304] 0 2023-12-05T13:26:42.384 INFO:tasks.workunit.client.0.smithi029.stdout:8/605: write d5/d6/fa3 [1256087,100107] 0 2023-12-05T13:26:42.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/602: link d1/d16/d1f/l60 d1/d16/d1f/d4c/dae/lbe 0 2023-12-05T13:26:42.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/603: dread - d1/d16/d36/fbb zero size 2023-12-05T13:26:42.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/604: chown d1/d16/d1f/d4c/f5f 564 1 2023-12-05T13:26:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:9/451: dwrite d7/d2c/d33/f5b [0,4194304] 0 2023-12-05T13:26:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:9/452: chown d7/l12 674 1 2023-12-05T13:26:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:2/588: getdents de/d11/d32 0 2023-12-05T13:26:42.391 INFO:tasks.workunit.client.0.smithi029.stdout:2/589: write f6 [8904841,63002] 0 2023-12-05T13:26:42.398 INFO:tasks.workunit.client.0.smithi029.stdout:8/606: creat d5/dbc/d1d/fd0 x:0 0 0 2023-12-05T13:26:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:7/709: dwrite d6/d50/d5b/d1a/d26/f74 [0,4194304] 0 2023-12-05T13:26:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:9/453: read d7/d19/d1f/f46 [844797,63081] 0 2023-12-05T13:26:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/637: rename d6/d1d/d39/lbe to d6/d64/d6d/lde 0 2023-12-05T13:26:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/638: read - d6/d1d/d36/fc3 zero size 2023-12-05T13:26:42.400 INFO:tasks.workunit.client.0.smithi029.stdout:6/639: read - d6/d1d/f84 zero size 2023-12-05T13:26:42.402 INFO:tasks.workunit.client.0.smithi029.stdout:1/617: dwrite d7/d6e/da9/f3c [4194304,4194304] 0 2023-12-05T13:26:42.403 INFO:tasks.workunit.client.0.smithi029.stdout:2/590: mkdir de/d11/d32/dbc 0 2023-12-05T13:26:42.404 INFO:tasks.workunit.client.0.smithi029.stdout:4/427: dwrite d0/d41/f53 [4194304,4194304] 0 2023-12-05T13:26:42.407 INFO:tasks.workunit.client.0.smithi029.stdout:3/605: dwrite d1/d10/f41 [0,4194304] 0 2023-12-05T13:26:42.412 INFO:tasks.workunit.client.0.smithi029.stdout:6/640: rmdir d6/d29/dc4/d40/d74/d52/d5c/d6f 39 2023-12-05T13:26:42.414 INFO:tasks.workunit.client.0.smithi029.stdout:4/428: dread d0/de/d15/f4e [4194304,4194304] 0 2023-12-05T13:26:42.416 INFO:tasks.workunit.client.0.smithi029.stdout:1/618: mkdir d7/d6e/da9/d4b/db1/dd1 0 2023-12-05T13:26:42.421 INFO:tasks.workunit.client.0.smithi029.stdout:3/606: creat d1/d16/d1f/fbf x:0 0 0 2023-12-05T13:26:42.423 INFO:tasks.workunit.client.0.smithi029.stdout:4/429: mknod d0/d16/d22/d4f/c8b 0 2023-12-05T13:26:42.426 INFO:tasks.workunit.client.0.smithi029.stdout:3/607: mkdir d1/d16/d1f/d4c/dc0 0 2023-12-05T13:26:42.431 INFO:tasks.workunit.client.0.smithi029.stdout:4/430: getdents d0/de/d30/d32/d35/d3d 0 2023-12-05T13:26:42.431 INFO:tasks.workunit.client.0.smithi029.stdout:4/431: fsync d0/de/f45 0 2023-12-05T13:26:42.437 INFO:tasks.workunit.client.0.smithi029.stdout:4/432: dread d0/de/d30/d32/d35/d3d/f5a [0,4194304] 0 2023-12-05T13:26:42.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/433: mknod d0/d3c/c8c 0 2023-12-05T13:26:42.442 INFO:tasks.workunit.client.0.smithi029.stdout:4/434: chown d0/da/f18 177 1 2023-12-05T13:26:42.443 INFO:tasks.workunit.client.0.smithi029.stdout:3/608: dwrite d1/d10/f8c [0,4194304] 0 2023-12-05T13:26:42.445 INFO:tasks.workunit.client.0.smithi029.stdout:4/435: creat d0/de/d15/d2b/f8d x:0 0 0 2023-12-05T13:26:42.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/454: link d7/d2c/l35 d7/d19/d28/l96 0 2023-12-05T13:26:42.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/455: readlink d7/d19/d28/l96 0 2023-12-05T13:26:42.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/456: dread - d7/d2c/d3a/d52/f6e zero size 2023-12-05T13:26:42.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/457: chown d7/d2c/d3a/d52/f6e 67811 1 2023-12-05T13:26:42.450 INFO:tasks.workunit.client.0.smithi029.stdout:4/436: link d0/da/f18 d0/d16/d2f/d69/f8e 0 2023-12-05T13:26:42.452 INFO:tasks.workunit.client.0.smithi029.stdout:9/458: unlink l6 0 2023-12-05T13:26:42.455 INFO:tasks.workunit.client.0.smithi029.stdout:9/459: mknod d7/d19/d30/d43/c97 0 2023-12-05T13:26:42.456 INFO:tasks.workunit.client.0.smithi029.stdout:0/562: mknod dc/d33/d3d/d7a/cad 0 2023-12-05T13:26:42.456 INFO:tasks.workunit.client.0.smithi029.stdout:9/460: creat d7/d2c/d33/f98 x:0 0 0 2023-12-05T13:26:42.458 INFO:tasks.workunit.client.0.smithi029.stdout:3/609: dwrite d1/d10/d91/f96 [0,4194304] 0 2023-12-05T13:26:42.458 INFO:tasks.workunit.client.0.smithi029.stdout:0/563: symlink dc/d33/d3d/d7a/d84/d8d/d97/d98/lae 0 2023-12-05T13:26:42.458 INFO:tasks.workunit.client.0.smithi029.stdout:3/610: write d1/d18/f2e [227645,34199] 0 2023-12-05T13:26:42.459 INFO:tasks.workunit.client.0.smithi029.stdout:3/611: write d1/d10/f8c [598503,38596] 0 2023-12-05T13:26:42.459 INFO:tasks.workunit.client.0.smithi029.stdout:3/612: write d1/d5e/d74/f93 [4801675,12293] 0 2023-12-05T13:26:42.462 INFO:tasks.workunit.client.0.smithi029.stdout:7/710: rename d6/d35 to d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda 0 2023-12-05T13:26:42.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/564: link dc/d33/d3d/d7a/cad dc/d13/d4f/d63/caf 0 2023-12-05T13:26:42.464 INFO:tasks.workunit.client.0.smithi029.stdout:0/565: getdents dc/d13/d4f/d83 0 2023-12-05T13:26:42.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/491: mkdir d1/dc/d38/d3a/db3 0 2023-12-05T13:26:42.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/492: chown d1/dc/d38/c99 1830 1 2023-12-05T13:26:42.465 INFO:tasks.workunit.client.0.smithi029.stdout:5/493: truncate d1/dc/d25/d4c/f7e 4547252 0 2023-12-05T13:26:42.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/613: unlink d1/d18/f55 0 2023-12-05T13:26:42.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/614: chown d1/d18/c4d 179 1 2023-12-05T13:26:42.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/615: chown d1/d16/d36/d3a 7529096 1 2023-12-05T13:26:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/641: rename d6/f76 to d6/d64/fdf 0 2023-12-05T13:26:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/642: readlink d6/d1d/d39/l6a 0 2023-12-05T13:26:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/643: chown l4 9 1 2023-12-05T13:26:42.469 INFO:tasks.workunit.client.0.smithi029.stdout:6/644: chown d6/d29/dc4/d40/db5/c98 19124533 1 2023-12-05T13:26:42.470 INFO:tasks.workunit.client.0.smithi029.stdout:7/711: mknod d6/d50/d5b/d1a/d26/d72/cdb 0 2023-12-05T13:26:42.472 INFO:tasks.workunit.client.0.smithi029.stdout:5/494: truncate d1/dc/d27/f2e 2354138 0 2023-12-05T13:26:42.472 INFO:tasks.workunit.client.0.smithi029.stdout:5/495: read - d1/dc/d38/d55/f6e zero size 2023-12-05T13:26:42.475 INFO:tasks.workunit.client.0.smithi029.stdout:3/616: mknod d1/d16/d36/d3a/d6c/dbc/cc1 0 2023-12-05T13:26:42.476 INFO:tasks.workunit.client.0.smithi029.stdout:6/645: mkdir d6/d29/dc4/d40/d4d/d8f/de0 0 2023-12-05T13:26:42.478 INFO:tasks.workunit.client.0.smithi029.stdout:4/437: rename d0/d1/d37/l7b to d0/d41/l8f 0 2023-12-05T13:26:42.479 INFO:tasks.workunit.client.0.smithi029.stdout:4/438: dread d0/de/d30/f4c [0,4194304] 0 2023-12-05T13:26:42.482 INFO:tasks.workunit.client.0.smithi029.stdout:7/712: mknod d6/d19/cdc 0 2023-12-05T13:26:42.482 INFO:tasks.workunit.client.0.smithi029.stdout:7/713: write d6/d2a/d2f/d89/dad/fcc [639999,75686] 0 2023-12-05T13:26:42.484 INFO:tasks.workunit.client.0.smithi029.stdout:3/617: creat d1/d6/d11/fc2 x:0 0 0 2023-12-05T13:26:42.486 INFO:tasks.workunit.client.0.smithi029.stdout:5/496: rename d1/dc/d11/d17/l95 to d1/dc/d25/d4c/d61/lb4 0 2023-12-05T13:26:42.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/714: write d6/f11 [5728605,125669] 0 2023-12-05T13:26:42.499 INFO:tasks.workunit.client.0.smithi029.stdout:8/607: symlink d5/d6/d10/d13/ld1 0 2023-12-05T13:26:42.500 INFO:tasks.workunit.client.0.smithi029.stdout:8/608: getdents d5/dbc/d1d 0 2023-12-05T13:26:42.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/646: dwrite d6/d29/dc4/d40/d4d/fa2 [0,4194304] 0 2023-12-05T13:26:42.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/609: creat d5/d2f/d75/fd2 x:0 0 0 2023-12-05T13:26:42.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/610: stat d5/dbc/d53/l6c 0 2023-12-05T13:26:42.504 INFO:tasks.workunit.client.0.smithi029.stdout:8/611: chown d5/d2f/d3a/d86/dc3 14843 1 2023-12-05T13:26:42.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/439: dwrite d0/da/f18 [4194304,4194304] 0 2023-12-05T13:26:42.507 INFO:tasks.workunit.client.0.smithi029.stdout:7/715: dread d6/d50/d5b/d1a/d26/d6e/f95 [0,4194304] 0 2023-12-05T13:26:42.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/591: symlink de/lbd 0 2023-12-05T13:26:42.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/592: write de/d16/d43/f82 [9163362,21234] 0 2023-12-05T13:26:42.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/593: dread - de/d41/d56/fba zero size 2023-12-05T13:26:42.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/594: write de/d14/d24/f74 [904095,101352] 0 2023-12-05T13:26:42.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/497: dwrite d1/dc/d38/d55/d57/f76 [0,4194304] 0 2023-12-05T13:26:42.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/498: readlink d1/dc/l84 0 2023-12-05T13:26:42.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/499: chown d1/dc/d10/d1e/d75 5717 1 2023-12-05T13:26:42.511 INFO:tasks.workunit.client.0.smithi029.stdout:5/500: write d1/dc/d38/d3a/d5c/d87/fb0 [2216765,66182] 0 2023-12-05T13:26:42.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/716: mkdir d6/d2a/d4f/ddd 0 2023-12-05T13:26:42.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/440: symlink d0/de/d15/l90 0 2023-12-05T13:26:42.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/441: fsync d0/da/fb 0 2023-12-05T13:26:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:2/595: getdents de/d41/d56 0 2023-12-05T13:26:42.518 INFO:tasks.workunit.client.0.smithi029.stdout:2/596: chown de/d6a/d9d 0 1 2023-12-05T13:26:42.519 INFO:tasks.workunit.client.0.smithi029.stdout:8/612: dwrite d5/d2f/d3a/d86/fab [0,4194304] 0 2023-12-05T13:26:42.519 INFO:tasks.workunit.client.0.smithi029.stdout:8/613: dread - d5/dc/d18/d26/fb0 zero size 2023-12-05T13:26:42.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/647: dwrite d6/d29/dc4/d40/d74/d52/d5c/fa6 [0,4194304] 0 2023-12-05T13:26:42.523 INFO:tasks.workunit.client.0.smithi029.stdout:6/648: read - d6/d64/d6d/d85/fc8 zero size 2023-12-05T13:26:42.530 INFO:tasks.workunit.client.0.smithi029.stdout:5/501: link d1/c6 d1/dc/d38/d4b/cb5 0 2023-12-05T13:26:42.530 INFO:tasks.workunit.client.0.smithi029.stdout:5/502: fsync d1/dc/d38/f44 0 2023-12-05T13:26:42.531 INFO:tasks.workunit.client.0.smithi029.stdout:7/717: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/da4 to d6/d50/d5b/d5f/d7d/d97/d4a/d4b/dde 0 2023-12-05T13:26:42.533 INFO:tasks.workunit.client.0.smithi029.stdout:6/649: dread d6/d1d/d36/f69 [0,4194304] 0 2023-12-05T13:26:42.534 INFO:tasks.workunit.client.0.smithi029.stdout:8/614: dwrite d5/d6/d59/fad [0,4194304] 0 2023-12-05T13:26:42.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/597: creat de/d14/d62/fbe x:0 0 0 2023-12-05T13:26:42.544 INFO:tasks.workunit.client.0.smithi029.stdout:5/503: creat d1/dc/d10/d1e/d75/d7f/d8a/fb6 x:0 0 0 2023-12-05T13:26:42.544 INFO:tasks.workunit.client.0.smithi029.stdout:5/504: readlink d1/dc/d38/d3a/l83 0 2023-12-05T13:26:42.547 INFO:tasks.workunit.client.0.smithi029.stdout:6/650: rename d6/d64/d6d/lde to d6/d64/d6d/d85/le1 0 2023-12-05T13:26:42.548 INFO:tasks.workunit.client.0.smithi029.stdout:4/442: getdents d0/d41 0 2023-12-05T13:26:42.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/443: dread d0/de/d30/d32/d35/d3d/f5a [0,4194304] 0 2023-12-05T13:26:42.549 INFO:tasks.workunit.client.0.smithi029.stdout:7/718: dwrite d6/d50/d5b/d5f/d7d/d97/d4a/fb9 [0,4194304] 0 2023-12-05T13:26:42.551 INFO:tasks.workunit.client.0.smithi029.stdout:2/598: truncate de/d16/f2b 1645127 0 2023-12-05T13:26:42.556 INFO:tasks.workunit.client.0.smithi029.stdout:5/505: symlink d1/dc/d11/d17/lb7 0 2023-12-05T13:26:42.557 INFO:tasks.workunit.client.0.smithi029.stdout:7/719: dread d6/d50/d5b/f29 [0,4194304] 0 2023-12-05T13:26:42.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/615: rename d5/d2f/d3a/d3c/l92 to d5/d2f/ld3 0 2023-12-05T13:26:42.559 INFO:tasks.workunit.client.0.smithi029.stdout:8/616: dread - d5/d2f/d75/f71 zero size 2023-12-05T13:26:42.559 INFO:tasks.workunit.client.0.smithi029.stdout:6/651: truncate d6/f45 899822 0 2023-12-05T13:26:42.559 INFO:tasks.workunit.client.0.smithi029.stdout:6/652: write d6/d1d/d36/f48 [5376871,106663] 0 2023-12-05T13:26:42.560 INFO:tasks.workunit.client.0.smithi029.stdout:4/444: creat d0/d16/d22/d5f/f91 x:0 0 0 2023-12-05T13:26:42.564 INFO:tasks.workunit.client.0.smithi029.stdout:2/599: mkdir de/d16/d6c/d8e/dbf 0 2023-12-05T13:26:42.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/506: getdents d1/dc/d10/d1e/d33/d93 0 2023-12-05T13:26:42.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/507: fdatasync d1/dc/d25/d4c/d9b/d9a/fab 0 2023-12-05T13:26:42.567 INFO:tasks.workunit.client.0.smithi029.stdout:7/720: creat d6/d50/d5b/d1a/d26/dc9/fdf x:0 0 0 2023-12-05T13:26:42.569 INFO:tasks.workunit.client.0.smithi029.stdout:8/617: link d5/f27 d5/d2f/d3a/d86/dc3/fd4 0 2023-12-05T13:26:42.571 INFO:tasks.workunit.client.0.smithi029.stdout:6/653: mkdir d6/d1d/d39/d58/de2 0 2023-12-05T13:26:42.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/445: mkdir d0/de/d30/d32/d35/d3d/d92 0 2023-12-05T13:26:42.574 INFO:tasks.workunit.client.0.smithi029.stdout:2/600: creat de/d6a/fc0 x:0 0 0 2023-12-05T13:26:42.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/508: unlink d1/dc/d10/d1e/f47 0 2023-12-05T13:26:42.581 INFO:tasks.workunit.client.0.smithi029.stdout:8/618: link d5/f82 d5/d2f/d3a/d86/dc3/fd5 0 2023-12-05T13:26:42.583 INFO:tasks.workunit.client.0.smithi029.stdout:6/654: creat d6/d29/d60/dbc/fe3 x:0 0 0 2023-12-05T13:26:42.583 INFO:tasks.workunit.client.0.smithi029.stdout:6/655: write d6/d1d/d39/d58/f8b [325781,112130] 0 2023-12-05T13:26:42.586 INFO:tasks.workunit.client.0.smithi029.stdout:5/509: creat d1/dc/d38/d3a/d5c/d87/fb8 x:0 0 0 2023-12-05T13:26:42.588 INFO:tasks.workunit.client.0.smithi029.stdout:2/601: dwrite de/d16/d43/fa5 [0,4194304] 0 2023-12-05T13:26:42.588 INFO:tasks.workunit.client.0.smithi029.stdout:7/721: dwrite d6/d2a/d4f/dc5/fce [0,4194304] 0 2023-12-05T13:26:42.589 INFO:tasks.workunit.client.0.smithi029.stdout:2/602: truncate de/d14/d62/f6e 1799538 0 2023-12-05T13:26:42.589 INFO:tasks.workunit.client.0.smithi029.stdout:2/603: fdatasync de/d16/f31 0 2023-12-05T13:26:42.592 INFO:tasks.workunit.client.0.smithi029.stdout:6/656: mknod d6/ce4 0 2023-12-05T13:26:42.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/619: mknod d5/d6/cd6 0 2023-12-05T13:26:42.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/722: unlink d6/d50/d5b/f1f 0 2023-12-05T13:26:42.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/604: rename de/d14/c38 to de/d6a/d9d/cc1 0 2023-12-05T13:26:42.607 INFO:tasks.workunit.client.0.smithi029.stdout:6/657: mknod d6/d64/ce5 0 2023-12-05T13:26:42.609 INFO:tasks.workunit.client.0.smithi029.stdout:2/605: mkdir de/d16/d6c/d90/dc2 0 2023-12-05T13:26:42.613 INFO:tasks.workunit.client.0.smithi029.stdout:6/658: rename d6/d29/dc4/f28 to d6/d29/dc4/d40/db5/fe6 0 2023-12-05T13:26:42.613 INFO:tasks.workunit.client.0.smithi029.stdout:6/659: write d6/d29/dc4/d40/d4d/fbd [747231,67067] 0 2023-12-05T13:26:42.616 INFO:tasks.workunit.client.0.smithi029.stdout:4/446: truncate d0/da/f18 175854 0 2023-12-05T13:26:42.618 INFO:tasks.workunit.client.0.smithi029.stdout:8/620: mknod d5/d6/d59/cd7 0 2023-12-05T13:26:42.621 INFO:tasks.workunit.client.0.smithi029.stdout:8/621: write d5/f98 [205029,112621] 0 2023-12-05T13:26:42.621 INFO:tasks.workunit.client.0.smithi029.stdout:2/606: creat de/d41/d56/fc3 x:0 0 0 2023-12-05T13:26:42.623 INFO:tasks.workunit.client.0.smithi029.stdout:4/447: symlink d0/de/l93 0 2023-12-05T13:26:42.623 INFO:tasks.workunit.client.0.smithi029.stdout:4/448: chown d0 54955 1 2023-12-05T13:26:42.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/622: rename d5/dbc/l79 to d5/d2f/ld8 0 2023-12-05T13:26:42.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/623: fsync d5/dbc/d1d/f29 0 2023-12-05T13:26:42.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/624: readlink d5/d6/d10/d8a/lb4 0 2023-12-05T13:26:42.625 INFO:tasks.workunit.client.0.smithi029.stdout:8/625: rename d5/d6 to d5/d6/d10/d8a/db6/dd9 22 2023-12-05T13:26:42.626 INFO:tasks.workunit.client.0.smithi029.stdout:4/449: rmdir d0/d16 39 2023-12-05T13:26:42.626 INFO:tasks.workunit.client.0.smithi029.stdout:4/450: readlink d0/d3c/d85/l82 0 2023-12-05T13:26:42.628 INFO:tasks.workunit.client.0.smithi029.stdout:8/626: mknod d5/d2f/d3a/d86/cda 0 2023-12-05T13:26:42.629 INFO:tasks.workunit.client.0.smithi029.stdout:4/451: mkdir d0/de/d30/d94 0 2023-12-05T13:26:42.629 INFO:tasks.workunit.client.0.smithi029.stdout:4/452: chown d0/d16/d22/d4f/c8b 1952976 1 2023-12-05T13:26:42.631 INFO:tasks.workunit.client.0.smithi029.stdout:8/627: symlink d5/d2f/d3a/d3c/da2/ldb 0 2023-12-05T13:26:42.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/660: dwrite d6/d64/fdf [0,4194304] 0 2023-12-05T13:26:42.632 INFO:tasks.workunit.client.0.smithi029.stdout:6/661: read d6/d29/dc4/d40/f66 [3524157,107213] 0 2023-12-05T13:26:42.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/628: creat d5/d2f/d3a/d86/da8/fdc x:0 0 0 2023-12-05T13:26:42.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/629: stat d5/d6/d59 0 2023-12-05T13:26:42.638 INFO:tasks.workunit.client.0.smithi029.stdout:8/630: mknod d5/d6/d10/d85/cdd 0 2023-12-05T13:26:42.643 INFO:tasks.workunit.client.0.smithi029.stdout:5/510: dwrite d1/dc/d27/f2e [0,4194304] 0 2023-12-05T13:26:42.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/453: dread d0/f23 [0,4194304] 0 2023-12-05T13:26:42.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/454: truncate d0/de/d30/f4c 529163 0 2023-12-05T13:26:42.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/455: readlink d0/de/d15/l50 0 2023-12-05T13:26:42.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/456: chown d0/f2e 80146692 1 2023-12-05T13:26:42.643 INFO:tasks.workunit.client.0.smithi029.stdout:2/607: dwrite de/d14/f35 [0,4194304] 0 2023-12-05T13:26:42.646 INFO:tasks.workunit.client.0.smithi029.stdout:5/511: creat d1/dc/d38/d55/d57/d98/fb9 x:0 0 0 2023-12-05T13:26:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:8/631: dwrite d5/f82 [0,4194304] 0 2023-12-05T13:26:42.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/512: truncate d1/dc/d25/f5e 512598 0 2023-12-05T13:26:42.660 INFO:tasks.workunit.client.0.smithi029.stdout:8/632: symlink d5/dc/d18/dc8/lde 0 2023-12-05T13:26:42.661 INFO:tasks.workunit.client.0.smithi029.stdout:5/513: creat d1/dc/d38/d3a/d5c/d87/fba x:0 0 0 2023-12-05T13:26:42.662 INFO:tasks.workunit.client.0.smithi029.stdout:6/662: dwrite d6/d29/dc4/d40/f66 [4194304,4194304] 0 2023-12-05T13:26:42.662 INFO:tasks.workunit.client.0.smithi029.stdout:4/457: dwrite d0/da/f1b [0,4194304] 0 2023-12-05T13:26:42.663 INFO:tasks.workunit.client.0.smithi029.stdout:5/514: creat d1/dc/d27/fbb x:0 0 0 2023-12-05T13:26:42.665 INFO:tasks.workunit.client.0.smithi029.stdout:4/458: rmdir d0/d3c/d56 39 2023-12-05T13:26:42.667 INFO:tasks.workunit.client.0.smithi029.stdout:5/515: dread d1/dc/d10/d1e/d33/f6b [0,4194304] 0 2023-12-05T13:26:42.667 INFO:tasks.workunit.client.0.smithi029.stdout:4/459: rename d0/de/d15/l6b to d0/d16/d22/d5f/d79/l95 0 2023-12-05T13:26:42.669 INFO:tasks.workunit.client.0.smithi029.stdout:4/460: unlink d0/de/d30/d32/d35/d3d/f57 0 2023-12-05T13:26:42.669 INFO:tasks.workunit.client.0.smithi029.stdout:8/633: dread d5/d2f/d3a/d86/dc3/fd5 [0,4194304] 0 2023-12-05T13:26:42.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/663: dread d6/f10 [0,4194304] 0 2023-12-05T13:26:42.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/608: dwrite de/d6a/fb3 [0,4194304] 0 2023-12-05T13:26:42.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/664: truncate d6/d1d/d36/f42 709940 0 2023-12-05T13:26:42.674 INFO:tasks.workunit.client.0.smithi029.stdout:6/665: dread - d6/d1d/d39/fd5 zero size 2023-12-05T13:26:42.677 INFO:tasks.workunit.client.0.smithi029.stdout:2/609: mknod de/d11/dad/cc4 0 2023-12-05T13:26:42.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/461: read d0/d16/d2f/d69/f8e [55256,114179] 0 2023-12-05T13:26:42.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/666: dread d6/f4f [0,4194304] 0 2023-12-05T13:26:42.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/462: write d0/da/f73 [561490,79940] 0 2023-12-05T13:26:42.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/463: dread - d0/de/d30/f68 zero size 2023-12-05T13:26:42.691 INFO:tasks.workunit.client.0.smithi029.stdout:6/667: read d6/f54 [557304,4952] 0 2023-12-05T13:26:42.692 INFO:tasks.workunit.client.0.smithi029.stdout:4/464: creat d0/d16/d22/d5f/f96 x:0 0 0 2023-12-05T13:26:42.692 INFO:tasks.workunit.client.0.smithi029.stdout:6/668: getdents d6/d29/dc4/d40/d74/d52/d5c/d6f 0 2023-12-05T13:26:42.692 INFO:tasks.workunit.client.0.smithi029.stdout:5/516: dwrite d1/dc/d25/f92 [0,4194304] 0 2023-12-05T13:26:42.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/669: symlink d6/d64/le7 0 2023-12-05T13:26:42.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/670: chown d6/d3f/f9a 1 1 2023-12-05T13:26:42.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/671: dread - d6/d1d/fc9 zero size 2023-12-05T13:26:42.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/672: dread - d6/d1d/fac zero size 2023-12-05T13:26:42.695 INFO:tasks.workunit.client.0.smithi029.stdout:6/673: symlink d6/d64/d6d/da3/le8 0 2023-12-05T13:26:42.697 INFO:tasks.workunit.client.0.smithi029.stdout:8/634: dwrite d5/dbc/d53/f7e [0,4194304] 0 2023-12-05T13:26:42.697 INFO:tasks.workunit.client.0.smithi029.stdout:4/465: dread d0/de/d15/f4e [4194304,4194304] 0 2023-12-05T13:26:42.699 INFO:tasks.workunit.client.0.smithi029.stdout:4/466: mknod d0/de/d30/d32/d35/c97 0 2023-12-05T13:26:42.700 INFO:tasks.workunit.client.0.smithi029.stdout:4/467: rename d0/d1/d37 to d0/d16/d22/d98 0 2023-12-05T13:26:42.701 INFO:tasks.workunit.client.0.smithi029.stdout:4/468: creat d0/de/d15/f99 x:0 0 0 2023-12-05T13:26:42.702 INFO:tasks.workunit.client.0.smithi029.stdout:4/469: mknod d0/d3c/d56/c9a 0 2023-12-05T13:26:42.703 INFO:tasks.workunit.client.0.smithi029.stdout:6/674: dread d6/f1c [0,4194304] 0 2023-12-05T13:26:42.705 INFO:tasks.workunit.client.0.smithi029.stdout:8/635: write d5/d6/d10/f76 [58894,2489] 0 2023-12-05T13:26:42.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/517: dread d1/dc/d25/f92 [0,4194304] 0 2023-12-05T13:26:42.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/636: creat d5/d6/d10/d13/db7/fdf x:0 0 0 2023-12-05T13:26:42.710 INFO:tasks.workunit.client.0.smithi029.stdout:5/518: rename d1/dc/d11/f7d to d1/dc/d25/d4c/d9b/fbc 0 2023-12-05T13:26:42.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/637: mknod d5/d2f/d3a/d86/dc3/ce0 0 2023-12-05T13:26:42.711 INFO:tasks.workunit.client.0.smithi029.stdout:8/638: chown d5/dbc/d8b 201292 1 2023-12-05T13:26:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:8/639: dread d5/f27 [0,4194304] 0 2023-12-05T13:26:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/675: dread d6/d29/dc4/f99 [0,4194304] 0 2023-12-05T13:26:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/676: write d6/d1d/fc9 [716856,78503] 0 2023-12-05T13:26:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:6/677: fdatasync d6/d64/d6d/da3/dcf/fd6 0 2023-12-05T13:26:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:5/519: symlink d1/dc/d10/d1e/d9c/lbd 0 2023-12-05T13:26:42.713 INFO:tasks.workunit.client.0.smithi029.stdout:8/640: write d5/d2f/d3a/d86/dc3/fd5 [2400653,52334] 0 2023-12-05T13:26:42.714 INFO:tasks.workunit.client.0.smithi029.stdout:8/641: fsync d5/dc/d56/f81 0 2023-12-05T13:26:42.715 INFO:tasks.workunit.client.0.smithi029.stdout:6/678: creat d6/d1d/d39/d58/de2/fe9 x:0 0 0 2023-12-05T13:26:42.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/470: rmdir d0/de/d15 39 2023-12-05T13:26:42.718 INFO:tasks.workunit.client.0.smithi029.stdout:5/520: unlink d1/dc/d25/f92 0 2023-12-05T13:26:42.718 INFO:tasks.workunit.client.0.smithi029.stdout:5/521: fsync d1/dc/d25/f5e 0 2023-12-05T13:26:42.718 INFO:tasks.workunit.client.0.smithi029.stdout:5/522: chown d1/dc/l84 5 1 2023-12-05T13:26:42.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/679: rmdir d6/d64 39 2023-12-05T13:26:42.719 INFO:tasks.workunit.client.0.smithi029.stdout:6/680: fdatasync d6/d1d/d36/f4c 0 2023-12-05T13:26:42.719 INFO:tasks.workunit.client.0.smithi029.stdout:4/471: getdents d0/de/d30/d32/d35 0 2023-12-05T13:26:42.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/472: write d0/d16/d22/d5f/f91 [858058,99971] 0 2023-12-05T13:26:42.720 INFO:tasks.workunit.client.0.smithi029.stdout:4/473: read - d0/d16/d2f/f76 zero size 2023-12-05T13:26:42.720 INFO:tasks.workunit.client.0.smithi029.stdout:6/681: write d6/fa [107428,37976] 0 2023-12-05T13:26:42.722 INFO:tasks.workunit.client.0.smithi029.stdout:8/642: rename d5/dbc/c36 to d5/ce1 0 2023-12-05T13:26:42.722 INFO:tasks.workunit.client.0.smithi029.stdout:8/643: dread - d5/d2f/d75/f71 zero size 2023-12-05T13:26:42.722 INFO:tasks.workunit.client.0.smithi029.stdout:6/682: creat d6/d3f/fea x:0 0 0 2023-12-05T13:26:42.723 INFO:tasks.workunit.client.0.smithi029.stdout:8/644: mknod d5/d2f/d3a/d86/ce2 0 2023-12-05T13:26:42.723 INFO:tasks.workunit.client.0.smithi029.stdout:8/645: write d5/d2f/d3a/d3c/da2/fbe [707566,105166] 0 2023-12-05T13:26:42.724 INFO:tasks.workunit.client.0.smithi029.stdout:6/683: getdents d6/d29/dc4/d40/d74/d59 0 2023-12-05T13:26:42.724 INFO:tasks.workunit.client.0.smithi029.stdout:6/684: truncate d6/d29/dc4/d40/d74/d59/faa 1163135 0 2023-12-05T13:26:42.726 INFO:tasks.workunit.client.0.smithi029.stdout:6/685: creat d6/d29/da4/feb x:0 0 0 2023-12-05T13:26:42.732 INFO:tasks.workunit.client.0.smithi029.stdout:8/646: dread d5/d2f/d3a/d86/dc3/fd5 [0,4194304] 0 2023-12-05T13:26:42.736 INFO:tasks.workunit.client.0.smithi029.stdout:4/474: dwrite d0/f23 [0,4194304] 0 2023-12-05T13:26:42.738 INFO:tasks.workunit.client.0.smithi029.stdout:4/475: creat d0/d16/d22/d5f/d79/f9b x:0 0 0 2023-12-05T13:26:42.740 INFO:tasks.workunit.client.0.smithi029.stdout:4/476: link d0/de/d15/l90 d0/d16/d22/d4f/l9c 0 2023-12-05T13:26:42.742 INFO:tasks.workunit.client.0.smithi029.stdout:4/477: truncate d0/d16/d22/d4f/f6d 2400675 0 2023-12-05T13:26:42.742 INFO:tasks.workunit.client.0.smithi029.stdout:4/478: write d0/d16/d22/d5f/f96 [659301,51520] 0 2023-12-05T13:26:42.743 INFO:tasks.workunit.client.0.smithi029.stdout:5/523: dread d1/dc/d25/f5e [0,4194304] 0 2023-12-05T13:26:42.743 INFO:tasks.workunit.client.0.smithi029.stdout:5/524: chown d1/dc/l84 4799714 1 2023-12-05T13:26:42.743 INFO:tasks.workunit.client.0.smithi029.stdout:4/479: getdents d0/de/d15 0 2023-12-05T13:26:42.744 INFO:tasks.workunit.client.0.smithi029.stdout:5/525: creat d1/dc/d11/fbe x:0 0 0 2023-12-05T13:26:42.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/526: stat d1/dc/d10/d1e/d75/d7f/c8b 0 2023-12-05T13:26:42.746 INFO:tasks.workunit.client.0.smithi029.stdout:4/480: rename d0/da/f39 to d0/d41/f9d 0 2023-12-05T13:26:42.746 INFO:tasks.workunit.client.0.smithi029.stdout:5/527: symlink d1/lbf 0 2023-12-05T13:26:42.748 INFO:tasks.workunit.client.0.smithi029.stdout:4/481: rename d0/d16/d22/d5f/d79/f9b to d0/d16/d22/f9e 0 2023-12-05T13:26:42.748 INFO:tasks.workunit.client.0.smithi029.stdout:6/686: dwrite d6/d29/dc4/d40/fd2 [0,4194304] 0 2023-12-05T13:26:42.748 INFO:tasks.workunit.client.0.smithi029.stdout:6/687: write d6/f54 [1408471,92265] 0 2023-12-05T13:26:42.749 INFO:tasks.workunit.client.0.smithi029.stdout:6/688: truncate d6/d29/fa0 1084803 0 2023-12-05T13:26:42.749 INFO:tasks.workunit.client.0.smithi029.stdout:8/647: dwrite d5/d6/f9 [0,4194304] 0 2023-12-05T13:26:42.749 INFO:tasks.workunit.client.0.smithi029.stdout:4/482: write d0/da/f1b [2720388,7094] 0 2023-12-05T13:26:42.750 INFO:tasks.workunit.client.0.smithi029.stdout:5/528: unlink d1/dc/d10/d1e/d33/l4a 0 2023-12-05T13:26:42.755 INFO:tasks.workunit.client.0.smithi029.stdout:6/689: creat d6/d5a/fec x:0 0 0 2023-12-05T13:26:42.757 INFO:tasks.workunit.client.0.smithi029.stdout:8/648: mknod d5/d2f/d75/ce3 0 2023-12-05T13:26:42.758 INFO:tasks.workunit.client.0.smithi029.stdout:8/649: write d5/d6/f4b [1664325,37982] 0 2023-12-05T13:26:42.758 INFO:tasks.workunit.client.0.smithi029.stdout:4/483: mknod d0/de/c9f 0 2023-12-05T13:26:42.759 INFO:tasks.workunit.client.0.smithi029.stdout:4/484: write d0/de/d15/f64 [439670,94506] 0 2023-12-05T13:26:42.760 INFO:tasks.workunit.client.0.smithi029.stdout:6/690: fsync d6/fa 0 2023-12-05T13:26:42.760 INFO:tasks.workunit.client.0.smithi029.stdout:6/691: read d6/d1d/f55 [289164,75181] 0 2023-12-05T13:26:42.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/650: mknod d5/d6/d10/d13/ce4 0 2023-12-05T13:26:42.762 INFO:tasks.workunit.client.0.smithi029.stdout:8/651: truncate d5/d6/fa3 1391867 0 2023-12-05T13:26:42.763 INFO:tasks.workunit.client.0.smithi029.stdout:4/485: write d0/d16/d22/d4f/f5c [905942,77291] 0 2023-12-05T13:26:42.765 INFO:tasks.workunit.client.0.smithi029.stdout:6/692: mknod d6/d64/ced 0 2023-12-05T13:26:42.765 INFO:tasks.workunit.client.0.smithi029.stdout:6/693: read d6/f4f [375468,70357] 0 2023-12-05T13:26:42.767 INFO:tasks.workunit.client.0.smithi029.stdout:8/652: rename d5/d2f/d3a/d86/l99 to d5/d6/d10/d8a/le5 0 2023-12-05T13:26:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:8/653: read d5/d2f/d3a/d86/fab [1566168,60615] 0 2023-12-05T13:26:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:5/529: dwrite d1/dc/d38/d3a/d5c/d87/f91 [0,4194304] 0 2023-12-05T13:26:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:8/654: write d5/f82 [4964489,57582] 0 2023-12-05T13:26:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:8/655: stat d5/d2f/d75/ce3 0 2023-12-05T13:26:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/486: rmdir d0/d16/d22 39 2023-12-05T13:26:42.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/487: chown d0/f2e 66 1 2023-12-05T13:26:42.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/694: creat d6/d29/dc4/d40/d4d/d8f/fee x:0 0 0 2023-12-05T13:26:42.775 INFO:tasks.workunit.client.0.smithi029.stdout:8/656: link d5/d6/d10/d8a/f8e d5/d6/d10/d85/daa/fe6 0 2023-12-05T13:26:42.775 INFO:tasks.workunit.client.0.smithi029.stdout:8/657: chown d5/fb3 671 1 2023-12-05T13:26:42.775 INFO:tasks.workunit.client.0.smithi029.stdout:8/658: fsync d5/d2f/d3a/d3c/da2/fbe 0 2023-12-05T13:26:42.776 INFO:tasks.workunit.client.0.smithi029.stdout:8/659: chown d5/d6/d59/fba 1910010 1 2023-12-05T13:26:42.776 INFO:tasks.workunit.client.0.smithi029.stdout:8/660: chown d5/dc/l23 164174 1 2023-12-05T13:26:42.777 INFO:tasks.workunit.client.0.smithi029.stdout:4/488: link d0/da/c12 d0/d16/d22/d5f/d79/ca0 0 2023-12-05T13:26:42.777 INFO:tasks.workunit.client.0.smithi029.stdout:4/489: chown d0/d16/d22/d5f/d79 6 1 2023-12-05T13:26:42.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/661: creat d5/dc/d56/fe7 x:0 0 0 2023-12-05T13:26:42.788 INFO:tasks.workunit.client.0.smithi029.stdout:8/662: chown d5/dc/d56 5952204 1 2023-12-05T13:26:42.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/490: dwrite d0/d16/d22/d4f/f71 [0,4194304] 0 2023-12-05T13:26:42.797 INFO:tasks.workunit.client.0.smithi029.stdout:4/491: mkdir d0/d1/da1 0 2023-12-05T13:26:42.798 INFO:tasks.workunit.client.0.smithi029.stdout:4/492: symlink d0/d16/d22/d5f/la2 0 2023-12-05T13:26:42.798 INFO:tasks.workunit.client.0.smithi029.stdout:4/493: fsync d0/de/d15/f4e 0 2023-12-05T13:26:42.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/494: creat d0/d16/d2f/d69/d77/fa3 x:0 0 0 2023-12-05T13:26:42.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/495: chown d0/d3c/d56/l6a 28 1 2023-12-05T13:26:42.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/496: chown d0/d3c/c8c 185 1 2023-12-05T13:26:42.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/497: mkdir d0/de/d30/d94/da4 0 2023-12-05T13:26:42.802 INFO:tasks.workunit.client.0.smithi029.stdout:4/498: write d0/da/f20 [197477,37057] 0 2023-12-05T13:26:42.804 INFO:tasks.workunit.client.0.smithi029.stdout:8/663: dwrite d5/d6/d59/f72 [0,4194304] 0 2023-12-05T13:26:42.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/499: dread d0/d16/d22/d5f/f91 [0,4194304] 0 2023-12-05T13:26:42.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/500: readlink d0/d3c/d56/l6a 0 2023-12-05T13:26:42.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/501: stat d0/da/f18 0 2023-12-05T13:26:42.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/502: readlink d0/d16/d22/d5f/la2 0 2023-12-05T13:26:42.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/503: read d0/da/f18 [138576,98035] 0 2023-12-05T13:26:42.806 INFO:tasks.workunit.client.0.smithi029.stdout:8/664: getdents d5/d6/d10/d13/db7/dc2 0 2023-12-05T13:26:42.807 INFO:tasks.workunit.client.0.smithi029.stdout:4/504: creat d0/de/d30/d32/fa5 x:0 0 0 2023-12-05T13:26:42.808 INFO:tasks.workunit.client.0.smithi029.stdout:4/505: mkdir d0/de/d30/d32/d35/d3d/d92/da6 0 2023-12-05T13:26:42.808 INFO:tasks.workunit.client.0.smithi029.stdout:4/506: truncate d0/d16/d2f/f76 600828 0 2023-12-05T13:26:42.808 INFO:tasks.workunit.client.0.smithi029.stdout:4/507: dread - d0/d16/d22/d5f/f89 zero size 2023-12-05T13:26:42.810 INFO:tasks.workunit.client.0.smithi029.stdout:4/508: mknod d0/d16/d2f/d69/ca7 0 2023-12-05T13:26:42.810 INFO:tasks.workunit.client.0.smithi029.stdout:4/509: fsync d0/de/d30/d32/d35/f47 0 2023-12-05T13:26:42.813 INFO:tasks.workunit.client.0.smithi029.stdout:8/665: dread d5/d2f/f68 [0,4194304] 0 2023-12-05T13:26:42.814 INFO:tasks.workunit.client.0.smithi029.stdout:4/510: rename d0/d16/d2f/l5e to d0/d1/la8 0 2023-12-05T13:26:42.815 INFO:tasks.workunit.client.0.smithi029.stdout:8/666: creat d5/dc/d18/d26/dc0/fe8 x:0 0 0 2023-12-05T13:26:42.816 INFO:tasks.workunit.client.0.smithi029.stdout:4/511: truncate d0/d41/f53 5834386 0 2023-12-05T13:26:42.817 INFO:tasks.workunit.client.0.smithi029.stdout:4/512: creat d0/d16/d2f/fa9 x:0 0 0 2023-12-05T13:26:42.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/667: dread d5/fe [0,4194304] 0 2023-12-05T13:26:42.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/668: read d5/d6/d10/f76 [22022,49839] 0 2023-12-05T13:26:42.821 INFO:tasks.workunit.client.0.smithi029.stdout:4/513: dread d0/d16/f4a [0,4194304] 0 2023-12-05T13:26:42.821 INFO:tasks.workunit.client.0.smithi029.stdout:4/514: readlink d0/d1/l9 0 2023-12-05T13:26:42.821 INFO:tasks.workunit.client.0.smithi029.stdout:8/669: rmdir d5/d2f/d3a/d86/dc3 39 2023-12-05T13:26:42.821 INFO:tasks.workunit.client.0.smithi029.stdout:8/670: fsync d5/d2f/d3a/d3c/da2/fb9 0 2023-12-05T13:26:42.822 INFO:tasks.workunit.client.0.smithi029.stdout:8/671: chown d5/d2f/d3a/d86/f95 33 1 2023-12-05T13:26:42.822 INFO:tasks.workunit.client.0.smithi029.stdout:8/672: write d5/d2f/d3a/d86/dc3/fd5 [3947506,92465] 0 2023-12-05T13:26:42.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/673: creat d5/d6/d10/d8a/db6/fe9 x:0 0 0 2023-12-05T13:26:42.825 INFO:tasks.workunit.client.0.smithi029.stdout:8/674: unlink d5/dc/l9e 0 2023-12-05T13:26:42.826 INFO:tasks.workunit.client.0.smithi029.stdout:8/675: rmdir d5/dc/d56 39 2023-12-05T13:26:42.829 INFO:tasks.workunit.client.0.smithi029.stdout:8/676: creat d5/d2f/fea x:0 0 0 2023-12-05T13:26:42.831 INFO:tasks.workunit.client.0.smithi029.stdout:8/677: mkdir d5/d2f/d3a/d3c/deb 0 2023-12-05T13:26:42.838 INFO:tasks.workunit.client.0.smithi029.stdout:4/515: dwrite d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:42.841 INFO:tasks.workunit.client.0.smithi029.stdout:4/516: unlink d0/de/d15/d2b/f8d 0 2023-12-05T13:26:42.841 INFO:tasks.workunit.client.0.smithi029.stdout:4/517: chown d0/d16 102125 1 2023-12-05T13:26:42.842 INFO:tasks.workunit.client.0.smithi029.stdout:4/518: symlink d0/de/d30/laa 0 2023-12-05T13:26:42.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/519: truncate d0/f2e 359724 0 2023-12-05T13:26:42.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/520: chown d0/d16 10305538 1 2023-12-05T13:26:42.844 INFO:tasks.workunit.client.0.smithi029.stdout:4/521: link d0/de/d15/l50 d0/d41/lab 0 2023-12-05T13:26:42.846 INFO:tasks.workunit.client.0.smithi029.stdout:4/522: write d0/de/d15/f49 [1801223,4247] 0 2023-12-05T13:26:42.849 INFO:tasks.workunit.client.0.smithi029.stdout:8/678: dwrite d5/d6/d10/d13/db7/fb8 [4194304,4194304] 0 2023-12-05T13:26:42.851 INFO:tasks.workunit.client.0.smithi029.stdout:8/679: symlink d5/d6/d10/d13/db7/lec 0 2023-12-05T13:26:42.852 INFO:tasks.workunit.client.0.smithi029.stdout:8/680: link d5/d2f/fac d5/d2f/d3a/fed 0 2023-12-05T13:26:42.854 INFO:tasks.workunit.client.0.smithi029.stdout:8/681: write d5/d2f/d75/fa4 [2740968,13338] 0 2023-12-05T13:26:42.859 INFO:tasks.workunit.client.0.smithi029.stdout:8/682: dread d5/d2f/d3a/d86/dc3/fd5 [0,4194304] 0 2023-12-05T13:26:42.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/683: mknod d5/d2f/d3a/cee 0 2023-12-05T13:26:42.860 INFO:tasks.workunit.client.0.smithi029.stdout:8/684: chown d5/dc/l23 9979895 1 2023-12-05T13:26:42.861 INFO:tasks.workunit.client.0.smithi029.stdout:8/685: getdents d5/d2f/d3a/d3c/da2 0 2023-12-05T13:26:42.861 INFO:tasks.workunit.client.0.smithi029.stdout:8/686: dread - d5/d6/d10/d13/db7/fdf zero size 2023-12-05T13:26:42.863 INFO:tasks.workunit.client.0.smithi029.stdout:8/687: unlink d5/dbc/d53/f62 0 2023-12-05T13:26:42.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/688: dwrite d5/d2f/d3a/d86/da8/fdc [0,4194304] 0 2023-12-05T13:26:42.893 INFO:tasks.workunit.client.0.smithi029.stdout:8/689: dwrite d5/f98 [0,4194304] 0 2023-12-05T13:26:42.894 INFO:tasks.workunit.client.0.smithi029.stdout:8/690: truncate d5/d2f/d3a/d3c/da2/fb9 917663 0 2023-12-05T13:26:42.907 INFO:tasks.workunit.client.0.smithi029.stdout:8/691: dwrite d5/f27 [0,4194304] 0 2023-12-05T13:26:42.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/692: truncate d5/d2f/f68 1836091 0 2023-12-05T13:26:42.909 INFO:tasks.workunit.client.0.smithi029.stdout:8/693: fsync d5/d2f/d3a/d3c/da2/fb5 0 2023-12-05T13:26:42.910 INFO:tasks.workunit.client.0.smithi029.stdout:8/694: mknod d5/dbc/d53/cef 0 2023-12-05T13:26:42.910 INFO:tasks.workunit.client.0.smithi029.stdout:8/695: fsync d5/d6/d59/fba 0 2023-12-05T13:26:42.911 INFO:tasks.workunit.client.0.smithi029.stdout:8/696: truncate d5/d6/d59/fba 2035833 0 2023-12-05T13:26:42.911 INFO:tasks.workunit.client.0.smithi029.stdout:8/697: chown d5/d2f/d3a/d86/ce2 4866141 1 2023-12-05T13:26:42.911 INFO:tasks.workunit.client.0.smithi029.stdout:8/698: fsync d5/d2f/d75/f84 0 2023-12-05T13:26:42.930 INFO:tasks.workunit.client.0.smithi029.stdout:8/699: dwrite d5/dc/d18/d26/f94 [0,4194304] 0 2023-12-05T13:26:42.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/700: creat d5/d6/d10/d13/ff0 x:0 0 0 2023-12-05T13:26:42.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/701: chown d5/dc/c31 5 1 2023-12-05T13:26:42.932 INFO:tasks.workunit.client.0.smithi029.stdout:8/702: dread - d5/d6/d10/d8a/db6/fe9 zero size 2023-12-05T13:26:42.933 INFO:tasks.workunit.client.0.smithi029.stdout:8/703: symlink d5/dbc/d1d/lf1 0 2023-12-05T13:26:42.934 INFO:tasks.workunit.client.0.smithi029.stdout:8/704: rmdir d5/d6/d59 39 2023-12-05T13:26:42.936 INFO:tasks.workunit.client.0.smithi029.stdout:8/705: rename d5/d2f/d3a/f48 to d5/d6/d59/ff2 0 2023-12-05T13:26:42.938 INFO:tasks.workunit.client.0.smithi029.stdout:8/706: link d5/d2f/d3a/d3c/da2/cb2 d5/cf3 0 2023-12-05T13:26:42.939 INFO:tasks.workunit.client.0.smithi029.stdout:8/707: mknod d5/d6/d59/cf4 0 2023-12-05T13:26:42.956 INFO:tasks.workunit.client.0.smithi029.stdout:8/708: dwrite d5/d6/d59/f6f [0,4194304] 0 2023-12-05T13:26:43.466 INFO:tasks.workunit.client.0.smithi029.stdout:1/619: sync 2023-12-05T13:26:43.467 INFO:tasks.workunit.client.0.smithi029.stdout:1/620: write d7/d5e/f28 [2003886,73482] 0 2023-12-05T13:26:43.470 INFO:tasks.workunit.client.0.smithi029.stdout:1/621: link d7/d5e/d52/d5f/d12/f76 d7/d61/d77/d9f/db4/fd2 0 2023-12-05T13:26:43.485 INFO:tasks.workunit.client.0.smithi029.stdout:1/622: dwrite d7/d6e/da9/f51 [0,4194304] 0 2023-12-05T13:26:43.486 INFO:tasks.workunit.client.0.smithi029.stdout:1/623: symlink d7/d61/d4f/ld3 0 2023-12-05T13:26:43.488 INFO:tasks.workunit.client.0.smithi029.stdout:1/624: symlink d7/d6e/da9/d4b/d72/ld4 0 2023-12-05T13:26:43.488 INFO:tasks.workunit.client.0.smithi029.stdout:1/625: chown d7/d6e/f8d 121 1 2023-12-05T13:26:43.489 INFO:tasks.workunit.client.0.smithi029.stdout:1/626: read d7/d5e/f28 [2331754,119914] 0 2023-12-05T13:26:43.491 INFO:tasks.workunit.client.0.smithi029.stdout:1/627: creat d7/d56/fd5 x:0 0 0 2023-12-05T13:26:43.492 INFO:tasks.workunit.client.0.smithi029.stdout:1/628: mkdir d7/d5e/d52/d90/dd6 0 2023-12-05T13:26:43.492 INFO:tasks.workunit.client.0.smithi029.stdout:1/629: chown d7/d5e/d52/d90/f96 290632 1 2023-12-05T13:26:43.492 INFO:tasks.workunit.client.0.smithi029.stdout:1/630: fdatasync d7/fd 0 2023-12-05T13:26:43.492 INFO:tasks.workunit.client.0.smithi029.stdout:1/631: getdents d7/d5b/dc3 0 2023-12-05T13:26:43.493 INFO:tasks.workunit.client.0.smithi029.stdout:1/632: creat d7/d5e/d52/d90/fd7 x:0 0 0 2023-12-05T13:26:43.493 INFO:tasks.workunit.client.0.smithi029.stdout:1/633: truncate d7/d5e/d52/d5f/d48/f98 901296 0 2023-12-05T13:26:43.510 INFO:tasks.workunit.client.0.smithi029.stdout:1/634: dwrite d7/d6e/da9/d4b/db1/fc4 [0,4194304] 0 2023-12-05T13:26:43.603 INFO:tasks.workunit.client.0.smithi029.stdout:2/610: sync 2023-12-05T13:26:43.603 INFO:tasks.workunit.client.0.smithi029.stdout:5/530: sync 2023-12-05T13:26:43.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/523: sync 2023-12-05T13:26:43.603 INFO:tasks.workunit.client.0.smithi029.stdout:7/723: sync 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/566: sync 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:6/695: sync 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:2/611: truncate de/d11/f9f 786169 0 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:8/709: sync 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/524: fsync d0/d16/d2f/d69/f8e 0 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/567: chown dc/d23/d3a/d41/d57/d58/d73/c8a 0 1 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:9/461: sync 2023-12-05T13:26:43.604 INFO:tasks.workunit.client.0.smithi029.stdout:3/618: sync 2023-12-05T13:26:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/696: mkdir d6/d3f/db7/def 0 2023-12-05T13:26:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/697: dread - d6/d29/da4/feb zero size 2023-12-05T13:26:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:0/568: write dc/d23/d3a/d41/d57/f59 [2867494,130811] 0 2023-12-05T13:26:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:6/698: dread - d6/d64/d6d/d85/fc8 zero size 2023-12-05T13:26:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:0/569: chown dc/d23/d3a/d41/d57/l75 2 1 2023-12-05T13:26:43.605 INFO:tasks.workunit.client.0.smithi029.stdout:8/710: write d5/dc/f90 [3741911,6679] 0 2023-12-05T13:26:43.606 INFO:tasks.workunit.client.0.smithi029.stdout:2/612: rename de/d41/d56/da9 to de/d14/d24/d93/dc5 0 2023-12-05T13:26:43.606 INFO:tasks.workunit.client.0.smithi029.stdout:2/613: fsync de/d14/d24/f40 0 2023-12-05T13:26:43.606 INFO:tasks.workunit.client.0.smithi029.stdout:4/525: symlink d0/de/d30/d94/lac 0 2023-12-05T13:26:43.617 INFO:tasks.workunit.client.0.smithi029.stdout:5/531: dwrite d1/dc/d11/d17/f9f [0,4194304] 0 2023-12-05T13:26:43.718 INFO:tasks.workunit.client.0.smithi029.stdout:7/724: mkdir d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/de0 0 2023-12-05T13:26:43.719 INFO:tasks.workunit.client.0.smithi029.stdout:7/725: fsync d6/d50/f41 0 2023-12-05T13:26:43.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/462: chown d7/d19/d28/d65/d73/l93 0 1 2023-12-05T13:26:43.721 INFO:tasks.workunit.client.0.smithi029.stdout:3/619: symlink d1/d6/d11/da3/lc3 0 2023-12-05T13:26:43.723 INFO:tasks.workunit.client.0.smithi029.stdout:3/620: write d1/d18/f2e [280789,101593] 0 2023-12-05T13:26:43.724 INFO:tasks.workunit.client.0.smithi029.stdout:5/532: dwrite d1/f20 [4194304,4194304] 0 2023-12-05T13:26:43.725 INFO:tasks.workunit.client.0.smithi029.stdout:6/699: truncate d6/d1d/d36/f7d 3113010 0 2023-12-05T13:26:43.727 INFO:tasks.workunit.client.0.smithi029.stdout:8/711: rmdir d5/d6/d59 39 2023-12-05T13:26:43.730 INFO:tasks.workunit.client.0.smithi029.stdout:0/570: rename dc/d13/d4f/d88/fac to dc/d33/d3d/d7a/d84/d8d/fb0 0 2023-12-05T13:26:43.733 INFO:tasks.workunit.client.0.smithi029.stdout:2/614: rmdir de/d16/d6c/d90/dc2 0 2023-12-05T13:26:43.735 INFO:tasks.workunit.client.0.smithi029.stdout:4/526: symlink d0/d41/lad 0 2023-12-05T13:26:43.735 INFO:tasks.workunit.client.0.smithi029.stdout:4/527: chown d0/d16/d22/d5f 207629 1 2023-12-05T13:26:43.737 INFO:tasks.workunit.client.0.smithi029.stdout:3/621: dread d1/d6/d4a/f97 [0,4194304] 0 2023-12-05T13:26:43.738 INFO:tasks.workunit.client.0.smithi029.stdout:7/726: dwrite d6/d2a/d4f/dc5/fce [0,4194304] 0 2023-12-05T13:26:43.740 INFO:tasks.workunit.client.0.smithi029.stdout:5/533: symlink d1/dc/d25/d4c/d61/lc0 0 2023-12-05T13:26:43.743 INFO:tasks.workunit.client.0.smithi029.stdout:2/615: dread de/d16/f2c [0,4194304] 0 2023-12-05T13:26:43.746 INFO:tasks.workunit.client.0.smithi029.stdout:9/463: rename d7/d19/d30/d43/d67 to d7/d19/d30/d99 0 2023-12-05T13:26:43.746 INFO:tasks.workunit.client.0.smithi029.stdout:8/712: dwrite d5/dc/d18/d26/fb0 [0,4194304] 0 2023-12-05T13:26:43.747 INFO:tasks.workunit.client.0.smithi029.stdout:9/464: write d7/d19/d1f/f21 [2827888,48184] 0 2023-12-05T13:26:43.749 INFO:tasks.workunit.client.0.smithi029.stdout:0/571: mkdir dc/d33/d3d/d7a/d84/db1 0 2023-12-05T13:26:43.749 INFO:tasks.workunit.client.0.smithi029.stdout:0/572: chown dc/d23/f6f 99173 1 2023-12-05T13:26:43.753 INFO:tasks.workunit.client.0.smithi029.stdout:4/528: link d0/de/d30/c5b d0/d41/cae 0 2023-12-05T13:26:43.757 INFO:tasks.workunit.client.0.smithi029.stdout:7/727: creat d6/d50/d5b/d5f/d7d/d96/fe1 x:0 0 0 2023-12-05T13:26:43.758 INFO:tasks.workunit.client.0.smithi029.stdout:5/534: truncate d1/dc/d11/f12 1086810 0 2023-12-05T13:26:43.761 INFO:tasks.workunit.client.0.smithi029.stdout:2/616: mknod de/d11/d32/dbc/cc6 0 2023-12-05T13:26:43.765 INFO:tasks.workunit.client.0.smithi029.stdout:8/713: creat d5/dc/d56/ff5 x:0 0 0 2023-12-05T13:26:43.765 INFO:tasks.workunit.client.0.smithi029.stdout:8/714: fdatasync d5/d2f/d3a/fed 0 2023-12-05T13:26:43.765 INFO:tasks.workunit.client.0.smithi029.stdout:8/715: write d5/dc/d18/d26/f9f [1044673,31209] 0 2023-12-05T13:26:43.765 INFO:tasks.workunit.client.0.smithi029.stdout:9/465: chown d7/d2c/d3a/d64 1489318 1 2023-12-05T13:26:43.766 INFO:tasks.workunit.client.0.smithi029.stdout:9/466: write d7/d19/d30/d40/f7e [24437,3132] 0 2023-12-05T13:26:43.767 INFO:tasks.workunit.client.0.smithi029.stdout:0/573: symlink dc/d23/d3a/d41/d57/d58/lb2 0 2023-12-05T13:26:43.767 INFO:tasks.workunit.client.0.smithi029.stdout:0/574: chown dc/d13/f34 1935 1 2023-12-05T13:26:43.767 INFO:tasks.workunit.client.0.smithi029.stdout:0/575: readlink dc/d13/d4f/d63/l96 0 2023-12-05T13:26:43.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/529: mknod d0/d16/d22/d98/caf 0 2023-12-05T13:26:43.773 INFO:tasks.workunit.client.0.smithi029.stdout:7/728: dwrite d6/d50/d5b/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:43.774 INFO:tasks.workunit.client.0.smithi029.stdout:7/729: write d6/d2a/d4f/dc5/f45 [1119478,45717] 0 2023-12-05T13:26:43.774 INFO:tasks.workunit.client.0.smithi029.stdout:7/730: fsync d6/d50/d5b/d1a/d26/f59 0 2023-12-05T13:26:43.776 INFO:tasks.workunit.client.0.smithi029.stdout:5/535: mknod d1/dc/cc1 0 2023-12-05T13:26:43.776 INFO:tasks.workunit.client.0.smithi029.stdout:5/536: fsync d1/dc/d38/d3a/d5c/d87/fba 0 2023-12-05T13:26:43.783 INFO:tasks.workunit.client.0.smithi029.stdout:2/617: mknod de/d14/d24/cc7 0 2023-12-05T13:26:43.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/716: symlink d5/d2f/d3a/lf6 0 2023-12-05T13:26:43.783 INFO:tasks.workunit.client.0.smithi029.stdout:8/717: chown d5/d2f/l30 320 1 2023-12-05T13:26:43.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/576: mknod dc/d33/d3d/cb3 0 2023-12-05T13:26:43.784 INFO:tasks.workunit.client.0.smithi029.stdout:5/537: dread d1/dc/d25/d4c/d9b/d9a/f88 [0,4194304] 0 2023-12-05T13:26:43.784 INFO:tasks.workunit.client.0.smithi029.stdout:5/538: dread - d1/dc/d25/d4c/d61/f90 zero size 2023-12-05T13:26:43.784 INFO:tasks.workunit.client.0.smithi029.stdout:5/539: dread - d1/dc/d11/d17/d3d/f58 zero size 2023-12-05T13:26:43.784 INFO:tasks.workunit.client.0.smithi029.stdout:4/530: link d0/de/d30/c7a d0/de/d15/cb0 0 2023-12-05T13:26:43.789 INFO:tasks.workunit.client.0.smithi029.stdout:7/731: mkdir d6/d2a/d7e/d7b/de2 0 2023-12-05T13:26:43.789 INFO:tasks.workunit.client.0.smithi029.stdout:7/732: stat d6/d2a/d71/l5d 0 2023-12-05T13:26:43.789 INFO:tasks.workunit.client.0.smithi029.stdout:7/733: readlink d6/d50/d5b/d5f/d7d/d97/d4a/laf 0 2023-12-05T13:26:43.791 INFO:tasks.workunit.client.0.smithi029.stdout:2/618: getdents de/d11/dad 0 2023-12-05T13:26:43.792 INFO:tasks.workunit.client.0.smithi029.stdout:8/718: dread d5/dbc/f4e [0,4194304] 0 2023-12-05T13:26:43.792 INFO:tasks.workunit.client.0.smithi029.stdout:8/719: dread - d5/dbc/d1d/fd0 zero size 2023-12-05T13:26:43.792 INFO:tasks.workunit.client.0.smithi029.stdout:8/720: fdatasync d5/d6/d10/d8a/db6/fe9 0 2023-12-05T13:26:43.792 INFO:tasks.workunit.client.0.smithi029.stdout:9/467: mknod d7/d2c/d68/c9a 0 2023-12-05T13:26:43.793 INFO:tasks.workunit.client.0.smithi029.stdout:0/577: rmdir dc/d23/d3a/d41/d70 39 2023-12-05T13:26:43.794 INFO:tasks.workunit.client.0.smithi029.stdout:5/540: creat d1/dc/d10/d1e/d75/d7f/d8a/fc2 x:0 0 0 2023-12-05T13:26:43.795 INFO:tasks.workunit.client.0.smithi029.stdout:7/734: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/fe3 x:0 0 0 2023-12-05T13:26:43.796 INFO:tasks.workunit.client.0.smithi029.stdout:2/619: creat de/d16/fc8 x:0 0 0 2023-12-05T13:26:43.798 INFO:tasks.workunit.client.0.smithi029.stdout:8/721: mknod d5/d2f/d3a/d86/da8/cf7 0 2023-12-05T13:26:43.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/620: write de/d16/f47 [2730577,50556] 0 2023-12-05T13:26:43.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/621: chown de/f27 23308 1 2023-12-05T13:26:43.798 INFO:tasks.workunit.client.0.smithi029.stdout:2/622: write de/d16/f31 [2183754,71002] 0 2023-12-05T13:26:43.798 INFO:tasks.workunit.client.0.smithi029.stdout:9/468: chown c5 1338 1 2023-12-05T13:26:43.800 INFO:tasks.workunit.client.0.smithi029.stdout:0/578: rename dc/d23/f2b to dc/d33/d3d/d7a/fb4 0 2023-12-05T13:26:43.801 INFO:tasks.workunit.client.0.smithi029.stdout:5/541: truncate d1/f60 2489907 0 2023-12-05T13:26:43.802 INFO:tasks.workunit.client.0.smithi029.stdout:8/722: creat d5/dc/d56/ff8 x:0 0 0 2023-12-05T13:26:43.802 INFO:tasks.workunit.client.0.smithi029.stdout:2/623: rmdir de/d11/d32 39 2023-12-05T13:26:43.804 INFO:tasks.workunit.client.0.smithi029.stdout:9/469: rename d7/f72 to d7/d19/f9b 0 2023-12-05T13:26:43.804 INFO:tasks.workunit.client.0.smithi029.stdout:0/579: symlink dc/d13/d4f/d91/lb5 0 2023-12-05T13:26:43.805 INFO:tasks.workunit.client.0.smithi029.stdout:7/735: dread d6/d50/d5b/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:43.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/531: dwrite d0/d16/f4a [0,4194304] 0 2023-12-05T13:26:43.805 INFO:tasks.workunit.client.0.smithi029.stdout:4/532: write d0/de/d30/d32/fa5 [98270,22413] 0 2023-12-05T13:26:43.807 INFO:tasks.workunit.client.0.smithi029.stdout:8/723: creat d5/d2f/d3a/d3c/deb/ff9 x:0 0 0 2023-12-05T13:26:43.807 INFO:tasks.workunit.client.0.smithi029.stdout:8/724: fdatasync d5/dbc/d1d/fca 0 2023-12-05T13:26:43.807 INFO:tasks.workunit.client.0.smithi029.stdout:9/470: dread d7/d19/d28/d65/f69 [0,4194304] 0 2023-12-05T13:26:43.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/580: mknod dc/d13/d4f/d83/cb6 0 2023-12-05T13:26:43.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/581: truncate dc/d13/d4f/d88/f99 607805 0 2023-12-05T13:26:43.811 INFO:tasks.workunit.client.0.smithi029.stdout:7/736: link d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d6a/ld1 d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/dd3/le4 0 2023-12-05T13:26:43.811 INFO:tasks.workunit.client.0.smithi029.stdout:7/737: chown d6/d50/d5b/d1a/fc4 184264 1 2023-12-05T13:26:43.811 INFO:tasks.workunit.client.0.smithi029.stdout:7/738: fsync d6/f13 0 2023-12-05T13:26:43.813 INFO:tasks.workunit.client.0.smithi029.stdout:5/542: dread d1/dc/d38/d3a/d5c/d87/f91 [0,4194304] 0 2023-12-05T13:26:43.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/543: chown d1/dc/d25/d4c/d61 2074 1 2023-12-05T13:26:43.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/544: stat d1/dc/d25/d4c/d9b/d9a/fab 0 2023-12-05T13:26:43.814 INFO:tasks.workunit.client.0.smithi029.stdout:8/725: write d5/d6/d59/f72 [2775501,16838] 0 2023-12-05T13:26:43.814 INFO:tasks.workunit.client.0.smithi029.stdout:9/471: rmdir d7/d90 0 2023-12-05T13:26:43.814 INFO:tasks.workunit.client.0.smithi029.stdout:0/582: creat dc/fb7 x:0 0 0 2023-12-05T13:26:43.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/545: dread d1/dc/d25/d4c/f7e [0,4194304] 0 2023-12-05T13:26:43.816 INFO:tasks.workunit.client.0.smithi029.stdout:5/546: fdatasync d1/dc/d10/d1e/f65 0 2023-12-05T13:26:43.816 INFO:tasks.workunit.client.0.smithi029.stdout:7/739: rename d6/d50/d5b/d5f/d7d/d97/d4a/l62 to d6/d50/d5b/d5f/d7d/d97/le5 0 2023-12-05T13:26:43.816 INFO:tasks.workunit.client.0.smithi029.stdout:8/726: creat d5/dc/d18/d26/dc0/ffa x:0 0 0 2023-12-05T13:26:43.818 INFO:tasks.workunit.client.0.smithi029.stdout:9/472: symlink d7/d19/d30/d40/l9c 0 2023-12-05T13:26:43.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/547: rename d1/dc/d38/f78 to d1/dc/d10/d1e/d75/fc3 0 2023-12-05T13:26:43.821 INFO:tasks.workunit.client.0.smithi029.stdout:7/740: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/dca/fe6 x:0 0 0 2023-12-05T13:26:43.822 INFO:tasks.workunit.client.0.smithi029.stdout:4/533: dwrite d0/d16/d2f/fa9 [0,4194304] 0 2023-12-05T13:26:43.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/727: mknod d5/dc/d18/cfb 0 2023-12-05T13:26:43.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/728: dread - d5/d2f/fea zero size 2023-12-05T13:26:43.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/729: write d5/d2f/d3a/fed [102278,6114] 0 2023-12-05T13:26:43.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/730: readlink d5/d6/d10/d8a/le5 0 2023-12-05T13:26:43.823 INFO:tasks.workunit.client.0.smithi029.stdout:8/731: chown d5/dbc/d8b/l8f 657101 1 2023-12-05T13:26:43.824 INFO:tasks.workunit.client.0.smithi029.stdout:2/624: dread de/d16/f47 [4194304,4194304] 0 2023-12-05T13:26:43.824 INFO:tasks.workunit.client.0.smithi029.stdout:2/625: stat de/d14/d24/c48 0 2023-12-05T13:26:43.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/473: rename d7/d2c/d3a/f45 to d7/d19/d30/f9d 0 2023-12-05T13:26:43.828 INFO:tasks.workunit.client.0.smithi029.stdout:0/583: dread dc/f2c [0,4194304] 0 2023-12-05T13:26:43.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/534: symlink d0/de/d30/d32/d35/d3d/lb1 0 2023-12-05T13:26:43.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/535: fsync d0/d16/d22/d4f/f71 0 2023-12-05T13:26:43.833 INFO:tasks.workunit.client.0.smithi029.stdout:4/536: write d0/d16/d22/d4f/f59 [339811,108956] 0 2023-12-05T13:26:43.838 INFO:tasks.workunit.client.0.smithi029.stdout:5/548: rename d1/dc/d10/d1e/d33/d93/da5/db2/c68 to d1/dc/d25/d4c/cc4 0 2023-12-05T13:26:43.839 INFO:tasks.workunit.client.0.smithi029.stdout:9/474: fsync d7/d19/f9b 0 2023-12-05T13:26:43.842 INFO:tasks.workunit.client.0.smithi029.stdout:0/584: unlink dc/d13/l17 0 2023-12-05T13:26:43.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/537: rmdir d0/de/d30/d32/d35 39 2023-12-05T13:26:43.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/538: chown d0/d1/l9 582641 1 2023-12-05T13:26:43.849 INFO:tasks.workunit.client.0.smithi029.stdout:4/539: write d0/de/d30/d32/fa5 [1063254,91073] 0 2023-12-05T13:26:43.849 INFO:tasks.workunit.client.0.smithi029.stdout:1/635: sync 2023-12-05T13:26:43.850 INFO:tasks.workunit.client.0.smithi029.stdout:8/732: link d5/d2f/d3a/d3c/da2/cb2 d5/dbc/d53/cfc 0 2023-12-05T13:26:43.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/475: mknod d7/d2c/d3a/c9e 0 2023-12-05T13:26:43.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/476: write d7/d19/f9b [764437,129201] 0 2023-12-05T13:26:43.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/477: truncate d7/d19/d30/d43/f62 1101947 0 2023-12-05T13:26:43.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/478: stat d7/d19/d30/d99/f82 0 2023-12-05T13:26:43.857 INFO:tasks.workunit.client.0.smithi029.stdout:0/585: getdents dc/d33/d3d/d7a/d84/d8d/d97/d98 0 2023-12-05T13:26:43.857 INFO:tasks.workunit.client.0.smithi029.stdout:7/741: fsync d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/dca/fe6 0 2023-12-05T13:26:43.861 INFO:tasks.workunit.client.0.smithi029.stdout:4/540: mknod d0/de/d30/d32/d35/cb2 0 2023-12-05T13:26:43.862 INFO:tasks.workunit.client.0.smithi029.stdout:1/636: creat d7/d5e/d52/d5f/d12/d60/fd8 x:0 0 0 2023-12-05T13:26:43.863 INFO:tasks.workunit.client.0.smithi029.stdout:1/637: write d7/d6e/da9/f8b [763532,124810] 0 2023-12-05T13:26:43.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/479: creat d7/d19/d30/d40/f9f x:0 0 0 2023-12-05T13:26:43.866 INFO:tasks.workunit.client.0.smithi029.stdout:0/586: link dc/d23/d3a/d41/d70/la1 dc/d33/d3d/d7a/lb8 0 2023-12-05T13:26:43.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/549: getdents d1/dc/d25/d4c 0 2023-12-05T13:26:43.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/733: dwrite d5/d6/f9 [0,4194304] 0 2023-12-05T13:26:43.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/734: truncate d5/d2f/d3a/d3c/f89 1244125 0 2023-12-05T13:26:43.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/735: readlink d5/d6/lae 0 2023-12-05T13:26:43.870 INFO:tasks.workunit.client.0.smithi029.stdout:7/742: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/dca/fe6 to d6/d50/d5b/d5f/fe7 0 2023-12-05T13:26:43.871 INFO:tasks.workunit.client.0.smithi029.stdout:4/541: creat d0/de/d30/d94/fb3 x:0 0 0 2023-12-05T13:26:43.873 INFO:tasks.workunit.client.0.smithi029.stdout:1/638: creat d7/d5e/d52/d90/dd6/fd9 x:0 0 0 2023-12-05T13:26:43.874 INFO:tasks.workunit.client.0.smithi029.stdout:9/480: dread d7/d19/d30/d40/d4e/d5e/f88 [0,4194304] 0 2023-12-05T13:26:43.875 INFO:tasks.workunit.client.0.smithi029.stdout:0/587: creat dc/d13/fb9 x:0 0 0 2023-12-05T13:26:43.877 INFO:tasks.workunit.client.0.smithi029.stdout:5/550: link d1/dc/f89 d1/dc/d10/d1e/d33/fc5 0 2023-12-05T13:26:43.877 INFO:tasks.workunit.client.0.smithi029.stdout:5/551: write d1/dc/d25/d4c/f7e [1540798,112698] 0 2023-12-05T13:26:43.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/736: symlink d5/d2f/d75/lfd 0 2023-12-05T13:26:43.877 INFO:tasks.workunit.client.0.smithi029.stdout:8/737: chown d5/d2f/d3a/d86/da8 13689 1 2023-12-05T13:26:43.880 INFO:tasks.workunit.client.0.smithi029.stdout:7/743: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/f8c to d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/fe8 0 2023-12-05T13:26:43.880 INFO:tasks.workunit.client.0.smithi029.stdout:7/744: chown d6/d2a/d2f/c3d 7866504 1 2023-12-05T13:26:43.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/639: unlink d7/d5b/fc1 0 2023-12-05T13:26:43.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/640: read d7/d61/d4f/f6c [326101,78295] 0 2023-12-05T13:26:43.883 INFO:tasks.workunit.client.0.smithi029.stdout:1/641: stat d7/d5e/d52/lc8 0 2023-12-05T13:26:43.887 INFO:tasks.workunit.client.0.smithi029.stdout:0/588: stat dc/c25 0 2023-12-05T13:26:43.888 INFO:tasks.workunit.client.0.smithi029.stdout:4/542: dwrite d0/de/d30/f68 [0,4194304] 0 2023-12-05T13:26:43.890 INFO:tasks.workunit.client.0.smithi029.stdout:5/552: unlink d1/dc/l48 0 2023-12-05T13:26:43.890 INFO:tasks.workunit.client.0.smithi029.stdout:5/553: stat d1/dc/d38/d3a/d5c 0 2023-12-05T13:26:43.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/738: unlink d5/dbc/d8b/l8f 0 2023-12-05T13:26:43.893 INFO:tasks.workunit.client.0.smithi029.stdout:8/739: write d5/f82 [629729,1151] 0 2023-12-05T13:26:43.893 INFO:tasks.workunit.client.0.smithi029.stdout:8/740: fdatasync d5/dc/d56/f81 0 2023-12-05T13:26:43.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/481: rename d7/d19/d30/d43/c75 to d7/d19/d30/d99/ca0 0 2023-12-05T13:26:43.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/482: fsync d7/fe 0 2023-12-05T13:26:43.897 INFO:tasks.workunit.client.0.smithi029.stdout:7/745: mknod d6/d2a/d4f/ce9 0 2023-12-05T13:26:43.899 INFO:tasks.workunit.client.0.smithi029.stdout:1/642: creat d7/d6e/da9/fda x:0 0 0 2023-12-05T13:26:43.900 INFO:tasks.workunit.client.0.smithi029.stdout:1/643: write d7/d5e/d52/d90/fbb [572778,101554] 0 2023-12-05T13:26:43.900 INFO:tasks.workunit.client.0.smithi029.stdout:1/644: chown d7/d5e/d52/d5f/d12/d60/cc2 29944077 1 2023-12-05T13:26:43.908 INFO:tasks.workunit.client.0.smithi029.stdout:0/589: dread dc/d23/d3a/d41/f6e [0,4194304] 0 2023-12-05T13:26:43.911 INFO:tasks.workunit.client.0.smithi029.stdout:4/543: rename d0/de/d15/f4e to d0/d16/d22/fb4 0 2023-12-05T13:26:43.912 INFO:tasks.workunit.client.0.smithi029.stdout:4/544: write d0/f23 [4287256,31903] 0 2023-12-05T13:26:43.914 INFO:tasks.workunit.client.0.smithi029.stdout:9/483: creat d7/d2c/d68/fa1 x:0 0 0 2023-12-05T13:26:43.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/746: mknod d6/d2a/d4f/dc5/d52/cea 0 2023-12-05T13:26:43.916 INFO:tasks.workunit.client.0.smithi029.stdout:7/747: chown d6/d19/f21 0 1 2023-12-05T13:26:43.917 INFO:tasks.workunit.client.0.smithi029.stdout:1/645: stat c2 0 2023-12-05T13:26:43.918 INFO:tasks.workunit.client.0.smithi029.stdout:1/646: read d7/f13 [102522,2760] 0 2023-12-05T13:26:43.919 INFO:tasks.workunit.client.0.smithi029.stdout:8/741: rename d5/d2f/d3a/d86/dc3 to d5/d6/d10/d85/daa/dfe 0 2023-12-05T13:26:43.920 INFO:tasks.workunit.client.0.smithi029.stdout:4/545: mkdir d0/de/d30/db5 0 2023-12-05T13:26:43.922 INFO:tasks.workunit.client.0.smithi029.stdout:9/484: mkdir d7/d19/d1f/da2 0 2023-12-05T13:26:43.924 INFO:tasks.workunit.client.0.smithi029.stdout:7/748: symlink d6/d50/d5b/d5f/d7d/d97/d51/leb 0 2023-12-05T13:26:43.924 INFO:tasks.workunit.client.0.smithi029.stdout:7/749: readlink d6/d2a/d4f/dc5/l43 0 2023-12-05T13:26:43.926 INFO:tasks.workunit.client.0.smithi029.stdout:1/647: creat d7/fdb x:0 0 0 2023-12-05T13:26:43.926 INFO:tasks.workunit.client.0.smithi029.stdout:0/590: dwrite dc/d23/d3a/d41/d57/d58/f7d [0,4194304] 0 2023-12-05T13:26:43.926 INFO:tasks.workunit.client.0.smithi029.stdout:7/750: write d6/f13 [2639041,2408] 0 2023-12-05T13:26:43.927 INFO:tasks.workunit.client.0.smithi029.stdout:4/546: mkdir d0/d16/db6 0 2023-12-05T13:26:43.928 INFO:tasks.workunit.client.0.smithi029.stdout:1/648: dread d7/d5e/d52/d5f/d12/f76 [0,4194304] 0 2023-12-05T13:26:43.929 INFO:tasks.workunit.client.0.smithi029.stdout:1/649: write d7/d6e/da9/f8b [653581,123544] 0 2023-12-05T13:26:43.929 INFO:tasks.workunit.client.0.smithi029.stdout:1/650: fsync d7/d61/d4f/f65 0 2023-12-05T13:26:43.930 INFO:tasks.workunit.client.0.smithi029.stdout:7/751: unlink d6/ld 0 2023-12-05T13:26:43.931 INFO:tasks.workunit.client.0.smithi029.stdout:0/591: symlink dc/d13/d4f/d91/lba 0 2023-12-05T13:26:43.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/485: dread d7/d19/d28/f37 [0,4194304] 0 2023-12-05T13:26:43.934 INFO:tasks.workunit.client.0.smithi029.stdout:1/651: symlink d7/d5e/d52/ldc 0 2023-12-05T13:26:43.935 INFO:tasks.workunit.client.0.smithi029.stdout:1/652: readlink d7/d6e/da9/l33 0 2023-12-05T13:26:43.935 INFO:tasks.workunit.client.0.smithi029.stdout:1/653: write d7/d6e/da9/d4b/db1/fc7 [292015,102335] 0 2023-12-05T13:26:43.935 INFO:tasks.workunit.client.0.smithi029.stdout:8/742: dwrite d5/dbc/d1d/f2a [0,4194304] 0 2023-12-05T13:26:43.939 INFO:tasks.workunit.client.0.smithi029.stdout:0/592: write dc/fd [4726115,51805] 0 2023-12-05T13:26:43.941 INFO:tasks.workunit.client.0.smithi029.stdout:1/654: mknod d7/d6e/cdd 0 2023-12-05T13:26:43.942 INFO:tasks.workunit.client.0.smithi029.stdout:8/743: rmdir d5/d6/d10/d13/db7 39 2023-12-05T13:26:43.945 INFO:tasks.workunit.client.0.smithi029.stdout:1/655: link d7/d5e/f5a d7/d5e/d52/d5f/d48/fde 0 2023-12-05T13:26:43.949 INFO:tasks.workunit.client.0.smithi029.stdout:7/752: dwrite d6/d2a/d4f/dc5/f45 [0,4194304] 0 2023-12-05T13:26:43.949 INFO:tasks.workunit.client.0.smithi029.stdout:8/744: mknod d5/cff 0 2023-12-05T13:26:43.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/486: getdents d7/d2c/d68 0 2023-12-05T13:26:43.956 INFO:tasks.workunit.client.0.smithi029.stdout:7/753: dread d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/f6c [0,4194304] 0 2023-12-05T13:26:43.958 INFO:tasks.workunit.client.0.smithi029.stdout:8/745: dread d5/d2f/d75/fa5 [8388608,4194304] 0 2023-12-05T13:26:43.959 INFO:tasks.workunit.client.0.smithi029.stdout:8/746: write d5/dc/d18/d26/f9f [786025,64233] 0 2023-12-05T13:26:43.961 INFO:tasks.workunit.client.0.smithi029.stdout:8/747: symlink d5/d6/d10/d8a/l100 0 2023-12-05T13:26:43.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/748: unlink d5/d6/d10/d8a/la9 0 2023-12-05T13:26:43.964 INFO:tasks.workunit.client.0.smithi029.stdout:8/749: stat d5/dbc/d53/f7e 0 2023-12-05T13:26:43.966 INFO:tasks.workunit.client.0.smithi029.stdout:0/593: write dc/d23/d3a/f71 [1424805,93874] 0 2023-12-05T13:26:43.968 INFO:tasks.workunit.client.0.smithi029.stdout:1/656: fsync d7/d5e/d52/d5f/d48/fde 0 2023-12-05T13:26:43.972 INFO:tasks.workunit.client.0.smithi029.stdout:7/754: dwrite d6/d50/d5b/d5f/f84 [4194304,4194304] 0 2023-12-05T13:26:43.972 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:43 smithi052 ceph-mon[121072]: pgmap v43: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 135 MiB/s wr, 230 op/s 2023-12-05T13:26:43.974 INFO:tasks.workunit.client.0.smithi029.stdout:7/755: creat d6/d2a/d2f/fec x:0 0 0 2023-12-05T13:26:43.974 INFO:tasks.workunit.client.0.smithi029.stdout:7/756: fsync d6/f13 0 2023-12-05T13:26:43.975 INFO:tasks.workunit.client.0.smithi029.stdout:7/757: creat d6/d50/d5b/d5f/d7d/d97/db2/fed x:0 0 0 2023-12-05T13:26:43.980 INFO:tasks.workunit.client.0.smithi029.stdout:7/758: dread d6/f15 [0,4194304] 0 2023-12-05T13:26:43.981 INFO:tasks.workunit.client.0.smithi029.stdout:7/759: write d6/d50/d5b/d5f/d7d/d97/d51/f77 [1757660,45775] 0 2023-12-05T13:26:43.982 INFO:tasks.workunit.client.0.smithi029.stdout:7/760: write d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/f6c [200217,49270] 0 2023-12-05T13:26:43.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/657: dwrite d7/d5e/d52/d5f/d48/f66 [0,4194304] 0 2023-12-05T13:26:43.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/658: dread - d7/d5e/d52/d5f/d48/fae zero size 2023-12-05T13:26:43.985 INFO:tasks.workunit.client.0.smithi029.stdout:1/659: fdatasync d7/d6e/da9/d4b/db1/fc5 0 2023-12-05T13:26:43.985 INFO:tasks.workunit.client.0.smithi029.stdout:7/761: link d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d3e/fa8 d6/d2a/fee 0 2023-12-05T13:26:43.985 INFO:tasks.workunit.client.0.smithi029.stdout:7/762: stat d6/d50/d5b/d1a/d26/d72/cd6 0 2023-12-05T13:26:43.985 INFO:tasks.workunit.client.0.smithi029.stdout:7/763: chown d6/d50/d5b/l33 19513481 1 2023-12-05T13:26:43.986 INFO:tasks.workunit.client.0.smithi029.stdout:1/660: creat d7/d5b/fdf x:0 0 0 2023-12-05T13:26:43.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/594: dwrite dc/d33/d3d/d7a/d84/d8d/d97/faa [0,4194304] 0 2023-12-05T13:26:43.988 INFO:tasks.workunit.client.0.smithi029.stdout:1/661: rmdir d7/d6e/da9/d4b 39 2023-12-05T13:26:43.991 INFO:tasks.workunit.client.0.smithi029.stdout:0/595: mknod dc/d33/d3d/cbb 0 2023-12-05T13:26:43.992 INFO:tasks.workunit.client.0.smithi029.stdout:7/764: fsync d6/d50/d5b/f29 0 2023-12-05T13:26:43.992 INFO:tasks.workunit.client.0.smithi029.stdout:7/765: write d6/d2a/d7e/d7b/f99 [4767760,101887] 0 2023-12-05T13:26:43.993 INFO:tasks.workunit.client.0.smithi029.stdout:0/596: creat dc/d23/fbc x:0 0 0 2023-12-05T13:26:43.993 INFO:tasks.workunit.client.0.smithi029.stdout:7/766: write d6/d50/d5b/d1a/d26/d6e/f75 [954958,31037] 0 2023-12-05T13:26:43.995 INFO:tasks.workunit.client.0.smithi029.stdout:0/597: rename dc/d23/d3a/d41/f6e to dc/d33/d3d/d7a/d84/db1/fbd 0 2023-12-05T13:26:44.006 INFO:tasks.workunit.client.0.smithi029.stdout:1/662: dwrite d7/d5e/d52/d5f/d48/f67 [0,4194304] 0 2023-12-05T13:26:44.006 INFO:tasks.workunit.client.0.smithi029.stdout:1/663: write d7/d5e/d52/d90/f96 [688268,77701] 0 2023-12-05T13:26:44.046 INFO:tasks.workunit.client.0.smithi029.stdout:7/767: mknod d6/d50/d5b/d1a/d26/d6e/cef 0 2023-12-05T13:26:44.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/598: mkdir dc/d33/d3d/d7a/d84/da4/dbe 0 2023-12-05T13:26:44.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/664: creat d7/d61/d4f/fe0 x:0 0 0 2023-12-05T13:26:44.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/665: chown d7/d6e/da9/l3f 319419957 1 2023-12-05T13:26:44.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/666: write d7/d56/fd5 [747039,100668] 0 2023-12-05T13:26:44.052 INFO:tasks.workunit.client.0.smithi029.stdout:7/768: mknod d6/d2a/cf0 0 2023-12-05T13:26:44.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/599: dread dc/d23/d3a/d41/d57/d58/f5c [0,4194304] 0 2023-12-05T13:26:44.056 INFO:tasks.workunit.client.0.smithi029.stdout:0/600: write dc/d13/d4f/f8c [476364,96541] 0 2023-12-05T13:26:44.057 INFO:tasks.workunit.client.0.smithi029.stdout:1/667: write d7/d61/d4f/f6c [1456736,48009] 0 2023-12-05T13:26:44.058 INFO:tasks.workunit.client.0.smithi029.stdout:7/769: symlink d6/d50/d5b/d1a/d26/lf1 0 2023-12-05T13:26:44.058 INFO:tasks.workunit.client.0.smithi029.stdout:7/770: dread - d6/d50/d5b/d5f/fe7 zero size 2023-12-05T13:26:44.059 INFO:tasks.workunit.client.0.smithi029.stdout:0/601: mkdir dc/d23/dbf 0 2023-12-05T13:26:44.060 INFO:tasks.workunit.client.0.smithi029.stdout:1/668: creat d7/d5e/d52/d5f/d48/fe1 x:0 0 0 2023-12-05T13:26:44.062 INFO:tasks.workunit.client.0.smithi029.stdout:7/771: creat d6/d50/d5b/d1a/d26/d6e/d8b/ff2 x:0 0 0 2023-12-05T13:26:44.062 INFO:tasks.workunit.client.0.smithi029.stdout:7/772: truncate d6/d50/d5b/d1a/d26/d72/f76 826412 0 2023-12-05T13:26:44.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/669: symlink d7/d5e/d52/d5f/d48/le2 0 2023-12-05T13:26:44.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/670: chown d7/d5e/d52/d5f/d12/f2d 10069967 1 2023-12-05T13:26:44.063 INFO:tasks.workunit.client.0.smithi029.stdout:1/671: mknod d7/d5e/d52/d5f/ce3 0 2023-12-05T13:26:44.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/672: mkdir d7/d5e/d52/de4 0 2023-12-05T13:26:44.065 INFO:tasks.workunit.client.0.smithi029.stdout:1/673: write d7/d61/d4f/fe0 [526501,36201] 0 2023-12-05T13:26:44.067 INFO:tasks.workunit.client.0.smithi029.stdout:1/674: creat d7/d6e/da9/d4b/db1/dd1/fe5 x:0 0 0 2023-12-05T13:26:44.067 INFO:tasks.workunit.client.0.smithi029.stdout:1/675: write d7/d61/d4f/f6c [2263461,19726] 0 2023-12-05T13:26:44.075 INFO:tasks.workunit.client.0.smithi029.stdout:0/602: dwrite dc/d33/d3d/d7a/d84/d8d/d97/faa [0,4194304] 0 2023-12-05T13:26:44.076 INFO:tasks.workunit.client.0.smithi029.stdout:7/773: dread d6/f13 [0,4194304] 0 2023-12-05T13:26:44.076 INFO:tasks.workunit.client.0.smithi029.stdout:1/676: dread d7/fd [0,4194304] 0 2023-12-05T13:26:44.077 INFO:tasks.workunit.client.0.smithi029.stdout:0/603: rmdir dc/d23/d3a/d41/d70 39 2023-12-05T13:26:44.078 INFO:tasks.workunit.client.0.smithi029.stdout:7/774: unlink d6/d19/f34 0 2023-12-05T13:26:44.080 INFO:tasks.workunit.client.0.smithi029.stdout:1/677: unlink d7/d5e/d52/d5f/d48/c71 0 2023-12-05T13:26:44.080 INFO:tasks.workunit.client.0.smithi029.stdout:1/678: fsync d7/d6e/da9/d4b/db1/fc7 0 2023-12-05T13:26:44.080 INFO:tasks.workunit.client.0.smithi029.stdout:1/679: fsync d7/d61/d4f/f54 0 2023-12-05T13:26:44.081 INFO:tasks.workunit.client.0.smithi029.stdout:7/775: mknod d6/d2a/d2f/d89/dad/cf3 0 2023-12-05T13:26:44.082 INFO:tasks.workunit.client.0.smithi029.stdout:7/776: write d6/d50/d5b/d1a/d26/f31 [3852352,95406] 0 2023-12-05T13:26:44.083 INFO:tasks.workunit.client.0.smithi029.stdout:1/680: getdents d7/d5b 0 2023-12-05T13:26:44.086 INFO:tasks.workunit.client.0.smithi029.stdout:7/777: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/ff4 x:0 0 0 2023-12-05T13:26:44.086 INFO:tasks.workunit.client.0.smithi029.stdout:7/778: chown d6/d50/d5b/d5f/d7d 3 1 2023-12-05T13:26:44.087 INFO:tasks.workunit.client.0.smithi029.stdout:1/681: rmdir d7/d61/d4f 39 2023-12-05T13:26:44.088 INFO:tasks.workunit.client.0.smithi029.stdout:1/682: write d7/d61/f6d [2883707,69970] 0 2023-12-05T13:26:44.088 INFO:tasks.workunit.client.0.smithi029.stdout:1/683: fdatasync d7/d5e/f7d 0 2023-12-05T13:26:44.089 INFO:tasks.workunit.client.0.smithi029.stdout:7/779: creat d6/d50/d5b/d1a/d26/ff5 x:0 0 0 2023-12-05T13:26:44.101 INFO:tasks.workunit.client.0.smithi029.stdout:7/780: dread d6/d50/d5b/d1a/d26/f59 [0,4194304] 0 2023-12-05T13:26:44.102 INFO:tasks.workunit.client.0.smithi029.stdout:7/781: readlink d6/d19/ld2 0 2023-12-05T13:26:44.102 INFO:tasks.workunit.client.0.smithi029.stdout:7/782: stat d6/d2a/d2f/fa7 0 2023-12-05T13:26:44.102 INFO:tasks.workunit.client.0.smithi029.stdout:7/783: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/ff6 x:0 0 0 2023-12-05T13:26:44.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:43 smithi029 ceph-mon[112128]: pgmap v43: 65 pgs: 65 active+clean; 1.3 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 135 MiB/s wr, 230 op/s 2023-12-05T13:26:44.103 INFO:tasks.workunit.client.0.smithi029.stdout:7/784: mknod d6/d50/d5b/d1a/d26/d6e/d8b/da9/cf7 0 2023-12-05T13:26:44.104 INFO:tasks.workunit.client.0.smithi029.stdout:7/785: mknod d6/d50/d5b/d1a/d26/dc9/cf8 0 2023-12-05T13:26:44.105 INFO:tasks.workunit.client.0.smithi029.stdout:7/786: read d6/d19/f25 [2252263,120647] 0 2023-12-05T13:26:44.105 INFO:tasks.workunit.client.0.smithi029.stdout:7/787: write d6/d50/d5b/d5f/d7d/d97/d4a/d4b/dde/fb3 [2898,26532] 0 2023-12-05T13:26:44.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/788: symlink d6/d50/d5b/d5f/d7d/d97/d73/lf9 0 2023-12-05T13:26:44.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/789: truncate d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/ff6 71782 0 2023-12-05T13:26:44.106 INFO:tasks.workunit.client.0.smithi029.stdout:7/790: fdatasync d6/d2a/d7e/d7b/f99 0 2023-12-05T13:26:44.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/684: dwrite d7/d5e/d52/d5f/d48/fb7 [0,4194304] 0 2023-12-05T13:26:44.111 INFO:tasks.workunit.client.0.smithi029.stdout:7/791: dread d6/f11 [0,4194304] 0 2023-12-05T13:26:44.112 INFO:tasks.workunit.client.0.smithi029.stdout:7/792: rename d6/d50/d5b/d1a/d26/d6e/cef to d6/d50/d5b/d1a/d26/d6e/cfa 0 2023-12-05T13:26:44.113 INFO:tasks.workunit.client.0.smithi029.stdout:7/793: write d6/d19/f25 [3328715,28151] 0 2023-12-05T13:26:44.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/794: creat d6/d50/d5b/d1a/d26/d82/ffb x:0 0 0 2023-12-05T13:26:44.115 INFO:tasks.workunit.client.0.smithi029.stdout:7/795: write d6/d50/d5b/d1a/d26/dc9/fdf [913924,13371] 0 2023-12-05T13:26:44.116 INFO:tasks.workunit.client.0.smithi029.stdout:7/796: unlink d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/cae 0 2023-12-05T13:26:44.133 INFO:tasks.workunit.client.0.smithi029.stdout:7/797: dwrite d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/ff6 [0,4194304] 0 2023-12-05T13:26:44.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/685: dwrite d7/d5e/d52/d5f/d12/f76 [0,4194304] 0 2023-12-05T13:26:44.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/686: write d7/d5e/d52/d5f/d12/f2d [3456150,35223] 0 2023-12-05T13:26:44.138 INFO:tasks.workunit.client.0.smithi029.stdout:1/687: truncate d7/d61/d4f/f5d 2171849 0 2023-12-05T13:26:44.138 INFO:tasks.workunit.client.0.smithi029.stdout:1/688: write d7/d5e/d52/d5f/d48/fde [590177,129909] 0 2023-12-05T13:26:44.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/689: chown d7/d5e/d52/lc8 10869 1 2023-12-05T13:26:44.139 INFO:tasks.workunit.client.0.smithi029.stdout:7/798: dread d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/f6c [0,4194304] 0 2023-12-05T13:26:44.142 INFO:tasks.workunit.client.0.smithi029.stdout:1/690: link d7/d5e/d52/d5f/d48/fae d7/d5e/fe6 0 2023-12-05T13:26:44.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/691: symlink d7/d56/le7 0 2023-12-05T13:26:44.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/692: rmdir d7/d61/d4f/db0 0 2023-12-05T13:26:44.155 INFO:tasks.workunit.client.0.smithi029.stdout:7/799: dwrite d6/d50/d5b/d1a/d26/f74 [0,4194304] 0 2023-12-05T13:26:44.159 INFO:tasks.workunit.client.0.smithi029.stdout:7/800: rename d6/d50/d5b/d1a/d26/d82/ffb to d6/d2a/d4f/dc5/d52/ffc 0 2023-12-05T13:26:44.160 INFO:tasks.workunit.client.0.smithi029.stdout:7/801: getdents d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d3e 0 2023-12-05T13:26:44.160 INFO:tasks.workunit.client.0.smithi029.stdout:7/802: dread - d6/d50/d5b/d5f/fe7 zero size 2023-12-05T13:26:44.308 INFO:tasks.workunit.client.0.smithi029.stdout:3/622: sync 2023-12-05T13:26:44.308 INFO:tasks.workunit.client.0.smithi029.stdout:6/700: sync 2023-12-05T13:26:44.313 INFO:tasks.workunit.client.0.smithi029.stdout:6/701: mknod d6/d29/dc4/d40/d74/d52/d5c/d6f/cf0 0 2023-12-05T13:26:44.313 INFO:tasks.workunit.client.0.smithi029.stdout:6/702: fsync d6/d29/dc4/d40/f41 0 2023-12-05T13:26:44.317 INFO:tasks.workunit.client.0.smithi029.stdout:3/623: dread d1/d5e/fa7 [0,4194304] 0 2023-12-05T13:26:44.323 INFO:tasks.workunit.client.0.smithi029.stdout:6/703: dread d6/d29/dc4/d40/d74/d52/d5c/fa6 [0,4194304] 0 2023-12-05T13:26:44.332 INFO:tasks.workunit.client.0.smithi029.stdout:6/704: dread d6/d1d/d39/d58/fc1 [0,4194304] 0 2023-12-05T13:26:44.333 INFO:tasks.workunit.client.0.smithi029.stdout:6/705: fsync d6/d29/dc4/f5e 0 2023-12-05T13:26:44.336 INFO:tasks.workunit.client.0.smithi029.stdout:3/624: dwrite d1/d10/d91/f84 [0,4194304] 0 2023-12-05T13:26:44.348 INFO:tasks.workunit.client.0.smithi029.stdout:6/706: dwrite d6/d64/d6d/da3/dcf/fd6 [0,4194304] 0 2023-12-05T13:26:44.352 INFO:tasks.workunit.client.0.smithi029.stdout:6/707: rename d6/d29/dc4/d40/d4d/d8f/fee to d6/d29/dc4/d40/d4d/d8f/de0/ff1 0 2023-12-05T13:26:44.352 INFO:tasks.workunit.client.0.smithi029.stdout:6/708: truncate d6/d29/fa0 1260409 0 2023-12-05T13:26:44.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/709: getdents d6/d64/d6d 0 2023-12-05T13:26:44.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/710: chown d6/d29/c34 64294985 1 2023-12-05T13:26:44.355 INFO:tasks.workunit.client.0.smithi029.stdout:6/711: mknod d6/d29/dc4/d40/d74/cf2 0 2023-12-05T13:26:44.355 INFO:tasks.workunit.client.0.smithi029.stdout:3/625: dwrite d1/d5e/d74/f93 [0,4194304] 0 2023-12-05T13:26:44.356 INFO:tasks.workunit.client.0.smithi029.stdout:6/712: rename d6/d29/dc4/d40/f41 to d6/d29/dc4/d40/d74/ff3 0 2023-12-05T13:26:44.357 INFO:tasks.workunit.client.0.smithi029.stdout:3/626: symlink d1/d6/d11/lc4 0 2023-12-05T13:26:44.358 INFO:tasks.workunit.client.0.smithi029.stdout:6/713: creat d6/d1d/d36/ff4 x:0 0 0 2023-12-05T13:26:44.359 INFO:tasks.workunit.client.0.smithi029.stdout:6/714: write d6/d29/d60/fb0 [3787811,75920] 0 2023-12-05T13:26:44.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/627: dwrite d1/d10/f41 [0,4194304] 0 2023-12-05T13:26:44.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/628: getdents d1/d6/d4a 0 2023-12-05T13:26:44.384 INFO:tasks.workunit.client.0.smithi029.stdout:3/629: dread d1/d6/f2a [0,4194304] 0 2023-12-05T13:26:44.385 INFO:tasks.workunit.client.0.smithi029.stdout:3/630: creat d1/d5e/d74/fc5 x:0 0 0 2023-12-05T13:26:44.392 INFO:tasks.workunit.client.0.smithi029.stdout:3/631: dread d1/d10/d91/f96 [0,4194304] 0 2023-12-05T13:26:44.401 INFO:tasks.workunit.client.0.smithi029.stdout:3/632: dread d1/d16/d36/f66 [0,4194304] 0 2023-12-05T13:26:44.402 INFO:tasks.workunit.client.0.smithi029.stdout:3/633: rmdir d1/d16/d1f 39 2023-12-05T13:26:44.404 INFO:tasks.workunit.client.0.smithi029.stdout:3/634: truncate d1/d10/f5d 7876821 0 2023-12-05T13:26:44.418 INFO:tasks.workunit.client.0.smithi029.stdout:3/635: dwrite d1/d10/d91/f68 [0,4194304] 0 2023-12-05T13:26:44.420 INFO:tasks.workunit.client.0.smithi029.stdout:3/636: creat d1/d6/fc6 x:0 0 0 2023-12-05T13:26:44.436 INFO:tasks.workunit.client.0.smithi029.stdout:3/637: dwrite d1/f48 [0,4194304] 0 2023-12-05T13:26:44.444 INFO:tasks.workunit.client.0.smithi029.stdout:3/638: dread d1/d5e/d74/f93 [0,4194304] 0 2023-12-05T13:26:44.446 INFO:tasks.workunit.client.0.smithi029.stdout:3/639: mkdir d1/db3/dc7 0 2023-12-05T13:26:44.448 INFO:tasks.workunit.client.0.smithi029.stdout:3/640: creat d1/d16/d36/d3a/d6c/fc8 x:0 0 0 2023-12-05T13:26:44.450 INFO:tasks.workunit.client.0.smithi029.stdout:3/641: truncate d1/d18/f1d 2853681 0 2023-12-05T13:26:44.450 INFO:tasks.workunit.client.0.smithi029.stdout:3/642: chown d1/d10/d91/c3e 109 1 2023-12-05T13:26:44.451 INFO:tasks.workunit.client.0.smithi029.stdout:3/643: getdents d1/d10 0 2023-12-05T13:26:44.453 INFO:tasks.workunit.client.0.smithi029.stdout:3/644: symlink d1/d6/d4a/db8/lc9 0 2023-12-05T13:26:44.455 INFO:tasks.workunit.client.0.smithi029.stdout:3/645: symlink d1/d16/d36/d4b/db9/lca 0 2023-12-05T13:26:44.458 INFO:tasks.workunit.client.0.smithi029.stdout:3/646: rename d1/d16/d36/d3a/d6c/fc8 to d1/d16/d1f/d4c/fcb 0 2023-12-05T13:26:44.464 INFO:tasks.workunit.client.0.smithi029.stdout:3/647: fsync d1/d16/d1f/d4c/fcb 0 2023-12-05T13:26:44.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/648: creat d1/d16/d36/d4b/daf/fcc x:0 0 0 2023-12-05T13:26:44.467 INFO:tasks.workunit.client.0.smithi029.stdout:3/649: mkdir d1/d6/d4a/dcd 0 2023-12-05T13:26:44.467 INFO:tasks.workunit.client.0.smithi029.stdout:3/650: rmdir d1/d16/d36/d3a/d6c/d7d 39 2023-12-05T13:26:44.467 INFO:tasks.workunit.client.0.smithi029.stdout:3/651: truncate d1/d6/fc6 994577 0 2023-12-05T13:26:44.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/652: readlink d1/d10/d91/l35 0 2023-12-05T13:26:44.468 INFO:tasks.workunit.client.0.smithi029.stdout:3/653: symlink d1/d16/lce 0 2023-12-05T13:26:44.477 INFO:tasks.workunit.client.0.smithi029.stdout:3/654: dread d1/d10/d91/f68 [0,4194304] 0 2023-12-05T13:26:44.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/655: chown d1/d16 6798 1 2023-12-05T13:26:44.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/656: fdatasync d1/d6/f3c 0 2023-12-05T13:26:44.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/657: fsync d1/d10/f51 0 2023-12-05T13:26:44.478 INFO:tasks.workunit.client.0.smithi029.stdout:3/658: link d1/d6/d11/l1c d1/d6/d4a/db6/lcf 0 2023-12-05T13:26:44.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/659: mknod d1/d10/cd0 0 2023-12-05T13:26:44.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/660: getdents d1/db3/dc7 0 2023-12-05T13:26:44.480 INFO:tasks.workunit.client.0.smithi029.stdout:3/661: truncate d1/d6/d11/fc2 423609 0 2023-12-05T13:26:44.481 INFO:tasks.workunit.client.0.smithi029.stdout:3/662: creat d1/d16/d9c/fd1 x:0 0 0 2023-12-05T13:26:44.482 INFO:tasks.workunit.client.0.smithi029.stdout:3/663: rmdir d1/d16/d1f/d4c/dc0 0 2023-12-05T13:26:44.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/554: sync 2023-12-05T13:26:44.485 INFO:tasks.workunit.client.0.smithi029.stdout:4/547: sync 2023-12-05T13:26:44.485 INFO:tasks.workunit.client.0.smithi029.stdout:2/626: sync 2023-12-05T13:26:44.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/555: dread - d1/dc/d11/d17/d3d/f58 zero size 2023-12-05T13:26:44.485 INFO:tasks.workunit.client.0.smithi029.stdout:5/556: dread - d1/dc/d38/d3a/d5c/d87/fb8 zero size 2023-12-05T13:26:44.489 INFO:tasks.workunit.client.0.smithi029.stdout:4/548: mkdir d0/d3c/d85/db7 0 2023-12-05T13:26:44.490 INFO:tasks.workunit.client.0.smithi029.stdout:5/557: mknod d1/dc/d10/d1e/d33/d93/cc6 0 2023-12-05T13:26:44.491 INFO:tasks.workunit.client.0.smithi029.stdout:3/664: dread d1/d10/f71 [0,4194304] 0 2023-12-05T13:26:44.495 INFO:tasks.workunit.client.0.smithi029.stdout:2/627: dread de/d16/f5c [0,4194304] 0 2023-12-05T13:26:44.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/628: rename de/d14/d62 to de/d14/d24/d93/dc5/dc9 0 2023-12-05T13:26:44.498 INFO:tasks.workunit.client.0.smithi029.stdout:4/549: dread d0/d16/d22/d4f/f71 [0,4194304] 0 2023-12-05T13:26:44.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/629: creat de/d41/d56/d58/fca x:0 0 0 2023-12-05T13:26:44.504 INFO:tasks.workunit.client.0.smithi029.stdout:2/630: rmdir de/d6a/d9d/dac 0 2023-12-05T13:26:44.505 INFO:tasks.workunit.client.0.smithi029.stdout:2/631: rmdir de/d6a/d9d 39 2023-12-05T13:26:44.505 INFO:tasks.workunit.client.0.smithi029.stdout:2/632: truncate de/d41/d56/fba 404541 0 2023-12-05T13:26:44.505 INFO:tasks.workunit.client.0.smithi029.stdout:2/633: truncate de/d11/f30 1270569 0 2023-12-05T13:26:44.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/634: chown de/d11/d32/f3e 77735657 1 2023-12-05T13:26:44.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/635: chown de/d14/c2d 27136878 1 2023-12-05T13:26:44.506 INFO:tasks.workunit.client.0.smithi029.stdout:2/636: read de/d16/f29 [1085026,58345] 0 2023-12-05T13:26:44.511 INFO:tasks.workunit.client.0.smithi029.stdout:4/550: dwrite d0/d3c/d56/f67 [0,4194304] 0 2023-12-05T13:26:44.515 INFO:tasks.workunit.client.0.smithi029.stdout:2/637: dread de/f27 [0,4194304] 0 2023-12-05T13:26:44.529 INFO:tasks.workunit.client.0.smithi029.stdout:4/551: dwrite d0/de/d30/d32/f88 [0,4194304] 0 2023-12-05T13:26:44.529 INFO:tasks.workunit.client.0.smithi029.stdout:4/552: write d0/d16/d22/d5f/f96 [1208007,74703] 0 2023-12-05T13:26:44.531 INFO:tasks.workunit.client.0.smithi029.stdout:4/553: creat d0/de/d30/d32/fb8 x:0 0 0 2023-12-05T13:26:44.533 INFO:tasks.workunit.client.0.smithi029.stdout:2/638: dwrite de/d16/f29 [0,4194304] 0 2023-12-05T13:26:44.533 INFO:tasks.workunit.client.0.smithi029.stdout:2/639: chown de/d14/f35 3658467 1 2023-12-05T13:26:44.533 INFO:tasks.workunit.client.0.smithi029.stdout:4/554: dread d0/d16/d2f/d69/f8e [0,4194304] 0 2023-12-05T13:26:44.533 INFO:tasks.workunit.client.0.smithi029.stdout:2/640: write f6 [57125,35537] 0 2023-12-05T13:26:44.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/641: dread de/d16/d43/fa5 [0,4194304] 0 2023-12-05T13:26:44.543 INFO:tasks.workunit.client.0.smithi029.stdout:2/642: chown de/d14/d24/d93/dc5 2342 1 2023-12-05T13:26:44.543 INFO:tasks.workunit.client.0.smithi029.stdout:2/643: read f4 [522707,52372] 0 2023-12-05T13:26:44.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/644: link de/d11/f30 de/d16/fcb 0 2023-12-05T13:26:44.545 INFO:tasks.workunit.client.0.smithi029.stdout:4/555: dwrite d0/de/d15/f49 [4194304,4194304] 0 2023-12-05T13:26:44.547 INFO:tasks.workunit.client.0.smithi029.stdout:4/556: dread d0/da/f18 [0,4194304] 0 2023-12-05T13:26:44.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/557: rename d0/de/d30/d32/d35/c6c to d0/d16/d22/d5f/d79/cb9 0 2023-12-05T13:26:44.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/558: truncate d0/d16/d22/f61 934998 0 2023-12-05T13:26:44.551 INFO:tasks.workunit.client.0.smithi029.stdout:4/559: creat d0/d16/d22/d98/fba x:0 0 0 2023-12-05T13:26:44.551 INFO:tasks.workunit.client.0.smithi029.stdout:4/560: stat d0/da/fb 0 2023-12-05T13:26:44.551 INFO:tasks.workunit.client.0.smithi029.stdout:4/561: fdatasync d0/d16/f4a 0 2023-12-05T13:26:44.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/562: dwrite d0/d16/d2f/d69/f8e [0,4194304] 0 2023-12-05T13:26:44.566 INFO:tasks.workunit.client.0.smithi029.stdout:4/563: chown d0/d16/d22/c27 2151370 1 2023-12-05T13:26:44.567 INFO:tasks.workunit.client.0.smithi029.stdout:4/564: symlink d0/d41/lbb 0 2023-12-05T13:26:44.567 INFO:tasks.workunit.client.0.smithi029.stdout:4/565: rmdir d0/d16 39 2023-12-05T13:26:44.568 INFO:tasks.workunit.client.0.smithi029.stdout:4/566: getdents d0/d3c/d56 0 2023-12-05T13:26:44.569 INFO:tasks.workunit.client.0.smithi029.stdout:4/567: creat d0/d3c/d56/fbc x:0 0 0 2023-12-05T13:26:44.569 INFO:tasks.workunit.client.0.smithi029.stdout:4/568: stat d0/d16/d22/d5f/d79/l95 0 2023-12-05T13:26:44.570 INFO:tasks.workunit.client.0.smithi029.stdout:4/569: readlink d0/d16/d22/d5f/l81 0 2023-12-05T13:26:44.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/570: dwrite d0/d16/d22/f61 [0,4194304] 0 2023-12-05T13:26:44.587 INFO:tasks.workunit.client.0.smithi029.stdout:4/571: truncate d0/d1/f51 3246958 0 2023-12-05T13:26:44.588 INFO:tasks.workunit.client.0.smithi029.stdout:4/572: mkdir d0/de/d30/d32/dbd 0 2023-12-05T13:26:44.589 INFO:tasks.workunit.client.0.smithi029.stdout:4/573: read d0/d16/d22/d4f/f6d [1936235,50766] 0 2023-12-05T13:26:44.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/574: symlink d0/d41/lbe 0 2023-12-05T13:26:44.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/575: getdents d0/de/d30/d32/d35 0 2023-12-05T13:26:44.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/576: stat d0/d3c/d85 0 2023-12-05T13:26:44.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/577: dread - d0/de/d30/d94/fb3 zero size 2023-12-05T13:26:44.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/578: creat d0/d16/d22/d5f/d79/fbf x:0 0 0 2023-12-05T13:26:44.597 INFO:tasks.workunit.client.0.smithi029.stdout:4/579: dread d0/de/d30/d32/fa5 [0,4194304] 0 2023-12-05T13:26:44.598 INFO:tasks.workunit.client.0.smithi029.stdout:4/580: getdents d0/d16 0 2023-12-05T13:26:44.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/581: unlink d0/d1/l9 0 2023-12-05T13:26:44.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/582: stat d0/da/c72 0 2023-12-05T13:26:44.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/583: readlink d0/de/l8a 0 2023-12-05T13:26:44.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/584: mkdir d0/de/d15/dc0 0 2023-12-05T13:26:44.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/585: unlink d0/de/d15/f64 0 2023-12-05T13:26:44.603 INFO:tasks.workunit.client.0.smithi029.stdout:4/586: mknod d0/d16/d22/d5f/d79/cc1 0 2023-12-05T13:26:44.604 INFO:tasks.workunit.client.0.smithi029.stdout:4/587: truncate d0/d16/d22/f61 1080163 0 2023-12-05T13:26:44.605 INFO:tasks.workunit.client.0.smithi029.stdout:4/588: mkdir d0/d16/d22/dc2 0 2023-12-05T13:26:44.606 INFO:tasks.workunit.client.0.smithi029.stdout:4/589: truncate d0/de/d30/d32/fb8 763819 0 2023-12-05T13:26:44.627 INFO:tasks.workunit.client.0.smithi029.stdout:4/590: dwrite d0/d16/d22/d98/fba [0,4194304] 0 2023-12-05T13:26:44.630 INFO:tasks.workunit.client.0.smithi029.stdout:4/591: unlink d0/d16/d2f/d69/f8e 0 2023-12-05T13:26:44.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/592: mknod d0/d16/d22/d4f/cc3 0 2023-12-05T13:26:44.646 INFO:tasks.workunit.client.0.smithi029.stdout:4/593: unlink d0/d3c/d56/c7d 0 2023-12-05T13:26:44.647 INFO:tasks.workunit.client.0.smithi029.stdout:4/594: write d0/d16/d22/d5f/d79/fbf [855613,115767] 0 2023-12-05T13:26:44.647 INFO:tasks.workunit.client.0.smithi029.stdout:4/595: chown d0/d16/d22/d5f/f96 656 1 2023-12-05T13:26:44.662 INFO:tasks.workunit.client.0.smithi029.stdout:4/596: dwrite d0/d16/d22/d4f/f59 [0,4194304] 0 2023-12-05T13:26:44.664 INFO:tasks.workunit.client.0.smithi029.stdout:4/597: write d0/d16/d22/d98/fba [3233058,35458] 0 2023-12-05T13:26:44.707 INFO:tasks.workunit.client.0.smithi029.stdout:8/750: sync 2023-12-05T13:26:44.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/693: sync 2023-12-05T13:26:44.707 INFO:tasks.workunit.client.0.smithi029.stdout:6/715: sync 2023-12-05T13:26:44.707 INFO:tasks.workunit.client.0.smithi029.stdout:1/694: chown d7/d5e/d52/d5f/d12/f2d 1272 1 2023-12-05T13:26:44.707 INFO:tasks.workunit.client.0.smithi029.stdout:0/604: sync 2023-12-05T13:26:44.707 INFO:tasks.workunit.client.0.smithi029.stdout:9/487: sync 2023-12-05T13:26:44.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/803: sync 2023-12-05T13:26:44.708 INFO:tasks.workunit.client.0.smithi029.stdout:8/751: rmdir d5/d2f/d3a/d3c 39 2023-12-05T13:26:44.708 INFO:tasks.workunit.client.0.smithi029.stdout:1/695: mknod d7/d56/da8/ce8 0 2023-12-05T13:26:44.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/605: link dc/d23/d3a/d41/d57/f77 dc/d33/d3d/d7a/d84/fc0 0 2023-12-05T13:26:44.712 INFO:tasks.workunit.client.0.smithi029.stdout:9/488: creat d7/d19/d30/fa3 x:0 0 0 2023-12-05T13:26:44.713 INFO:tasks.workunit.client.0.smithi029.stdout:9/489: readlink d7/d19/d1f/l22 0 2023-12-05T13:26:44.713 INFO:tasks.workunit.client.0.smithi029.stdout:9/490: chown d7/d19/d28/d65/c80 96684902 1 2023-12-05T13:26:44.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/606: mknod dc/d13/d4f/d88/cc1 0 2023-12-05T13:26:44.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/607: chown dc/d13/d4f/d63/f87 126656 1 2023-12-05T13:26:44.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/491: symlink d7/d19/d28/la4 0 2023-12-05T13:26:44.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/492: truncate d7/d19/d30/d40/f9f 201152 0 2023-12-05T13:26:44.715 INFO:tasks.workunit.client.0.smithi029.stdout:9/493: write d7/d2c/d3a/d52/f6e [129082,70120] 0 2023-12-05T13:26:44.718 INFO:tasks.workunit.client.0.smithi029.stdout:0/608: rename dc/fe to dc/d13/d4f/d83/fc2 0 2023-12-05T13:26:44.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/494: rename d7/d19/d1f/f29 to d7/d19/fa5 0 2023-12-05T13:26:44.722 INFO:tasks.workunit.client.0.smithi029.stdout:0/609: rmdir dc/d33/d3d/d7a/d84/da4 39 2023-12-05T13:26:44.724 INFO:tasks.workunit.client.0.smithi029.stdout:9/495: unlink d7/c79 0 2023-12-05T13:26:44.726 INFO:tasks.workunit.client.0.smithi029.stdout:9/496: rename d7/d2c/d68/c9a to d7/d2c/d3a/ca6 0 2023-12-05T13:26:44.729 INFO:tasks.workunit.client.0.smithi029.stdout:9/497: write d7/d2c/f4c [2541679,29453] 0 2023-12-05T13:26:44.729 INFO:tasks.workunit.client.0.smithi029.stdout:9/498: fsync d7/d19/f41 0 2023-12-05T13:26:44.730 INFO:tasks.workunit.client.0.smithi029.stdout:9/499: truncate d7/d19/d1f/f4f 154057 0 2023-12-05T13:26:44.734 INFO:tasks.workunit.client.0.smithi029.stdout:9/500: getdents d7/d19/d28 0 2023-12-05T13:26:44.735 INFO:tasks.workunit.client.0.smithi029.stdout:1/696: dwrite d7/d61/d77/fbd [0,4194304] 0 2023-12-05T13:26:44.736 INFO:tasks.workunit.client.0.smithi029.stdout:1/697: dread - d7/d5e/d52/d5f/d48/fae zero size 2023-12-05T13:26:44.736 INFO:tasks.workunit.client.0.smithi029.stdout:9/501: unlink d7/d2c/d3a/d52/f6e 0 2023-12-05T13:26:44.739 INFO:tasks.workunit.client.0.smithi029.stdout:8/752: dread d5/dc/d18/d26/dc0/fcb [0,4194304] 0 2023-12-05T13:26:44.739 INFO:tasks.workunit.client.0.smithi029.stdout:6/716: dwrite d6/d1d/d39/d58/de2/fe9 [0,4194304] 0 2023-12-05T13:26:44.741 INFO:tasks.workunit.client.0.smithi029.stdout:6/717: read d6/d29/dc4/d40/d74/d52/d5c/fa6 [3800826,101311] 0 2023-12-05T13:26:44.741 INFO:tasks.workunit.client.0.smithi029.stdout:6/718: readlink d6/d29/dc4/d40/d74/d52/d5c/d6f/l75 0 2023-12-05T13:26:44.741 INFO:tasks.workunit.client.0.smithi029.stdout:6/719: fsync d6/d1d/d39/d58/fc1 0 2023-12-05T13:26:44.741 INFO:tasks.workunit.client.0.smithi029.stdout:1/698: rename d7/d61/f59 to d7/d5e/fe9 0 2023-12-05T13:26:44.742 INFO:tasks.workunit.client.0.smithi029.stdout:9/502: mknod d7/d2c/d3a/d64/ca7 0 2023-12-05T13:26:44.743 INFO:tasks.workunit.client.0.smithi029.stdout:0/610: dwrite dc/f5a [0,4194304] 0 2023-12-05T13:26:44.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/753: symlink d5/dc/d18/l101 0 2023-12-05T13:26:44.747 INFO:tasks.workunit.client.0.smithi029.stdout:8/754: chown d5/d2f/d3a/d3c 23 1 2023-12-05T13:26:44.749 INFO:tasks.workunit.client.0.smithi029.stdout:1/699: mknod d7/d5e/d52/de4/cea 0 2023-12-05T13:26:44.752 INFO:tasks.workunit.client.0.smithi029.stdout:9/503: mknod d7/d19/d30/d43/ca8 0 2023-12-05T13:26:44.752 INFO:tasks.workunit.client.0.smithi029.stdout:9/504: fsync d7/d19/d30/d40/f7e 0 2023-12-05T13:26:44.752 INFO:tasks.workunit.client.0.smithi029.stdout:0/611: creat dc/d13/d4f/d91/fc3 x:0 0 0 2023-12-05T13:26:44.756 INFO:tasks.workunit.client.0.smithi029.stdout:1/700: rename d7/d5e/d52/d5f/l45 to d7/d5e/leb 0 2023-12-05T13:26:44.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/505: readlink d7/d2c/l76 0 2023-12-05T13:26:44.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/506: fsync d7/d19/d30/d40/d4e/f5f 0 2023-12-05T13:26:44.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/507: chown d7/d19/d30/d40/f9f 3 1 2023-12-05T13:26:44.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/508: stat d7/d19/d30/d99/c6f 0 2023-12-05T13:26:44.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/701: creat d7/d5e/d52/d90/dd6/fec x:0 0 0 2023-12-05T13:26:44.758 INFO:tasks.workunit.client.0.smithi029.stdout:1/702: chown d7/d5e/d52/d5f/d12/d60/fd8 177395 1 2023-12-05T13:26:44.761 INFO:tasks.workunit.client.0.smithi029.stdout:0/612: dread f9 [0,4194304] 0 2023-12-05T13:26:44.761 INFO:tasks.workunit.client.0.smithi029.stdout:6/720: dwrite d6/d29/dc4/d40/db5/fe6 [0,4194304] 0 2023-12-05T13:26:44.762 INFO:tasks.workunit.client.0.smithi029.stdout:6/721: truncate d6/d29/dc4/d40/d4d/d8f/de0/ff1 37435 0 2023-12-05T13:26:44.764 INFO:tasks.workunit.client.0.smithi029.stdout:0/613: mkdir dc/d13/d4f/d88/dc4 0 2023-12-05T13:26:44.766 INFO:tasks.workunit.client.0.smithi029.stdout:8/755: dwrite d5/d2f/d3a/d3c/da2/fb9 [0,4194304] 0 2023-12-05T13:26:44.766 INFO:tasks.workunit.client.0.smithi029.stdout:8/756: stat d5/d6/d10/f76 0 2023-12-05T13:26:44.766 INFO:tasks.workunit.client.0.smithi029.stdout:0/614: rename dc/l10 to dc/d23/d3a/d41/lc5 0 2023-12-05T13:26:44.769 INFO:tasks.workunit.client.0.smithi029.stdout:0/615: truncate dc/d33/d3d/d7a/d84/d8d/d97/fa3 2026754 0 2023-12-05T13:26:44.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/757: symlink d5/l102 0 2023-12-05T13:26:44.771 INFO:tasks.workunit.client.0.smithi029.stdout:8/758: write d5/d6/d10/d8a/f8e [450990,62603] 0 2023-12-05T13:26:44.773 INFO:tasks.workunit.client.0.smithi029.stdout:8/759: getdents d5/d2f 0 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/616: dread dc/f14 [0,4194304] 0 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/617: chown dc/d33/d3d/cb3 2788 1 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/618: chown dc/d33/d3d/d7a/d84/d8d/fb0 14 1 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/619: fsync dc/d13/d4f/d88/f99 0 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:0/620: fdatasync dc/d13/d4f/d88/f99 0 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/703: dwrite d7/d6e/da9/d4b/d72/f83 [0,4194304] 0 2023-12-05T13:26:44.783 INFO:tasks.workunit.client.0.smithi029.stdout:1/704: chown d7/d5e/d52/d5f/l62 41534084 1 2023-12-05T13:26:44.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/509: dwrite d7/d19/d30/f9d [0,4194304] 0 2023-12-05T13:26:44.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/510: chown d7/d19/f9b 335322 1 2023-12-05T13:26:44.785 INFO:tasks.workunit.client.0.smithi029.stdout:9/511: chown d7/f13 15352804 1 2023-12-05T13:26:44.785 INFO:tasks.workunit.client.0.smithi029.stdout:0/621: creat dc/d33/d3d/d7a/d84/d8d/fc6 x:0 0 0 2023-12-05T13:26:44.789 INFO:tasks.workunit.client.0.smithi029.stdout:6/722: dwrite d6/d1d/d39/f87 [0,4194304] 0 2023-12-05T13:26:44.789 INFO:tasks.workunit.client.0.smithi029.stdout:6/723: fdatasync d6/d29/dc4/d40/d4d/fa2 0 2023-12-05T13:26:44.790 INFO:tasks.workunit.client.0.smithi029.stdout:1/705: creat d7/d61/d4f/fed x:0 0 0 2023-12-05T13:26:44.791 INFO:tasks.workunit.client.0.smithi029.stdout:9/512: rmdir d7/d19/d30/d40 39 2023-12-05T13:26:44.793 INFO:tasks.workunit.client.0.smithi029.stdout:0/622: symlink dc/d33/d3d/d7a/d84/d8d/d97/lc7 0 2023-12-05T13:26:44.799 INFO:tasks.workunit.client.0.smithi029.stdout:9/513: dread d7/d19/d1f/f61 [0,4194304] 0 2023-12-05T13:26:44.800 INFO:tasks.workunit.client.0.smithi029.stdout:6/724: symlink d6/d64/d6d/da3/lf5 0 2023-12-05T13:26:44.804 INFO:tasks.workunit.client.0.smithi029.stdout:1/706: rename d7/d5e/d52/d90/dd6/fd9 to d7/fee 0 2023-12-05T13:26:44.805 INFO:tasks.workunit.client.0.smithi029.stdout:0/623: dread dc/d33/d3d/d7a/d84/d8d/d97/faa [0,4194304] 0 2023-12-05T13:26:44.806 INFO:tasks.workunit.client.0.smithi029.stdout:9/514: creat d7/d19/d28/d65/fa9 x:0 0 0 2023-12-05T13:26:44.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/707: creat d7/d5b/fef x:0 0 0 2023-12-05T13:26:44.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/708: fsync d7/d6e/da9/d4b/db1/fc4 0 2023-12-05T13:26:44.808 INFO:tasks.workunit.client.0.smithi029.stdout:1/709: chown d7/d56/da8/fad 2 1 2023-12-05T13:26:44.809 INFO:tasks.workunit.client.0.smithi029.stdout:0/624: mknod dc/d33/d3d/d65/d85/cc8 0 2023-12-05T13:26:44.810 INFO:tasks.workunit.client.0.smithi029.stdout:0/625: read dc/f14 [419597,81346] 0 2023-12-05T13:26:44.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/515: truncate d7/d19/d1f/f4f 869165 0 2023-12-05T13:26:44.812 INFO:tasks.workunit.client.0.smithi029.stdout:3/665: sync 2023-12-05T13:26:44.812 INFO:tasks.workunit.client.0.smithi029.stdout:3/666: write d1/d16/d36/d3a/d6c/d7d/fa1 [5449,101048] 0 2023-12-05T13:26:44.813 INFO:tasks.workunit.client.0.smithi029.stdout:0/626: write dc/f35 [614039,32333] 0 2023-12-05T13:26:44.814 INFO:tasks.workunit.client.0.smithi029.stdout:3/667: truncate d1/d10/d91/f68 2602620 0 2023-12-05T13:26:44.814 INFO:tasks.workunit.client.0.smithi029.stdout:3/668: fsync d1/d16/d36/f66 0 2023-12-05T13:26:44.815 INFO:tasks.workunit.client.0.smithi029.stdout:0/627: creat dc/d23/dbf/fc9 x:0 0 0 2023-12-05T13:26:44.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/725: dwrite d6/d64/d6d/da3/dcf/fd6 [0,4194304] 0 2023-12-05T13:26:44.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/726: rename d6/d29/dc4/d40/d4d/fbd to d6/d29/d9c/ff6 0 2023-12-05T13:26:44.830 INFO:tasks.workunit.client.0.smithi029.stdout:3/669: dwrite d1/d16/f49 [0,4194304] 0 2023-12-05T13:26:44.830 INFO:tasks.workunit.client.0.smithi029.stdout:3/670: readlink d1/d10/d91/l35 0 2023-12-05T13:26:44.831 INFO:tasks.workunit.client.0.smithi029.stdout:9/516: dwrite d7/d19/d1f/f61 [0,4194304] 0 2023-12-05T13:26:44.831 INFO:tasks.workunit.client.0.smithi029.stdout:6/727: dread d6/d29/dc4/d40/d74/d59/faa [0,4194304] 0 2023-12-05T13:26:44.832 INFO:tasks.workunit.client.0.smithi029.stdout:3/671: rmdir d1/d18 39 2023-12-05T13:26:44.838 INFO:tasks.workunit.client.0.smithi029.stdout:9/517: mknod d7/d19/d30/d99/d8d/caa 0 2023-12-05T13:26:44.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/728: creat d6/d3f/db7/def/ff7 x:0 0 0 2023-12-05T13:26:44.850 INFO:tasks.workunit.client.0.smithi029.stdout:3/672: dwrite d1/d10/d91/f7e [0,4194304] 0 2023-12-05T13:26:44.859 INFO:tasks.workunit.client.0.smithi029.stdout:6/729: dwrite d6/d64/d6d/d85/fc8 [0,4194304] 0 2023-12-05T13:26:44.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/518: dwrite d7/d19/d28/f37 [0,4194304] 0 2023-12-05T13:26:44.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/519: chown d7/d2c/d3a/f3e 85 1 2023-12-05T13:26:44.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/520: write d7/d19/d30/d99/f82 [645815,24174] 0 2023-12-05T13:26:44.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/521: getdents d7/d2c/d33 0 2023-12-05T13:26:44.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/522: mknod d7/d5a/cab 0 2023-12-05T13:26:44.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/523: getdents d7/d2c/d68/d7f 0 2023-12-05T13:26:44.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/524: chown d7/d2c/d3a/c9e 0 1 2023-12-05T13:26:44.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/673: dwrite d1/d16/fb2 [0,4194304] 0 2023-12-05T13:26:44.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/674: readlink d1/d6/d4a/db8/lc9 0 2023-12-05T13:26:44.867 INFO:tasks.workunit.client.0.smithi029.stdout:3/675: chown d1/d10/d91/l35 0 1 2023-12-05T13:26:44.867 INFO:tasks.workunit.client.0.smithi029.stdout:9/525: symlink d7/lac 0 2023-12-05T13:26:44.871 INFO:tasks.workunit.client.0.smithi029.stdout:9/526: mkdir d7/d19/d30/d99/d8d/dad 0 2023-12-05T13:26:44.873 INFO:tasks.workunit.client.0.smithi029.stdout:9/527: creat d7/d2c/d33/fae x:0 0 0 2023-12-05T13:26:44.874 INFO:tasks.workunit.client.0.smithi029.stdout:5/558: sync 2023-12-05T13:26:44.874 INFO:tasks.workunit.client.0.smithi029.stdout:5/559: fdatasync d1/dc/d11/f12 0 2023-12-05T13:26:44.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/528: rename d7/d19/d30/d99/ca0 to d7/caf 0 2023-12-05T13:26:44.878 INFO:tasks.workunit.client.0.smithi029.stdout:9/529: symlink d7/d19/d28/lb0 0 2023-12-05T13:26:44.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/730: dwrite d6/f1c [4194304,4194304] 0 2023-12-05T13:26:44.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/731: truncate d6/d1d/f55 953384 0 2023-12-05T13:26:44.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/732: readlink d6/d29/dc4/d40/d74/d52/ld1 0 2023-12-05T13:26:44.879 INFO:tasks.workunit.client.0.smithi029.stdout:6/733: readlink d6/d29/dc4/lca 0 2023-12-05T13:26:44.879 INFO:tasks.workunit.client.0.smithi029.stdout:9/530: read d7/d19/d1f/f61 [866392,98719] 0 2023-12-05T13:26:44.881 INFO:tasks.workunit.client.0.smithi029.stdout:3/676: dwrite d1/fd [0,4194304] 0 2023-12-05T13:26:44.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/531: write d7/d19/d30/d40/d4e/f74 [2039393,42220] 0 2023-12-05T13:26:44.882 INFO:tasks.workunit.client.0.smithi029.stdout:6/734: write d6/d1d/d39/f87 [1680950,7219] 0 2023-12-05T13:26:44.887 INFO:tasks.workunit.client.0.smithi029.stdout:3/677: rename d1/d16/d1f/d4c/dae/lbe to d1/db3/d72/ld2 0 2023-12-05T13:26:44.888 INFO:tasks.workunit.client.0.smithi029.stdout:6/735: creat d6/d29/dc4/d40/ff8 x:0 0 0 2023-12-05T13:26:44.889 INFO:tasks.workunit.client.0.smithi029.stdout:3/678: symlink d1/d6/d4a/ld3 0 2023-12-05T13:26:44.889 INFO:tasks.workunit.client.0.smithi029.stdout:3/679: fdatasync d1/d16/d1f/d4c/f5f 0 2023-12-05T13:26:44.890 INFO:tasks.workunit.client.0.smithi029.stdout:6/736: truncate d6/d29/dc4/d40/fd2 1734563 0 2023-12-05T13:26:44.891 INFO:tasks.workunit.client.0.smithi029.stdout:3/680: creat d1/d5e/d74/fd4 x:0 0 0 2023-12-05T13:26:44.891 INFO:tasks.workunit.client.0.smithi029.stdout:3/681: dread - d1/d18/fa0 zero size 2023-12-05T13:26:44.892 INFO:tasks.workunit.client.0.smithi029.stdout:3/682: symlink d1/d16/d1f/d4c/ld5 0 2023-12-05T13:26:44.899 INFO:tasks.workunit.client.0.smithi029.stdout:5/560: dwrite d1/dc/d27/f49 [0,4194304] 0 2023-12-05T13:26:44.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/532: dwrite d7/d2c/f4c [0,4194304] 0 2023-12-05T13:26:44.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/533: readlink d7/l12 0 2023-12-05T13:26:44.901 INFO:tasks.workunit.client.0.smithi029.stdout:9/534: creat d7/d19/d30/d40/d4e/fb1 x:0 0 0 2023-12-05T13:26:44.901 INFO:tasks.workunit.client.0.smithi029.stdout:9/535: truncate d7/d19/d30/d40/d4e/f5f 726897 0 2023-12-05T13:26:44.901 INFO:tasks.workunit.client.0.smithi029.stdout:9/536: read d7/d19/d1f/f46 [1058539,47163] 0 2023-12-05T13:26:44.903 INFO:tasks.workunit.client.0.smithi029.stdout:9/537: dread d7/d19/d1f/f4f [0,4194304] 0 2023-12-05T13:26:44.914 INFO:tasks.workunit.client.0.smithi029.stdout:5/561: dwrite d1/dc/d25/f5e [0,4194304] 0 2023-12-05T13:26:44.914 INFO:tasks.workunit.client.0.smithi029.stdout:5/562: write d1/dc/d38/d3a/d5c/d87/fb8 [365571,67594] 0 2023-12-05T13:26:44.918 INFO:tasks.workunit.client.0.smithi029.stdout:5/563: mknod d1/dc/d38/d3a/d5c/d87/cc7 0 2023-12-05T13:26:44.919 INFO:tasks.workunit.client.0.smithi029.stdout:5/564: symlink d1/dc/d10/lc8 0 2023-12-05T13:26:44.920 INFO:tasks.workunit.client.0.smithi029.stdout:5/565: chown d1/dc/d38/d3a/d5c/d87/cc7 27976 1 2023-12-05T13:26:44.926 INFO:tasks.workunit.client.0.smithi029.stdout:9/538: dwrite d7/d19/d30/d43/f4d [0,4194304] 0 2023-12-05T13:26:44.927 INFO:tasks.workunit.client.0.smithi029.stdout:9/539: write d7/d5a/f91 [854941,106064] 0 2023-12-05T13:26:44.928 INFO:tasks.workunit.client.0.smithi029.stdout:9/540: unlink d7/d2c/d3a/f3e 0 2023-12-05T13:26:44.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/541: link d7/d19/d30/d99/d8d/caa d7/d19/cb2 0 2023-12-05T13:26:44.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/542: readlink d7/d19/l25 0 2023-12-05T13:26:44.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/543: write d7/d19/d30/d99/f82 [1223851,110577] 0 2023-12-05T13:26:44.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/544: chown d7/d19/d28/d65/fa9 14461675 1 2023-12-05T13:26:44.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/545: chown d7/d2c/d3a/d64 15991000 1 2023-12-05T13:26:44.930 INFO:tasks.workunit.client.0.smithi029.stdout:9/546: symlink d7/d5a/lb3 0 2023-12-05T13:26:44.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/547: rmdir d7/d2c/d3a/d52 39 2023-12-05T13:26:44.933 INFO:tasks.workunit.client.0.smithi029.stdout:9/548: symlink d7/d2c/d68/d7f/lb4 0 2023-12-05T13:26:44.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/549: mkdir d7/d19/d30/d99/d8d/db5 0 2023-12-05T13:26:44.934 INFO:tasks.workunit.client.0.smithi029.stdout:9/550: fdatasync d7/d2c/d33/fae 0 2023-12-05T13:26:44.940 INFO:tasks.workunit.client.0.smithi029.stdout:9/551: dread d7/d19/fa5 [0,4194304] 0 2023-12-05T13:26:44.941 INFO:tasks.workunit.client.0.smithi029.stdout:9/552: read d7/d19/d30/d99/f82 [574455,30693] 0 2023-12-05T13:26:44.941 INFO:tasks.workunit.client.0.smithi029.stdout:9/553: rmdir d7/d19/d30/d99/d8d 39 2023-12-05T13:26:44.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/554: dread d7/d2c/d33/f5b [0,4194304] 0 2023-12-05T13:26:44.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/555: readlink d7/d19/l1a 0 2023-12-05T13:26:44.951 INFO:tasks.workunit.client.0.smithi029.stdout:9/556: symlink d7/d19/d28/d65/d73/lb6 0 2023-12-05T13:26:44.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/557: getdents d7/d2c/d68/d7f 0 2023-12-05T13:26:44.959 INFO:tasks.workunit.client.0.smithi029.stdout:9/558: dread d7/d5a/f91 [0,4194304] 0 2023-12-05T13:26:44.960 INFO:tasks.workunit.client.0.smithi029.stdout:9/559: symlink d7/d19/d28/d50/lb7 0 2023-12-05T13:26:44.977 INFO:tasks.workunit.client.0.smithi029.stdout:9/560: dwrite d7/d19/d28/f37 [0,4194304] 0 2023-12-05T13:26:44.978 INFO:tasks.workunit.client.0.smithi029.stdout:9/561: creat d7/d19/fb8 x:0 0 0 2023-12-05T13:26:44.978 INFO:tasks.workunit.client.0.smithi029.stdout:9/562: chown d7/d19/l31 55 1 2023-12-05T13:26:44.995 INFO:tasks.workunit.client.0.smithi029.stdout:9/563: dwrite d7/f3c [0,4194304] 0 2023-12-05T13:26:44.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/564: mkdir d7/d2c/d3a/d52/db9 0 2023-12-05T13:26:44.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/565: fsync d7/d5a/f91 0 2023-12-05T13:26:44.996 INFO:tasks.workunit.client.0.smithi029.stdout:9/566: getdents d7/d19/d1f/da2 0 2023-12-05T13:26:44.997 INFO:tasks.workunit.client.0.smithi029.stdout:9/567: unlink d7/d19/d30/d43/f4d 0 2023-12-05T13:26:44.998 INFO:tasks.workunit.client.0.smithi029.stdout:9/568: creat d7/d19/d30/d99/d8d/dad/fba x:0 0 0 2023-12-05T13:26:45.000 INFO:tasks.workunit.client.0.smithi029.stdout:9/569: symlink d7/d19/d30/d40/d4e/lbb 0 2023-12-05T13:26:45.001 INFO:tasks.workunit.client.0.smithi029.stdout:9/570: dread d7/d19/d1f/f4f [0,4194304] 0 2023-12-05T13:26:45.001 INFO:tasks.workunit.client.0.smithi029.stdout:9/571: chown d7/d19/d30/l4b 71793 1 2023-12-05T13:26:45.006 INFO:tasks.workunit.client.0.smithi029.stdout:9/572: unlink d7/d2c/d3a/c9e 0 2023-12-05T13:26:45.010 INFO:tasks.workunit.client.0.smithi029.stdout:2/645: sync 2023-12-05T13:26:45.011 INFO:tasks.workunit.client.0.smithi029.stdout:2/646: creat de/d16/d6c/fcc x:0 0 0 2023-12-05T13:26:45.011 INFO:tasks.workunit.client.0.smithi029.stdout:2/647: fsync f3 0 2023-12-05T13:26:45.013 INFO:tasks.workunit.client.0.smithi029.stdout:2/648: rename de/c3b to de/d16/d43/ccd 0 2023-12-05T13:26:45.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/649: rename fa to de/d41/d56/d58/fce 0 2023-12-05T13:26:45.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/650: chown de/d16/d43/f82 167 1 2023-12-05T13:26:45.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/651: read de/d14/d24/f1c [2033745,100037] 0 2023-12-05T13:26:45.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/652: fdatasync de/d14/d24/d93/dc5/dc9/f68 0 2023-12-05T13:26:45.016 INFO:tasks.workunit.client.0.smithi029.stdout:2/653: chown de/d41/d56/fb9 225202391 1 2023-12-05T13:26:45.018 INFO:tasks.workunit.client.0.smithi029.stdout:2/654: rename de/d11/d32/f3e to de/d14/d24/db7/fcf 0 2023-12-05T13:26:45.018 INFO:tasks.workunit.client.0.smithi029.stdout:2/655: truncate de/d14/d24/f74 659866 0 2023-12-05T13:26:45.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/573: dwrite d7/d19/d30/d99/f7d [0,4194304] 0 2023-12-05T13:26:45.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/574: fdatasync d7/d19/d30/d40/f9f 0 2023-12-05T13:26:45.019 INFO:tasks.workunit.client.0.smithi029.stdout:9/575: write d7/d5a/f91 [2409662,3147] 0 2023-12-05T13:26:45.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/656: write de/d16/d6c/d8e/fb0 [3365728,34948] 0 2023-12-05T13:26:45.022 INFO:tasks.workunit.client.0.smithi029.stdout:2/657: mknod de/d6a/cd0 0 2023-12-05T13:26:45.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/658: creat de/d14/d24/d93/fd1 x:0 0 0 2023-12-05T13:26:45.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/659: chown de/d14/d24/cc7 8044 1 2023-12-05T13:26:45.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/660: chown de/d41/d56/d58/fca 13117909 1 2023-12-05T13:26:45.035 INFO:tasks.workunit.client.0.smithi029.stdout:9/576: dwrite d7/d19/f41 [0,4194304] 0 2023-12-05T13:26:45.035 INFO:tasks.workunit.client.0.smithi029.stdout:2/661: dread de/d6a/fb3 [0,4194304] 0 2023-12-05T13:26:45.101 INFO:tasks.workunit.client.0.smithi029.stdout:9/577: creat d7/d19/d1f/fbc x:0 0 0 2023-12-05T13:26:45.102 INFO:tasks.workunit.client.0.smithi029.stdout:2/662: mknod de/d11/dad/cd2 0 2023-12-05T13:26:45.104 INFO:tasks.workunit.client.0.smithi029.stdout:9/578: symlink d7/d2c/d68/lbd 0 2023-12-05T13:26:45.106 INFO:tasks.workunit.client.0.smithi029.stdout:9/579: truncate d7/d19/fa5 2720251 0 2023-12-05T13:26:45.116 INFO:tasks.workunit.client.0.smithi029.stdout:2/663: dwrite de/d11/f25 [0,4194304] 0 2023-12-05T13:26:45.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/664: link de/d41/d56/f75 de/d14/d24/d93/dc5/dc9/fd3 0 2023-12-05T13:26:45.120 INFO:tasks.workunit.client.0.smithi029.stdout:2/665: symlink de/d16/d6c/d8e/dbf/ld4 0 2023-12-05T13:26:45.121 INFO:tasks.workunit.client.0.smithi029.stdout:2/666: creat de/d14/da3/fd5 x:0 0 0 2023-12-05T13:26:45.121 INFO:tasks.workunit.client.0.smithi029.stdout:2/667: chown de/d6a/fb3 1607248034 1 2023-12-05T13:26:45.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/668: getdents de/d16/d43 0 2023-12-05T13:26:45.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/669: fdatasync de/d11/f4f 0 2023-12-05T13:26:45.123 INFO:tasks.workunit.client.0.smithi029.stdout:2/670: symlink de/d14/d24/d93/ld6 0 2023-12-05T13:26:45.123 INFO:tasks.workunit.client.0.smithi029.stdout:2/671: write de/d16/d6c/fcc [58504,67229] 0 2023-12-05T13:26:45.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/672: rename de/d14/d24/db7/fcf to de/d41/d56/fd7 0 2023-12-05T13:26:45.126 INFO:tasks.workunit.client.0.smithi029.stdout:2/673: unlink de/d11/dad/cc4 0 2023-12-05T13:26:45.126 INFO:tasks.workunit.client.0.smithi029.stdout:2/674: creat de/d14/d24/d93/fd8 x:0 0 0 2023-12-05T13:26:45.250 INFO:tasks.workunit.client.0.smithi029.stdout:1/710: sync 2023-12-05T13:26:45.273 INFO:tasks.workunit.client.0.smithi029.stdout:1/711: dwrite d7/d6e/da9/d4b/db1/dd1/fe5 [0,4194304] 0 2023-12-05T13:26:45.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:45 smithi029 ceph-mon[112128]: pgmap v44: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 78 MiB/s rd, 150 MiB/s wr, 258 op/s 2023-12-05T13:26:45.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:45 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:45.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:45 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:45 smithi052 ceph-mon[121072]: pgmap v44: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 78 MiB/s rd, 150 MiB/s wr, 258 op/s 2023-12-05T13:26:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:45 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:45.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:45 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:46.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:46 smithi052 ceph-mon[121072]: Reconfiguring grafana.smithi029 (dependencies changed)... 2023-12-05T13:26:46.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:46 smithi052 ceph-mon[121072]: Reconfiguring daemon grafana.smithi029 on smithi029 2023-12-05T13:26:47.005 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:46 smithi029 ceph-mon[112128]: Reconfiguring grafana.smithi029 (dependencies changed)... 2023-12-05T13:26:47.005 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:46 smithi029 ceph-mon[112128]: Reconfiguring daemon grafana.smithi029 on smithi029 2023-12-05T13:26:47.350 INFO:tasks.workunit.client.0.smithi029.stdout:7/804: sync 2023-12-05T13:26:47.352 INFO:tasks.workunit.client.0.smithi029.stdout:3/683: sync 2023-12-05T13:26:47.352 INFO:tasks.workunit.client.0.smithi029.stdout:9/580: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:2/675: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:3/684: truncate d1/d6/d4a/f9b 1388445 0 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:1/712: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:1/713: read - d7/d5e/d52/d5f/d48/fae zero size 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:5/566: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:6/737: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:0/628: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:8/760: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:4/598: sync 2023-12-05T13:26:47.353 INFO:tasks.workunit.client.0.smithi029.stdout:4/599: read - d0/de/d15/f99 zero size 2023-12-05T13:26:47.354 INFO:tasks.workunit.client.0.smithi029.stdout:2/676: write de/d16/f1b [2192805,114306] 0 2023-12-05T13:26:47.354 INFO:tasks.workunit.client.0.smithi029.stdout:2/677: stat de/d41/d56/f67 0 2023-12-05T13:26:47.355 INFO:tasks.workunit.client.0.smithi029.stdout:0/629: read dc/d13/f2d [2690943,81832] 0 2023-12-05T13:26:47.360 INFO:tasks.workunit.client.0.smithi029.stdout:7/805: dread d6/f15 [0,4194304] 0 2023-12-05T13:26:47.360 INFO:tasks.workunit.client.0.smithi029.stdout:1/714: rmdir d7/d6e/da9 39 2023-12-05T13:26:47.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/581: mkdir d7/d19/d28/d65/dbe 0 2023-12-05T13:26:47.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/582: truncate d7/d19/fb8 358328 0 2023-12-05T13:26:47.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/583: dread d7/d19/d30/d43/f48 [0,4194304] 0 2023-12-05T13:26:47.369 INFO:tasks.workunit.client.0.smithi029.stdout:9/584: chown d7/d19/d30/d99 198710 1 2023-12-05T13:26:47.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/685: write d1/d10/d91/f7e [1614997,102524] 0 2023-12-05T13:26:47.369 INFO:tasks.workunit.client.0.smithi029.stdout:3/686: dread - d1/d16/d36/d3a/fb4 zero size 2023-12-05T13:26:47.374 INFO:tasks.workunit.client.0.smithi029.stdout:0/630: creat dc/d23/d3a/d41/fca x:0 0 0 2023-12-05T13:26:47.375 INFO:tasks.workunit.client.0.smithi029.stdout:7/806: mknod d6/d2a/d71/cfd 0 2023-12-05T13:26:47.375 INFO:tasks.workunit.client.0.smithi029.stdout:7/807: write d6/d50/d5b/d5f/d7d/d97/d51/f77 [4290474,105725] 0 2023-12-05T13:26:47.375 INFO:tasks.workunit.client.0.smithi029.stdout:7/808: chown d6/d50/d5b/d5f/d7d/d97/db2 322 1 2023-12-05T13:26:47.376 INFO:tasks.workunit.client.0.smithi029.stdout:3/687: read d1/d18/f45 [3097846,44329] 0 2023-12-05T13:26:47.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/715: rmdir d7/d5e/d52 39 2023-12-05T13:26:47.378 INFO:tasks.workunit.client.0.smithi029.stdout:1/716: chown d7/d6e/da9/d4b/c9e 787325 1 2023-12-05T13:26:47.386 INFO:tasks.workunit.client.0.smithi029.stdout:6/738: dwrite d6/d29/dc4/d40/d74/ff3 [0,4194304] 0 2023-12-05T13:26:47.387 INFO:tasks.workunit.client.0.smithi029.stdout:5/567: dwrite d1/dc/d38/d3a/d5c/d87/fb8 [0,4194304] 0 2023-12-05T13:26:47.392 INFO:tasks.workunit.client.0.smithi029.stdout:7/809: dread d6/d19/f21 [0,4194304] 0 2023-12-05T13:26:47.392 INFO:tasks.workunit.client.0.smithi029.stdout:7/810: chown d6/d2a/d4f/dc5/d52/ffc 438 1 2023-12-05T13:26:47.392 INFO:tasks.workunit.client.0.smithi029.stdout:7/811: chown d6/d50/d5b/d5f 73949404 1 2023-12-05T13:26:47.392 INFO:tasks.workunit.client.0.smithi029.stdout:3/688: mknod d1/d5e/d74/dab/cd6 0 2023-12-05T13:26:47.392 INFO:tasks.workunit.client.0.smithi029.stdout:3/689: dread - d1/d5e/d74/fc5 zero size 2023-12-05T13:26:47.392 INFO:tasks.workunit.client.0.smithi029.stdout:3/690: truncate d1/d5e/d74/fd4 745845 0 2023-12-05T13:26:47.396 INFO:tasks.workunit.client.0.smithi029.stdout:9/585: dwrite d7/f18 [4194304,4194304] 0 2023-12-05T13:26:47.396 INFO:tasks.workunit.client.0.smithi029.stdout:6/739: creat d6/d1d/d39/d58/d71/dbf/ff9 x:0 0 0 2023-12-05T13:26:47.396 INFO:tasks.workunit.client.0.smithi029.stdout:4/600: dwrite d0/d3c/d56/fbc [0,4194304] 0 2023-12-05T13:26:47.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/568: write d1/dc/d10/d1e/d33/d93/da5/db2/f4f [2056963,40999] 0 2023-12-05T13:26:47.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/569: readlink d1/dc/d11/d17/d3d/l41 0 2023-12-05T13:26:47.397 INFO:tasks.workunit.client.0.smithi029.stdout:5/570: write d1/dc/d27/f2a [1353862,129466] 0 2023-12-05T13:26:47.405 INFO:tasks.workunit.client.0.smithi029.stdout:4/601: dread d0/de/f45 [0,4194304] 0 2023-12-05T13:26:47.406 INFO:tasks.workunit.client.0.smithi029.stdout:9/586: dread d7/d2c/d33/f5b [0,4194304] 0 2023-12-05T13:26:47.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/602: read d0/d16/d22/d4f/f59 [2341729,58296] 0 2023-12-05T13:26:47.408 INFO:tasks.workunit.client.0.smithi029.stdout:3/691: creat d1/d16/fd7 x:0 0 0 2023-12-05T13:26:47.419 INFO:tasks.workunit.client.0.smithi029.stdout:7/812: dwrite d6/d50/d5b/d5f/d7d/d97/fd7 [0,4194304] 0 2023-12-05T13:26:47.420 INFO:tasks.workunit.client.0.smithi029.stdout:5/571: mkdir d1/dc/d27/dc9 0 2023-12-05T13:26:47.421 INFO:tasks.workunit.client.0.smithi029.stdout:5/572: stat d1/dc/d11/d17/d3d/f62 0 2023-12-05T13:26:47.427 INFO:tasks.workunit.client.0.smithi029.stdout:4/603: creat d0/d16/d22/dc2/fc4 x:0 0 0 2023-12-05T13:26:47.427 INFO:tasks.workunit.client.0.smithi029.stdout:4/604: fsync d0/d41/f9d 0 2023-12-05T13:26:47.432 INFO:tasks.workunit.client.0.smithi029.stdout:3/692: getdents d1/d16/d36 0 2023-12-05T13:26:47.434 INFO:tasks.workunit.client.0.smithi029.stdout:7/813: mknod d6/d50/d5b/d1a/cfe 0 2023-12-05T13:26:47.438 INFO:tasks.workunit.client.0.smithi029.stdout:4/605: creat d0/de/d30/d32/fc5 x:0 0 0 2023-12-05T13:26:47.445 INFO:tasks.workunit.client.0.smithi029.stdout:3/693: symlink d1/d6/d4a/db6/ld8 0 2023-12-05T13:26:47.447 INFO:tasks.workunit.client.0.smithi029.stdout:4/606: dread d0/da/f20 [0,4194304] 0 2023-12-05T13:26:47.453 INFO:tasks.workunit.client.0.smithi029.stdout:3/694: read d1/d10/f6e [290039,53961] 0 2023-12-05T13:26:47.456 INFO:tasks.workunit.client.0.smithi029.stdout:2/678: creat de/d6a/fd9 x:0 0 0 2023-12-05T13:26:47.462 INFO:tasks.workunit.client.0.smithi029.stdout:2/679: dread de/d11/f9f [0,4194304] 0 2023-12-05T13:26:47.465 INFO:tasks.workunit.client.0.smithi029.stdout:2/680: dread de/d41/d56/f6f [0,4194304] 0 2023-12-05T13:26:47.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/681: dread de/d11/f9f [0,4194304] 0 2023-12-05T13:26:47.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/682: chown fb 21 1 2023-12-05T13:26:47.467 INFO:tasks.workunit.client.0.smithi029.stdout:2/683: stat de/d14/d24/f89 0 2023-12-05T13:26:47.469 INFO:tasks.workunit.client.0.smithi029.stdout:2/684: mkdir de/db8/dda 0 2023-12-05T13:26:47.470 INFO:tasks.workunit.client.0.smithi029.stdout:3/695: dwrite d1/d5e/d74/fd4 [0,4194304] 0 2023-12-05T13:26:47.470 INFO:tasks.workunit.client.0.smithi029.stdout:3/696: readlink d1/d6/d4a/db6/lcf 0 2023-12-05T13:26:47.473 INFO:tasks.workunit.client.0.smithi029.stdout:0/631: rename dc/d33/d3d/d65/d85/fa0 to dc/d23/d3a/fcb 0 2023-12-05T13:26:47.473 INFO:tasks.workunit.client.0.smithi029.stdout:0/632: readlink dc/d33/d3d/d7a/d84/d8d/d97/d98/lae 0 2023-12-05T13:26:47.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/740: rename d6/d29/dc4/l23 to d6/d29/dc4/d40/d74/lfa 0 2023-12-05T13:26:47.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/633: dread dc/f35 [0,4194304] 0 2023-12-05T13:26:47.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/741: mkdir d6/d29/dc4/d40/d74/d59/dfb 0 2023-12-05T13:26:47.487 INFO:tasks.workunit.client.0.smithi029.stdout:6/742: truncate d6/d3f/f9d 957869 0 2023-12-05T13:26:47.488 INFO:tasks.workunit.client.0.smithi029.stdout:6/743: fdatasync d6/d29/dc4/d40/d4d/d8f/fa1 0 2023-12-05T13:26:47.491 INFO:tasks.workunit.client.0.smithi029.stdout:7/814: rename d6/d2a/d4f/ce9 to d6/d19/cff 0 2023-12-05T13:26:47.491 INFO:tasks.workunit.client.0.smithi029.stdout:7/815: truncate d6/d2a/d7e/d7b/f99 5006577 0 2023-12-05T13:26:47.492 INFO:tasks.workunit.client.0.smithi029.stdout:7/816: truncate d6/f13 5743908 0 2023-12-05T13:26:47.493 INFO:tasks.workunit.client.0.smithi029.stdout:2/685: rename de/d14/d24/d93/la6 to de/d16/d6c/d8e/ldb 0 2023-12-05T13:26:47.493 INFO:tasks.workunit.client.0.smithi029.stdout:3/697: dwrite d1/d10/d91/f68 [0,4194304] 0 2023-12-05T13:26:47.496 INFO:tasks.workunit.client.0.smithi029.stdout:6/744: rename d6/d29/da4 to d6/d1d/d39/d58/dfc 0 2023-12-05T13:26:47.496 INFO:tasks.workunit.client.0.smithi029.stdout:6/745: write d6/d29/dc4/d40/d4d/d8f/de0/ff1 [1014960,122631] 0 2023-12-05T13:26:47.497 INFO:tasks.workunit.client.0.smithi029.stdout:2/686: mkdir de/d16/d6c/ddc 0 2023-12-05T13:26:47.499 INFO:tasks.workunit.client.0.smithi029.stdout:0/634: dwrite dc/d33/d3d/d7a/d84/fc0 [0,4194304] 0 2023-12-05T13:26:47.502 INFO:tasks.workunit.client.0.smithi029.stdout:3/698: unlink d1/d5e/cb1 0 2023-12-05T13:26:47.502 INFO:tasks.workunit.client.0.smithi029.stdout:3/699: chown d1/d18/f2e 87075887 1 2023-12-05T13:26:47.502 INFO:tasks.workunit.client.0.smithi029.stdout:3/700: fsync d1/d10/f71 0 2023-12-05T13:26:47.502 INFO:tasks.workunit.client.0.smithi029.stdout:6/746: creat d6/d29/dc4/d40/d74/ffd x:0 0 0 2023-12-05T13:26:47.502 INFO:tasks.workunit.client.0.smithi029.stdout:6/747: readlink d6/l27 0 2023-12-05T13:26:47.504 INFO:tasks.workunit.client.0.smithi029.stdout:2/687: link de/d16/f47 de/d11/fdd 0 2023-12-05T13:26:47.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/635: symlink dc/d33/d3d/d7a/d84/db1/lcc 0 2023-12-05T13:26:47.507 INFO:tasks.workunit.client.0.smithi029.stdout:3/701: symlink d1/d6/d4a/db6/ld9 0 2023-12-05T13:26:47.509 INFO:tasks.workunit.client.0.smithi029.stdout:2/688: getdents de 0 2023-12-05T13:26:47.511 INFO:tasks.workunit.client.0.smithi029.stdout:3/702: mkdir d1/d10/d91/dda 0 2023-12-05T13:26:47.511 INFO:tasks.workunit.client.0.smithi029.stdout:0/636: write dc/ff [67598,5944] 0 2023-12-05T13:26:47.514 INFO:tasks.workunit.client.0.smithi029.stdout:2/689: rename de/d14/f7e to de/db8/fde 0 2023-12-05T13:26:47.514 INFO:tasks.workunit.client.0.smithi029.stdout:2/690: read - de/d16/fc8 zero size 2023-12-05T13:26:47.515 INFO:tasks.workunit.client.0.smithi029.stdout:3/703: creat d1/d16/d36/fdb x:0 0 0 2023-12-05T13:26:47.516 INFO:tasks.workunit.client.0.smithi029.stdout:0/637: mkdir dc/d23/d3a/d41/d57/d58/dcd 0 2023-12-05T13:26:47.517 INFO:tasks.workunit.client.0.smithi029.stdout:3/704: mknod d1/d16/d9c/cdc 0 2023-12-05T13:26:47.522 INFO:tasks.workunit.client.0.smithi029.stdout:0/638: link dc/fb7 dc/d23/d3a/d41/d57/d58/d73/fce 0 2023-12-05T13:26:47.522 INFO:tasks.workunit.client.0.smithi029.stdout:0/639: fsync dc/d13/fb9 0 2023-12-05T13:26:47.523 INFO:tasks.workunit.client.0.smithi029.stdout:0/640: creat dc/d33/d3d/d7a/d84/fcf x:0 0 0 2023-12-05T13:26:47.523 INFO:tasks.workunit.client.0.smithi029.stdout:9/587: mknod d7/d19/d30/cbf 0 2023-12-05T13:26:47.524 INFO:tasks.workunit.client.0.smithi029.stdout:0/641: symlink dc/d23/ld0 0 2023-12-05T13:26:47.524 INFO:tasks.workunit.client.0.smithi029.stdout:0/642: truncate dc/d23/fbc 954279 0 2023-12-05T13:26:47.527 INFO:tasks.workunit.client.0.smithi029.stdout:9/588: rename d7/d2c/d68 to d7/d19/d28/d50/dc0 0 2023-12-05T13:26:47.530 INFO:tasks.workunit.client.0.smithi029.stdout:0/643: unlink dc/d33/d3d/d7e/f9f 0 2023-12-05T13:26:47.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/691: dwrite de/d16/d43/f46 [0,4194304] 0 2023-12-05T13:26:47.531 INFO:tasks.workunit.client.0.smithi029.stdout:2/692: dread - de/d14/da3/fd5 zero size 2023-12-05T13:26:47.532 INFO:tasks.workunit.client.0.smithi029.stdout:0/644: unlink dc/d13/d4f/d88/cc1 0 2023-12-05T13:26:47.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/589: mknod d7/d2c/cc1 0 2023-12-05T13:26:47.533 INFO:tasks.workunit.client.0.smithi029.stdout:9/590: write d7/d2c/d3a/d52/f81 [502877,85080] 0 2023-12-05T13:26:47.538 INFO:tasks.workunit.client.0.smithi029.stdout:0/645: creat dc/d13/d4f/d91/fd1 x:0 0 0 2023-12-05T13:26:47.541 INFO:tasks.workunit.client.0.smithi029.stdout:3/705: dwrite d1/d6/d4a/f97 [0,4194304] 0 2023-12-05T13:26:47.542 INFO:tasks.workunit.client.0.smithi029.stdout:0/646: unlink dc/d13/d4f/d91/lba 0 2023-12-05T13:26:47.542 INFO:tasks.workunit.client.0.smithi029.stdout:0/647: chown dc/d33/d3d/d7a/c93 73137 1 2023-12-05T13:26:47.542 INFO:tasks.workunit.client.0.smithi029.stdout:0/648: dread - dc/d23/d3a/d41/d70/f81 zero size 2023-12-05T13:26:47.544 INFO:tasks.workunit.client.0.smithi029.stdout:3/706: rename d1/d10/l90 to d1/db3/dc7/ldd 0 2023-12-05T13:26:47.544 INFO:tasks.workunit.client.0.smithi029.stdout:0/649: rename dc/d23/d3a/d41 to dc/d23/d3a/d41/d57/d58/d73/dd2 22 2023-12-05T13:26:47.545 INFO:tasks.workunit.client.0.smithi029.stdout:3/707: mkdir d1/d10/d91/dde 0 2023-12-05T13:26:47.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/717: rmdir d7/d5e/d52/d5f 39 2023-12-05T13:26:47.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/718: chown d7/d5e/fe9 913725782 1 2023-12-05T13:26:47.546 INFO:tasks.workunit.client.0.smithi029.stdout:1/719: truncate d7/d61/f92 744543 0 2023-12-05T13:26:47.547 INFO:tasks.workunit.client.0.smithi029.stdout:0/650: creat dc/d23/d3a/fd3 x:0 0 0 2023-12-05T13:26:47.547 INFO:tasks.workunit.client.0.smithi029.stdout:0/651: fdatasync dc/d23/d3a/d41/d57/f59 0 2023-12-05T13:26:47.549 INFO:tasks.workunit.client.0.smithi029.stdout:1/720: creat d7/d56/ff0 x:0 0 0 2023-12-05T13:26:47.550 INFO:tasks.workunit.client.0.smithi029.stdout:0/652: creat dc/d23/dbf/fd4 x:0 0 0 2023-12-05T13:26:47.551 INFO:tasks.workunit.client.0.smithi029.stdout:1/721: dread d7/d6e/f86 [0,4194304] 0 2023-12-05T13:26:47.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/653: symlink dc/d23/d3a/d41/d57/d58/d73/d86/ld5 0 2023-12-05T13:26:47.554 INFO:tasks.workunit.client.0.smithi029.stdout:3/708: dread d1/f48 [0,4194304] 0 2023-12-05T13:26:47.555 INFO:tasks.workunit.client.0.smithi029.stdout:1/722: symlink d7/d61/d77/lf1 0 2023-12-05T13:26:47.555 INFO:tasks.workunit.client.0.smithi029.stdout:1/723: stat d7/d61/d4f/f8a 0 2023-12-05T13:26:47.556 INFO:tasks.workunit.client.0.smithi029.stdout:1/724: chown d7/d6e/da9/d4b/d72 2 1 2023-12-05T13:26:47.556 INFO:tasks.workunit.client.0.smithi029.stdout:1/725: write d7/d5e/d52/d5f/f6f [483809,39344] 0 2023-12-05T13:26:47.558 INFO:tasks.workunit.client.0.smithi029.stdout:3/709: write d1/d10/f41 [232645,43360] 0 2023-12-05T13:26:47.560 INFO:tasks.workunit.client.0.smithi029.stdout:7/817: rename d6/d2a to d6/d100 0 2023-12-05T13:26:47.560 INFO:tasks.workunit.client.0.smithi029.stdout:7/818: dread - d6/d100/d2f/fa0 zero size 2023-12-05T13:26:47.561 INFO:tasks.workunit.client.0.smithi029.stdout:3/710: mknod d1/d16/d36/d3a/cdf 0 2023-12-05T13:26:47.562 INFO:tasks.workunit.client.0.smithi029.stdout:0/654: dread dc/d23/d3a/d41/d57/d58/f7d [0,4194304] 0 2023-12-05T13:26:47.564 INFO:tasks.workunit.client.0.smithi029.stdout:7/819: rename d6/l1b to d6/d50/d5b/d1a/d26/dd8/l101 0 2023-12-05T13:26:47.566 INFO:tasks.workunit.client.0.smithi029.stdout:3/711: symlink d1/d16/d9c/le0 0 2023-12-05T13:26:47.567 INFO:tasks.workunit.client.0.smithi029.stdout:3/712: chown d1/db3/dc7 372 1 2023-12-05T13:26:47.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/820: creat d6/d50/f102 x:0 0 0 2023-12-05T13:26:47.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/821: truncate d6/d100/d2f/fec 509136 0 2023-12-05T13:26:47.582 INFO:tasks.workunit.client.0.smithi029.stdout:3/713: rename d1/d6/d11/da3/lc3 to d1/d16/d36/d3a/d6c/dbc/le1 0 2023-12-05T13:26:47.582 INFO:tasks.workunit.client.0.smithi029.stdout:3/714: read - d1/d16/d36/d3a/fb4 zero size 2023-12-05T13:26:47.582 INFO:tasks.workunit.client.0.smithi029.stdout:3/715: read - d1/d16/d36/fbb zero size 2023-12-05T13:26:47.583 INFO:tasks.workunit.client.0.smithi029.stdout:7/822: getdents d6/d50/d5b/d5f/d7d/d97/db2 0 2023-12-05T13:26:47.585 INFO:tasks.workunit.client.0.smithi029.stdout:3/716: link d1/d10/f8c d1/d6/fe2 0 2023-12-05T13:26:47.587 INFO:tasks.workunit.client.0.smithi029.stdout:7/823: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/de0/f103 x:0 0 0 2023-12-05T13:26:47.589 INFO:tasks.workunit.client.0.smithi029.stdout:3/717: rmdir d1/d16/d36/d4b/db9 39 2023-12-05T13:26:47.589 INFO:tasks.workunit.client.0.smithi029.stdout:3/718: write d1/d16/fd7 [84343,13583] 0 2023-12-05T13:26:47.591 INFO:tasks.workunit.client.0.smithi029.stdout:7/824: creat d6/d100/d2f/d89/f104 x:0 0 0 2023-12-05T13:26:47.592 INFO:tasks.workunit.client.0.smithi029.stdout:7/825: write f1 [1575557,101640] 0 2023-12-05T13:26:47.593 INFO:tasks.workunit.client.0.smithi029.stdout:3/719: link d1/d6/d11/l1c d1/d6/d4a/le3 0 2023-12-05T13:26:47.595 INFO:tasks.workunit.client.0.smithi029.stdout:7/826: symlink d6/d100/d4f/dc5/d52/l105 0 2023-12-05T13:26:47.596 INFO:tasks.workunit.client.0.smithi029.stdout:3/720: creat d1/d16/d36/d4b/fe4 x:0 0 0 2023-12-05T13:26:47.596 INFO:tasks.workunit.client.0.smithi029.stdout:3/721: chown d1/d16/d36/d3a/fba 53431800 1 2023-12-05T13:26:47.597 INFO:tasks.workunit.client.0.smithi029.stdout:7/827: getdents d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d6a 0 2023-12-05T13:26:47.597 INFO:tasks.workunit.client.0.smithi029.stdout:3/722: write d1/d5e/d74/fd4 [703550,113737] 0 2023-12-05T13:26:47.597 INFO:tasks.workunit.client.0.smithi029.stdout:3/723: chown d1/d6/fc6 33738164 1 2023-12-05T13:26:47.598 INFO:tasks.workunit.client.0.smithi029.stdout:7/828: mknod d6/d50/d5b/d5f/d7d/d96/c106 0 2023-12-05T13:26:47.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/693: write de/d14/f99 [1834282,42845] 0 2023-12-05T13:26:47.599 INFO:tasks.workunit.client.0.smithi029.stdout:2/694: stat de/d41/d56/d58/fce 0 2023-12-05T13:26:47.600 INFO:tasks.workunit.client.0.smithi029.stdout:2/695: readlink de/lbd 0 2023-12-05T13:26:47.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/724: link d1/d16/d36/d3a/fba d1/db3/dc7/fe5 0 2023-12-05T13:26:47.602 INFO:tasks.workunit.client.0.smithi029.stdout:7/829: mknod d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/de0/c107 0 2023-12-05T13:26:47.605 INFO:tasks.workunit.client.0.smithi029.stdout:2/696: unlink de/d16/d43/f46 0 2023-12-05T13:26:47.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/725: rename d1/d16/d36/d8d to d1/d16/d1f/de6 0 2023-12-05T13:26:47.610 INFO:tasks.workunit.client.0.smithi029.stdout:2/697: truncate de/d14/d24/f73 2574674 0 2023-12-05T13:26:47.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/655: getdents dc/d23/d3a 0 2023-12-05T13:26:47.616 INFO:tasks.workunit.client.0.smithi029.stdout:0/656: write f9 [537574,91591] 0 2023-12-05T13:26:47.617 INFO:tasks.workunit.client.0.smithi029.stdout:7/830: dwrite d6/d100/d2f/d89/f104 [0,4194304] 0 2023-12-05T13:26:47.632 INFO:tasks.workunit.client.0.smithi029.stdout:0/657: dwrite dc/d23/d3a/d41/fca [0,4194304] 0 2023-12-05T13:26:47.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/658: rmdir dc/d33/d3d/d7a/d84/d8d 39 2023-12-05T13:26:47.655 INFO:tasks.workunit.client.0.smithi029.stdout:3/726: dwrite d1/d10/f2f [0,4194304] 0 2023-12-05T13:26:47.657 INFO:tasks.workunit.client.0.smithi029.stdout:7/831: dwrite d6/d100/fee [0,4194304] 0 2023-12-05T13:26:47.657 INFO:tasks.workunit.client.0.smithi029.stdout:7/832: stat d6/d50/d5b/d1a/d26/d72/f76 0 2023-12-05T13:26:47.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/659: dwrite dc/d23/d3a/d41/d57/f5d [0,4194304] 0 2023-12-05T13:26:47.660 INFO:tasks.workunit.client.0.smithi029.stdout:3/727: creat d1/d16/d36/d3a/d6c/d7d/d95/fe7 x:0 0 0 2023-12-05T13:26:47.664 INFO:tasks.workunit.client.0.smithi029.stdout:7/833: mkdir d6/d19/d108 0 2023-12-05T13:26:47.665 INFO:tasks.workunit.client.0.smithi029.stdout:0/660: link dc/d23/d3a/d41/d70/f81 dc/d33/d47/fd6 0 2023-12-05T13:26:47.666 INFO:tasks.workunit.client.0.smithi029.stdout:3/728: getdents d1/d16/d36/d3a/d6c/d7d 0 2023-12-05T13:26:47.666 INFO:tasks.workunit.client.0.smithi029.stdout:3/729: fsync d1/d16/d36/f66 0 2023-12-05T13:26:47.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/834: truncate d6/d100/d4f/d93/fa3 2482765 0 2023-12-05T13:26:47.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/835: read - d6/d100/d2f/fa0 zero size 2023-12-05T13:26:47.673 INFO:tasks.workunit.client.0.smithi029.stdout:0/661: rmdir dc/d23/d3a/d41/d57/d58 39 2023-12-05T13:26:47.674 INFO:tasks.workunit.client.0.smithi029.stdout:3/730: creat d1/db3/fe8 x:0 0 0 2023-12-05T13:26:47.688 INFO:tasks.workunit.client.0.smithi029.stdout:3/731: dwrite d1/d10/f71 [0,4194304] 0 2023-12-05T13:26:47.689 INFO:tasks.workunit.client.0.smithi029.stdout:3/732: fsync d1/d5e/d74/f78 0 2023-12-05T13:26:47.698 INFO:tasks.workunit.client.0.smithi029.stdout:3/733: dread d1/d16/d36/d4b/f6b [0,4194304] 0 2023-12-05T13:26:47.698 INFO:tasks.workunit.client.0.smithi029.stdout:3/734: stat d1/d5e/fa7 0 2023-12-05T13:26:47.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/735: write d1/d10/d91/f96 [3734492,44912] 0 2023-12-05T13:26:47.699 INFO:tasks.workunit.client.0.smithi029.stdout:3/736: fdatasync d1/d16/d1f/de6/fa8 0 2023-12-05T13:26:47.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/737: dwrite d1/d5e/f67 [0,4194304] 0 2023-12-05T13:26:47.714 INFO:tasks.workunit.client.0.smithi029.stdout:3/738: mknod d1/d16/d1f/d4c/ce9 0 2023-12-05T13:26:47.714 INFO:tasks.workunit.client.0.smithi029.stdout:3/739: truncate d1/d10/f5b 727453 0 2023-12-05T13:26:47.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:47 smithi052 ceph-mon[121072]: pgmap v45: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 35 MiB/s rd, 72 MiB/s wr, 123 op/s 2023-12-05T13:26:48.059 INFO:tasks.workunit.client.0.smithi029.stdout:8/761: sync 2023-12-05T13:26:48.060 INFO:tasks.workunit.client.0.smithi029.stdout:8/762: truncate d5/d2f/d75/f33 1748432 0 2023-12-05T13:26:48.063 INFO:tasks.workunit.client.0.smithi029.stdout:8/763: dread d5/dc/d18/d26/f64 [0,4194304] 0 2023-12-05T13:26:48.064 INFO:tasks.workunit.client.0.smithi029.stdout:8/764: chown d5/dbc/d1d/f2a 204549312 1 2023-12-05T13:26:48.065 INFO:tasks.workunit.client.0.smithi029.stdout:8/765: unlink d5/d6/d10/d85/lc4 0 2023-12-05T13:26:48.072 INFO:tasks.workunit.client.0.smithi029.stdout:5/573: sync 2023-12-05T13:26:48.085 INFO:tasks.workunit.client.0.smithi029.stdout:8/766: dwrite d5/d6/f1a [0,4194304] 0 2023-12-05T13:26:48.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:47 smithi029 ceph-mon[112128]: pgmap v45: 65 pgs: 65 active+clean; 1.4 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 35 MiB/s rd, 72 MiB/s wr, 123 op/s 2023-12-05T13:26:48.261 INFO:tasks.workunit.client.0.smithi029.stdout:6/748: sync 2023-12-05T13:26:48.262 INFO:tasks.workunit.client.0.smithi029.stdout:4/607: sync 2023-12-05T13:26:48.263 INFO:tasks.workunit.client.0.smithi029.stdout:4/608: mknod d0/de/d30/d32/d35/d3d/cc6 0 2023-12-05T13:26:48.288 INFO:tasks.workunit.client.0.smithi029.stdout:6/749: dwrite d6/d29/d9c/ff6 [0,4194304] 0 2023-12-05T13:26:48.288 INFO:tasks.workunit.client.0.smithi029.stdout:4/609: dwrite d0/d41/f9d [0,4194304] 0 2023-12-05T13:26:48.290 INFO:tasks.workunit.client.0.smithi029.stdout:6/750: mkdir d6/d64/dfe 0 2023-12-05T13:26:48.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/610: creat d0/d3c/d85/db7/fc7 x:0 0 0 2023-12-05T13:26:48.293 INFO:tasks.workunit.client.0.smithi029.stdout:6/751: creat d6/d29/dc4/d40/d74/d59/fff x:0 0 0 2023-12-05T13:26:48.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/752: write d6/d64/fdf [1694316,101752] 0 2023-12-05T13:26:48.295 INFO:tasks.workunit.client.0.smithi029.stdout:6/753: write d6/d29/dc4/d40/d74/d59/fff [1044204,64279] 0 2023-12-05T13:26:48.295 INFO:tasks.workunit.client.0.smithi029.stdout:4/611: mknod d0/de/d30/d32/cc8 0 2023-12-05T13:26:48.296 INFO:tasks.workunit.client.0.smithi029.stdout:4/612: creat d0/d41/fc9 x:0 0 0 2023-12-05T13:26:48.297 INFO:tasks.workunit.client.0.smithi029.stdout:4/613: write d0/de/d30/f68 [2191603,88220] 0 2023-12-05T13:26:48.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/614: write d0/da/fb [7303640,34638] 0 2023-12-05T13:26:48.299 INFO:tasks.workunit.client.0.smithi029.stdout:4/615: mkdir d0/de/d30/d32/d35/dca 0 2023-12-05T13:26:48.300 INFO:tasks.workunit.client.0.smithi029.stdout:4/616: symlink d0/de/d30/d32/d35/dca/lcb 0 2023-12-05T13:26:48.302 INFO:tasks.workunit.client.0.smithi029.stdout:4/617: symlink d0/lcc 0 2023-12-05T13:26:48.302 INFO:tasks.workunit.client.0.smithi029.stdout:4/618: chown d0/d3c/d56 0 1 2023-12-05T13:26:48.303 INFO:tasks.workunit.client.0.smithi029.stdout:4/619: rmdir d0/d16/d22/d98 39 2023-12-05T13:26:48.305 INFO:tasks.workunit.client.0.smithi029.stdout:4/620: rmdir d0/d16/d22/d5f/d79 39 2023-12-05T13:26:48.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/621: truncate d0/d16/d22/d5f/f91 145977 0 2023-12-05T13:26:48.306 INFO:tasks.workunit.client.0.smithi029.stdout:4/622: chown d0/de/d30/d32/d35/dca 576464025 1 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:5/574: sync 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:1/726: sync 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:2/698: sync 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:8/767: sync 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:5/575: dread - d1/dc/d25/fa8 zero size 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/591: sync 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:0/662: sync 2023-12-05T13:26:48.364 INFO:tasks.workunit.client.0.smithi029.stdout:5/576: write d1/dc/d25/d4c/d9b/d9a/fab [386145,67897] 0 2023-12-05T13:26:48.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/836: sync 2023-12-05T13:26:48.365 INFO:tasks.workunit.client.0.smithi029.stdout:3/740: sync 2023-12-05T13:26:48.365 INFO:tasks.workunit.client.0.smithi029.stdout:7/837: fsync d6/d19/f25 0 2023-12-05T13:26:48.365 INFO:tasks.workunit.client.0.smithi029.stdout:2/699: mkdir de/d14/ddf 0 2023-12-05T13:26:48.368 INFO:tasks.workunit.client.0.smithi029.stdout:9/592: unlink d7/d19/l51 0 2023-12-05T13:26:48.370 INFO:tasks.workunit.client.0.smithi029.stdout:0/663: creat dc/d33/d3d/d7a/d84/da4/fd7 x:0 0 0 2023-12-05T13:26:48.374 INFO:tasks.workunit.client.0.smithi029.stdout:3/741: creat d1/d16/d1f/d4c/dae/fea x:0 0 0 2023-12-05T13:26:48.375 INFO:tasks.workunit.client.0.smithi029.stdout:7/838: dread d6/d50/d5b/d5f/d7d/d97/d4a/fc7 [0,4194304] 0 2023-12-05T13:26:48.378 INFO:tasks.workunit.client.0.smithi029.stdout:0/664: creat dc/d23/d3a/d41/d57/d58/fd8 x:0 0 0 2023-12-05T13:26:48.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/577: mknod d1/dc/d10/d1e/d33/d93/da5/db2/da6/cca 0 2023-12-05T13:26:48.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/578: write d1/dc/d10/d1e/d75/d7f/d8a/fc2 [312191,24082] 0 2023-12-05T13:26:48.378 INFO:tasks.workunit.client.0.smithi029.stdout:5/579: fsync d1/dc/d10/d1e/d33/fc5 0 2023-12-05T13:26:48.379 INFO:tasks.workunit.client.0.smithi029.stdout:8/768: dread d5/d2f/d75/fa5 [8388608,4194304] 0 2023-12-05T13:26:48.379 INFO:tasks.workunit.client.0.smithi029.stdout:2/700: dread de/d16/d6c/d8e/fb0 [0,4194304] 0 2023-12-05T13:26:48.384 INFO:tasks.workunit.client.0.smithi029.stdout:0/665: dread dc/d13/f34 [0,4194304] 0 2023-12-05T13:26:48.387 INFO:tasks.workunit.client.0.smithi029.stdout:8/769: mkdir d5/dc/d56/d103 0 2023-12-05T13:26:48.388 INFO:tasks.workunit.client.0.smithi029.stdout:2/701: rename de/d14/l88 to de/d16/d6c/le0 0 2023-12-05T13:26:48.389 INFO:tasks.workunit.client.0.smithi029.stdout:0/666: mknod dc/d33/d3d/d7a/d84/d8d/cd9 0 2023-12-05T13:26:48.390 INFO:tasks.workunit.client.0.smithi029.stdout:8/770: mknod d5/d2f/c104 0 2023-12-05T13:26:48.392 INFO:tasks.workunit.client.0.smithi029.stdout:1/727: dwrite d7/d61/f6d [4194304,4194304] 0 2023-12-05T13:26:48.396 INFO:tasks.workunit.client.0.smithi029.stdout:2/702: rename de/d16/d6c/d8e/fb0 to de/d14/d24/d93/dc5/fe1 0 2023-12-05T13:26:48.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/771: symlink d5/dc/d18/d26/dc0/l105 0 2023-12-05T13:26:48.396 INFO:tasks.workunit.client.0.smithi029.stdout:0/667: mkdir dc/d33/d3d/d7a/d84/db1/dda 0 2023-12-05T13:26:48.396 INFO:tasks.workunit.client.0.smithi029.stdout:8/772: truncate d5/d2f/d3a/f9b 347629 0 2023-12-05T13:26:48.398 INFO:tasks.workunit.client.0.smithi029.stdout:3/742: dwrite d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:48.398 INFO:tasks.workunit.client.0.smithi029.stdout:9/593: dwrite d7/d2c/d33/f5b [0,4194304] 0 2023-12-05T13:26:48.399 INFO:tasks.workunit.client.0.smithi029.stdout:2/703: link de/d14/d24/d93/f9b de/d16/fe2 0 2023-12-05T13:26:48.399 INFO:tasks.workunit.client.0.smithi029.stdout:2/704: dread - de/d14/f65 zero size 2023-12-05T13:26:48.400 INFO:tasks.workunit.client.0.smithi029.stdout:0/668: mknod dc/d33/cdb 0 2023-12-05T13:26:48.402 INFO:tasks.workunit.client.0.smithi029.stdout:8/773: creat d5/dbc/d1d/f106 x:0 0 0 2023-12-05T13:26:48.403 INFO:tasks.workunit.client.0.smithi029.stdout:3/743: truncate d1/d10/d91/f68 1025044 0 2023-12-05T13:26:48.404 INFO:tasks.workunit.client.0.smithi029.stdout:3/744: write d1/d16/fd7 [200527,59736] 0 2023-12-05T13:26:48.404 INFO:tasks.workunit.client.0.smithi029.stdout:3/745: chown d1/d16/d1f/d4c/dae 852817 1 2023-12-05T13:26:48.404 INFO:tasks.workunit.client.0.smithi029.stdout:7/839: dwrite d6/d50/d5b/d5f/d7d/d97/d51/f77 [0,4194304] 0 2023-12-05T13:26:48.405 INFO:tasks.workunit.client.0.smithi029.stdout:2/705: mknod de/d14/d24/db7/ce3 0 2023-12-05T13:26:48.406 INFO:tasks.workunit.client.0.smithi029.stdout:0/669: mknod dc/d13/d4f/d83/cdc 0 2023-12-05T13:26:48.406 INFO:tasks.workunit.client.0.smithi029.stdout:0/670: fsync dc/d33/d3d/d7a/d84/d8d/d97/fa3 0 2023-12-05T13:26:48.406 INFO:tasks.workunit.client.0.smithi029.stdout:0/671: truncate dc/d23/d3a/d41/d70/f81 941775 0 2023-12-05T13:26:48.406 INFO:tasks.workunit.client.0.smithi029.stdout:5/580: dwrite d1/dc/d38/d3a/d5c/d87/f91 [0,4194304] 0 2023-12-05T13:26:48.408 INFO:tasks.workunit.client.0.smithi029.stdout:3/746: creat d1/d16/d9c/feb x:0 0 0 2023-12-05T13:26:48.409 INFO:tasks.workunit.client.0.smithi029.stdout:2/706: getdents de/d6a 0 2023-12-05T13:26:48.409 INFO:tasks.workunit.client.0.smithi029.stdout:2/707: stat de/d41/f78 0 2023-12-05T13:26:48.412 INFO:tasks.workunit.client.0.smithi029.stdout:0/672: getdents dc/d33/d3d/d7a/d84/d8d/d97 0 2023-12-05T13:26:48.414 INFO:tasks.workunit.client.0.smithi029.stdout:1/728: dwrite d7/d61/d4f/f65 [0,4194304] 0 2023-12-05T13:26:48.418 INFO:tasks.workunit.client.0.smithi029.stdout:3/747: rename d1/d16/d36/d4b to d1/d16/d36/dec 0 2023-12-05T13:26:48.418 INFO:tasks.workunit.client.0.smithi029.stdout:3/748: dread - d1/db3/dc7/fe5 zero size 2023-12-05T13:26:48.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/673: fdatasync dc/f80 0 2023-12-05T13:26:48.419 INFO:tasks.workunit.client.0.smithi029.stdout:0/674: fdatasync dc/ff 0 2023-12-05T13:26:48.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/729: creat d7/d5e/d52/d90/ff2 x:0 0 0 2023-12-05T13:26:48.423 INFO:tasks.workunit.client.0.smithi029.stdout:1/730: fdatasync d7/d5e/d52/d5f/d48/fb6 0 2023-12-05T13:26:48.424 INFO:tasks.workunit.client.0.smithi029.stdout:3/749: stat d1/d5e/d74/c7a 0 2023-12-05T13:26:48.427 INFO:tasks.workunit.client.0.smithi029.stdout:1/731: mkdir d7/d61/df3 0 2023-12-05T13:26:48.427 INFO:tasks.workunit.client.0.smithi029.stdout:1/732: truncate d7/d6e/da9/f3c 9161092 0 2023-12-05T13:26:48.427 INFO:tasks.workunit.client.0.smithi029.stdout:7/840: dread d6/d50/d5b/d1a/d26/d6e/f75 [0,4194304] 0 2023-12-05T13:26:48.432 INFO:tasks.workunit.client.0.smithi029.stdout:8/774: dwrite d5/d6/d10/f76 [0,4194304] 0 2023-12-05T13:26:48.432 INFO:tasks.workunit.client.0.smithi029.stdout:2/708: dread de/d41/d56/d58/f5e [0,4194304] 0 2023-12-05T13:26:48.432 INFO:tasks.workunit.client.0.smithi029.stdout:0/675: dread dc/d23/d3a/d41/d57/f5d [0,4194304] 0 2023-12-05T13:26:48.432 INFO:tasks.workunit.client.0.smithi029.stdout:9/594: dwrite d7/d19/d30/d40/d4e/f74 [0,4194304] 0 2023-12-05T13:26:48.432 INFO:tasks.workunit.client.0.smithi029.stdout:2/709: write de/d41/d56/fba [313028,38875] 0 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/710: write de/d6a/fd9 [750313,2402] 0 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/711: write de/d41/d56/d58/f5e [1195265,79899] 0 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/712: chown de/d16/c91 777 1 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/713: chown de/d14/l34 3357 1 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/714: chown de/d11/dad 65008387 1 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/715: readlink de/d14/d24/l8b 0 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:2/716: chown de/d41/d56/fd7 3873 1 2023-12-05T13:26:48.433 INFO:tasks.workunit.client.0.smithi029.stdout:5/581: dwrite d1/dc/d11/d17/d3d/f58 [0,4194304] 0 2023-12-05T13:26:48.436 INFO:tasks.workunit.client.0.smithi029.stdout:7/841: rename d6/d50/d5b/d1a/d26/d82 to d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d109 0 2023-12-05T13:26:48.439 INFO:tasks.workunit.client.0.smithi029.stdout:7/842: write d6/d19/f21 [1243287,72996] 0 2023-12-05T13:26:48.439 INFO:tasks.workunit.client.0.smithi029.stdout:7/843: dread - d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/fe3 zero size 2023-12-05T13:26:48.440 INFO:tasks.workunit.client.0.smithi029.stdout:8/775: link d5/dbc/d1d/f29 d5/dc/d18/dc8/f107 0 2023-12-05T13:26:48.442 INFO:tasks.workunit.client.0.smithi029.stdout:3/750: dwrite d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:48.447 INFO:tasks.workunit.client.0.smithi029.stdout:9/595: dread d7/f18 [4194304,4194304] 0 2023-12-05T13:26:48.449 INFO:tasks.workunit.client.0.smithi029.stdout:2/717: mknod de/d16/ce4 0 2023-12-05T13:26:48.456 INFO:tasks.workunit.client.0.smithi029.stdout:7/844: dwrite d6/d50/d5b/f29 [0,4194304] 0 2023-12-05T13:26:48.456 INFO:tasks.workunit.client.0.smithi029.stdout:5/582: dwrite d1/dc/d27/f2e [0,4194304] 0 2023-12-05T13:26:48.457 INFO:tasks.workunit.client.0.smithi029.stdout:2/718: creat de/d14/fe5 x:0 0 0 2023-12-05T13:26:48.459 INFO:tasks.workunit.client.0.smithi029.stdout:0/676: rename dc/c9c to dc/d33/d3d/d7a/cdd 0 2023-12-05T13:26:48.462 INFO:tasks.workunit.client.0.smithi029.stdout:3/751: mkdir d1/d5e/d74/ded 0 2023-12-05T13:26:48.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/596: dwrite d7/d19/d30/fa3 [0,4194304] 0 2023-12-05T13:26:48.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/597: dread - d7/d19/d28/f70 zero size 2023-12-05T13:26:48.462 INFO:tasks.workunit.client.0.smithi029.stdout:9/598: fsync d7/d19/fa5 0 2023-12-05T13:26:48.463 INFO:tasks.workunit.client.0.smithi029.stdout:5/583: getdents d1/dc/d25/d4c/d61 0 2023-12-05T13:26:48.466 INFO:tasks.workunit.client.0.smithi029.stdout:2/719: creat de/d16/d6c/d8e/dbf/fe6 x:0 0 0 2023-12-05T13:26:48.466 INFO:tasks.workunit.client.0.smithi029.stdout:5/584: dread d1/dc/d11/f12 [0,4194304] 0 2023-12-05T13:26:48.467 INFO:tasks.workunit.client.0.smithi029.stdout:8/776: rename d5/d6/d10/d13/db7 to d5/d6/d10/d8a/db6/d108 0 2023-12-05T13:26:48.468 INFO:tasks.workunit.client.0.smithi029.stdout:0/677: mkdir dc/d33/d3d/d7a/d84/dde 0 2023-12-05T13:26:48.472 INFO:tasks.workunit.client.0.smithi029.stdout:9/599: creat d7/d2c/d33/fc2 x:0 0 0 2023-12-05T13:26:48.475 INFO:tasks.workunit.client.0.smithi029.stdout:2/720: unlink de/d16/d6c/le0 0 2023-12-05T13:26:48.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/721: read f6 [4023844,111902] 0 2023-12-05T13:26:48.476 INFO:tasks.workunit.client.0.smithi029.stdout:2/722: chown de/d6a/c84 26739750 1 2023-12-05T13:26:48.477 INFO:tasks.workunit.client.0.smithi029.stdout:7/845: rename d6/d100/d4f/dc5/d52/lac to d6/d100/d2f/l10a 0 2023-12-05T13:26:48.477 INFO:tasks.workunit.client.0.smithi029.stdout:7/846: fdatasync d6/d100/d2f/fec 0 2023-12-05T13:26:48.479 INFO:tasks.workunit.client.0.smithi029.stdout:8/777: link d5/d6/l65 d5/dbc/d8b/l109 0 2023-12-05T13:26:48.479 INFO:tasks.workunit.client.0.smithi029.stdout:8/778: read - d5/dbc/d1d/fca zero size 2023-12-05T13:26:48.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/678: mkdir dc/d33/d3d/d7a/d84/dde/ddf 0 2023-12-05T13:26:48.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/679: fsync dc/d23/d3a/d41/d57/d58/d73/fce 0 2023-12-05T13:26:48.481 INFO:tasks.workunit.client.0.smithi029.stdout:0/680: fdatasync dc/d33/d3d/d7a/fb4 0 2023-12-05T13:26:48.484 INFO:tasks.workunit.client.0.smithi029.stdout:2/723: creat de/d14/d24/d93/dc5/fe7 x:0 0 0 2023-12-05T13:26:48.486 INFO:tasks.workunit.client.0.smithi029.stdout:3/752: rename d1/db3/d72/c8b to d1/d6/d11/da3/cee 0 2023-12-05T13:26:48.488 INFO:tasks.workunit.client.0.smithi029.stdout:7/847: mkdir d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d6a/d10b 0 2023-12-05T13:26:48.488 INFO:tasks.workunit.client.0.smithi029.stdout:9/600: dwrite d7/d19/f41 [0,4194304] 0 2023-12-05T13:26:48.488 INFO:tasks.workunit.client.0.smithi029.stdout:9/601: chown d7/d5a/cab 1 1 2023-12-05T13:26:48.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/681: symlink dc/d23/dbf/le0 0 2023-12-05T13:26:48.492 INFO:tasks.workunit.client.0.smithi029.stdout:2/724: creat de/d16/d43/fe8 x:0 0 0 2023-12-05T13:26:48.492 INFO:tasks.workunit.client.0.smithi029.stdout:2/725: dread - de/d41/d56/fc3 zero size 2023-12-05T13:26:48.494 INFO:tasks.workunit.client.0.smithi029.stdout:8/779: rename d5/dbc/d1d/l5d to d5/dc/d18/dc8/l10a 0 2023-12-05T13:26:48.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/753: rmdir d1/db3/dc7 39 2023-12-05T13:26:48.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/754: readlink d1/d16/lce 0 2023-12-05T13:26:48.496 INFO:tasks.workunit.client.0.smithi029.stdout:3/755: write d1/d6/d11/fc2 [1355685,21981] 0 2023-12-05T13:26:48.497 INFO:tasks.workunit.client.0.smithi029.stdout:7/848: symlink d6/d100/d2f/d89/dad/l10c 0 2023-12-05T13:26:48.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/726: dread de/d16/f1b [0,4194304] 0 2023-12-05T13:26:48.500 INFO:tasks.workunit.client.0.smithi029.stdout:9/602: unlink d7/d19/d30/d99/l71 0 2023-12-05T13:26:48.500 INFO:tasks.workunit.client.0.smithi029.stdout:7/849: write d6/d100/d4f/dc5/fce [3642788,10710] 0 2023-12-05T13:26:48.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/682: unlink dc/fd 0 2023-12-05T13:26:48.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/683: chown dc/d23/d3a/d41/d57/d58/d73/d86 394193 1 2023-12-05T13:26:48.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/684: chown dc/d33/d3d/d65/d85/f8e 484189208 1 2023-12-05T13:26:48.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/585: truncate d1/dc/d27/f2e 8323585 0 2023-12-05T13:26:48.509 INFO:tasks.workunit.client.0.smithi029.stdout:3/756: dwrite d1/d16/d1f/de6/f92 [0,4194304] 0 2023-12-05T13:26:48.517 INFO:tasks.workunit.client.0.smithi029.stdout:2/727: symlink de/d11/dad/le9 0 2023-12-05T13:26:48.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/603: mkdir d7/d19/d30/d40/dc3 0 2023-12-05T13:26:48.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/604: dread - d7/d19/d30/d40/d4e/fb1 zero size 2023-12-05T13:26:48.519 INFO:tasks.workunit.client.0.smithi029.stdout:7/850: symlink d6/d50/d5b/d1a/l10d 0 2023-12-05T13:26:48.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/685: mkdir dc/d33/d3d/d7e/de1 0 2023-12-05T13:26:48.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/686: readlink dc/d23/d3a/d41/lc5 0 2023-12-05T13:26:48.521 INFO:tasks.workunit.client.0.smithi029.stdout:0/687: dread - dc/d13/d4f/d63/f87 zero size 2023-12-05T13:26:48.522 INFO:tasks.workunit.client.0.smithi029.stdout:5/586: rename d1/dc/d10/d1e/d9c/lbd to d1/dc/d38/d3a/d5c/lcb 0 2023-12-05T13:26:48.526 INFO:tasks.workunit.client.0.smithi029.stdout:3/757: link d1/d5e/f6d d1/d16/d36/d3a/d6c/d7d/fef 0 2023-12-05T13:26:48.528 INFO:tasks.workunit.client.0.smithi029.stdout:8/780: mknod d5/dbc/d53/c10b 0 2023-12-05T13:26:48.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/728: chown de/d11/d32/f5a 30 1 2023-12-05T13:26:48.533 INFO:tasks.workunit.client.0.smithi029.stdout:0/688: symlink dc/d13/d4f/d63/le2 0 2023-12-05T13:26:48.536 INFO:tasks.workunit.client.0.smithi029.stdout:7/851: dwrite d6/d50/d5b/d1a/d26/d72/fbf [0,4194304] 0 2023-12-05T13:26:48.536 INFO:tasks.workunit.client.0.smithi029.stdout:3/758: rename d1/d10/d91/ca6 to d1/d5e/cf0 0 2023-12-05T13:26:48.540 INFO:tasks.workunit.client.0.smithi029.stdout:8/781: creat d5/d6/d10/d8a/f10c x:0 0 0 2023-12-05T13:26:48.543 INFO:tasks.workunit.client.0.smithi029.stdout:2/729: mknod de/d16/d6c/d8e/cea 0 2023-12-05T13:26:48.543 INFO:tasks.workunit.client.0.smithi029.stdout:2/730: truncate de/d14/d24/f89 985175 0 2023-12-05T13:26:48.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/852: creat d6/d100/d71/f10e x:0 0 0 2023-12-05T13:26:48.551 INFO:tasks.workunit.client.0.smithi029.stdout:7/853: chown d6/d100/d7e/d7b/dc2 1513 1 2023-12-05T13:26:48.551 INFO:tasks.workunit.client.0.smithi029.stdout:3/759: rmdir d1/d6/d4a/db8 39 2023-12-05T13:26:48.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/689: dwrite dc/d33/d3d/d7a/d84/fc0 [0,4194304] 0 2023-12-05T13:26:48.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/690: chown dc/d23/d3a/d41/d57/d58 1478620 1 2023-12-05T13:26:48.552 INFO:tasks.workunit.client.0.smithi029.stdout:2/731: mknod de/db8/dda/ceb 0 2023-12-05T13:26:48.554 INFO:tasks.workunit.client.0.smithi029.stdout:0/691: symlink dc/d33/d3d/d7e/de1/le3 0 2023-12-05T13:26:48.554 INFO:tasks.workunit.client.0.smithi029.stdout:0/692: rename dc to dc/d23/d3a/d41/de4 22 2023-12-05T13:26:48.554 INFO:tasks.workunit.client.0.smithi029.stdout:8/782: dwrite d5/d2f/d3a/d86/da8/fdc [4194304,4194304] 0 2023-12-05T13:26:48.555 INFO:tasks.workunit.client.0.smithi029.stdout:9/605: write d7/d19/d30/d43/f62 [740075,90800] 0 2023-12-05T13:26:48.555 INFO:tasks.workunit.client.0.smithi029.stdout:9/606: chown d7/d2c/d33/f8a 134742 1 2023-12-05T13:26:48.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/732: dread de/d41/d56/f75 [0,4194304] 0 2023-12-05T13:26:48.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/733: write de/d16/f2c [752929,49569] 0 2023-12-05T13:26:48.556 INFO:tasks.workunit.client.0.smithi029.stdout:2/734: truncate de/d14/da3/fd5 430599 0 2023-12-05T13:26:48.561 INFO:tasks.workunit.client.0.smithi029.stdout:8/783: symlink d5/d6/d10/d8a/l10d 0 2023-12-05T13:26:48.563 INFO:tasks.workunit.client.0.smithi029.stdout:9/607: creat d7/d19/d30/d99/d8d/db5/fc4 x:0 0 0 2023-12-05T13:26:48.565 INFO:tasks.workunit.client.0.smithi029.stdout:2/735: rename de/d14/d24/d93/fd1 to de/d16/d4c/fec 0 2023-12-05T13:26:48.566 INFO:tasks.workunit.client.0.smithi029.stdout:8/784: symlink d5/dc/d18/l10e 0 2023-12-05T13:26:48.566 INFO:tasks.workunit.client.0.smithi029.stdout:0/693: dread dc/d23/d3a/d41/d57/d58/f7d [4194304,4194304] 0 2023-12-05T13:26:48.568 INFO:tasks.workunit.client.0.smithi029.stdout:9/608: rename d7/d2c/d3a/ca6 to d7/d19/d30/d99/cc5 0 2023-12-05T13:26:48.570 INFO:tasks.workunit.client.0.smithi029.stdout:2/736: creat de/d16/d4c/fed x:0 0 0 2023-12-05T13:26:48.572 INFO:tasks.workunit.client.0.smithi029.stdout:8/785: rmdir d5/dbc 39 2023-12-05T13:26:48.573 INFO:tasks.workunit.client.0.smithi029.stdout:8/786: write d5/d6/d10/d85/daa/dfe/fd5 [4464664,54946] 0 2023-12-05T13:26:48.575 INFO:tasks.workunit.client.0.smithi029.stdout:2/737: dread fb [0,4194304] 0 2023-12-05T13:26:48.577 INFO:tasks.workunit.client.0.smithi029.stdout:0/694: rename dc/d13/d4f/f8b to dc/d33/d3d/d7e/de1/fe5 0 2023-12-05T13:26:48.578 INFO:tasks.workunit.client.0.smithi029.stdout:9/609: symlink d7/d19/d28/d50/lc6 0 2023-12-05T13:26:48.579 INFO:tasks.workunit.client.0.smithi029.stdout:0/695: mknod dc/d23/d3a/d41/d70/ce6 0 2023-12-05T13:26:48.579 INFO:tasks.workunit.client.0.smithi029.stdout:2/738: write de/d16/d43/f82 [1227706,74162] 0 2023-12-05T13:26:48.580 INFO:tasks.workunit.client.0.smithi029.stdout:3/760: dwrite d1/d6/d4a/f9b [0,4194304] 0 2023-12-05T13:26:48.582 INFO:tasks.workunit.client.0.smithi029.stdout:9/610: rename d7/d2c/f4c to d7/d2c/d3a/d52/db9/fc7 0 2023-12-05T13:26:48.582 INFO:tasks.workunit.client.0.smithi029.stdout:9/611: readlink d7/d19/d28/la4 0 2023-12-05T13:26:48.585 INFO:tasks.workunit.client.0.smithi029.stdout:0/696: link dc/d13/c92 dc/d33/d3d/d7e/ce7 0 2023-12-05T13:26:48.585 INFO:tasks.workunit.client.0.smithi029.stdout:0/697: write dc/d13/f2d [5139139,95060] 0 2023-12-05T13:26:48.592 INFO:tasks.workunit.client.0.smithi029.stdout:3/761: symlink d1/d6/d4a/lf1 0 2023-12-05T13:26:48.592 INFO:tasks.workunit.client.0.smithi029.stdout:3/762: fsync d1/d10/f51 0 2023-12-05T13:26:48.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/787: dwrite d5/dc/d18/d26/f9f [0,4194304] 0 2023-12-05T13:26:48.593 INFO:tasks.workunit.client.0.smithi029.stdout:0/698: mkdir dc/d33/d3d/d65/de8 0 2023-12-05T13:26:48.595 INFO:tasks.workunit.client.0.smithi029.stdout:3/763: symlink d1/d16/d1f/d4c/dae/lf2 0 2023-12-05T13:26:48.598 INFO:tasks.workunit.client.0.smithi029.stdout:8/788: rmdir d5/d2f/d3a/d86/da8 39 2023-12-05T13:26:48.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/699: creat dc/d23/d3a/d41/fe9 x:0 0 0 2023-12-05T13:26:48.601 INFO:tasks.workunit.client.0.smithi029.stdout:8/789: dread d5/d6/d59/fba [0,4194304] 0 2023-12-05T13:26:48.602 INFO:tasks.workunit.client.0.smithi029.stdout:0/700: write dc/d33/d3d/d7a/d84/d8d/d97/faa [2739211,48731] 0 2023-12-05T13:26:48.603 INFO:tasks.workunit.client.0.smithi029.stdout:3/764: rename d1/d6/d4a/ld3 to d1/d16/lf3 0 2023-12-05T13:26:48.603 INFO:tasks.workunit.client.0.smithi029.stdout:3/765: read d1/d6/d4a/f9b [3987427,128372] 0 2023-12-05T13:26:48.606 INFO:tasks.workunit.client.0.smithi029.stdout:8/790: dread d5/dc/f87 [0,4194304] 0 2023-12-05T13:26:48.606 INFO:tasks.workunit.client.0.smithi029.stdout:3/766: rmdir d1/d10/d91/dda 0 2023-12-05T13:26:48.607 INFO:tasks.workunit.client.0.smithi029.stdout:9/612: dwrite d7/d19/d28/d50/dc0/fa1 [0,4194304] 0 2023-12-05T13:26:48.607 INFO:tasks.workunit.client.0.smithi029.stdout:2/739: dwrite de/d14/d24/f40 [0,4194304] 0 2023-12-05T13:26:48.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/767: truncate d1/d10/d91/f96 1985943 0 2023-12-05T13:26:48.609 INFO:tasks.workunit.client.0.smithi029.stdout:3/768: write d1/d16/f49 [1246803,115309] 0 2023-12-05T13:26:48.609 INFO:tasks.workunit.client.0.smithi029.stdout:6/754: sync 2023-12-05T13:26:48.614 INFO:tasks.workunit.client.0.smithi029.stdout:0/701: dread dc/d13/f1c [0,4194304] 0 2023-12-05T13:26:48.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/791: fdatasync d5/d6/d10/d85/daa/dfe/fd5 0 2023-12-05T13:26:48.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/792: chown d5/d2f/d3a/d86/da8/cf7 6572 1 2023-12-05T13:26:48.614 INFO:tasks.workunit.client.0.smithi029.stdout:8/793: chown d5/d2f/d3a/l5f 595 1 2023-12-05T13:26:48.616 INFO:tasks.workunit.client.0.smithi029.stdout:9/613: rmdir d7/d2c/d3a/d52/db9 39 2023-12-05T13:26:48.619 INFO:tasks.workunit.client.0.smithi029.stdout:2/740: write de/f13 [35903,17592] 0 2023-12-05T13:26:48.619 INFO:tasks.workunit.client.0.smithi029.stdout:0/702: truncate dc/d23/f2e 298045 0 2023-12-05T13:26:48.619 INFO:tasks.workunit.client.0.smithi029.stdout:2/741: stat de/d16/d6c/f7c 0 2023-12-05T13:26:48.620 INFO:tasks.workunit.client.0.smithi029.stdout:8/794: getdents d5/dc/d56 0 2023-12-05T13:26:48.620 INFO:tasks.workunit.client.0.smithi029.stdout:8/795: chown d5/d2f/d3a 142 1 2023-12-05T13:26:48.621 INFO:tasks.workunit.client.0.smithi029.stdout:2/742: dread de/d16/d43/f72 [0,4194304] 0 2023-12-05T13:26:48.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/614: mkdir d7/d2c/d3a/d64/dc8 0 2023-12-05T13:26:48.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/615: truncate d7/d19/d30/d40/f7e 440075 0 2023-12-05T13:26:48.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/616: stat d7/d2c/d33/c54 0 2023-12-05T13:26:48.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/617: dread - d7/d19/f83 zero size 2023-12-05T13:26:48.623 INFO:tasks.workunit.client.0.smithi029.stdout:8/796: write d5/d6/f9 [1344166,56215] 0 2023-12-05T13:26:48.626 INFO:tasks.workunit.client.0.smithi029.stdout:9/618: mkdir d7/d2c/d3a/d52/dc9 0 2023-12-05T13:26:48.626 INFO:tasks.workunit.client.0.smithi029.stdout:9/619: readlink d7/d19/d28/la4 0 2023-12-05T13:26:48.631 INFO:tasks.workunit.client.0.smithi029.stdout:3/769: dread d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:48.633 INFO:tasks.workunit.client.0.smithi029.stdout:8/797: rename d5/d2f/d3a to d5/dbc/d1d/d10f 0 2023-12-05T13:26:48.635 INFO:tasks.workunit.client.0.smithi029.stdout:3/770: dread d1/d10/f87 [0,4194304] 0 2023-12-05T13:26:48.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/703: dwrite dc/d33/d3d/d7a/d84/fcf [0,4194304] 0 2023-12-05T13:26:48.641 INFO:tasks.workunit.client.0.smithi029.stdout:8/798: link d5/dc/d18/dc8/f107 d5/d2f/d75/f110 0 2023-12-05T13:26:48.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/771: rename d1/d18/f1d to d1/d6/d4a/db8/ff4 0 2023-12-05T13:26:48.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/772: write d1/d16/d36/d3a/fb4 [267463,98103] 0 2023-12-05T13:26:48.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/773: readlink d1/d16/d1f/l2d 0 2023-12-05T13:26:48.644 INFO:tasks.workunit.client.0.smithi029.stdout:3/774: write d1/d5e/f6d [108524,9996] 0 2023-12-05T13:26:48.644 INFO:tasks.workunit.client.0.smithi029.stdout:6/755: dwrite d6/d1d/d36/f4c [4194304,4194304] 0 2023-12-05T13:26:48.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/620: dwrite d7/d2c/d33/f8a [0,4194304] 0 2023-12-05T13:26:48.653 INFO:tasks.workunit.client.0.smithi029.stdout:9/621: chown d7/d2c/d3a/d52/l87 0 1 2023-12-05T13:26:48.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/756: symlink d6/d1d/d39/d58/l100 0 2023-12-05T13:26:48.654 INFO:tasks.workunit.client.0.smithi029.stdout:6/757: read - d6/d93/fc6 zero size 2023-12-05T13:26:48.657 INFO:tasks.workunit.client.0.smithi029.stdout:9/622: dread d7/d2c/d3a/d52/f81 [0,4194304] 0 2023-12-05T13:26:48.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/704: dwrite dc/d23/d3a/f71 [0,4194304] 0 2023-12-05T13:26:48.661 INFO:tasks.workunit.client.0.smithi029.stdout:6/758: mkdir d6/d29/dc4/d40/d74/d52/d5c/d6f/ddb/d101 0 2023-12-05T13:26:48.662 INFO:tasks.workunit.client.0.smithi029.stdout:3/775: dwrite d1/d16/d36/d3a/fba [0,4194304] 0 2023-12-05T13:26:48.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/776: fsync d1/d16/d1f/de6/f92 0 2023-12-05T13:26:48.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/777: readlink d1/d6/l33 0 2023-12-05T13:26:48.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/799: dwrite d5/dbc/d1d/f29 [0,4194304] 0 2023-12-05T13:26:48.667 INFO:tasks.workunit.client.0.smithi029.stdout:8/800: chown d5/dbc/d1d/d10f/lf6 392 1 2023-12-05T13:26:48.673 INFO:tasks.workunit.client.0.smithi029.stdout:3/778: mknod d1/d6/d11/cf5 0 2023-12-05T13:26:48.673 INFO:tasks.workunit.client.0.smithi029.stdout:3/779: stat d1/d6/f3c 0 2023-12-05T13:26:48.674 INFO:tasks.workunit.client.0.smithi029.stdout:8/801: link d5/d6/d59/cd7 d5/d6/d10/d85/daa/c111 0 2023-12-05T13:26:48.675 INFO:tasks.workunit.client.0.smithi029.stdout:3/780: symlink d1/db3/d72/lf6 0 2023-12-05T13:26:48.676 INFO:tasks.workunit.client.0.smithi029.stdout:9/623: dwrite d7/d19/d30/d43/f48 [0,4194304] 0 2023-12-05T13:26:48.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/802: creat d5/d6/d10/d8a/db6/d108/f112 x:0 0 0 2023-12-05T13:26:48.678 INFO:tasks.workunit.client.0.smithi029.stdout:8/803: chown d5/dbc/d53/c10b 3787081 1 2023-12-05T13:26:48.679 INFO:tasks.workunit.client.0.smithi029.stdout:3/781: creat d1/d10/ff7 x:0 0 0 2023-12-05T13:26:48.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/759: write d6/d3f/f9d [1329008,81281] 0 2023-12-05T13:26:48.682 INFO:tasks.workunit.client.0.smithi029.stdout:0/705: dwrite dc/d23/d3a/d41/d57/d58/f5c [0,4194304] 0 2023-12-05T13:26:48.683 INFO:tasks.workunit.client.0.smithi029.stdout:9/624: rename d7/l12 to d7/d2c/d3a/d64/lca 0 2023-12-05T13:26:48.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/625: write d7/d19/d28/d50/dc0/fa1 [33357,49652] 0 2023-12-05T13:26:48.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/760: creat d6/d3f/db7/def/f102 x:0 0 0 2023-12-05T13:26:48.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/761: chown d6/c1b 1285115 1 2023-12-05T13:26:48.684 INFO:tasks.workunit.client.0.smithi029.stdout:6/762: write d6/d29/dc4/d40/d74/ffd [552366,25541] 0 2023-12-05T13:26:48.685 INFO:tasks.workunit.client.0.smithi029.stdout:0/706: getdents dc/d13/d4f/d88 0 2023-12-05T13:26:48.686 INFO:tasks.workunit.client.0.smithi029.stdout:9/626: fdatasync d7/d19/d28/d50/dc0/fa1 0 2023-12-05T13:26:48.688 INFO:tasks.workunit.client.0.smithi029.stdout:8/804: rename d5/dbc/d1d/f106 to d5/dc/d18/dc8/f113 0 2023-12-05T13:26:48.690 INFO:tasks.workunit.client.0.smithi029.stdout:6/763: unlink d6/d29/dc4/d40/d74/d52/d5c/d6f/fc5 0 2023-12-05T13:26:48.691 INFO:tasks.workunit.client.0.smithi029.stdout:0/707: rmdir dc/d23/d3a/d41/d57/d58 39 2023-12-05T13:26:48.692 INFO:tasks.workunit.client.0.smithi029.stdout:9/627: symlink d7/d19/d28/d50/lcb 0 2023-12-05T13:26:48.692 INFO:tasks.workunit.client.0.smithi029.stdout:9/628: readlink d7/d19/d28/d50/dc0/d7f/lb4 0 2023-12-05T13:26:48.694 INFO:tasks.workunit.client.0.smithi029.stdout:3/782: rename d1/d5e/f67 to d1/d16/d36/ff8 0 2023-12-05T13:26:48.694 INFO:tasks.workunit.client.0.smithi029.stdout:3/783: chown d1/d16/d36/fbb 677212 1 2023-12-05T13:26:48.694 INFO:tasks.workunit.client.0.smithi029.stdout:3/784: fdatasync d1/fd 0 2023-12-05T13:26:48.697 INFO:tasks.workunit.client.0.smithi029.stdout:8/805: unlink d5/dbc/d1d/d10f/d86/fab 0 2023-12-05T13:26:48.697 INFO:tasks.workunit.client.0.smithi029.stdout:8/806: write d5/dbc/d1d/fca [505288,59101] 0 2023-12-05T13:26:48.698 INFO:tasks.workunit.client.0.smithi029.stdout:6/764: creat d6/d29/d60/f103 x:0 0 0 2023-12-05T13:26:48.699 INFO:tasks.workunit.client.0.smithi029.stdout:0/708: symlink dc/d33/d3d/d7a/lea 0 2023-12-05T13:26:48.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/785: creat d1/d6/d11/da3/ff9 x:0 0 0 2023-12-05T13:26:48.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/786: write d1/d16/d36/dec/fe4 [981867,792] 0 2023-12-05T13:26:48.700 INFO:tasks.workunit.client.0.smithi029.stdout:8/807: getdents d5/dbc/d1d/d10f/d3c 0 2023-12-05T13:26:48.703 INFO:tasks.workunit.client.0.smithi029.stdout:6/765: unlink d6/d29/dc4/d40/d74/ff3 0 2023-12-05T13:26:48.703 INFO:tasks.workunit.client.0.smithi029.stdout:6/766: write d6/d29/dc4/d40/d4d/d8f/de0/ff1 [1993290,11806] 0 2023-12-05T13:26:48.704 INFO:tasks.workunit.client.0.smithi029.stdout:3/787: unlink d1/d16/d1f/d4c/f4f 0 2023-12-05T13:26:48.705 INFO:tasks.workunit.client.0.smithi029.stdout:6/767: mkdir d6/d29/dc4/d40/d74/d59/d104 0 2023-12-05T13:26:48.705 INFO:tasks.workunit.client.0.smithi029.stdout:6/768: fsync d6/d3f/db7/def/f102 0 2023-12-05T13:26:48.705 INFO:tasks.workunit.client.0.smithi029.stdout:6/769: dread - d6/d3f/db7/def/f102 zero size 2023-12-05T13:26:48.706 INFO:tasks.workunit.client.0.smithi029.stdout:9/629: dwrite d7/d19/d30/d99/d8d/dad/fba [0,4194304] 0 2023-12-05T13:26:48.706 INFO:tasks.workunit.client.0.smithi029.stdout:0/709: rename dc/d13/d4f/d63/l67 to dc/d23/d3a/d41/d57/d58/dcd/leb 0 2023-12-05T13:26:48.707 INFO:tasks.workunit.client.0.smithi029.stdout:3/788: getdents d1/db3/dc7 0 2023-12-05T13:26:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/630: creat d7/d19/d30/d99/d8d/fcc x:0 0 0 2023-12-05T13:26:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/631: fsync d7/f13 0 2023-12-05T13:26:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/632: truncate d7/d19/d30/d99/f82 2232009 0 2023-12-05T13:26:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/633: fsync d7/d19/d30/d43/f62 0 2023-12-05T13:26:48.710 INFO:tasks.workunit.client.0.smithi029.stdout:9/634: chown d7/lac 1 1 2023-12-05T13:26:48.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/789: creat d1/d16/d36/dec/ffa x:0 0 0 2023-12-05T13:26:48.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/790: chown d1/d18/f45 45678 1 2023-12-05T13:26:48.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/791: getdents d1/d6/d4a/dcd 0 2023-12-05T13:26:48.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/792: truncate d1/d18/fa0 602347 0 2023-12-05T13:26:48.712 INFO:tasks.workunit.client.0.smithi029.stdout:3/793: fsync d1/d10/d91/f96 0 2023-12-05T13:26:48.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/710: mknod dc/d23/d3a/d41/d57/d58/cec 0 2023-12-05T13:26:48.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/711: write f6 [1384043,129248] 0 2023-12-05T13:26:48.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/712: write dc/d13/d4f/d91/fd1 [655391,88947] 0 2023-12-05T13:26:48.714 INFO:tasks.workunit.client.0.smithi029.stdout:9/635: write d7/d19/d30/d40/d4e/d5e/f88 [1635755,36598] 0 2023-12-05T13:26:48.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/713: dread dc/d23/d3a/d41/d70/f81 [0,4194304] 0 2023-12-05T13:26:48.716 INFO:tasks.workunit.client.0.smithi029.stdout:3/794: mknod d1/db3/cfb 0 2023-12-05T13:26:48.716 INFO:tasks.workunit.client.0.smithi029.stdout:3/795: chown d1/d10/c9e 4821504 1 2023-12-05T13:26:48.716 INFO:tasks.workunit.client.0.smithi029.stdout:3/796: chown d1/d5e/d74/dab 2302063 1 2023-12-05T13:26:48.716 INFO:tasks.workunit.client.0.smithi029.stdout:9/636: creat d7/d19/d30/d40/fcd x:0 0 0 2023-12-05T13:26:48.717 INFO:tasks.workunit.client.0.smithi029.stdout:0/714: write dc/d23/d3a/d41/d57/f5b [3225942,78611] 0 2023-12-05T13:26:48.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/637: mknod d7/d2c/d3a/d64/dc8/cce 0 2023-12-05T13:26:48.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/638: truncate d7/d2c/d33/fae 129546 0 2023-12-05T13:26:48.721 INFO:tasks.workunit.client.0.smithi029.stdout:9/639: mknod d7/d19/d30/d40/ccf 0 2023-12-05T13:26:48.722 INFO:tasks.workunit.client.0.smithi029.stdout:9/640: chown d7/d19/d28/d65/f69 15561020 1 2023-12-05T13:26:48.722 INFO:tasks.workunit.client.0.smithi029.stdout:9/641: write d7/d19/d28/f70 [689262,42674] 0 2023-12-05T13:26:48.722 INFO:tasks.workunit.client.0.smithi029.stdout:9/642: getdents d7/d19/d30/d40/dc3 0 2023-12-05T13:26:48.725 INFO:tasks.workunit.client.0.smithi029.stdout:3/797: dread d1/d5e/d74/f93 [0,4194304] 0 2023-12-05T13:26:48.725 INFO:tasks.workunit.client.0.smithi029.stdout:8/808: dwrite d5/d6/d10/d13/ff0 [0,4194304] 0 2023-12-05T13:26:48.725 INFO:tasks.workunit.client.0.smithi029.stdout:6/770: dwrite d6/d64/d6d/da3/dcf/fd6 [0,4194304] 0 2023-12-05T13:26:48.726 INFO:tasks.workunit.client.0.smithi029.stdout:6/771: read - d6/d1d/d39/d58/dfc/feb zero size 2023-12-05T13:26:48.726 INFO:tasks.workunit.client.0.smithi029.stdout:9/643: unlink d7/d19/d28/d65/fa9 0 2023-12-05T13:26:48.731 INFO:tasks.workunit.client.0.smithi029.stdout:3/798: getdents d1/d6/d4a/db6 0 2023-12-05T13:26:48.732 INFO:tasks.workunit.client.0.smithi029.stdout:3/799: chown d1/d6/d11/da3/cee 158131 1 2023-12-05T13:26:48.732 INFO:tasks.workunit.client.0.smithi029.stdout:8/809: creat d5/f114 x:0 0 0 2023-12-05T13:26:48.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/715: dwrite dc/d13/d4f/f6b [0,4194304] 0 2023-12-05T13:26:48.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/716: truncate dc/d13/fb9 1023986 0 2023-12-05T13:26:48.737 INFO:tasks.workunit.client.0.smithi029.stdout:0/717: write dc/d13/fb9 [1352684,89137] 0 2023-12-05T13:26:48.737 INFO:tasks.workunit.client.0.smithi029.stdout:3/800: truncate d1/d5e/d74/fd4 1309000 0 2023-12-05T13:26:48.742 INFO:tasks.workunit.client.0.smithi029.stdout:8/810: truncate d5/dc/d18/d26/f66 2774928 0 2023-12-05T13:26:48.743 INFO:tasks.workunit.client.0.smithi029.stdout:9/644: link d7/d19/f32 d7/d2c/fd0 0 2023-12-05T13:26:48.744 INFO:tasks.workunit.client.0.smithi029.stdout:0/718: dread dc/d33/d3d/d7a/d84/d8d/d97/fa3 [0,4194304] 0 2023-12-05T13:26:48.745 INFO:tasks.workunit.client.0.smithi029.stdout:9/645: dread d7/d2c/d33/f63 [0,4194304] 0 2023-12-05T13:26:48.747 INFO:tasks.workunit.client.0.smithi029.stdout:9/646: write d7/d19/d28/d65/f69 [1427504,9056] 0 2023-12-05T13:26:48.747 INFO:tasks.workunit.client.0.smithi029.stdout:9/647: chown d7/d19/d30/d40/dc3 7529 1 2023-12-05T13:26:48.750 INFO:tasks.workunit.client.0.smithi029.stdout:8/811: link d5/dc/d56/fe7 d5/dc/d56/f115 0 2023-12-05T13:26:48.750 INFO:tasks.workunit.client.0.smithi029.stdout:8/812: dread - d5/d2f/fea zero size 2023-12-05T13:26:48.752 INFO:tasks.workunit.client.0.smithi029.stdout:8/813: write d5/d6/d10/d13/ff0 [3342587,61196] 0 2023-12-05T13:26:48.752 INFO:tasks.workunit.client.0.smithi029.stdout:0/719: mknod dc/d23/dbf/ced 0 2023-12-05T13:26:48.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/648: dread d7/f18 [0,4194304] 0 2023-12-05T13:26:48.757 INFO:tasks.workunit.client.0.smithi029.stdout:3/801: dwrite d1/d16/d1f/d4c/dae/fea [0,4194304] 0 2023-12-05T13:26:48.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/649: stat d7/d19/d28/d50/dc0/d7f 0 2023-12-05T13:26:48.757 INFO:tasks.workunit.client.0.smithi029.stdout:9/650: truncate d7/d19/d30/d99/d8d/fcc 852439 0 2023-12-05T13:26:48.760 INFO:tasks.workunit.client.0.smithi029.stdout:6/772: write d6/d29/fa0 [1630773,83525] 0 2023-12-05T13:26:48.761 INFO:tasks.workunit.client.0.smithi029.stdout:3/802: chown d1/d16/d36/d3a/d6c/dbc 20028 1 2023-12-05T13:26:48.762 INFO:tasks.workunit.client.0.smithi029.stdout:6/773: creat d6/d1d/d39/d58/d71/dbf/f105 x:0 0 0 2023-12-05T13:26:48.763 INFO:tasks.workunit.client.0.smithi029.stdout:6/774: chown d6/d1d/d39/d58/fc1 400031 1 2023-12-05T13:26:48.766 INFO:tasks.workunit.client.0.smithi029.stdout:6/775: read d6/f54 [818302,86097] 0 2023-12-05T13:26:48.770 INFO:tasks.workunit.client.0.smithi029.stdout:6/776: creat d6/d64/dfe/f106 x:0 0 0 2023-12-05T13:26:48.776 INFO:tasks.workunit.client.0.smithi029.stdout:9/651: dwrite d7/d19/d1f/f21 [4194304,4194304] 0 2023-12-05T13:26:48.777 INFO:tasks.workunit.client.0.smithi029.stdout:8/814: dwrite d5/dbc/d1d/f2a [0,4194304] 0 2023-12-05T13:26:48.779 INFO:tasks.workunit.client.0.smithi029.stdout:6/777: truncate d6/d1d/d39/d58/fc1 3992982 0 2023-12-05T13:26:48.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/815: write d5/d6/d10/d85/daa/dfe/fd5 [556648,80309] 0 2023-12-05T13:26:48.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/816: write d5/dbc/d1d/d10f/d86/f95 [913995,129964] 0 2023-12-05T13:26:48.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/817: dread - d5/d6/d10/d13/fce zero size 2023-12-05T13:26:48.780 INFO:tasks.workunit.client.0.smithi029.stdout:8/818: readlink d5/dc/d18/dc8/lde 0 2023-12-05T13:26:48.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/652: dread d7/d2c/d33/f8a [0,4194304] 0 2023-12-05T13:26:48.784 INFO:tasks.workunit.client.0.smithi029.stdout:9/653: fsync d7/d19/d30/d40/d4e/fb1 0 2023-12-05T13:26:48.791 INFO:tasks.workunit.client.0.smithi029.stdout:6/778: creat d6/d1d/f107 x:0 0 0 2023-12-05T13:26:48.792 INFO:tasks.workunit.client.0.smithi029.stdout:9/654: creat d7/d19/d28/d65/fd1 x:0 0 0 2023-12-05T13:26:48.793 INFO:tasks.workunit.client.0.smithi029.stdout:9/655: creat d7/d19/d28/fd2 x:0 0 0 2023-12-05T13:26:48.797 INFO:tasks.workunit.client.0.smithi029.stdout:6/779: write d6/d29/dc4/f9f [3322132,116919] 0 2023-12-05T13:26:48.799 INFO:tasks.workunit.client.0.smithi029.stdout:6/780: creat d6/d29/dc4/d40/d74/d59/f108 x:0 0 0 2023-12-05T13:26:48.801 INFO:tasks.workunit.client.0.smithi029.stdout:8/819: dwrite d5/dc/f7a [0,4194304] 0 2023-12-05T13:26:48.801 INFO:tasks.workunit.client.0.smithi029.stdout:8/820: chown d5/dc/d18/d26/dc0/l105 0 1 2023-12-05T13:26:48.802 INFO:tasks.workunit.client.0.smithi029.stdout:6/781: getdents d6/d3f 0 2023-12-05T13:26:48.803 INFO:tasks.workunit.client.0.smithi029.stdout:8/821: mknod d5/dbc/d1d/d10f/d86/c116 0 2023-12-05T13:26:48.805 INFO:tasks.workunit.client.0.smithi029.stdout:8/822: creat d5/dbc/d1d/d10f/d3c/da2/f117 x:0 0 0 2023-12-05T13:26:48.807 INFO:tasks.workunit.client.0.smithi029.stdout:8/823: symlink d5/d6/l118 0 2023-12-05T13:26:48.809 INFO:tasks.workunit.client.0.smithi029.stdout:8/824: write d5/d6/f4b [3466784,60272] 0 2023-12-05T13:26:48.809 INFO:tasks.workunit.client.0.smithi029.stdout:9/656: dwrite d7/d19/d28/f2d [0,4194304] 0 2023-12-05T13:26:48.813 INFO:tasks.workunit.client.0.smithi029.stdout:8/825: unlink d5/dc/d18/d26/fb0 0 2023-12-05T13:26:48.816 INFO:tasks.workunit.client.0.smithi029.stdout:6/782: dwrite d6/d1d/d39/d58/f8b [0,4194304] 0 2023-12-05T13:26:48.817 INFO:tasks.workunit.client.0.smithi029.stdout:8/826: write d5/dc/d18/dc8/f107 [3906527,58313] 0 2023-12-05T13:26:48.819 INFO:tasks.workunit.client.0.smithi029.stdout:6/783: rename d6/d3f/db7/def/ff7 to d6/d29/dc4/d40/d74/d59/dfb/f109 0 2023-12-05T13:26:48.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/827: rmdir d5/dc/d18/dc8 39 2023-12-05T13:26:48.822 INFO:tasks.workunit.client.0.smithi029.stdout:6/784: rename d6/d29/dc4/d40/d74/f53 to d6/d29/dc4/d40/d4d/d8f/f10a 0 2023-12-05T13:26:48.827 INFO:tasks.workunit.client.0.smithi029.stdout:9/657: dwrite d7/d2c/d3a/d52/f81 [0,4194304] 0 2023-12-05T13:26:48.827 INFO:tasks.workunit.client.0.smithi029.stdout:6/785: mknod d6/d1d/d39/d58/de2/c10b 0 2023-12-05T13:26:48.828 INFO:tasks.workunit.client.0.smithi029.stdout:8/828: mkdir d5/d119 0 2023-12-05T13:26:48.842 INFO:tasks.workunit.client.0.smithi029.stdout:6/786: symlink d6/d29/dc4/d40/d74/d59/l10c 0 2023-12-05T13:26:48.847 INFO:tasks.workunit.client.0.smithi029.stdout:9/658: rename d7/d2c/c89 to d7/d5a/cd3 0 2023-12-05T13:26:48.849 INFO:tasks.workunit.client.0.smithi029.stdout:8/829: rename d5/d6/d10/d8a/lb4 to d5/d6/d10/d13/l11a 0 2023-12-05T13:26:48.851 INFO:tasks.workunit.client.0.smithi029.stdout:9/659: mkdir d7/d5a/dd4 0 2023-12-05T13:26:48.854 INFO:tasks.workunit.client.0.smithi029.stdout:9/660: link d7/d19/d30/d43/l7b d7/d19/d28/d50/ld5 0 2023-12-05T13:26:48.855 INFO:tasks.workunit.client.0.smithi029.stdout:8/830: mkdir d5/d11b 0 2023-12-05T13:26:48.856 INFO:tasks.workunit.client.0.smithi029.stdout:9/661: symlink d7/d19/d28/d50/ld6 0 2023-12-05T13:26:48.856 INFO:tasks.workunit.client.0.smithi029.stdout:9/662: write d7/d19/d1f/f46 [817237,130899] 0 2023-12-05T13:26:48.856 INFO:tasks.workunit.client.0.smithi029.stdout:8/831: truncate f4 3410854 0 2023-12-05T13:26:48.864 INFO:tasks.workunit.client.0.smithi029.stdout:6/787: dwrite d6/d1d/d39/d58/d71/dbf/ff9 [0,4194304] 0 2023-12-05T13:26:48.864 INFO:tasks.workunit.client.0.smithi029.stdout:6/788: fdatasync d6/d29/dc4/f99 0 2023-12-05T13:26:48.864 INFO:tasks.workunit.client.0.smithi029.stdout:4/623: sync 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:6/789: read d6/d64/d6d/d85/fc8 [1754573,99850] 0 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:8/832: mknod d5/d6/d10/c11c 0 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/733: sync 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/734: chown d7/d6e/da9/l3f 2018184 1 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/735: readlink d7/d6e/da9/l4c 0 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:1/736: chown d7/d61/d77/fbd 193237 1 2023-12-05T13:26:48.865 INFO:tasks.workunit.client.0.smithi029.stdout:4/624: getdents d0/d16/d22/dc2 0 2023-12-05T13:26:48.867 INFO:tasks.workunit.client.0.smithi029.stdout:8/833: symlink d5/d6/d10/l11d 0 2023-12-05T13:26:48.868 INFO:tasks.workunit.client.0.smithi029.stdout:8/834: fsync d5/dbc/f4e 0 2023-12-05T13:26:48.869 INFO:tasks.workunit.client.0.smithi029.stdout:4/625: truncate d0/d41/f9d 3128286 0 2023-12-05T13:26:48.869 INFO:tasks.workunit.client.0.smithi029.stdout:4/626: readlink d0/de/d15/d2b/l48 0 2023-12-05T13:26:48.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/835: creat d5/dbc/d8b/f11e x:0 0 0 2023-12-05T13:26:48.872 INFO:tasks.workunit.client.0.smithi029.stdout:8/836: fdatasync d5/d6/d10/d8a/db6/fe9 0 2023-12-05T13:26:48.873 INFO:tasks.workunit.client.0.smithi029.stdout:4/627: symlink d0/d41/lcd 0 2023-12-05T13:26:48.873 INFO:tasks.workunit.client.0.smithi029.stdout:4/628: write d0/de/d30/d32/f88 [4996736,47647] 0 2023-12-05T13:26:48.873 INFO:tasks.workunit.client.0.smithi029.stdout:4/629: read - d0/de/d30/d94/fb3 zero size 2023-12-05T13:26:48.875 INFO:tasks.workunit.client.0.smithi029.stdout:8/837: mkdir d5/dc/d56/d103/d11f 0 2023-12-05T13:26:48.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/790: dwrite d6/d29/d60/fb0 [0,4194304] 0 2023-12-05T13:26:48.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/791: fsync d6/d1d/d36/f7d 0 2023-12-05T13:26:48.879 INFO:tasks.workunit.client.0.smithi029.stdout:4/630: rmdir d0/d16/d2f 39 2023-12-05T13:26:48.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/631: chown d0/d16/f4a 3280619 1 2023-12-05T13:26:48.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/838: mkdir d5/dbc/d8b/d120 0 2023-12-05T13:26:48.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/839: chown d5/d6/d10/d13/fce 181 1 2023-12-05T13:26:48.889 INFO:tasks.workunit.client.0.smithi029.stdout:8/840: unlink d5/d6/d10/d85/daa/dfe/fd4 0 2023-12-05T13:26:48.890 INFO:tasks.workunit.client.0.smithi029.stdout:8/841: getdents d5/dbc/d1d/d10f/d3c 0 2023-12-05T13:26:48.891 INFO:tasks.workunit.client.0.smithi029.stdout:8/842: write d5/d6/d59/f72 [4823854,91530] 0 2023-12-05T13:26:48.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/843: rmdir d5/d2f 39 2023-12-05T13:26:48.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/844: stat d5/d2f/d75/f110 0 2023-12-05T13:26:48.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/845: write d5/dc/d56/fe7 [170759,72692] 0 2023-12-05T13:26:48.892 INFO:tasks.workunit.client.0.smithi029.stdout:8/846: mknod d5/dc/c121 0 2023-12-05T13:26:48.894 INFO:tasks.workunit.client.0.smithi029.stdout:9/663: dwrite d7/d2c/d33/f66 [4194304,4194304] 0 2023-12-05T13:26:48.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/664: link d7/d19/d30/d99/c94 d7/d19/d30/d99/cd7 0 2023-12-05T13:26:48.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/665: chown d7/d19/d28/f37 20200464 1 2023-12-05T13:26:48.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/666: mknod d7/d2c/d3a/d52/dc9/cd8 0 2023-12-05T13:26:48.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/667: write d7/d19/d30/d99/d8d/db5/fc4 [611523,34853] 0 2023-12-05T13:26:48.899 INFO:tasks.workunit.client.0.smithi029.stdout:6/792: dwrite d6/f45 [0,4194304] 0 2023-12-05T13:26:48.899 INFO:tasks.workunit.client.0.smithi029.stdout:9/668: creat d7/d5a/dd4/fd9 x:0 0 0 2023-12-05T13:26:48.900 INFO:tasks.workunit.client.0.smithi029.stdout:4/632: dread d0/d41/f9d [0,4194304] 0 2023-12-05T13:26:48.901 INFO:tasks.workunit.client.0.smithi029.stdout:6/793: getdents d6/d5a 0 2023-12-05T13:26:48.901 INFO:tasks.workunit.client.0.smithi029.stdout:6/794: write d6/d29/dc4/d40/ff8 [503968,40061] 0 2023-12-05T13:26:48.903 INFO:tasks.workunit.client.0.smithi029.stdout:9/669: creat d7/d19/d28/d50/dc0/d7f/fda x:0 0 0 2023-12-05T13:26:48.904 INFO:tasks.workunit.client.0.smithi029.stdout:8/847: dwrite d5/d2f/d75/fa4 [0,4194304] 0 2023-12-05T13:26:48.905 INFO:tasks.workunit.client.0.smithi029.stdout:4/633: creat d0/de/d30/d32/d35/d3d/fce x:0 0 0 2023-12-05T13:26:48.905 INFO:tasks.workunit.client.0.smithi029.stdout:4/634: dread - d0/de/d30/d32/fc5 zero size 2023-12-05T13:26:48.907 INFO:tasks.workunit.client.0.smithi029.stdout:6/795: rename d6/d93/fc6 to d6/d29/dc4/d40/d74/d59/dfb/f10d 0 2023-12-05T13:26:48.908 INFO:tasks.workunit.client.0.smithi029.stdout:8/848: link d5/dbc/d1d/d10f/l5f d5/d6/d10/d8a/db6/d108/l122 0 2023-12-05T13:26:48.910 INFO:tasks.workunit.client.0.smithi029.stdout:4/635: mkdir d0/d16/d22/d5f/d79/dcf 0 2023-12-05T13:26:48.911 INFO:tasks.workunit.client.0.smithi029.stdout:4/636: write d0/d16/d22/d4f/f59 [727813,79073] 0 2023-12-05T13:26:48.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/670: rename d7/d19/d28/d50/dc0/fa1 to d7/d19/d30/d40/d4e/d5e/fdb 0 2023-12-05T13:26:48.914 INFO:tasks.workunit.client.0.smithi029.stdout:6/796: unlink d6/d29/dc4/d40/d4d/f96 0 2023-12-05T13:26:48.918 INFO:tasks.workunit.client.0.smithi029.stdout:4/637: mkdir d0/d16/dd0 0 2023-12-05T13:26:48.918 INFO:tasks.workunit.client.0.smithi029.stdout:4/638: chown d0/d16/db6 375994367 1 2023-12-05T13:26:48.919 INFO:tasks.workunit.client.0.smithi029.stdout:9/671: mknod d7/d19/d28/d50/dc0/cdc 0 2023-12-05T13:26:48.919 INFO:tasks.workunit.client.0.smithi029.stdout:9/672: chown d7/d19/d28/d50/dc0/f6c 3370013 1 2023-12-05T13:26:48.921 INFO:tasks.workunit.client.0.smithi029.stdout:9/673: dread d7/d19/d30/d40/f9f [0,4194304] 0 2023-12-05T13:26:48.921 INFO:tasks.workunit.client.0.smithi029.stdout:9/674: truncate d7/d19/d1f/f46 2516320 0 2023-12-05T13:26:48.921 INFO:tasks.workunit.client.0.smithi029.stdout:9/675: truncate d7/d2c/d33/f63 1059489 0 2023-12-05T13:26:48.922 INFO:tasks.workunit.client.0.smithi029.stdout:9/676: fdatasync d7/d2c/d3a/d52/db9/fc7 0 2023-12-05T13:26:48.922 INFO:tasks.workunit.client.0.smithi029.stdout:9/677: chown d7/d2c/c56 143 1 2023-12-05T13:26:48.925 INFO:tasks.workunit.client.0.smithi029.stdout:4/639: read d0/de/d30/d32/fa5 [176178,55496] 0 2023-12-05T13:26:48.927 INFO:tasks.workunit.client.0.smithi029.stdout:4/640: symlink d0/de/d30/d32/d35/ld1 0 2023-12-05T13:26:48.927 INFO:tasks.workunit.client.0.smithi029.stdout:4/641: read - d0/d41/fc9 zero size 2023-12-05T13:26:48.928 INFO:tasks.workunit.client.0.smithi029.stdout:4/642: stat d0/de/d30/d32/d35/f58 0 2023-12-05T13:26:48.929 INFO:tasks.workunit.client.0.smithi029.stdout:4/643: creat d0/d16/d22/fd2 x:0 0 0 2023-12-05T13:26:48.930 INFO:tasks.workunit.client.0.smithi029.stdout:4/644: mkdir d0/de/d30/d32/d35/dd3 0 2023-12-05T13:26:48.936 INFO:tasks.workunit.client.0.smithi029.stdout:8/849: dwrite d5/d2f/d75/f71 [0,4194304] 0 2023-12-05T13:26:48.937 INFO:tasks.workunit.client.0.smithi029.stdout:8/850: dread - d5/d6/d10/d8a/db6/d108/fdf zero size 2023-12-05T13:26:48.937 INFO:tasks.workunit.client.0.smithi029.stdout:8/851: chown d5/c1b 302 1 2023-12-05T13:26:48.937 INFO:tasks.workunit.client.0.smithi029.stdout:8/852: write d5/dc/d18/d26/dc0/fcb [4394474,94843] 0 2023-12-05T13:26:48.937 INFO:tasks.workunit.client.0.smithi029.stdout:9/678: dwrite d7/d19/fb8 [0,4194304] 0 2023-12-05T13:26:48.941 INFO:tasks.workunit.client.0.smithi029.stdout:6/797: dwrite d6/f18 [0,4194304] 0 2023-12-05T13:26:48.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/798: creat d6/d29/f10e x:0 0 0 2023-12-05T13:26:48.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/799: stat d6/d29/dc4/d40/d74/d52/d5c/l6c 0 2023-12-05T13:26:48.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/800: fsync d6/d29/dc4/d40/d4d/d8f/de0/ff1 0 2023-12-05T13:26:48.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/801: chown d6/d29/dc4/d40/d4d/d8f 97433 1 2023-12-05T13:26:48.947 INFO:tasks.workunit.client.0.smithi029.stdout:9/679: dread d7/d19/d28/d50/f7c [0,4194304] 0 2023-12-05T13:26:48.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/680: creat d7/d19/d28/d50/dc0/fdd x:0 0 0 2023-12-05T13:26:48.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/681: read - d7/d2c/d33/f59 zero size 2023-12-05T13:26:48.950 INFO:tasks.workunit.client.0.smithi029.stdout:9/682: symlink d7/d2c/d3a/d52/lde 0 2023-12-05T13:26:48.951 INFO:tasks.workunit.client.0.smithi029.stdout:9/683: read d7/d2c/d33/f5b [2609273,33326] 0 2023-12-05T13:26:48.953 INFO:tasks.workunit.client.0.smithi029.stdout:9/684: getdents d7/d19/d30/d40/d4e 0 2023-12-05T13:26:48.953 INFO:tasks.workunit.client.0.smithi029.stdout:9/685: dread - d7/d19/d28/d50/dc0/d7f/fda zero size 2023-12-05T13:26:48.957 INFO:tasks.workunit.client.0.smithi029.stdout:8/853: dwrite d5/d6/d59/fba [0,4194304] 0 2023-12-05T13:26:48.960 INFO:tasks.workunit.client.0.smithi029.stdout:9/686: mkdir d7/d5a/ddf 0 2023-12-05T13:26:48.964 INFO:tasks.workunit.client.0.smithi029.stdout:9/687: rename d7/d5a/lb3 to d7/d19/d28/d50/dc0/le0 0 2023-12-05T13:26:48.973 INFO:tasks.workunit.client.0.smithi029.stdout:8/854: dwrite d5/d2f/fea [0,4194304] 0 2023-12-05T13:26:48.973 INFO:tasks.workunit.client.0.smithi029.stdout:9/688: rmdir d7/d19/d28/d50/dc0 39 2023-12-05T13:26:48.975 INFO:tasks.workunit.client.0.smithi029.stdout:8/855: truncate d5/dc/d18/d26/f94 2679403 0 2023-12-05T13:26:48.977 INFO:tasks.workunit.client.0.smithi029.stdout:9/689: rename d7/fe to d7/d2c/d33/fe1 0 2023-12-05T13:26:48.977 INFO:tasks.workunit.client.0.smithi029.stdout:9/690: truncate d7/d2c/d33/f63 1413881 0 2023-12-05T13:26:48.979 INFO:tasks.workunit.client.0.smithi029.stdout:9/691: symlink d7/d19/d28/d65/d73/le2 0 2023-12-05T13:26:48.990 INFO:tasks.workunit.client.0.smithi029.stdout:6/802: dwrite d6/d29/dc4/d40/d74/d59/faa [0,4194304] 0 2023-12-05T13:26:48.994 INFO:tasks.workunit.client.0.smithi029.stdout:8/856: dwrite d5/dc/d18/fbf [0,4194304] 0 2023-12-05T13:26:48.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/857: getdents d5/d6/d10/d85 0 2023-12-05T13:26:48.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/858: stat d5/d6/l118 0 2023-12-05T13:26:48.997 INFO:tasks.workunit.client.0.smithi029.stdout:8/859: chown d5/dc/d18/l58 353276 1 2023-12-05T13:26:48.998 INFO:tasks.workunit.client.0.smithi029.stdout:8/860: creat d5/dbc/d1d/d10f/f123 x:0 0 0 2023-12-05T13:26:49.000 INFO:tasks.workunit.client.0.smithi029.stdout:8/861: creat d5/dbc/d1d/d10f/d3c/f124 x:0 0 0 2023-12-05T13:26:49.000 INFO:tasks.workunit.client.0.smithi029.stdout:9/692: dwrite d7/d2c/d33/fae [0,4194304] 0 2023-12-05T13:26:49.003 INFO:tasks.workunit.client.0.smithi029.stdout:8/862: rename d5/dc/f32 to d5/d6/d10/d85/daa/f125 0 2023-12-05T13:26:49.004 INFO:tasks.workunit.client.0.smithi029.stdout:6/803: dwrite d6/f45 [0,4194304] 0 2023-12-05T13:26:49.004 INFO:tasks.workunit.client.0.smithi029.stdout:6/804: chown d6/d29/dc4/l33 553393946 1 2023-12-05T13:26:49.004 INFO:tasks.workunit.client.0.smithi029.stdout:6/805: truncate d6/d1d/d39/d58/dfc/feb 605381 0 2023-12-05T13:26:49.008 INFO:tasks.workunit.client.0.smithi029.stdout:9/693: symlink d7/d2c/d33/le3 0 2023-12-05T13:26:49.023 INFO:tasks.workunit.client.0.smithi029.stdout:6/806: dwrite d6/d3f/f9a [0,4194304] 0 2023-12-05T13:26:49.023 INFO:tasks.workunit.client.0.smithi029.stdout:8/863: dwrite d5/d6/f9 [0,4194304] 0 2023-12-05T13:26:49.026 INFO:tasks.workunit.client.0.smithi029.stdout:6/807: mkdir d6/d64/d10f 0 2023-12-05T13:26:49.026 INFO:tasks.workunit.client.0.smithi029.stdout:6/808: write d6/d29/d60/f103 [588236,10389] 0 2023-12-05T13:26:49.027 INFO:tasks.workunit.client.0.smithi029.stdout:6/809: mknod d6/d29/dc4/d40/d74/d59/dfb/c110 0 2023-12-05T13:26:49.029 INFO:tasks.workunit.client.0.smithi029.stdout:6/810: mkdir d6/d3f/db7/def/d111 0 2023-12-05T13:26:49.030 INFO:tasks.workunit.client.0.smithi029.stdout:6/811: mknod d6/d29/dc4/d40/d74/d52/d5c/c112 0 2023-12-05T13:26:49.030 INFO:tasks.workunit.client.0.smithi029.stdout:6/812: chown d6/d29/dc4/d40/d74/d59/dfb 2063131661 1 2023-12-05T13:26:49.045 INFO:tasks.workunit.client.0.smithi029.stdout:6/813: dwrite d6/d29/dc4/d40/d74/d59/fff [0,4194304] 0 2023-12-05T13:26:49.048 INFO:tasks.workunit.client.0.smithi029.stdout:6/814: symlink d6/d1d/d39/l113 0 2023-12-05T13:26:49.050 INFO:tasks.workunit.client.0.smithi029.stdout:6/815: creat d6/d64/d6d/da3/dcf/dd4/f114 x:0 0 0 2023-12-05T13:26:49.051 INFO:tasks.workunit.client.0.smithi029.stdout:6/816: truncate d6/d29/dc4/d40/d74/d52/d5c/fa6 427481 0 2023-12-05T13:26:49.053 INFO:tasks.workunit.client.0.smithi029.stdout:6/817: creat d6/d29/dc4/d40/f115 x:0 0 0 2023-12-05T13:26:49.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/818: dread d6/d29/dc4/f5e [0,4194304] 0 2023-12-05T13:26:49.061 INFO:tasks.workunit.client.0.smithi029.stdout:6/819: truncate d6/d29/dc4/d40/d74/d52/d5c/fa6 268446 0 2023-12-05T13:26:49.062 INFO:tasks.workunit.client.0.smithi029.stdout:6/820: stat d6/d5a 0 2023-12-05T13:26:49.062 INFO:tasks.workunit.client.0.smithi029.stdout:6/821: read - d6/d1d/d39/d58/d71/fd0 zero size 2023-12-05T13:26:49.063 INFO:tasks.workunit.client.0.smithi029.stdout:6/822: mkdir d6/d3f/db7/def/d111/d116 0 2023-12-05T13:26:49.063 INFO:tasks.workunit.client.0.smithi029.stdout:6/823: mkdir d6/d64/d6d/d117 0 2023-12-05T13:26:49.065 INFO:tasks.workunit.client.0.smithi029.stdout:6/824: truncate d6/fa 56127 0 2023-12-05T13:26:49.066 INFO:tasks.workunit.client.0.smithi029.stdout:6/825: creat d6/d64/d6d/d117/f118 x:0 0 0 2023-12-05T13:26:49.067 INFO:tasks.workunit.client.0.smithi029.stdout:6/826: getdents d6/d29/dc4/d40/d74/d52/d5c/d6f 0 2023-12-05T13:26:49.068 INFO:tasks.workunit.client.0.smithi029.stdout:6/827: link d6/ce4 d6/d29/dc4/d40/d4d/d8f/c119 0 2023-12-05T13:26:49.152 INFO:tasks.workunit.client.0.smithi029.stdout:5/587: sync 2023-12-05T13:26:49.154 INFO:tasks.workunit.client.0.smithi029.stdout:5/588: unlink d1/l82 0 2023-12-05T13:26:49.155 INFO:tasks.workunit.client.0.smithi029.stdout:5/589: write d1/dc/d25/d4c/d9b/d9a/f88 [585264,119037] 0 2023-12-05T13:26:49.172 INFO:tasks.workunit.client.0.smithi029.stdout:5/590: dwrite d1/dc/d10/d1e/d75/d7f/d8a/fc2 [0,4194304] 0 2023-12-05T13:26:49.174 INFO:tasks.workunit.client.0.smithi029.stdout:5/591: dread d1/dc/f89 [0,4194304] 0 2023-12-05T13:26:49.174 INFO:tasks.workunit.client.0.smithi029.stdout:5/592: write d1/dc/d11/fbe [137163,48353] 0 2023-12-05T13:26:49.174 INFO:tasks.workunit.client.0.smithi029.stdout:5/593: chown d1/dc/d10/d1e/d33/fc5 180015 1 2023-12-05T13:26:49.189 INFO:tasks.workunit.client.0.smithi029.stdout:5/594: dwrite d1/dc/d38/f44 [0,4194304] 0 2023-12-05T13:26:49.191 INFO:tasks.workunit.client.0.smithi029.stdout:5/595: creat d1/dc/d38/d3a/d5c/fcc x:0 0 0 2023-12-05T13:26:49.194 INFO:tasks.workunit.client.0.smithi029.stdout:5/596: dread d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:49.195 INFO:tasks.workunit.client.0.smithi029.stdout:5/597: creat d1/dc/d38/d4b/fcd x:0 0 0 2023-12-05T13:26:49.219 INFO:tasks.workunit.client.0.smithi029.stdout:5/598: dwrite d1/dc/d11/f79 [0,4194304] 0 2023-12-05T13:26:49.227 INFO:tasks.workunit.client.0.smithi029.stdout:5/599: dread d1/dc/d38/d3a/d5c/f63 [0,4194304] 0 2023-12-05T13:26:49.229 INFO:tasks.workunit.client.0.smithi029.stdout:5/600: creat d1/dc/d10/d1e/fce x:0 0 0 2023-12-05T13:26:49.230 INFO:tasks.workunit.client.0.smithi029.stdout:5/601: write d1/dc/d10/d1e/d33/f6b [878388,15975] 0 2023-12-05T13:26:49.251 INFO:tasks.workunit.client.0.smithi029.stdout:5/602: dwrite d1/dc/d10/d1e/f5f [0,4194304] 0 2023-12-05T13:26:49.253 INFO:tasks.workunit.client.0.smithi029.stdout:5/603: mknod d1/dc/d10/d1e/d75/ccf 0 2023-12-05T13:26:49.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/604: write d1/dc/d10/d1e/f5f [1755832,118150] 0 2023-12-05T13:26:49.254 INFO:tasks.workunit.client.0.smithi029.stdout:5/605: fsync d1/dc/d11/f79 0 2023-12-05T13:26:49.272 INFO:tasks.workunit.client.0.smithi029.stdout:5/606: dwrite d1/dc/d38/d4b/fcd [0,4194304] 0 2023-12-05T13:26:49.292 INFO:tasks.workunit.client.0.smithi029.stdout:5/607: dwrite d1/dc/d38/f6c [0,4194304] 0 2023-12-05T13:26:49.296 INFO:tasks.workunit.client.0.smithi029.stdout:5/608: creat d1/dc/d25/d4c/d9b/d9a/fd0 x:0 0 0 2023-12-05T13:26:49.296 INFO:tasks.workunit.client.0.smithi029.stdout:5/609: stat d1/dc/d10/d1e/d75/d7f/fb1 0 2023-12-05T13:26:49.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/610: dread - d1/dc/d38/d3a/d5c/f69 zero size 2023-12-05T13:26:49.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/611: dread - d1/dc/d38/d3a/d5c/f69 zero size 2023-12-05T13:26:49.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/612: fsync d1/dc/d27/f2a 0 2023-12-05T13:26:49.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/613: getdents d1/dc/d38/d4b 0 2023-12-05T13:26:49.311 INFO:tasks.workunit.client.0.smithi029.stdout:5/614: dwrite d1/f20 [4194304,4194304] 0 2023-12-05T13:26:49.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/615: stat d1/dc/l84 0 2023-12-05T13:26:49.312 INFO:tasks.workunit.client.0.smithi029.stdout:5/616: truncate d1/dc/f89 780784 0 2023-12-05T13:26:49.313 INFO:tasks.workunit.client.0.smithi029.stdout:5/617: read d1/dc/d10/d1e/d33/f4d [526253,63984] 0 2023-12-05T13:26:49.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/618: rmdir d1/dc/d27/dc9 0 2023-12-05T13:26:49.315 INFO:tasks.workunit.client.0.smithi029.stdout:5/619: link d1/dc/d38/d3a/d5c/d87/fb8 d1/dc/d10/d1e/d75/fd1 0 2023-12-05T13:26:49.316 INFO:tasks.workunit.client.0.smithi029.stdout:5/620: write d1/dc/d38/d3a/d5c/d87/f91 [1371322,83109] 0 2023-12-05T13:26:49.323 INFO:tasks.workunit.client.0.smithi029.stdout:0/720: sync 2023-12-05T13:26:49.323 INFO:tasks.workunit.client.0.smithi029.stdout:7/854: sync 2023-12-05T13:26:49.323 INFO:tasks.workunit.client.0.smithi029.stdout:2/743: sync 2023-12-05T13:26:49.325 INFO:tasks.workunit.client.0.smithi029.stdout:2/744: creat de/d11/d32/dbc/fee x:0 0 0 2023-12-05T13:26:49.326 INFO:tasks.workunit.client.0.smithi029.stdout:0/721: creat dc/d33/d3d/d7a/d84/da4/dbe/fee x:0 0 0 2023-12-05T13:26:49.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/855: dread d6/d50/d5b/d5f/d7d/d97/d4a/fc7 [0,4194304] 0 2023-12-05T13:26:49.328 INFO:tasks.workunit.client.0.smithi029.stdout:7/856: dread - d6/d50/d5b/d5f/d7d/d96/fe1 zero size 2023-12-05T13:26:49.330 INFO:tasks.workunit.client.0.smithi029.stdout:0/722: rename dc/f27 to dc/d33/d3d/d7a/d84/d8d/d97/d98/fef 0 2023-12-05T13:26:49.331 INFO:tasks.workunit.client.0.smithi029.stdout:7/857: dread d6/d100/d4f/dc5/d52/fa5 [0,4194304] 0 2023-12-05T13:26:49.332 INFO:tasks.workunit.client.0.smithi029.stdout:0/723: creat dc/d13/d4f/d83/ff0 x:0 0 0 2023-12-05T13:26:49.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/858: creat d6/d50/d5b/d5f/f10f x:0 0 0 2023-12-05T13:26:49.333 INFO:tasks.workunit.client.0.smithi029.stdout:7/859: readlink d6/d19/ld2 0 2023-12-05T13:26:49.334 INFO:tasks.workunit.client.0.smithi029.stdout:0/724: creat dc/d33/d3d/d7a/d84/d8d/ff1 x:0 0 0 2023-12-05T13:26:49.335 INFO:tasks.workunit.client.0.smithi029.stdout:7/860: truncate d6/d100/d4f/dc5/f42 3844080 0 2023-12-05T13:26:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:2/745: dread de/d11/fdd [0,4194304] 0 2023-12-05T13:26:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:2/746: stat de/d16/d43 0 2023-12-05T13:26:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:7/861: dread d6/d100/d2f/fec [0,4194304] 0 2023-12-05T13:26:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:0/725: link dc/d33/d3d/cb3 dc/d23/d3a/d41/d70/cf2 0 2023-12-05T13:26:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:2/747: stat de/d6a/d9d/cc1 0 2023-12-05T13:26:49.337 INFO:tasks.workunit.client.0.smithi029.stdout:7/862: write d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/fb0 [197940,28347] 0 2023-12-05T13:26:49.339 INFO:tasks.workunit.client.0.smithi029.stdout:7/863: read d6/d100/d2f/f91 [116556,40648] 0 2023-12-05T13:26:49.340 INFO:tasks.workunit.client.0.smithi029.stdout:0/726: symlink dc/d23/d3a/d41/lf3 0 2023-12-05T13:26:49.340 INFO:tasks.workunit.client.0.smithi029.stdout:0/727: write dc/d33/d3d/d7a/d84/da4/dbe/fee [693598,100663] 0 2023-12-05T13:26:49.340 INFO:tasks.workunit.client.0.smithi029.stdout:0/728: write dc/d13/d4f/d88/f99 [5025141,32448] 0 2023-12-05T13:26:49.340 INFO:tasks.workunit.client.0.smithi029.stdout:5/621: dwrite d1/dc/d10/d1e/d33/fc5 [0,4194304] 0 2023-12-05T13:26:49.340 INFO:tasks.workunit.client.0.smithi029.stdout:0/729: write dc/d23/f6f [378328,102154] 0 2023-12-05T13:26:49.340 INFO:tasks.workunit.client.0.smithi029.stdout:7/864: mknod d6/d100/d4f/dc5/c110 0 2023-12-05T13:26:49.341 INFO:tasks.workunit.client.0.smithi029.stdout:2/748: unlink de/d11/d32/la0 0 2023-12-05T13:26:49.343 INFO:tasks.workunit.client.0.smithi029.stdout:5/622: mknod d1/dc/d10/d1e/d75/d7f/d8a/cd2 0 2023-12-05T13:26:49.343 INFO:tasks.workunit.client.0.smithi029.stdout:5/623: chown d1/dc/d25/d4c/d61/f85 180128 1 2023-12-05T13:26:49.347 INFO:tasks.workunit.client.0.smithi029.stdout:2/749: dread de/d16/f2b [0,4194304] 0 2023-12-05T13:26:49.354 INFO:tasks.workunit.client.0.smithi029.stdout:7/865: dread d6/d50/d5b/d1a/d26/d72/fbf [0,4194304] 0 2023-12-05T13:26:49.359 INFO:tasks.workunit.client.0.smithi029.stdout:7/866: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d3e/f111 x:0 0 0 2023-12-05T13:26:49.362 INFO:tasks.workunit.client.0.smithi029.stdout:7/867: symlink d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d6a/d10b/l112 0 2023-12-05T13:26:49.362 INFO:tasks.workunit.client.0.smithi029.stdout:2/750: getdents de/d11/d32 0 2023-12-05T13:26:49.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/730: dwrite dc/d13/f34 [0,4194304] 0 2023-12-05T13:26:49.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/731: write dc/d13/d4f/d88/fab [310548,122710] 0 2023-12-05T13:26:49.363 INFO:tasks.workunit.client.0.smithi029.stdout:0/732: readlink dc/d33/d3d/d7a/d84/d8d/d97/d98/lae 0 2023-12-05T13:26:49.377 INFO:tasks.workunit.client.0.smithi029.stdout:0/733: dread dc/d13/d4f/d88/f99 [0,4194304] 0 2023-12-05T13:26:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:0/734: creat dc/d13/d4f/d88/dc4/ff4 x:0 0 0 2023-12-05T13:26:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:0/735: write dc/d13/d4f/d63/f87 [791123,18579] 0 2023-12-05T13:26:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:2/751: dread de/d16/f1b [0,4194304] 0 2023-12-05T13:26:49.388 INFO:tasks.workunit.client.0.smithi029.stdout:7/868: dwrite d6/f11 [0,4194304] 0 2023-12-05T13:26:49.397 INFO:tasks.workunit.client.0.smithi029.stdout:2/752: dwrite de/d14/d24/f1c [0,4194304] 0 2023-12-05T13:26:49.397 INFO:tasks.workunit.client.0.smithi029.stdout:0/736: dwrite dc/d33/d3d/d7a/fb4 [0,4194304] 0 2023-12-05T13:26:49.398 INFO:tasks.workunit.client.0.smithi029.stdout:2/753: creat de/d41/d56/fef x:0 0 0 2023-12-05T13:26:49.398 INFO:tasks.workunit.client.0.smithi029.stdout:2/754: chown de/d16/fcb 145 1 2023-12-05T13:26:49.398 INFO:tasks.workunit.client.0.smithi029.stdout:2/755: dread - de/d16/d43/fe8 zero size 2023-12-05T13:26:49.399 INFO:tasks.workunit.client.0.smithi029.stdout:2/756: truncate de/d41/f78 4227100 0 2023-12-05T13:26:49.399 INFO:tasks.workunit.client.0.smithi029.stdout:2/757: chown de/d11/d32/f5a 186 1 2023-12-05T13:26:49.399 INFO:tasks.workunit.client.0.smithi029.stdout:2/758: fdatasync de/d14/d24/f74 0 2023-12-05T13:26:49.399 INFO:tasks.workunit.client.0.smithi029.stdout:2/759: mkdir de/d16/df0 0 2023-12-05T13:26:49.400 INFO:tasks.workunit.client.0.smithi029.stdout:2/760: read de/d14/d24/f1c [1233140,121522] 0 2023-12-05T13:26:49.401 INFO:tasks.workunit.client.0.smithi029.stdout:2/761: truncate de/f5b 1082119 0 2023-12-05T13:26:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/737: dwrite dc/d33/d3d/d7a/d84/d8d/ff1 [0,4194304] 0 2023-12-05T13:26:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:0/738: write dc/d13/d4f/f6b [5138063,101686] 0 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:9/694: sync 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:6/828: sync 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:8/864: sync 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:3/803: sync 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:9/695: chown d7/d19/d28 0 1 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:1/737: sync 2023-12-05T13:26:49.535 INFO:tasks.workunit.client.0.smithi029.stdout:4/645: sync 2023-12-05T13:26:49.536 INFO:tasks.workunit.client.0.smithi029.stdout:8/865: readlink d5/dbc/d53/l6c 0 2023-12-05T13:26:49.536 INFO:tasks.workunit.client.0.smithi029.stdout:3/804: fsync d1/d16/d9c/feb 0 2023-12-05T13:26:49.542 INFO:tasks.workunit.client.0.smithi029.stdout:0/739: creat dc/d33/d3d/d7a/d84/dde/ff5 x:0 0 0 2023-12-05T13:26:49.547 INFO:tasks.workunit.client.0.smithi029.stdout:6/829: unlink d6/f18 0 2023-12-05T13:26:49.548 INFO:tasks.workunit.client.0.smithi029.stdout:9/696: mknod d7/d2c/d3a/ce4 0 2023-12-05T13:26:49.549 INFO:tasks.workunit.client.0.smithi029.stdout:9/697: write d7/d2c/d33/fae [4787813,20207] 0 2023-12-05T13:26:49.550 INFO:tasks.workunit.client.0.smithi029.stdout:8/866: symlink d5/dbc/d8b/d120/l126 0 2023-12-05T13:26:49.551 INFO:tasks.workunit.client.0.smithi029.stdout:0/740: mkdir dc/d33/d3d/d7a/d84/db1/dda/df6 0 2023-12-05T13:26:49.552 INFO:tasks.workunit.client.0.smithi029.stdout:6/830: truncate d6/d1d/d36/f69 3807288 0 2023-12-05T13:26:49.552 INFO:tasks.workunit.client.0.smithi029.stdout:0/741: write dc/d13/d4f/d83/fc2 [1130094,48857] 0 2023-12-05T13:26:49.554 INFO:tasks.workunit.client.0.smithi029.stdout:9/698: unlink d7/d19/d28/d65/d73/le2 0 2023-12-05T13:26:49.554 INFO:tasks.workunit.client.0.smithi029.stdout:9/699: stat d7/d19/d30/fa3 0 2023-12-05T13:26:49.558 INFO:tasks.workunit.client.0.smithi029.stdout:3/805: rmdir d1/d6/d11 39 2023-12-05T13:26:49.558 INFO:tasks.workunit.client.0.smithi029.stdout:4/646: dwrite d0/d41/f9d [0,4194304] 0 2023-12-05T13:26:49.558 INFO:tasks.workunit.client.0.smithi029.stdout:8/867: rename d5/d6/d59/cd7 to d5/dc/d18/dc8/c127 0 2023-12-05T13:26:49.558 INFO:tasks.workunit.client.0.smithi029.stdout:1/738: dwrite d7/d5e/fe9 [0,4194304] 0 2023-12-05T13:26:49.559 INFO:tasks.workunit.client.0.smithi029.stdout:6/831: symlink d6/d29/dc4/d40/d4d/l11a 0 2023-12-05T13:26:49.565 INFO:tasks.workunit.client.0.smithi029.stdout:3/806: mkdir d1/d16/d9c/dfc 0 2023-12-05T13:26:49.567 INFO:tasks.workunit.client.0.smithi029.stdout:8/868: dread d5/d6/d10/d85/daa/dfe/fd5 [0,4194304] 0 2023-12-05T13:26:49.568 INFO:tasks.workunit.client.0.smithi029.stdout:4/647: mkdir d0/de/d30/d94/da4/dd4 0 2023-12-05T13:26:49.568 INFO:tasks.workunit.client.0.smithi029.stdout:4/648: chown d0/d41/c86 3898 1 2023-12-05T13:26:49.572 INFO:tasks.workunit.client.0.smithi029.stdout:9/700: mkdir d7/d19/d28/d65/d73/de5 0 2023-12-05T13:26:49.573 INFO:tasks.workunit.client.0.smithi029.stdout:3/807: dread - d1/d18/fa5 zero size 2023-12-05T13:26:49.574 INFO:tasks.workunit.client.0.smithi029.stdout:6/832: dwrite d6/d29/dc4/d40/f115 [0,4194304] 0 2023-12-05T13:26:49.575 INFO:tasks.workunit.client.0.smithi029.stdout:6/833: write d6/f1c [4844970,130424] 0 2023-12-05T13:26:49.575 INFO:tasks.workunit.client.0.smithi029.stdout:6/834: read d6/d1d/d39/d58/d71/dbf/ff9 [3868193,17059] 0 2023-12-05T13:26:49.577 INFO:tasks.workunit.client.0.smithi029.stdout:8/869: getdents d5/dbc/d1d 0 2023-12-05T13:26:49.577 INFO:tasks.workunit.client.0.smithi029.stdout:8/870: readlink d5/dbc/d1d/l54 0 2023-12-05T13:26:49.577 INFO:tasks.workunit.client.0.smithi029.stdout:6/835: write d6/d29/dc4/d40/fd2 [532844,17202] 0 2023-12-05T13:26:49.578 INFO:tasks.workunit.client.0.smithi029.stdout:4/649: rmdir d0/de/d30 39 2023-12-05T13:26:49.581 INFO:tasks.workunit.client.0.smithi029.stdout:9/701: mkdir d7/d19/d30/d99/d8d/de6 0 2023-12-05T13:26:49.581 INFO:tasks.workunit.client.0.smithi029.stdout:9/702: chown d7/d19/d30/d40/d4e/f95 184 1 2023-12-05T13:26:49.582 INFO:tasks.workunit.client.0.smithi029.stdout:3/808: fdatasync d1/db3/dc7/fe5 0 2023-12-05T13:26:49.585 INFO:tasks.workunit.client.0.smithi029.stdout:1/739: write d7/d61/f92 [1772524,73366] 0 2023-12-05T13:26:49.587 INFO:tasks.workunit.client.0.smithi029.stdout:8/871: symlink d5/d6/d10/l128 0 2023-12-05T13:26:49.587 INFO:tasks.workunit.client.0.smithi029.stdout:8/872: readlink d5/dc/d18/dc8/lde 0 2023-12-05T13:26:49.589 INFO:tasks.workunit.client.0.smithi029.stdout:6/836: creat d6/d29/dc4/d40/d74/d52/d5c/f11b x:0 0 0 2023-12-05T13:26:49.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/650: creat d0/d16/d2f/d69/d77/fd5 x:0 0 0 2023-12-05T13:26:49.591 INFO:tasks.workunit.client.0.smithi029.stdout:9/703: mkdir d7/d19/d1f/da2/de7 0 2023-12-05T13:26:49.592 INFO:tasks.workunit.client.0.smithi029.stdout:3/809: rename d1/d16/lce to d1/db3/d72/lfd 0 2023-12-05T13:26:49.593 INFO:tasks.workunit.client.0.smithi029.stdout:1/740: creat d7/d5e/d52/d90/ff4 x:0 0 0 2023-12-05T13:26:49.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/873: mknod d5/dbc/d1d/d10f/d3c/c129 0 2023-12-05T13:26:49.593 INFO:tasks.workunit.client.0.smithi029.stdout:8/874: fdatasync d5/dbc/f4e 0 2023-12-05T13:26:49.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/742: dwrite dc/d23/f2e [0,4194304] 0 2023-12-05T13:26:49.597 INFO:tasks.workunit.client.0.smithi029.stdout:9/704: link d7/d2c/d3a/d64/ca7 d7/d19/d30/d99/ce8 0 2023-12-05T13:26:49.597 INFO:tasks.workunit.client.0.smithi029.stdout:0/743: dread dc/d13/d4f/d91/fd1 [0,4194304] 0 2023-12-05T13:26:49.597 INFO:tasks.workunit.client.0.smithi029.stdout:0/744: chown dc/d33/d3d/d7a/fb4 113 1 2023-12-05T13:26:49.598 INFO:tasks.workunit.client.0.smithi029.stdout:3/810: creat d1/d16/d36/d3a/d6c/ffe x:0 0 0 2023-12-05T13:26:49.598 INFO:tasks.workunit.client.0.smithi029.stdout:1/741: creat d7/d61/df3/ff5 x:0 0 0 2023-12-05T13:26:49.599 INFO:tasks.workunit.client.0.smithi029.stdout:3/811: write d1/d16/f49 [3239941,103549] 0 2023-12-05T13:26:49.599 INFO:tasks.workunit.client.0.smithi029.stdout:6/837: truncate d6/fa 309581 0 2023-12-05T13:26:49.603 INFO:tasks.workunit.client.0.smithi029.stdout:6/838: write d6/d29/fa0 [1457448,123593] 0 2023-12-05T13:26:49.603 INFO:tasks.workunit.client.0.smithi029.stdout:9/705: symlink d7/d2c/d33/le9 0 2023-12-05T13:26:49.606 INFO:tasks.workunit.client.0.smithi029.stdout:1/742: getdents d7/d5e/d52/d5f/d12/d60 0 2023-12-05T13:26:49.608 INFO:tasks.workunit.client.0.smithi029.stdout:3/812: mknod d1/d6/d4a/cff 0 2023-12-05T13:26:49.609 INFO:tasks.workunit.client.0.smithi029.stdout:6/839: mkdir d6/d29/dc4/d40/d74/d52/d5c/d6f/ddb/d11c 0 2023-12-05T13:26:49.612 INFO:tasks.workunit.client.0.smithi029.stdout:8/875: dwrite d5/dbc/d8b/f11e [0,4194304] 0 2023-12-05T13:26:49.613 INFO:tasks.workunit.client.0.smithi029.stdout:9/706: symlink d7/d19/d30/d40/d4e/lea 0 2023-12-05T13:26:49.613 INFO:tasks.workunit.client.0.smithi029.stdout:4/651: write d0/d16/d22/d5f/f91 [389981,50857] 0 2023-12-05T13:26:49.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/745: mkdir dc/d23/d3a/d41/d57/d58/df7 0 2023-12-05T13:26:49.615 INFO:tasks.workunit.client.0.smithi029.stdout:0/746: write dc/d13/d4f/d83/fc2 [3577251,13073] 0 2023-12-05T13:26:49.619 INFO:tasks.workunit.client.0.smithi029.stdout:6/840: dread d6/d29/dc4/d40/f115 [0,4194304] 0 2023-12-05T13:26:49.619 INFO:tasks.workunit.client.0.smithi029.stdout:6/841: fsync d6/d1d/d39/d58/d71/fd0 0 2023-12-05T13:26:49.621 INFO:tasks.workunit.client.0.smithi029.stdout:8/876: link d5/d6/d10/d85/daa/lc6 d5/d6/d10/d8a/db6/l12a 0 2023-12-05T13:26:49.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/707: creat d7/d19/d30/d99/d8d/feb x:0 0 0 2023-12-05T13:26:49.624 INFO:tasks.workunit.client.0.smithi029.stdout:4/652: symlink d0/d16/dd0/ld6 0 2023-12-05T13:26:49.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/747: creat dc/d33/d3d/d7a/d84/dde/ff8 x:0 0 0 2023-12-05T13:26:49.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/748: chown dc/d33/d3d/cb3 207849 1 2023-12-05T13:26:49.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/749: stat dc/d33/d47 0 2023-12-05T13:26:49.629 INFO:tasks.workunit.client.0.smithi029.stdout:8/877: creat d5/d6/d10/d8a/db6/f12b x:0 0 0 2023-12-05T13:26:49.629 INFO:tasks.workunit.client.0.smithi029.stdout:3/813: dwrite d1/d18/f20 [0,4194304] 0 2023-12-05T13:26:49.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/842: dread d6/f10 [0,4194304] 0 2023-12-05T13:26:49.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/843: chown d6/d29/dc4/d40/d74/d52/d5c/d6f/f88 10529 1 2023-12-05T13:26:49.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/844: getdents d6/d29/dc4/d40/d74/d59/d104 0 2023-12-05T13:26:49.632 INFO:tasks.workunit.client.0.smithi029.stdout:4/653: mkdir d0/d16/d2f/dd7 0 2023-12-05T13:26:49.633 INFO:tasks.workunit.client.0.smithi029.stdout:1/743: dwrite d7/d56/ff0 [0,4194304] 0 2023-12-05T13:26:49.634 INFO:tasks.workunit.client.0.smithi029.stdout:0/750: creat dc/d33/d3d/d7a/d84/dde/ddf/ff9 x:0 0 0 2023-12-05T13:26:49.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/708: dwrite d7/d2c/d33/fc2 [0,4194304] 0 2023-12-05T13:26:49.636 INFO:tasks.workunit.client.0.smithi029.stdout:9/709: chown d7/d2c/d3a 24421311 1 2023-12-05T13:26:49.636 INFO:tasks.workunit.client.0.smithi029.stdout:8/878: unlink d5/dc/d56/fe7 0 2023-12-05T13:26:49.636 INFO:tasks.workunit.client.0.smithi029.stdout:8/879: write d5/d6/f51 [116386,114651] 0 2023-12-05T13:26:49.636 INFO:tasks.workunit.client.0.smithi029.stdout:8/880: fsync d5/d6/d10/d8a/db6/d108/fb8 0 2023-12-05T13:26:49.637 INFO:tasks.workunit.client.0.smithi029.stdout:6/845: creat d6/d64/d6d/da3/dcf/f11d x:0 0 0 2023-12-05T13:26:49.638 INFO:tasks.workunit.client.0.smithi029.stdout:4/654: symlink d0/d16/ld8 0 2023-12-05T13:26:49.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/846: read d6/d29/dc4/d40/ff8 [105086,14685] 0 2023-12-05T13:26:49.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/847: fsync d6/d29/dc4/d40/d74/d59/faa 0 2023-12-05T13:26:49.641 INFO:tasks.workunit.client.0.smithi029.stdout:6/848: fsync d6/d29/dc4/d40/db5/fe6 0 2023-12-05T13:26:49.641 INFO:tasks.workunit.client.0.smithi029.stdout:1/744: mkdir d7/d5e/d52/d5f/d12/d60/df6 0 2023-12-05T13:26:49.642 INFO:tasks.workunit.client.0.smithi029.stdout:3/814: dread d1/d10/d91/f96 [0,4194304] 0 2023-12-05T13:26:49.642 INFO:tasks.workunit.client.0.smithi029.stdout:0/751: truncate dc/d13/d4f/d63/f87 504604 0 2023-12-05T13:26:49.644 INFO:tasks.workunit.client.0.smithi029.stdout:9/710: unlink d7/d19/d1f/f4f 0 2023-12-05T13:26:49.644 INFO:tasks.workunit.client.0.smithi029.stdout:9/711: fsync d7/d5a/f91 0 2023-12-05T13:26:49.645 INFO:tasks.workunit.client.0.smithi029.stdout:9/712: write d7/d19/d30/d40/d4e/d5e/f88 [535629,46365] 0 2023-12-05T13:26:49.647 INFO:tasks.workunit.client.0.smithi029.stdout:9/713: dread d7/d19/d30/d40/f7e [0,4194304] 0 2023-12-05T13:26:49.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/881: creat d5/d6/d59/f12c x:0 0 0 2023-12-05T13:26:49.648 INFO:tasks.workunit.client.0.smithi029.stdout:4/655: mknod d0/de/d30/d94/da4/dd4/cd9 0 2023-12-05T13:26:49.651 INFO:tasks.workunit.client.0.smithi029.stdout:6/849: symlink d6/d1d/d36/l11e 0 2023-12-05T13:26:49.651 INFO:tasks.workunit.client.0.smithi029.stdout:6/850: readlink d6/d29/dc4/d40/l61 0 2023-12-05T13:26:49.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/745: mknod d7/d61/d4f/cf7 0 2023-12-05T13:26:49.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/752: truncate dc/d33/d3d/d7a/d84/d8d/ff1 2425974 0 2023-12-05T13:26:49.663 INFO:tasks.workunit.client.0.smithi029.stdout:9/714: rename d7/d19/d28/d65/d73/l93 to d7/d19/d30/d43/lec 0 2023-12-05T13:26:49.665 INFO:tasks.workunit.client.0.smithi029.stdout:8/882: dwrite d5/d2f/f68 [0,4194304] 0 2023-12-05T13:26:49.665 INFO:tasks.workunit.client.0.smithi029.stdout:8/883: stat d5/dbc/d1d/fca 0 2023-12-05T13:26:49.665 INFO:tasks.workunit.client.0.smithi029.stdout:8/884: dread - d5/dbc/f91 zero size 2023-12-05T13:26:49.665 INFO:tasks.workunit.client.0.smithi029.stdout:8/885: write d5/dc/d18/d26/f5a [5112580,53420] 0 2023-12-05T13:26:49.667 INFO:tasks.workunit.client.0.smithi029.stdout:4/656: unlink d0/d16/d22/l25 0 2023-12-05T13:26:49.669 INFO:tasks.workunit.client.0.smithi029.stdout:6/851: symlink d6/d1d/d39/d58/d71/l11f 0 2023-12-05T13:26:49.673 INFO:tasks.workunit.client.0.smithi029.stdout:3/815: creat d1/d5e/f100 x:0 0 0 2023-12-05T13:26:49.676 INFO:tasks.workunit.client.0.smithi029.stdout:9/715: dread d7/d19/d30/fa3 [0,4194304] 0 2023-12-05T13:26:49.676 INFO:tasks.workunit.client.0.smithi029.stdout:1/746: truncate d7/d61/d77/fbd 2883696 0 2023-12-05T13:26:49.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/852: creat d6/d1d/d36/f120 x:0 0 0 2023-12-05T13:26:49.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/853: fsync d6/d1d/d39/d58/d71/dbf/f105 0 2023-12-05T13:26:49.682 INFO:tasks.workunit.client.0.smithi029.stdout:6/854: chown d6/d29/dc4/d40/d4d/d7f/cd9 298 1 2023-12-05T13:26:49.683 INFO:tasks.workunit.client.0.smithi029.stdout:3/816: creat d1/f101 x:0 0 0 2023-12-05T13:26:49.683 INFO:tasks.workunit.client.0.smithi029.stdout:0/753: dwrite dc/d23/f2e [0,4194304] 0 2023-12-05T13:26:49.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/657: dread d0/d16/d22/d4f/f59 [0,4194304] 0 2023-12-05T13:26:49.683 INFO:tasks.workunit.client.0.smithi029.stdout:4/658: dread - d0/de/d30/d32/d35/f58 zero size 2023-12-05T13:26:49.684 INFO:tasks.workunit.client.0.smithi029.stdout:9/716: mkdir d7/d2c/d3a/d52/db9/ded 0 2023-12-05T13:26:49.686 INFO:tasks.workunit.client.0.smithi029.stdout:1/747: dread d7/d5e/d52/d5f/d12/f46 [0,4194304] 0 2023-12-05T13:26:49.686 INFO:tasks.workunit.client.0.smithi029.stdout:1/748: getdents d7/d5e/d52/d5f/d12/d60/df6 0 2023-12-05T13:26:49.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/855: getdents d6/d64/d6d/d117 0 2023-12-05T13:26:49.687 INFO:tasks.workunit.client.0.smithi029.stdout:6/856: write d6/d3f/db7/def/f102 [690569,58735] 0 2023-12-05T13:26:49.687 INFO:tasks.workunit.client.0.smithi029.stdout:1/749: write d7/d5e/d52/d5f/f6f [847144,107018] 0 2023-12-05T13:26:49.692 INFO:tasks.workunit.client.0.smithi029.stdout:3/817: creat d1/d5e/f102 x:0 0 0 2023-12-05T13:26:49.699 INFO:tasks.workunit.client.0.smithi029.stdout:9/717: dwrite d7/d19/d30/f9d [4194304,4194304] 0 2023-12-05T13:26:49.699 INFO:tasks.workunit.client.0.smithi029.stdout:9/718: write d7/d2c/d33/f59 [631834,18854] 0 2023-12-05T13:26:49.700 INFO:tasks.workunit.client.0.smithi029.stdout:9/719: write d7/d2c/d33/f59 [252315,129790] 0 2023-12-05T13:26:49.710 INFO:tasks.workunit.client.0.smithi029.stdout:0/754: rename dc/d33/d3d/d7a/d84/da4/dbe to dc/d33/d3d/d65/d85/dfa 0 2023-12-05T13:26:49.710 INFO:tasks.workunit.client.0.smithi029.stdout:0/755: readlink dc/d13/d4f/d88/la8 0 2023-12-05T13:26:49.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/756: fsync dc/d23/d3a/d41/d57/f59 0 2023-12-05T13:26:49.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/757: readlink dc/d33/l3e 0 2023-12-05T13:26:49.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/758: write dc/d13/d4f/d88/f99 [663491,5743] 0 2023-12-05T13:26:49.713 INFO:tasks.workunit.client.0.smithi029.stdout:0/759: chown dc/d13/d4f/d83/ff0 72844099 1 2023-12-05T13:26:49.714 INFO:tasks.workunit.client.0.smithi029.stdout:0/760: write dc/d23/d3a/f71 [1682374,55376] 0 2023-12-05T13:26:49.719 INFO:tasks.workunit.client.0.smithi029.stdout:9/720: dwrite d7/d19/d30/d40/d4e/f5f [0,4194304] 0 2023-12-05T13:26:49.720 INFO:tasks.workunit.client.0.smithi029.stdout:9/721: read d7/d19/d28/f39 [2823494,61206] 0 2023-12-05T13:26:49.720 INFO:tasks.workunit.client.0.smithi029.stdout:9/722: readlink d7/d19/d28/l20 0 2023-12-05T13:26:49.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/857: creat d6/d29/d60/dbc/f121 x:0 0 0 2023-12-05T13:26:49.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/858: read - d6/d1d/d36/ff4 zero size 2023-12-05T13:26:49.774 INFO:tasks.workunit.client.0.smithi029.stdout:6/859: write d6/d1d/d39/d58/f8b [4839253,109053] 0 2023-12-05T13:26:49.775 INFO:tasks.workunit.client.0.smithi029.stdout:1/750: rmdir d7/d6e/da9 39 2023-12-05T13:26:49.794 INFO:tasks.workunit.client.0.smithi029.stdout:8/886: unlink d5/dc/d56/f115 0 2023-12-05T13:26:49.798 INFO:tasks.workunit.client.0.smithi029.stdout:5/624: sync 2023-12-05T13:26:49.799 INFO:tasks.workunit.client.0.smithi029.stdout:5/625: chown d1/dc/d11/f12 0 1 2023-12-05T13:26:49.800 INFO:tasks.workunit.client.0.smithi029.stdout:9/723: symlink d7/lee 0 2023-12-05T13:26:49.801 INFO:tasks.workunit.client.0.smithi029.stdout:5/626: write d1/dc/d38/f6c [2989042,44459] 0 2023-12-05T13:26:49.801 INFO:tasks.workunit.client.0.smithi029.stdout:5/627: chown d1/dc/d10/d1e/d33 7 1 2023-12-05T13:26:49.805 INFO:tasks.workunit.client.0.smithi029.stdout:6/860: creat d6/d64/d10f/f122 x:0 0 0 2023-12-05T13:26:49.805 INFO:tasks.workunit.client.0.smithi029.stdout:6/861: write d6/d29/fa0 [397170,72926] 0 2023-12-05T13:26:49.806 INFO:tasks.workunit.client.0.smithi029.stdout:6/862: readlink d6/d29/dc4/d40/d74/d59/l10c 0 2023-12-05T13:26:49.810 INFO:tasks.workunit.client.0.smithi029.stdout:8/887: dwrite d5/d6/d10/d8a/db6/d108/fb8 [0,4194304] 0 2023-12-05T13:26:49.810 INFO:tasks.workunit.client.0.smithi029.stdout:8/888: read d5/d2f/d75/fa5 [6061604,26341] 0 2023-12-05T13:26:49.811 INFO:tasks.workunit.client.0.smithi029.stdout:8/889: write d5/fe [372595,69299] 0 2023-12-05T13:26:49.811 INFO:tasks.workunit.client.0.smithi029.stdout:8/890: chown d5/dbc/d1d/f2a 2 1 2023-12-05T13:26:49.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/724: mkdir d7/d2c/d3a/d64/def 0 2023-12-05T13:26:49.813 INFO:tasks.workunit.client.0.smithi029.stdout:5/628: link d1/dc/d10/d1e/d75/d7f/d8a/fb6 d1/dc/d10/d1e/d75/d7f/d8a/fd3 0 2023-12-05T13:26:49.816 INFO:tasks.workunit.client.0.smithi029.stdout:6/863: creat d6/d29/d9c/f123 x:0 0 0 2023-12-05T13:26:49.820 INFO:tasks.workunit.client.0.smithi029.stdout:9/725: rmdir d7/d19/d30/d99 39 2023-12-05T13:26:49.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/891: dread d5/d6/d10/d13/ff0 [0,4194304] 0 2023-12-05T13:26:49.820 INFO:tasks.workunit.client.0.smithi029.stdout:8/892: fdatasync d5/dbc/f91 0 2023-12-05T13:26:49.822 INFO:tasks.workunit.client.0.smithi029.stdout:5/629: getdents d1/dc/d38 0 2023-12-05T13:26:49.822 INFO:tasks.workunit.client.0.smithi029.stdout:5/630: dread - d1/dc/d25/d4c/d9b/fbc zero size 2023-12-05T13:26:49.822 INFO:tasks.workunit.client.0.smithi029.stdout:1/751: write d7/d5e/f38 [435852,112696] 0 2023-12-05T13:26:49.822 INFO:tasks.workunit.client.0.smithi029.stdout:8/893: dread d5/d6/d10/d85/daa/fe6 [0,4194304] 0 2023-12-05T13:26:49.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/864: creat d6/d29/dc4/d40/f124 x:0 0 0 2023-12-05T13:26:49.823 INFO:tasks.workunit.client.0.smithi029.stdout:6/865: chown d6/d29/dc4/d40/fd2 37553874 1 2023-12-05T13:26:49.824 INFO:tasks.workunit.client.0.smithi029.stdout:9/726: mknod d7/d2c/d3a/cf0 0 2023-12-05T13:26:49.825 INFO:tasks.workunit.client.0.smithi029.stdout:9/727: read d7/d19/d30/fa3 [2067162,32685] 0 2023-12-05T13:26:49.825 INFO:tasks.workunit.client.0.smithi029.stdout:5/631: creat d1/dc/d25/d4c/d9b/fd4 x:0 0 0 2023-12-05T13:26:49.827 INFO:tasks.workunit.client.0.smithi029.stdout:1/752: unlink d7/d5e/c3a 0 2023-12-05T13:26:49.828 INFO:tasks.workunit.client.0.smithi029.stdout:6/866: mkdir d6/d29/dc4/d125 0 2023-12-05T13:26:49.829 INFO:tasks.workunit.client.0.smithi029.stdout:9/728: getdents d7/d19/d30/d40 0 2023-12-05T13:26:49.829 INFO:tasks.workunit.client.0.smithi029.stdout:9/729: chown d7/d19/d30/d43/c97 64181382 1 2023-12-05T13:26:49.830 INFO:tasks.workunit.client.0.smithi029.stdout:5/632: symlink d1/dc/d27/ld5 0 2023-12-05T13:26:49.830 INFO:tasks.workunit.client.0.smithi029.stdout:1/753: stat d7/c10 0 2023-12-05T13:26:49.831 INFO:tasks.workunit.client.0.smithi029.stdout:8/894: symlink d5/dc/d56/d103/d11f/l12d 0 2023-12-05T13:26:49.831 INFO:tasks.workunit.client.0.smithi029.stdout:8/895: chown d5/dc/f90 15942857 1 2023-12-05T13:26:49.831 INFO:tasks.workunit.client.0.smithi029.stdout:8/896: fsync d5/dbc/d1d/d10f/d86/da8/fdc 0 2023-12-05T13:26:49.832 INFO:tasks.workunit.client.0.smithi029.stdout:6/867: rename d6/d64/d6d/da3/lf5 to d6/d29/d60/l126 0 2023-12-05T13:26:49.833 INFO:tasks.workunit.client.0.smithi029.stdout:9/730: truncate d7/d19/f1b 5818703 0 2023-12-05T13:26:49.833 INFO:tasks.workunit.client.0.smithi029.stdout:9/731: truncate d7/d19/d28/d50/f7c 4982855 0 2023-12-05T13:26:49.835 INFO:tasks.workunit.client.0.smithi029.stdout:5/633: mkdir d1/dc/d10/d1e/d33/d93/da5/db2/da6/dd6 0 2023-12-05T13:26:49.837 INFO:tasks.workunit.client.0.smithi029.stdout:1/754: link d7/d5e/d52/d5f/l62 d7/d5e/d52/d5f/d48/lf8 0 2023-12-05T13:26:49.837 INFO:tasks.workunit.client.0.smithi029.stdout:1/755: chown d7/d61/d77/lf1 41809625 1 2023-12-05T13:26:49.839 INFO:tasks.workunit.client.0.smithi029.stdout:8/897: rmdir d5/d6/d10/d85 39 2023-12-05T13:26:49.841 INFO:tasks.workunit.client.0.smithi029.stdout:6/868: link d6/f4f d6/d1d/d39/d58/f127 0 2023-12-05T13:26:49.843 INFO:tasks.workunit.client.0.smithi029.stdout:9/732: rename d7/cb to d7/d5a/dd4/cf1 0 2023-12-05T13:26:49.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/634: truncate d1/dc/d25/d4c/f52 956133 0 2023-12-05T13:26:49.846 INFO:tasks.workunit.client.0.smithi029.stdout:5/635: write d1/dc/d38/d55/f81 [1458694,25379] 0 2023-12-05T13:26:49.846 INFO:tasks.workunit.client.0.smithi029.stdout:1/756: mkdir d7/d56/da8/df9 0 2023-12-05T13:26:49.847 INFO:tasks.workunit.client.0.smithi029.stdout:8/898: symlink d5/d6/d10/d85/daa/dfe/l12e 0 2023-12-05T13:26:49.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/899: readlink d5/d6/l40 0 2023-12-05T13:26:49.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/900: chown d5/dbc/d1d/d10f/lf6 505952 1 2023-12-05T13:26:49.848 INFO:tasks.workunit.client.0.smithi029.stdout:8/901: write d5/dbc/d1d/d10f/d3c/da2/fbe [1637635,118755] 0 2023-12-05T13:26:49.849 INFO:tasks.workunit.client.0.smithi029.stdout:6/869: rename d6/d1d/d39/d58/f90 to d6/d29/dc4/d40/db5/f128 0 2023-12-05T13:26:49.851 INFO:tasks.workunit.client.0.smithi029.stdout:9/733: getdents d7/d19/d30/d99/d8d/dad 0 2023-12-05T13:26:49.851 INFO:tasks.workunit.client.0.smithi029.stdout:9/734: read - d7/d19/d28/d50/dc0/fdd zero size 2023-12-05T13:26:49.853 INFO:tasks.workunit.client.0.smithi029.stdout:5/636: symlink d1/dc/d25/d4c/d61/ld7 0 2023-12-05T13:26:49.854 INFO:tasks.workunit.client.0.smithi029.stdout:8/902: creat d5/dc/d56/d103/f12f x:0 0 0 2023-12-05T13:26:49.856 INFO:tasks.workunit.client.0.smithi029.stdout:6/870: mkdir d6/d1d/d39/d58/dfc/d129 0 2023-12-05T13:26:49.856 INFO:tasks.workunit.client.0.smithi029.stdout:9/735: mknod d7/d2c/d3a/d52/db9/cf2 0 2023-12-05T13:26:49.858 INFO:tasks.workunit.client.0.smithi029.stdout:5/637: rename d1/dc/d10/d1e/d75/d7f/d8a/fb6 to d1/dc/fd8 0 2023-12-05T13:26:49.860 INFO:tasks.workunit.client.0.smithi029.stdout:9/736: read d7/d2c/d3a/d52/db9/fc7 [2757501,35030] 0 2023-12-05T13:26:49.861 INFO:tasks.workunit.client.0.smithi029.stdout:9/737: dread d7/d19/d30/d40/f9f [0,4194304] 0 2023-12-05T13:26:49.861 INFO:tasks.workunit.client.0.smithi029.stdout:9/738: write d7/d19/d30/d40/d4e/fb1 [608547,1567] 0 2023-12-05T13:26:49.861 INFO:tasks.workunit.client.0.smithi029.stdout:6/871: creat d6/d29/dc4/d40/d4d/d7f/f12a x:0 0 0 2023-12-05T13:26:49.862 INFO:tasks.workunit.client.0.smithi029.stdout:1/757: dwrite d7/d6e/da9/d4b/d72/f80 [0,4194304] 0 2023-12-05T13:26:49.864 INFO:tasks.workunit.client.0.smithi029.stdout:5/638: symlink d1/dc/d11/d17/ld9 0 2023-12-05T13:26:49.866 INFO:tasks.workunit.client.0.smithi029.stdout:9/739: mkdir d7/d19/d28/d65/dbe/df3 0 2023-12-05T13:26:49.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/872: getdents d6/d29/d60 0 2023-12-05T13:26:49.868 INFO:tasks.workunit.client.0.smithi029.stdout:6/873: stat d6/d29/dc4/d40/d74/cf2 0 2023-12-05T13:26:49.875 INFO:tasks.workunit.client.0.smithi029.stdout:9/740: link d7/d19/d28/d65/f69 d7/d19/d30/d40/d4e/ff4 0 2023-12-05T13:26:49.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/874: truncate d6/d29/dc4/d40/d4d/d8f/fa1 470346 0 2023-12-05T13:26:49.878 INFO:tasks.workunit.client.0.smithi029.stdout:6/875: readlink d6/d1d/d39/d58/d71/l11f 0 2023-12-05T13:26:49.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/903: dwrite d5/dbc/d1d/d10f/d3c/f124 [0,4194304] 0 2023-12-05T13:26:49.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/904: fsync d5/f98 0 2023-12-05T13:26:49.880 INFO:tasks.workunit.client.0.smithi029.stdout:8/905: chown d5/dbc/d1d/d10f/d86/ce2 309591567 1 2023-12-05T13:26:49.881 INFO:tasks.workunit.client.0.smithi029.stdout:8/906: write d5/dc/d18/d26/f64 [249077,88530] 0 2023-12-05T13:26:49.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/741: mknod d7/d2c/d3a/d64/def/cf5 0 2023-12-05T13:26:49.883 INFO:tasks.workunit.client.0.smithi029.stdout:6/876: symlink d6/d1d/l12b 0 2023-12-05T13:26:49.889 INFO:tasks.workunit.client.0.smithi029.stdout:1/758: dwrite d7/d6e/da9/d4b/d72/fbe [0,4194304] 0 2023-12-05T13:26:49.890 INFO:tasks.workunit.client.0.smithi029.stdout:8/907: symlink d5/d6/d10/d8a/l130 0 2023-12-05T13:26:49.891 INFO:tasks.workunit.client.0.smithi029.stdout:8/908: write d5/d6/d10/d13/f41 [1750401,66327] 0 2023-12-05T13:26:49.892 INFO:tasks.workunit.client.0.smithi029.stdout:9/742: symlink d7/d2c/d3a/d52/lf6 0 2023-12-05T13:26:49.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/743: write d7/d19/d30/d40/d4e/d5e/fdb [34650,13529] 0 2023-12-05T13:26:49.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/744: getdents d7/d19/d30/d40/dc3 0 2023-12-05T13:26:49.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/745: write d7/d19/d28/d50/dc0/fdd [725115,95080] 0 2023-12-05T13:26:49.893 INFO:tasks.workunit.client.0.smithi029.stdout:9/746: read d7/d19/d30/d99/d8d/db5/fc4 [434060,118757] 0 2023-12-05T13:26:49.897 INFO:tasks.workunit.client.0.smithi029.stdout:1/759: creat d7/d61/d77/d9f/ffa x:0 0 0 2023-12-05T13:26:49.902 INFO:tasks.workunit.client.0.smithi029.stdout:1/760: mkdir d7/d61/dfb 0 2023-12-05T13:26:49.903 INFO:tasks.workunit.client.0.smithi029.stdout:1/761: rename d7/d5e/d52/d5f/ce3 to d7/d5e/cfc 0 2023-12-05T13:26:49.904 INFO:tasks.workunit.client.0.smithi029.stdout:1/762: chown d7/d61/d4f/c91 60 1 2023-12-05T13:26:49.905 INFO:tasks.workunit.client.0.smithi029.stdout:6/877: dwrite d6/d29/dc4/d40/ff8 [0,4194304] 0 2023-12-05T13:26:49.905 INFO:tasks.workunit.client.0.smithi029.stdout:1/763: mknod d7/d56/cfd 0 2023-12-05T13:26:49.907 INFO:tasks.workunit.client.0.smithi029.stdout:9/747: dwrite d7/d19/d28/fd2 [0,4194304] 0 2023-12-05T13:26:49.908 INFO:tasks.workunit.client.0.smithi029.stdout:6/878: creat d6/d29/dc4/d40/f12c x:0 0 0 2023-12-05T13:26:49.909 INFO:tasks.workunit.client.0.smithi029.stdout:1/764: symlink d7/d61/d77/d9f/db4/lfe 0 2023-12-05T13:26:49.911 INFO:tasks.workunit.client.0.smithi029.stdout:9/748: stat d7/d19/cb2 0 2023-12-05T13:26:49.911 INFO:tasks.workunit.client.0.smithi029.stdout:9/749: chown d7/d2c/d33/c54 1 1 2023-12-05T13:26:49.912 INFO:tasks.workunit.client.0.smithi029.stdout:1/765: dread d7/f13 [0,4194304] 0 2023-12-05T13:26:49.912 INFO:tasks.workunit.client.0.smithi029.stdout:1/766: truncate d7/d5e/d52/d90/fd7 869253 0 2023-12-05T13:26:49.914 INFO:tasks.workunit.client.0.smithi029.stdout:6/879: rename d6/l19 to d6/d29/dc4/d40/d74/d59/l12d 0 2023-12-05T13:26:49.914 INFO:tasks.workunit.client.0.smithi029.stdout:6/880: write d6/d1d/d36/ff4 [102449,125177] 0 2023-12-05T13:26:49.915 INFO:tasks.workunit.client.0.smithi029.stdout:1/767: mknod d7/d5e/d52/d90/dd6/cff 0 2023-12-05T13:26:49.916 INFO:tasks.workunit.client.0.smithi029.stdout:1/768: dread - d7/d5e/fcc zero size 2023-12-05T13:26:49.917 INFO:tasks.workunit.client.0.smithi029.stdout:9/750: dread d7/d19/fa5 [0,4194304] 0 2023-12-05T13:26:49.917 INFO:tasks.workunit.client.0.smithi029.stdout:9/751: chown d7/c42 13434490 1 2023-12-05T13:26:49.921 INFO:tasks.workunit.client.0.smithi029.stdout:8/909: write d5/dc/d18/d26/f66 [3174315,72029] 0 2023-12-05T13:26:49.921 INFO:tasks.workunit.client.0.smithi029.stdout:8/910: truncate d5/dbc/f91 389686 0 2023-12-05T13:26:49.926 INFO:tasks.workunit.client.0.smithi029.stdout:8/911: mknod d5/dc/d18/d26/dc0/c131 0 2023-12-05T13:26:49.926 INFO:tasks.workunit.client.0.smithi029.stdout:8/912: chown d5/d6/d10/d8a/db6/d108/lec 484047200 1 2023-12-05T13:26:49.926 INFO:tasks.workunit.client.0.smithi029.stdout:6/881: dread d6/d1d/d36/f7d [0,4194304] 0 2023-12-05T13:26:49.929 INFO:tasks.workunit.client.0.smithi029.stdout:8/913: getdents d5/dc/d18 0 2023-12-05T13:26:49.932 INFO:tasks.workunit.client.0.smithi029.stdout:9/752: dwrite d7/d19/d28/d50/dc0/d7f/fda [0,4194304] 0 2023-12-05T13:26:49.933 INFO:tasks.workunit.client.0.smithi029.stdout:8/914: stat d5/d6/l40 0 2023-12-05T13:26:49.933 INFO:tasks.workunit.client.0.smithi029.stdout:8/915: readlink d5/d6/d10/l80 0 2023-12-05T13:26:49.938 INFO:tasks.workunit.client.0.smithi029.stdout:9/753: rmdir d7/d19 39 2023-12-05T13:26:49.938 INFO:tasks.workunit.client.0.smithi029.stdout:6/882: dread d6/d1d/d39/d58/f127 [0,4194304] 0 2023-12-05T13:26:49.938 INFO:tasks.workunit.client.0.smithi029.stdout:6/883: write d6/d29/dc4/d40/d74/d59/dfb/f10d [391396,94367] 0 2023-12-05T13:26:49.939 INFO:tasks.workunit.client.0.smithi029.stdout:6/884: rmdir d6/d29/dc4/d40/d74/d52 39 2023-12-05T13:26:49.939 INFO:tasks.workunit.client.0.smithi029.stdout:6/885: write d6/d3f/fea [127096,56795] 0 2023-12-05T13:26:49.941 INFO:tasks.workunit.client.0.smithi029.stdout:6/886: rename d6/d1d/d39/c89 to d6/d29/dc4/d40/d74/d52/d5c/d6f/ddb/d11c/c12e 0 2023-12-05T13:26:49.944 INFO:tasks.workunit.client.0.smithi029.stdout:6/887: symlink d6/d1d/d39/l12f 0 2023-12-05T13:26:49.945 INFO:tasks.workunit.client.0.smithi029.stdout:6/888: symlink d6/d64/d6d/d85/l130 0 2023-12-05T13:26:49.946 INFO:tasks.workunit.client.0.smithi029.stdout:1/769: dwrite d7/d5e/d52/d5f/d48/f98 [0,4194304] 0 2023-12-05T13:26:49.951 INFO:tasks.workunit.client.0.smithi029.stdout:6/889: rename d6/d29/d60/dbc to d6/d131 0 2023-12-05T13:26:49.952 INFO:tasks.workunit.client.0.smithi029.stdout:1/770: creat d7/f100 x:0 0 0 2023-12-05T13:26:49.955 INFO:tasks.workunit.client.0.smithi029.stdout:9/754: dwrite d7/d19/f1b [0,4194304] 0 2023-12-05T13:26:49.955 INFO:tasks.workunit.client.0.smithi029.stdout:9/755: write d7/d2c/d33/f63 [2186722,31220] 0 2023-12-05T13:26:49.955 INFO:tasks.workunit.client.0.smithi029.stdout:9/756: chown d7/d19/d28/d50/f7c 236 1 2023-12-05T13:26:49.956 INFO:tasks.workunit.client.0.smithi029.stdout:8/916: dwrite d5/dbc/d1d/d10f/fed [0,4194304] 0 2023-12-05T13:26:49.961 INFO:tasks.workunit.client.0.smithi029.stdout:8/917: link d5/d6/cd6 d5/d6/d10/d8a/db6/d108/c132 0 2023-12-05T13:26:49.961 INFO:tasks.workunit.client.0.smithi029.stdout:8/918: chown d5/f98 7597701 1 2023-12-05T13:26:49.962 INFO:tasks.workunit.client.0.smithi029.stdout:8/919: unlink d5/d6/d10/d8a/db6/d108/f112 0 2023-12-05T13:26:49.963 INFO:tasks.workunit.client.0.smithi029.stdout:8/920: write d5/d6/d10/d85/daa/f125 [2974497,36630] 0 2023-12-05T13:26:49.970 INFO:tasks.workunit.client.0.smithi029.stdout:1/771: dwrite d7/d5e/d52/d5f/d12/d60/fd8 [0,4194304] 0 2023-12-05T13:26:49.980 INFO:tasks.workunit.client.0.smithi029.stdout:6/890: dwrite d6/d29/dc4/d40/d74/d59/dfb/f10d [0,4194304] 0 2023-12-05T13:26:49.981 INFO:tasks.workunit.client.0.smithi029.stdout:8/921: dread d5/dbc/d1d/d10f/d3c/da2/fb9 [0,4194304] 0 2023-12-05T13:26:49.981 INFO:tasks.workunit.client.0.smithi029.stdout:9/757: dwrite d7/d2c/d3a/d52/f81 [4194304,4194304] 0 2023-12-05T13:26:49.981 INFO:tasks.workunit.client.0.smithi029.stdout:6/891: dread - d6/d1d/d39/d58/d71/fd0 zero size 2023-12-05T13:26:49.981 INFO:tasks.workunit.client.0.smithi029.stdout:8/922: chown d5/d2f/d75/fa5 11 1 2023-12-05T13:26:49.983 INFO:tasks.workunit.client.0.smithi029.stdout:6/892: symlink d6/d29/l132 0 2023-12-05T13:26:49.983 INFO:tasks.workunit.client.0.smithi029.stdout:6/893: dread - d6/d64/d6d/da3/dcf/dd4/f114 zero size 2023-12-05T13:26:49.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/758: mknod d7/d5a/dd4/cf7 0 2023-12-05T13:26:49.984 INFO:tasks.workunit.client.0.smithi029.stdout:9/759: readlink d7/d19/d28/d50/dc0/lbd 0 2023-12-05T13:26:49.985 INFO:tasks.workunit.client.0.smithi029.stdout:8/923: creat d5/d6/d59/f133 x:0 0 0 2023-12-05T13:26:49.986 INFO:tasks.workunit.client.0.smithi029.stdout:6/894: symlink d6/d64/d6d/d85/l133 0 2023-12-05T13:26:49.986 INFO:tasks.workunit.client.0.smithi029.stdout:6/895: write d6/d29/dc4/d40/d74/d52/d5c/f11b [860699,84250] 0 2023-12-05T13:26:49.987 INFO:tasks.workunit.client.0.smithi029.stdout:9/760: mkdir d7/d2c/d3a/d64/dc8/df8 0 2023-12-05T13:26:49.991 INFO:tasks.workunit.client.0.smithi029.stdout:6/896: rename d6/d1d/d36/f48 to d6/d64/d6d/d117/f134 0 2023-12-05T13:26:49.991 INFO:tasks.workunit.client.0.smithi029.stdout:6/897: readlink d6/d29/d60/l126 0 2023-12-05T13:26:49.992 INFO:tasks.workunit.client.0.smithi029.stdout:8/924: mknod d5/dc/d56/c134 0 2023-12-05T13:26:49.993 INFO:tasks.workunit.client.0.smithi029.stdout:6/898: creat d6/d64/dfe/f135 x:0 0 0 2023-12-05T13:26:49.995 INFO:tasks.workunit.client.0.smithi029.stdout:1/772: dwrite d7/f49 [0,4194304] 0 2023-12-05T13:26:49.995 INFO:tasks.workunit.client.0.smithi029.stdout:8/925: mkdir d5/d6/d10/d85/daa/dfe/d135 0 2023-12-05T13:26:49.996 INFO:tasks.workunit.client.0.smithi029.stdout:6/899: symlink d6/d29/dc4/d40/d4d/d7f/l136 0 2023-12-05T13:26:49.997 INFO:tasks.workunit.client.0.smithi029.stdout:1/773: dread d7/d61/d77/fa7 [0,4194304] 0 2023-12-05T13:26:49.999 INFO:tasks.workunit.client.0.smithi029.stdout:1/774: dread d7/d5e/d52/d90/fd7 [0,4194304] 0 2023-12-05T13:26:49.999 INFO:tasks.workunit.client.0.smithi029.stdout:8/926: symlink d5/d6/d59/l136 0 2023-12-05T13:26:50.002 INFO:tasks.workunit.client.0.smithi029.stdout:8/927: unlink d5/d6/d59/f133 0 2023-12-05T13:26:50.004 INFO:tasks.workunit.client.0.smithi029.stdout:9/761: dwrite d7/d19/d28/d50/f7c [0,4194304] 0 2023-12-05T13:26:50.005 INFO:tasks.workunit.client.0.smithi029.stdout:9/762: link d7/d19/d30/d99/d8d/fcc d7/d19/d28/d65/d73/de5/ff9 0 2023-12-05T13:26:50.006 INFO:tasks.workunit.client.0.smithi029.stdout:6/900: dread d6/d29/dc4/d40/d74/d59/dfb/f10d [0,4194304] 0 2023-12-05T13:26:50.007 INFO:tasks.workunit.client.0.smithi029.stdout:9/763: write d7/d2c/d3a/d52/f81 [684008,25187] 0 2023-12-05T13:26:50.007 INFO:tasks.workunit.client.0.smithi029.stdout:6/901: write d6/d29/dc4/d40/db5/f128 [3385022,20268] 0 2023-12-05T13:26:50.007 INFO:tasks.workunit.client.0.smithi029.stdout:6/902: stat d6/d29/dc4/f99 0 2023-12-05T13:26:50.007 INFO:tasks.workunit.client.0.smithi029.stdout:6/903: chown d6/d64/d6d/d85/lba 1 1 2023-12-05T13:26:50.010 INFO:tasks.workunit.client.0.smithi029.stdout:9/764: mkdir d7/d2c/d3a/d64/dfa 0 2023-12-05T13:26:50.015 INFO:tasks.workunit.client.0.smithi029.stdout:9/765: rename d7/d2c/l5d to d7/d2c/d3a/d64/dc8/df8/lfb 0 2023-12-05T13:26:50.015 INFO:tasks.workunit.client.0.smithi029.stdout:9/766: stat d7/d19/d30/d99/l8b 0 2023-12-05T13:26:50.027 INFO:tasks.workunit.client.0.smithi029.stdout:8/928: dwrite d5/dbc/d1d/d10f/d3c/da2/fb9 [0,4194304] 0 2023-12-05T13:26:50.027 INFO:tasks.workunit.client.0.smithi029.stdout:8/929: creat d5/d6/d59/f137 x:0 0 0 2023-12-05T13:26:50.028 INFO:tasks.workunit.client.0.smithi029.stdout:8/930: chown d5/dc/d18/d26/f9f 9814917 1 2023-12-05T13:26:50.032 INFO:tasks.workunit.client.0.smithi029.stdout:8/931: rename d5/d6/cc9 to d5/dbc/d1d/d10f/d3c/c138 0 2023-12-05T13:26:50.032 INFO:tasks.workunit.client.0.smithi029.stdout:8/932: write d5/d6/d10/d8a/f10c [431982,104297] 0 2023-12-05T13:26:50.032 INFO:tasks.workunit.client.0.smithi029.stdout:8/933: fdatasync d5/d2f/f7d 0 2023-12-05T13:26:50.032 INFO:tasks.workunit.client.0.smithi029.stdout:1/775: dwrite d7/f49 [4194304,4194304] 0 2023-12-05T13:26:50.033 INFO:tasks.workunit.client.0.smithi029.stdout:8/934: dread d5/dbc/d1d/d10f/d3c/da2/fbe [0,4194304] 0 2023-12-05T13:26:50.035 INFO:tasks.workunit.client.0.smithi029.stdout:1/776: creat d7/d5e/d52/d5f/d12/d60/f101 x:0 0 0 2023-12-05T13:26:50.036 INFO:tasks.workunit.client.0.smithi029.stdout:9/767: dwrite d7/d19/d30/d40/d4e/d5e/fdb [0,4194304] 0 2023-12-05T13:26:50.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/777: write d7/d61/d77/d9f/db4/fd2 [2414951,16893] 0 2023-12-05T13:26:50.036 INFO:tasks.workunit.client.0.smithi029.stdout:1/778: write d7/d5e/f28 [5114709,39056] 0 2023-12-05T13:26:50.045 INFO:tasks.workunit.client.0.smithi029.stdout:1/779: dread d7/d6e/da9/d4b/d72/f83 [0,4194304] 0 2023-12-05T13:26:50.047 INFO:tasks.workunit.client.0.smithi029.stdout:9/768: dread d7/d19/fb8 [0,4194304] 0 2023-12-05T13:26:50.047 INFO:tasks.workunit.client.0.smithi029.stdout:1/780: unlink d7/d5e/d52/d5f/d12/d60/l63 0 2023-12-05T13:26:50.047 INFO:tasks.workunit.client.0.smithi029.stdout:1/781: truncate d7/d5e/d52/d5f/d12/f93 920332 0 2023-12-05T13:26:50.048 INFO:tasks.workunit.client.0.smithi029.stdout:1/782: unlink d7/d6e/da9/d4b/l64 0 2023-12-05T13:26:50.049 INFO:tasks.workunit.client.0.smithi029.stdout:9/769: write d7/d19/d30/d99/d8d/dad/fba [774114,44303] 0 2023-12-05T13:26:50.050 INFO:tasks.workunit.client.0.smithi029.stdout:8/935: dwrite d5/dc/d18/f3d [4194304,4194304] 0 2023-12-05T13:26:50.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/783: rename d7/d6e/f86 to d7/d61/dfb/f102 0 2023-12-05T13:26:50.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/784: chown d7/d61/d4f/f65 30 1 2023-12-05T13:26:50.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/785: dread - d7/d6e/da9/d4b/db1/fc5 zero size 2023-12-05T13:26:50.050 INFO:tasks.workunit.client.0.smithi029.stdout:1/786: write d7/d5e/d52/d5f/d12/f76 [4863688,109015] 0 2023-12-05T13:26:50.052 INFO:tasks.workunit.client.0.smithi029.stdout:8/936: mkdir d5/dbc/d1d/d10f/d86/da8/d139 0 2023-12-05T13:26:50.053 INFO:tasks.workunit.client.0.smithi029.stdout:1/787: getdents d7/d5e/d52/d90 0 2023-12-05T13:26:50.055 INFO:tasks.workunit.client.0.smithi029.stdout:8/937: rename d5/dbc/d8b to d5/dbc/d1d/d10f/d3c/d13a 0 2023-12-05T13:26:50.056 INFO:tasks.workunit.client.0.smithi029.stdout:9/770: write d7/d2c/d3a/d52/f81 [3508803,107976] 0 2023-12-05T13:26:50.058 INFO:tasks.workunit.client.0.smithi029.stdout:1/788: link d7/d5e/d52/d5f/d12/d60/fd8 d7/d61/f103 0 2023-12-05T13:26:50.062 INFO:tasks.workunit.client.0.smithi029.stdout:8/938: link d5/dbc/d1d/d10f/d86/c116 d5/dbc/d1d/d10f/d3c/c13b 0 2023-12-05T13:26:50.064 INFO:tasks.workunit.client.0.smithi029.stdout:9/771: getdents d7/d19/d28/d65 0 2023-12-05T13:26:50.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/939: dread f4 [0,4194304] 0 2023-12-05T13:26:50.071 INFO:tasks.workunit.client.0.smithi029.stdout:8/940: stat d5/dbc/d1d/f2e 0 2023-12-05T13:26:50.072 INFO:tasks.workunit.client.0.smithi029.stdout:9/772: symlink d7/d19/d28/d50/dc0/lfc 0 2023-12-05T13:26:50.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/789: dwrite d7/d61/d4f/f65 [4194304,4194304] 0 2023-12-05T13:26:50.073 INFO:tasks.workunit.client.0.smithi029.stdout:9/773: creat d7/d2c/d3a/d64/dfa/ffd x:0 0 0 2023-12-05T13:26:50.077 INFO:tasks.workunit.client.0.smithi029.stdout:9/774: rmdir d7/d2c/d3a/d64/def 39 2023-12-05T13:26:50.077 INFO:tasks.workunit.client.0.smithi029.stdout:9/775: chown d7/d2c/d3a/d52/lf6 1082 1 2023-12-05T13:26:50.078 INFO:tasks.workunit.client.0.smithi029.stdout:8/941: symlink d5/dc/d56/l13c 0 2023-12-05T13:26:50.080 INFO:tasks.workunit.client.0.smithi029.stdout:9/776: rename d7/d19/d30/d99/c6f to d7/d2c/d3a/d52/cfe 0 2023-12-05T13:26:50.081 INFO:tasks.workunit.client.0.smithi029.stdout:8/942: mknod d5/d6/d10/d8a/db6/d108/dc2/c13d 0 2023-12-05T13:26:50.084 INFO:tasks.workunit.client.0.smithi029.stdout:8/943: rmdir d5/dbc/d1d/d10f/d3c/deb 39 2023-12-05T13:26:50.087 INFO:tasks.workunit.client.0.smithi029.stdout:9/777: rename d7/d2c/l35 to d7/d19/d1f/lff 0 2023-12-05T13:26:50.088 INFO:tasks.workunit.client.0.smithi029.stdout:8/944: creat d5/d2f/d75/f13e x:0 0 0 2023-12-05T13:26:50.088 INFO:tasks.workunit.client.0.smithi029.stdout:9/778: write d7/d19/d30/d99/d8d/dad/fba [517949,120135] 0 2023-12-05T13:26:50.091 INFO:tasks.workunit.client.0.smithi029.stdout:1/790: dwrite d7/d5e/d52/d5f/d12/f2d [0,4194304] 0 2023-12-05T13:26:50.091 INFO:tasks.workunit.client.0.smithi029.stdout:1/791: write d7/fb [137346,79619] 0 2023-12-05T13:26:50.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/945: unlink d5/dc/f90 0 2023-12-05T13:26:50.091 INFO:tasks.workunit.client.0.smithi029.stdout:8/946: read d5/dbc/d1d/d10f/fed [3052313,27953] 0 2023-12-05T13:26:50.091 INFO:tasks.workunit.client.0.smithi029.stdout:9/779: mkdir d7/d19/d30/d40/d4e/d100 0 2023-12-05T13:26:50.091 INFO:tasks.workunit.client.0.smithi029.stdout:9/780: read d7/d2c/d3a/d52/f81 [793595,1448] 0 2023-12-05T13:26:50.092 INFO:tasks.workunit.client.0.smithi029.stdout:1/792: truncate d7/d5e/fe9 4494157 0 2023-12-05T13:26:50.093 INFO:tasks.workunit.client.0.smithi029.stdout:9/781: mknod d7/d2c/d3a/d64/dfa/c101 0 2023-12-05T13:26:50.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/793: creat d7/d5e/d52/d5f/d12/d60/f104 x:0 0 0 2023-12-05T13:26:50.094 INFO:tasks.workunit.client.0.smithi029.stdout:1/794: fdatasync d7/fdb 0 2023-12-05T13:26:50.096 INFO:tasks.workunit.client.0.smithi029.stdout:9/782: rename d7/d19/d30/d99/c7a to d7/c102 0 2023-12-05T13:26:50.098 INFO:tasks.workunit.client.0.smithi029.stdout:9/783: mknod d7/d2c/d3a/d64/dfa/c103 0 2023-12-05T13:26:50.103 INFO:tasks.workunit.client.0.smithi029.stdout:9/784: rename d7/d19/d30/d40/d4e/d5e/f88 to d7/f104 0 2023-12-05T13:26:50.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:49 smithi029 ceph-mon[112128]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 52 MiB/s rd, 101 MiB/s wr, 175 op/s 2023-12-05T13:26:50.104 INFO:tasks.workunit.client.0.smithi029.stdout:9/785: read d7/d19/d30/d40/d4e/f5f [2146778,107919] 0 2023-12-05T13:26:50.105 INFO:tasks.workunit.client.0.smithi029.stdout:9/786: truncate d7/d19/d30/fa3 1710864 0 2023-12-05T13:26:50.107 INFO:tasks.workunit.client.0.smithi029.stdout:9/787: mkdir d7/d105 0 2023-12-05T13:26:50.108 INFO:tasks.workunit.client.0.smithi029.stdout:1/795: dwrite d7/d61/d4f/f88 [0,4194304] 0 2023-12-05T13:26:50.109 INFO:tasks.workunit.client.0.smithi029.stdout:9/788: creat d7/d5a/ddf/f106 x:0 0 0 2023-12-05T13:26:50.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/947: dwrite d5/dc/d18/dc8/f107 [0,4194304] 0 2023-12-05T13:26:50.109 INFO:tasks.workunit.client.0.smithi029.stdout:8/948: fdatasync d5/dbc/d1d/d10f/d3c/deb/ff9 0 2023-12-05T13:26:50.111 INFO:tasks.workunit.client.0.smithi029.stdout:1/796: rmdir d7/d61/d4f 39 2023-12-05T13:26:50.114 INFO:tasks.workunit.client.0.smithi029.stdout:9/789: creat d7/d19/d30/d40/f107 x:0 0 0 2023-12-05T13:26:50.115 INFO:tasks.workunit.client.0.smithi029.stdout:8/949: rmdir d5/dbc/d1d 39 2023-12-05T13:26:50.115 INFO:tasks.workunit.client.0.smithi029.stdout:8/950: chown d5/dc/d18/fbf 5226 1 2023-12-05T13:26:50.118 INFO:tasks.workunit.client.0.smithi029.stdout:8/951: rmdir d5/dc 39 2023-12-05T13:26:50.122 INFO:tasks.workunit.client.0.smithi029.stdout:8/952: mknod d5/dc/c13f 0 2023-12-05T13:26:50.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/953: fdatasync d5/dbc/d1d/d10f/fed 0 2023-12-05T13:26:50.123 INFO:tasks.workunit.client.0.smithi029.stdout:8/954: dread - d5/d2f/d75/f13e zero size 2023-12-05T13:26:50.130 INFO:tasks.workunit.client.0.smithi029.stdout:1/797: dread d7/d6e/da9/f3c [4194304,4194304] 0 2023-12-05T13:26:50.131 INFO:tasks.workunit.client.0.smithi029.stdout:1/798: creat d7/d61/d77/f105 x:0 0 0 2023-12-05T13:26:50.133 INFO:tasks.workunit.client.0.smithi029.stdout:9/790: dwrite d7/d19/d30/d99/d8d/db5/fc4 [0,4194304] 0 2023-12-05T13:26:50.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/791: chown d7/d19/d28/d65/dbe 245 1 2023-12-05T13:26:50.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/792: getdents d7/d105 0 2023-12-05T13:26:50.135 INFO:tasks.workunit.client.0.smithi029.stdout:9/793: write d7/d19/d28/fd2 [4500446,29595] 0 2023-12-05T13:26:50.135 INFO:tasks.workunit.client.0.smithi029.stdout:1/799: unlink d7/d61/c6b 0 2023-12-05T13:26:50.136 INFO:tasks.workunit.client.0.smithi029.stdout:1/800: stat d7/d5e/d52/ldc 0 2023-12-05T13:26:50.136 INFO:tasks.workunit.client.0.smithi029.stdout:9/794: rmdir d7 39 2023-12-05T13:26:50.137 INFO:tasks.workunit.client.0.smithi029.stdout:8/955: dwrite d5/d6/d10/d13/f41 [0,4194304] 0 2023-12-05T13:26:50.137 INFO:tasks.workunit.client.0.smithi029.stdout:8/956: fdatasync d5/dbc/d1d/d10f/d3c/da2/fb5 0 2023-12-05T13:26:50.138 INFO:tasks.workunit.client.0.smithi029.stdout:1/801: creat d7/d5b/dc3/f106 x:0 0 0 2023-12-05T13:26:50.138 INFO:tasks.workunit.client.0.smithi029.stdout:8/957: write d5/d2f/d75/f71 [3249241,94108] 0 2023-12-05T13:26:50.139 INFO:tasks.workunit.client.0.smithi029.stdout:9/795: creat d7/d2c/d3a/d52/dc9/f108 x:0 0 0 2023-12-05T13:26:50.141 INFO:tasks.workunit.client.0.smithi029.stdout:1/802: creat d7/d61/dfb/f107 x:0 0 0 2023-12-05T13:26:50.143 INFO:tasks.workunit.client.0.smithi029.stdout:1/803: creat d7/d56/f108 x:0 0 0 2023-12-05T13:26:50.143 INFO:tasks.workunit.client.0.smithi029.stdout:1/804: dread - d7/d5e/d52/d5f/d12/d60/f101 zero size 2023-12-05T13:26:50.144 INFO:tasks.workunit.client.0.smithi029.stdout:1/805: link d7/d56/le7 d7/d61/df3/l109 0 2023-12-05T13:26:50.146 INFO:tasks.workunit.client.0.smithi029.stdout:1/806: mknod d7/d5e/d52/c10a 0 2023-12-05T13:26:50.146 INFO:tasks.workunit.client.0.smithi029.stdout:1/807: fdatasync d7/d61/d4f/f6c 0 2023-12-05T13:26:50.146 INFO:tasks.workunit.client.0.smithi029.stdout:8/958: dread d5/d2f/d75/fa4 [0,4194304] 0 2023-12-05T13:26:50.147 INFO:tasks.workunit.client.0.smithi029.stdout:1/808: truncate d7/fb 293447 0 2023-12-05T13:26:50.148 INFO:tasks.workunit.client.0.smithi029.stdout:9/796: dread d7/d19/f32 [0,4194304] 0 2023-12-05T13:26:50.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/809: write d7/d5e/d52/d5f/d12/f44 [691351,86741] 0 2023-12-05T13:26:50.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/810: write d7/d5e/f38 [1413091,75440] 0 2023-12-05T13:26:50.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/811: write d7/d61/d4f/f54 [1235150,9807] 0 2023-12-05T13:26:50.150 INFO:tasks.workunit.client.0.smithi029.stdout:9/797: truncate d7/d19/d1f/f21 6601810 0 2023-12-05T13:26:50.151 INFO:tasks.workunit.client.0.smithi029.stdout:9/798: read - d7/d19/d30/d40/f107 zero size 2023-12-05T13:26:50.151 INFO:tasks.workunit.client.0.smithi029.stdout:1/812: symlink d7/d5e/d52/d90/dd6/l10b 0 2023-12-05T13:26:50.151 INFO:tasks.workunit.client.0.smithi029.stdout:1/813: stat d7/d5e/d52/d5f/d12/d60/ca1 0 2023-12-05T13:26:50.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/959: dwrite d5/dbc/d1d/f2a [0,4194304] 0 2023-12-05T13:26:50.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/960: write d5/dbc/d1d/fd0 [1008316,94906] 0 2023-12-05T13:26:50.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/961: truncate d5/d2f/d75/fd2 324868 0 2023-12-05T13:26:50.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/962: fsync d5/dc/d18/d26/f5a 0 2023-12-05T13:26:50.171 INFO:tasks.workunit.client.0.smithi029.stdout:8/963: getdents d5/d119 0 2023-12-05T13:26:50.181 INFO:tasks.workunit.client.0.smithi029.stdout:1/814: dwrite d7/d5e/f95 [0,4194304] 0 2023-12-05T13:26:50.184 INFO:tasks.workunit.client.0.smithi029.stdout:9/799: dwrite d7/d2c/d33/f98 [0,4194304] 0 2023-12-05T13:26:50.184 INFO:tasks.workunit.client.0.smithi029.stdout:8/964: dread d5/dc/d18/d26/f94 [0,4194304] 0 2023-12-05T13:26:50.184 INFO:tasks.workunit.client.0.smithi029.stdout:9/800: read d7/d19/d28/f70 [718594,53095] 0 2023-12-05T13:26:50.199 INFO:tasks.workunit.client.0.smithi029.stdout:1/815: dwrite d7/d61/d77/f105 [0,4194304] 0 2023-12-05T13:26:50.200 INFO:tasks.workunit.client.0.smithi029.stdout:1/816: dread - d7/d5e/d52/d5f/d12/d60/fc9 zero size 2023-12-05T13:26:50.202 INFO:tasks.workunit.client.0.smithi029.stdout:1/817: unlink d7/f100 0 2023-12-05T13:26:50.204 INFO:tasks.workunit.client.0.smithi029.stdout:1/818: read d7/d5e/d52/d5f/d48/f66 [1991908,106830] 0 2023-12-05T13:26:50.205 INFO:tasks.workunit.client.0.smithi029.stdout:9/801: dwrite d7/d19/d30/d40/d4e/f74 [0,4194304] 0 2023-12-05T13:26:50.207 INFO:tasks.workunit.client.0.smithi029.stdout:9/802: creat d7/d19/d30/d40/d4e/d100/f109 x:0 0 0 2023-12-05T13:26:50.207 INFO:tasks.workunit.client.0.smithi029.stdout:9/803: readlink d7/d2c/d33/le3 0 2023-12-05T13:26:50.208 INFO:tasks.workunit.client.0.smithi029.stdout:9/804: mknod d7/d19/d28/d50/dc0/d7f/c10a 0 2023-12-05T13:26:50.208 INFO:tasks.workunit.client.0.smithi029.stdout:8/965: dwrite d5/dbc/d1d/d10f/d86/f95 [0,4194304] 0 2023-12-05T13:26:50.209 INFO:tasks.workunit.client.0.smithi029.stdout:8/966: fdatasync d5/dc/d18/dc8/f113 0 2023-12-05T13:26:50.209 INFO:tasks.workunit.client.0.smithi029.stdout:8/967: readlink d5/dbc/d1d/d10f/d3c/l6e 0 2023-12-05T13:26:50.209 INFO:tasks.workunit.client.0.smithi029.stdout:8/968: fsync d5/d2f/d75/f33 0 2023-12-05T13:26:50.209 INFO:tasks.workunit.client.0.smithi029.stdout:9/805: write d7/d19/f32 [2486403,108587] 0 2023-12-05T13:26:50.211 INFO:tasks.workunit.client.0.smithi029.stdout:9/806: dread d7/d19/d30/d99/d8d/fcc [0,4194304] 0 2023-12-05T13:26:50.211 INFO:tasks.workunit.client.0.smithi029.stdout:9/807: dread - d7/d19/d1f/fbc zero size 2023-12-05T13:26:50.212 INFO:tasks.workunit.client.0.smithi029.stdout:8/969: mkdir d5/d11b/d140 0 2023-12-05T13:26:50.212 INFO:tasks.workunit.client.0.smithi029.stdout:8/970: write d5/dc/d18/d26/dc0/fe8 [758553,7453] 0 2023-12-05T13:26:50.216 INFO:tasks.workunit.client.0.smithi029.stdout:8/971: write d5/d6/d59/fad [1017458,43995] 0 2023-12-05T13:26:50.216 INFO:tasks.workunit.client.0.smithi029.stdout:8/972: chown d5/l102 2781889 1 2023-12-05T13:26:50.218 INFO:tasks.workunit.client.0.smithi029.stdout:8/973: symlink d5/dc/d18/d26/l141 0 2023-12-05T13:26:50.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:49 smithi052 ceph-mon[121072]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 52 MiB/s rd, 101 MiB/s wr, 175 op/s 2023-12-05T13:26:50.223 INFO:tasks.workunit.client.0.smithi029.stdout:8/974: rename d5/d11b to d5/dbc/d1d/d142 0 2023-12-05T13:26:50.225 INFO:tasks.workunit.client.0.smithi029.stdout:8/975: creat d5/d6/d10/d85/daa/dfe/f143 x:0 0 0 2023-12-05T13:26:50.226 INFO:tasks.workunit.client.0.smithi029.stdout:8/976: creat d5/dbc/d1d/d10f/f144 x:0 0 0 2023-12-05T13:26:50.227 INFO:tasks.workunit.client.0.smithi029.stdout:8/977: write d5/dbc/d1d/fd0 [1706235,97419] 0 2023-12-05T13:26:50.230 INFO:tasks.workunit.client.0.smithi029.stdout:8/978: write d5/dc/d18/dc8/f107 [2296316,34306] 0 2023-12-05T13:26:50.232 INFO:tasks.workunit.client.0.smithi029.stdout:1/819: dwrite d7/d5e/d52/d5f/d12/f93 [0,4194304] 0 2023-12-05T13:26:50.234 INFO:tasks.workunit.client.0.smithi029.stdout:9/808: dwrite d7/d19/d30/d99/d8d/fcc [0,4194304] 0 2023-12-05T13:26:50.234 INFO:tasks.workunit.client.0.smithi029.stdout:1/820: getdents d7/d61/df3 0 2023-12-05T13:26:50.235 INFO:tasks.workunit.client.0.smithi029.stdout:9/809: write d7/d2c/d33/f59 [221614,86171] 0 2023-12-05T13:26:50.239 INFO:tasks.workunit.client.0.smithi029.stdout:9/810: getdents d7/d2c/d3a/d52/db9 0 2023-12-05T13:26:50.243 INFO:tasks.workunit.client.0.smithi029.stdout:9/811: rmdir d7/d2c/d3a/d64/dfa 39 2023-12-05T13:26:50.243 INFO:tasks.workunit.client.0.smithi029.stdout:9/812: chown d7/d19/d30/d43 30536842 1 2023-12-05T13:26:50.243 INFO:tasks.workunit.client.0.smithi029.stdout:1/821: dread d7/d6e/da9/d4b/db1/dd1/fe5 [0,4194304] 0 2023-12-05T13:26:50.245 INFO:tasks.workunit.client.0.smithi029.stdout:9/813: mknod d7/d2c/d3a/c10b 0 2023-12-05T13:26:50.246 INFO:tasks.workunit.client.0.smithi029.stdout:1/822: link d7/d5e/leb d7/d5e/d52/d5f/d12/l10c 0 2023-12-05T13:26:50.252 INFO:tasks.workunit.client.0.smithi029.stdout:9/814: dread d7/d2c/d3a/d52/db9/fc7 [0,4194304] 0 2023-12-05T13:26:50.253 INFO:tasks.workunit.client.0.smithi029.stdout:9/815: getdents d7/d19/d28/d65/d73/de5 0 2023-12-05T13:26:50.253 INFO:tasks.workunit.client.0.smithi029.stdout:9/816: chown d7/d19/d1f/l22 385 1 2023-12-05T13:26:50.254 INFO:tasks.workunit.client.0.smithi029.stdout:9/817: dread d7/d19/d30/d40/f7e [0,4194304] 0 2023-12-05T13:26:50.254 INFO:tasks.workunit.client.0.smithi029.stdout:9/818: chown d7/d19 6 1 2023-12-05T13:26:50.255 INFO:tasks.workunit.client.0.smithi029.stdout:9/819: creat d7/d19/d1f/f10c x:0 0 0 2023-12-05T13:26:50.262 INFO:tasks.workunit.client.0.smithi029.stdout:9/820: dread d7/d19/d28/d50/dc0/d7f/fda [0,4194304] 0 2023-12-05T13:26:50.264 INFO:tasks.workunit.client.0.smithi029.stdout:9/821: symlink d7/d19/d30/d99/d8d/de6/l10d 0 2023-12-05T13:26:50.266 INFO:tasks.workunit.client.0.smithi029.stdout:9/822: rename d7/d19/d28/d50 to d7/d19/d30/d40/d4e/d5e/d10e 0 2023-12-05T13:26:50.266 INFO:tasks.workunit.client.0.smithi029.stdout:9/823: truncate d7/d19/d28/fd2 72828 0 2023-12-05T13:26:50.267 INFO:tasks.workunit.client.0.smithi029.stdout:1/823: dwrite d7/d5e/d52/d90/fd7 [0,4194304] 0 2023-12-05T13:26:50.267 INFO:tasks.workunit.client.0.smithi029.stdout:1/824: dread - d7/d5e/f7d zero size 2023-12-05T13:26:50.267 INFO:tasks.workunit.client.0.smithi029.stdout:1/825: write d7/d5e/fe6 [500793,115968] 0 2023-12-05T13:26:50.268 INFO:tasks.workunit.client.0.smithi029.stdout:1/826: write d7/d61/d4f/f6c [2218820,120525] 0 2023-12-05T13:26:50.268 INFO:tasks.workunit.client.0.smithi029.stdout:9/824: mkdir d7/d19/d30/d40/d4e/d5e/d10e/dc0/d10f 0 2023-12-05T13:26:50.269 INFO:tasks.workunit.client.0.smithi029.stdout:9/825: write d7/d19/f32 [3520483,23573] 0 2023-12-05T13:26:50.271 INFO:tasks.workunit.client.0.smithi029.stdout:1/827: mknod d7/d61/da0/c10d 0 2023-12-05T13:26:50.271 INFO:tasks.workunit.client.0.smithi029.stdout:1/828: write d7/d6e/da9/d4b/fba [1249748,95635] 0 2023-12-05T13:26:50.271 INFO:tasks.workunit.client.0.smithi029.stdout:9/826: getdents d7/d2c/d3a/d52 0 2023-12-05T13:26:50.284 INFO:tasks.workunit.client.0.smithi029.stdout:9/827: dread d7/d19/f32 [0,4194304] 0 2023-12-05T13:26:50.289 INFO:tasks.workunit.client.0.smithi029.stdout:1/829: dwrite d7/d5e/fcc [0,4194304] 0 2023-12-05T13:26:50.307 INFO:tasks.workunit.client.0.smithi029.stdout:1/830: dwrite d7/d5e/d52/d5f/d12/f93 [0,4194304] 0 2023-12-05T13:26:50.312 INFO:tasks.workunit.client.0.smithi029.stdout:9/828: dwrite d7/d2c/d33/f59 [0,4194304] 0 2023-12-05T13:26:50.315 INFO:tasks.workunit.client.0.smithi029.stdout:1/831: dread d7/d6e/da9/d4b/d72/fbe [0,4194304] 0 2023-12-05T13:26:50.315 INFO:tasks.workunit.client.0.smithi029.stdout:9/829: mknod d7/d5a/c110 0 2023-12-05T13:26:50.315 INFO:tasks.workunit.client.0.smithi029.stdout:9/830: getdents d7/d2c/d3a/d52/db9 0 2023-12-05T13:26:50.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/831: write d7/d19/d28/fd2 [387472,77310] 0 2023-12-05T13:26:50.316 INFO:tasks.workunit.client.0.smithi029.stdout:9/832: chown d7/d19/d30/d99 1043317 1 2023-12-05T13:26:50.317 INFO:tasks.workunit.client.0.smithi029.stdout:9/833: mkdir d7/d19/d30/d40/d4e/d111 0 2023-12-05T13:26:50.318 INFO:tasks.workunit.client.0.smithi029.stdout:9/834: mknod d7/d2c/d3a/d64/def/c112 0 2023-12-05T13:26:50.318 INFO:tasks.workunit.client.0.smithi029.stdout:9/835: fsync d7/d19/d28/f37 0 2023-12-05T13:26:50.332 INFO:tasks.workunit.client.0.smithi029.stdout:1/832: dwrite d7/d5e/d52/d90/f96 [0,4194304] 0 2023-12-05T13:26:50.332 INFO:tasks.workunit.client.0.smithi029.stdout:1/833: chown d7/d5e/d52/d5f/d48/f67 11091036 1 2023-12-05T13:26:50.332 INFO:tasks.workunit.client.0.smithi029.stdout:9/836: dwrite d7/d19/d30/d40/d4e/f95 [0,4194304] 0 2023-12-05T13:26:50.334 INFO:tasks.workunit.client.0.smithi029.stdout:1/834: mkdir d7/d61/d77/d10e 0 2023-12-05T13:26:50.334 INFO:tasks.workunit.client.0.smithi029.stdout:1/835: chown d7/d6e/da9/d4b/db1/dd1 2023 1 2023-12-05T13:26:50.336 INFO:tasks.workunit.client.0.smithi029.stdout:9/837: mknod d7/d19/d1f/da2/c113 0 2023-12-05T13:26:50.354 INFO:tasks.workunit.client.0.smithi029.stdout:1/836: dwrite d7/d5e/d52/d5f/d12/f93 [0,4194304] 0 2023-12-05T13:26:50.355 INFO:tasks.workunit.client.0.smithi029.stdout:9/838: dwrite d7/d19/d30/d40/fcd [0,4194304] 0 2023-12-05T13:26:50.355 INFO:tasks.workunit.client.0.smithi029.stdout:1/837: write d7/d5e/d52/d5f/d12/f93 [297810,19048] 0 2023-12-05T13:26:50.358 INFO:tasks.workunit.client.0.smithi029.stdout:9/839: mknod d7/d19/d1f/c114 0 2023-12-05T13:26:50.359 INFO:tasks.workunit.client.0.smithi029.stdout:9/840: write d7/d19/d30/d99/d8d/fcc [1487371,76550] 0 2023-12-05T13:26:50.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/841: creat d7/f115 x:0 0 0 2023-12-05T13:26:50.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/842: chown d7/d19/d30/d99/f82 6 1 2023-12-05T13:26:50.361 INFO:tasks.workunit.client.0.smithi029.stdout:9/843: chown d7/d19/d30/d99 784889383 1 2023-12-05T13:26:50.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/844: mknod d7/d5a/ddf/c116 0 2023-12-05T13:26:50.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/845: stat d7/d2c/d3a/d64/dc8 0 2023-12-05T13:26:50.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/846: chown d7/d19/d30/d40/d4e/d5e/d10e/f7c 12566 1 2023-12-05T13:26:50.363 INFO:tasks.workunit.client.0.smithi029.stdout:9/847: truncate d7/d19/d1f/f61 2481439 0 2023-12-05T13:26:50.364 INFO:tasks.workunit.client.0.smithi029.stdout:9/848: symlink d7/d2c/d3a/d64/dfa/l117 0 2023-12-05T13:26:50.366 INFO:tasks.workunit.client.0.smithi029.stdout:9/849: creat d7/d19/d30/d40/d4e/d5e/d10e/dc0/f118 x:0 0 0 2023-12-05T13:26:50.366 INFO:tasks.workunit.client.0.smithi029.stdout:9/850: mkdir d7/d2c/d33/d119 0 2023-12-05T13:26:50.389 INFO:tasks.workunit.client.0.smithi029.stdout:9/851: dwrite d7/d19/d30/d40/d4e/f5f [0,4194304] 0 2023-12-05T13:26:50.390 INFO:tasks.workunit.client.0.smithi029.stdout:9/852: mkdir d7/d19/d1f/da2/de7/d11a 0 2023-12-05T13:26:50.391 INFO:tasks.workunit.client.0.smithi029.stdout:9/853: symlink d7/l11b 0 2023-12-05T13:26:50.392 INFO:tasks.workunit.client.0.smithi029.stdout:9/854: mknod d7/d19/d30/d40/d4e/d5e/d10e/dc0/d10f/c11c 0 2023-12-05T13:26:50.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/855: mkdir d7/d2c/d3a/d64/d11d 0 2023-12-05T13:26:50.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/856: fdatasync d7/d19/d28/f2d 0 2023-12-05T13:26:50.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/857: fsync d7/d19/d30/d40/d4e/d5e/d10e/dc0/f118 0 2023-12-05T13:26:50.394 INFO:tasks.workunit.client.0.smithi029.stdout:9/858: chown d7/d19/d1f/f46 41 1 2023-12-05T13:26:50.395 INFO:tasks.workunit.client.0.smithi029.stdout:9/859: symlink d7/d19/d30/d99/d8d/dad/l11e 0 2023-12-05T13:26:50.410 INFO:tasks.workunit.client.0.smithi029.stdout:9/860: dwrite d7/d19/d30/d43/f62 [0,4194304] 0 2023-12-05T13:26:50.412 INFO:tasks.workunit.client.0.smithi029.stdout:9/861: creat d7/d5a/ddf/f11f x:0 0 0 2023-12-05T13:26:50.413 INFO:tasks.workunit.client.0.smithi029.stdout:9/862: creat d7/d19/d30/d99/d8d/f120 x:0 0 0 2023-12-05T13:26:50.414 INFO:tasks.workunit.client.0.smithi029.stdout:9/863: dread d7/d19/d30/d40/f7e [0,4194304] 0 2023-12-05T13:26:50.415 INFO:tasks.workunit.client.0.smithi029.stdout:9/864: read d7/f13 [3922130,118077] 0 2023-12-05T13:26:50.417 INFO:tasks.workunit.client.0.smithi029.stdout:9/865: creat d7/d2c/d33/f121 x:0 0 0 2023-12-05T13:26:50.417 INFO:tasks.workunit.client.0.smithi029.stdout:9/866: write d7/d19/d30/d40/d4e/f74 [4199879,103160] 0 2023-12-05T13:26:50.417 INFO:tasks.workunit.client.0.smithi029.stdout:9/867: truncate d7/d19/d30/d40/f107 1004989 0 2023-12-05T13:26:50.432 INFO:tasks.workunit.client.0.smithi029.stdout:9/868: dwrite d7/d2c/d33/f59 [0,4194304] 0 2023-12-05T13:26:50.432 INFO:tasks.workunit.client.0.smithi029.stdout:9/869: chown d7/d5a/dd4 0 1 2023-12-05T13:26:50.433 INFO:tasks.workunit.client.0.smithi029.stdout:9/870: creat d7/d19/d1f/da2/de7/f122 x:0 0 0 2023-12-05T13:26:50.443 INFO:tasks.workunit.client.0.smithi029.stdout:9/871: dread d7/d19/d1f/f61 [0,4194304] 0 2023-12-05T13:26:50.444 INFO:tasks.workunit.client.0.smithi029.stdout:9/872: rmdir d7/d2c/d3a/d64/dc8 39 2023-12-05T13:26:50.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/873: rename d7/d19/d30/d43 to d7/d19/d28/d65/d73/d123 0 2023-12-05T13:26:50.446 INFO:tasks.workunit.client.0.smithi029.stdout:9/874: chown d7/d19/d30/d40/d4e/d5e/d10e/dc0/d7f/lb4 4817605 1 2023-12-05T13:26:50.447 INFO:tasks.workunit.client.0.smithi029.stdout:9/875: mknod d7/d5a/ddf/c124 0 2023-12-05T13:26:50.448 INFO:tasks.workunit.client.0.smithi029.stdout:9/876: mkdir d7/d19/d1f/da2/de7/d125 0 2023-12-05T13:26:50.450 INFO:tasks.workunit.client.0.smithi029.stdout:9/877: dread d7/d19/d30/d99/f82 [0,4194304] 0 2023-12-05T13:26:50.452 INFO:tasks.workunit.client.0.smithi029.stdout:9/878: getdents d7/d19/d28 0 2023-12-05T13:26:50.453 INFO:tasks.workunit.client.0.smithi029.stdout:9/879: link d7/d2c/d3a/d64/dfa/c101 d7/d19/d30/d40/d4e/d111/c126 0 2023-12-05T13:26:50.470 INFO:tasks.workunit.client.0.smithi029.stdout:9/880: dwrite d7/d19/d28/d65/d73/d123/f48 [0,4194304] 0 2023-12-05T13:26:50.489 INFO:tasks.workunit.client.0.smithi029.stdout:9/881: dwrite d7/d19/d1f/f46 [0,4194304] 0 2023-12-05T13:26:50.490 INFO:tasks.workunit.client.0.smithi029.stdout:9/882: symlink d7/d2c/d3a/d64/dc8/l127 0 2023-12-05T13:26:50.491 INFO:tasks.workunit.client.0.smithi029.stdout:9/883: mkdir d7/d19/d1f/da2/de7/d11a/d128 0 2023-12-05T13:26:50.506 INFO:tasks.workunit.client.0.smithi029.stdout:9/884: dwrite d7/d19/d30/d99/f7d [0,4194304] 0 2023-12-05T13:26:50.506 INFO:tasks.workunit.client.0.smithi029.stdout:9/885: chown d7/d2c/d33/le9 8822621 1 2023-12-05T13:26:50.506 INFO:tasks.workunit.client.0.smithi029.stdout:9/886: write d7/d19/d30/d40/f9f [772130,31533] 0 2023-12-05T13:26:50.508 INFO:tasks.workunit.client.0.smithi029.stdout:9/887: creat d7/d19/d1f/da2/de7/d125/f129 x:0 0 0 2023-12-05T13:26:50.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/888: symlink d7/d2c/d3a/d52/dc9/l12a 0 2023-12-05T13:26:50.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/889: chown d7/caf 118689617 1 2023-12-05T13:26:50.509 INFO:tasks.workunit.client.0.smithi029.stdout:9/890: readlink d7/d2c/d3a/d64/dfa/l117 0 2023-12-05T13:26:50.511 INFO:tasks.workunit.client.0.smithi029.stdout:9/891: link d7/d19/d28/d65/d73/d123/c36 d7/d19/d1f/da2/de7/d11a/d128/c12b 0 2023-12-05T13:26:50.512 INFO:tasks.workunit.client.0.smithi029.stdout:9/892: write d7/d19/d1f/f46 [554122,55265] 0 2023-12-05T13:26:50.515 INFO:tasks.workunit.client.0.smithi029.stdout:9/893: rename d7/d19/d30/d40/d4e/d5e/d10e/lb7 to d7/d2c/d3a/d64/dc8/l12c 0 2023-12-05T13:26:50.516 INFO:tasks.workunit.client.0.smithi029.stdout:2/762: sync 2023-12-05T13:26:50.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/869: sync 2023-12-05T13:26:50.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/659: sync 2023-12-05T13:26:50.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/818: sync 2023-12-05T13:26:50.516 INFO:tasks.workunit.client.0.smithi029.stdout:3/819: fdatasync d1/d6/d4a/f9b 0 2023-12-05T13:26:50.516 INFO:tasks.workunit.client.0.smithi029.stdout:4/660: dread - d0/de/d15/f99 zero size 2023-12-05T13:26:50.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/894: rename d7/d19/d30/d40/d4e/d100 to d7/d19/d30/d99/d8d/d12d 0 2023-12-05T13:26:50.518 INFO:tasks.workunit.client.0.smithi029.stdout:9/895: write d7/d19/d30/d40/d4e/d5e/d10e/dc0/fdd [841663,31708] 0 2023-12-05T13:26:50.520 INFO:tasks.workunit.client.0.smithi029.stdout:2/763: creat de/d41/d56/d58/ff1 x:0 0 0 2023-12-05T13:26:50.523 INFO:tasks.workunit.client.0.smithi029.stdout:3/820: creat d1/d6/d4a/db8/f103 x:0 0 0 2023-12-05T13:26:50.524 INFO:tasks.workunit.client.0.smithi029.stdout:4/661: unlink d0/de/d30/d32/f88 0 2023-12-05T13:26:50.524 INFO:tasks.workunit.client.0.smithi029.stdout:9/896: truncate d7/f18 4504070 0 2023-12-05T13:26:50.526 INFO:tasks.workunit.client.0.smithi029.stdout:3/821: dread d1/d5e/d74/f93 [4194304,4194304] 0 2023-12-05T13:26:50.526 INFO:tasks.workunit.client.0.smithi029.stdout:9/897: read d7/d19/d28/f39 [1540890,127205] 0 2023-12-05T13:26:50.528 INFO:tasks.workunit.client.0.smithi029.stdout:2/764: rename de/d14/da3/fd5 to de/d16/d6c/d8e/dbf/ff2 0 2023-12-05T13:26:50.529 INFO:tasks.workunit.client.0.smithi029.stdout:7/870: dwrite d6/d100/d2f/fa7 [0,4194304] 0 2023-12-05T13:26:50.530 INFO:tasks.workunit.client.0.smithi029.stdout:3/822: link d1/d16/d1f/l60 d1/db3/l104 0 2023-12-05T13:26:50.532 INFO:tasks.workunit.client.0.smithi029.stdout:9/898: rmdir d7/d2c/d3a 39 2023-12-05T13:26:50.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/765: mkdir de/d14/d24/db7/df3 0 2023-12-05T13:26:50.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/766: chown de/d16/d6c 27274 1 2023-12-05T13:26:50.535 INFO:tasks.workunit.client.0.smithi029.stdout:2/767: fsync de/d41/d56/d58/fce 0 2023-12-05T13:26:50.542 INFO:tasks.workunit.client.0.smithi029.stdout:3/823: mkdir d1/d6/d11/d105 0 2023-12-05T13:26:50.542 INFO:tasks.workunit.client.0.smithi029.stdout:3/824: stat d1/d6/d11/c21 0 2023-12-05T13:26:50.544 INFO:tasks.workunit.client.0.smithi029.stdout:9/899: creat d7/d19/d1f/da2/f12e x:0 0 0 2023-12-05T13:26:50.545 INFO:tasks.workunit.client.0.smithi029.stdout:2/768: dread de/d11/f9f [0,4194304] 0 2023-12-05T13:26:50.546 INFO:tasks.workunit.client.0.smithi029.stdout:9/900: truncate d7/f3c 278739 0 2023-12-05T13:26:50.548 INFO:tasks.workunit.client.0.smithi029.stdout:2/769: truncate de/d16/d6c/f7c 22585 0 2023-12-05T13:26:50.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/871: dwrite d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/fb0 [0,4194304] 0 2023-12-05T13:26:50.550 INFO:tasks.workunit.client.0.smithi029.stdout:7/872: chown d6/f6b 34803859 1 2023-12-05T13:26:50.560 INFO:tasks.workunit.client.0.smithi029.stdout:7/873: mknod d6/d50/d5b/d1a/d26/d6e/c113 0 2023-12-05T13:26:50.560 INFO:tasks.workunit.client.0.smithi029.stdout:9/901: mkdir d7/d19/d28/d65/d73/d12f 0 2023-12-05T13:26:50.561 INFO:tasks.workunit.client.0.smithi029.stdout:9/902: symlink d7/d19/d30/d99/d8d/l130 0 2023-12-05T13:26:50.563 INFO:tasks.workunit.client.0.smithi029.stdout:9/903: creat d7/d19/f131 x:0 0 0 2023-12-05T13:26:50.563 INFO:tasks.workunit.client.0.smithi029.stdout:3/825: dwrite d1/db3/fe8 [0,4194304] 0 2023-12-05T13:26:50.563 INFO:tasks.workunit.client.0.smithi029.stdout:2/770: dwrite de/d14/d24/d93/dc5/fe1 [0,4194304] 0 2023-12-05T13:26:50.567 INFO:tasks.workunit.client.0.smithi029.stdout:3/826: mknod d1/d6/d4a/dcd/c106 0 2023-12-05T13:26:50.571 INFO:tasks.workunit.client.0.smithi029.stdout:3/827: mknod d1/d16/d1f/d4c/c107 0 2023-12-05T13:26:50.571 INFO:tasks.workunit.client.0.smithi029.stdout:9/904: dread d7/d19/d1f/f21 [0,4194304] 0 2023-12-05T13:26:50.573 INFO:tasks.workunit.client.0.smithi029.stdout:3/828: mkdir d1/d16/d1f/de6/d108 0 2023-12-05T13:26:50.573 INFO:tasks.workunit.client.0.smithi029.stdout:9/905: getdents d7/d19/d1f/da2/de7/d11a 0 2023-12-05T13:26:50.574 INFO:tasks.workunit.client.0.smithi029.stdout:3/829: mknod d1/db3/d72/c109 0 2023-12-05T13:26:50.577 INFO:tasks.workunit.client.0.smithi029.stdout:9/906: unlink d7/d5a/dd4/cf1 0 2023-12-05T13:26:50.577 INFO:tasks.workunit.client.0.smithi029.stdout:9/907: chown d7/d19/l31 23 1 2023-12-05T13:26:50.587 INFO:tasks.workunit.client.0.smithi029.stdout:9/908: dread d7/d19/d30/d40/d4e/f5f [0,4194304] 0 2023-12-05T13:26:50.589 INFO:tasks.workunit.client.0.smithi029.stdout:9/909: mkdir d7/d2c/d3a/d64/d132 0 2023-12-05T13:26:50.589 INFO:tasks.workunit.client.0.smithi029.stdout:9/910: fdatasync d7/d19/d28/f2d 0 2023-12-05T13:26:50.589 INFO:tasks.workunit.client.0.smithi029.stdout:9/911: truncate d7/d19/d30/d40/d4e/ff4 4553375 0 2023-12-05T13:26:50.599 INFO:tasks.workunit.client.0.smithi029.stdout:3/830: dwrite d1/d16/d36/d3a/d6c/f8f [0,4194304] 0 2023-12-05T13:26:50.601 INFO:tasks.workunit.client.0.smithi029.stdout:3/831: truncate d1/d6/d4a/db8/ff4 1249923 0 2023-12-05T13:26:50.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/832: getdents d1/db3 0 2023-12-05T13:26:50.602 INFO:tasks.workunit.client.0.smithi029.stdout:3/833: dread - d1/d16/d1f/d4c/fcb zero size 2023-12-05T13:26:50.603 INFO:tasks.workunit.client.0.smithi029.stdout:3/834: mkdir d1/d6/d4a/db6/d10a 0 2023-12-05T13:26:50.604 INFO:tasks.workunit.client.0.smithi029.stdout:3/835: mkdir d1/d10/d10b 0 2023-12-05T13:26:50.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/912: dwrite d7/d19/d28/d65/d73/d123/f48 [0,4194304] 0 2023-12-05T13:26:50.617 INFO:tasks.workunit.client.0.smithi029.stdout:9/913: truncate d7/d19/d30/d40/d4e/f5f 4644368 0 2023-12-05T13:26:50.619 INFO:tasks.workunit.client.0.smithi029.stdout:3/836: dwrite d1/d10/d91/f68 [0,4194304] 0 2023-12-05T13:26:50.620 INFO:tasks.workunit.client.0.smithi029.stdout:3/837: read d1/d10/f51 [3213116,2589] 0 2023-12-05T13:26:50.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/914: unlink c5 0 2023-12-05T13:26:50.622 INFO:tasks.workunit.client.0.smithi029.stdout:9/915: write d7/d19/d1f/f46 [2905527,7963] 0 2023-12-05T13:26:50.624 INFO:tasks.workunit.client.0.smithi029.stdout:9/916: mkdir d7/d19/d30/d40/d4e/d5e/d10e/d133 0 2023-12-05T13:26:50.627 INFO:tasks.workunit.client.0.smithi029.stdout:9/917: rename d7/d19/d30/d40/d4e/d5e/fdb to d7/d2c/d3a/d64/d11d/f134 0 2023-12-05T13:26:50.629 INFO:tasks.workunit.client.0.smithi029.stdout:6/904: sync 2023-12-05T13:26:50.629 INFO:tasks.workunit.client.0.smithi029.stdout:0/761: sync 2023-12-05T13:26:50.630 INFO:tasks.workunit.client.0.smithi029.stdout:5/639: sync 2023-12-05T13:26:50.630 INFO:tasks.workunit.client.0.smithi029.stdout:0/762: chown dc/d33/d3d/d65/d85/f8e 151181 1 2023-12-05T13:26:50.630 INFO:tasks.workunit.client.0.smithi029.stdout:5/640: write d1/dc/d38/f22 [5237697,16609] 0 2023-12-05T13:26:50.630 INFO:tasks.workunit.client.0.smithi029.stdout:6/905: rename d6/d5a to d6/d1d/d39/d58/d137 0 2023-12-05T13:26:50.631 INFO:tasks.workunit.client.0.smithi029.stdout:6/906: chown d6/d29/dc4/d40/d74/ffd 249 1 2023-12-05T13:26:50.631 INFO:tasks.workunit.client.0.smithi029.stdout:3/838: write d1/d5e/d74/f78 [294700,63910] 0 2023-12-05T13:26:50.631 INFO:tasks.workunit.client.0.smithi029.stdout:3/839: dread - d1/d16/d36/dec/daf/fcc zero size 2023-12-05T13:26:50.631 INFO:tasks.workunit.client.0.smithi029.stdout:3/840: chown d1/d16/d1f/d4c/ce9 7 1 2023-12-05T13:26:50.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/763: unlink dc/d13/f1c 0 2023-12-05T13:26:50.636 INFO:tasks.workunit.client.0.smithi029.stdout:3/841: mkdir d1/d5e/d74/dab/d10c 0 2023-12-05T13:26:50.636 INFO:tasks.workunit.client.0.smithi029.stdout:3/842: write d1/d16/d1f/d4c/f79 [4808039,90167] 0 2023-12-05T13:26:50.636 INFO:tasks.workunit.client.0.smithi029.stdout:3/843: chown d1/fd 329847340 1 2023-12-05T13:26:50.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/844: creat d1/db3/d72/f10d x:0 0 0 2023-12-05T13:26:50.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/845: truncate d1/d6/fc6 1882868 0 2023-12-05T13:26:50.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/846: truncate d1/d16/fd7 816202 0 2023-12-05T13:26:50.639 INFO:tasks.workunit.client.0.smithi029.stdout:3/847: write d1/d5e/f102 [273707,3934] 0 2023-12-05T13:26:50.639 INFO:tasks.workunit.client.0.smithi029.stdout:6/907: write d6/d29/dc4/d40/d4d/fa2 [491254,95720] 0 2023-12-05T13:26:50.639 INFO:tasks.workunit.client.0.smithi029.stdout:6/908: readlink d6/l27 0 2023-12-05T13:26:50.640 INFO:tasks.workunit.client.0.smithi029.stdout:3/848: mkdir d1/d6/d4a/db6/d10e 0 2023-12-05T13:26:50.643 INFO:tasks.workunit.client.0.smithi029.stdout:6/909: mkdir d6/d29/dc4/d40/d74/d59/dfb/d138 0 2023-12-05T13:26:50.643 INFO:tasks.workunit.client.0.smithi029.stdout:6/910: fdatasync d6/d1d/d39/f87 0 2023-12-05T13:26:50.646 INFO:tasks.workunit.client.0.smithi029.stdout:3/849: rename d1/d5e/fa7 to d1/d10/d91/dde/f10f 0 2023-12-05T13:26:50.646 INFO:tasks.workunit.client.0.smithi029.stdout:0/764: dread dc/d33/d3d/d7a/d84/fc0 [0,4194304] 0 2023-12-05T13:26:50.646 INFO:tasks.workunit.client.0.smithi029.stdout:0/765: chown dc/d13/d4f/d88/fab 55 1 2023-12-05T13:26:50.650 INFO:tasks.workunit.client.0.smithi029.stdout:9/918: dwrite d7/d19/d30/f9d [4194304,4194304] 0 2023-12-05T13:26:50.651 INFO:tasks.workunit.client.0.smithi029.stdout:5/641: dwrite d1/dc/d25/d4c/f7e [4194304,4194304] 0 2023-12-05T13:26:50.652 INFO:tasks.workunit.client.0.smithi029.stdout:6/911: dread d6/d29/dc4/d40/db5/fe6 [4194304,4194304] 0 2023-12-05T13:26:50.657 INFO:tasks.workunit.client.0.smithi029.stdout:3/850: dread d1/d16/d1f/de6/f92 [0,4194304] 0 2023-12-05T13:26:50.659 INFO:tasks.workunit.client.0.smithi029.stdout:3/851: getdents d1/d16/d1f 0 2023-12-05T13:26:50.662 INFO:tasks.workunit.client.0.smithi029.stdout:3/852: read d1/d16/d36/d3a/d6c/f8f [757424,29226] 0 2023-12-05T13:26:50.663 INFO:tasks.workunit.client.0.smithi029.stdout:3/853: creat d1/d16/f110 x:0 0 0 2023-12-05T13:26:50.664 INFO:tasks.workunit.client.0.smithi029.stdout:0/766: dwrite dc/d33/d3d/d7a/d84/d8d/ff1 [0,4194304] 0 2023-12-05T13:26:50.667 INFO:tasks.workunit.client.0.smithi029.stdout:0/767: rename dc/f5a to dc/d13/d4f/ffb 0 2023-12-05T13:26:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/919: dwrite d7/d2c/d33/f8a [0,4194304] 0 2023-12-05T13:26:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:9/920: fsync d7/d2c/d3a/d64/d11d/f134 0 2023-12-05T13:26:50.680 INFO:tasks.workunit.client.0.smithi029.stdout:5/642: dwrite d1/dc/d38/f22 [0,4194304] 0 2023-12-05T13:26:50.681 INFO:tasks.workunit.client.0.smithi029.stdout:9/921: unlink d7/d2c/d3a/d64/dc8/df8/lfb 0 2023-12-05T13:26:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/643: creat d1/dc/d10/fda x:0 0 0 2023-12-05T13:26:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/644: dread - d1/dc/d25/d4c/d61/f90 zero size 2023-12-05T13:26:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:5/645: chown d1/dc/d38/d55/d57/f76 61298395 1 2023-12-05T13:26:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:5/646: creat d1/dc/d10/d1e/d9c/fdb x:0 0 0 2023-12-05T13:26:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:0/768: dwrite dc/d23/d3a/d41/d57/f59 [0,4194304] 0 2023-12-05T13:26:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:3/854: dwrite d1/d10/d91/f68 [0,4194304] 0 2023-12-05T13:26:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:0/769: dread dc/d23/d3a/d41/d57/f77 [0,4194304] 0 2023-12-05T13:26:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:3/855: read d1/d16/d36/d3a/fb4 [198281,83539] 0 2023-12-05T13:26:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:0/770: write dc/d13/d4f/d83/fc2 [2526329,4080] 0 2023-12-05T13:26:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:0/771: chown dc/d33/l43 2030957760 1 2023-12-05T13:26:50.700 INFO:tasks.workunit.client.0.smithi029.stdout:3/856: truncate d1/d5e/d74/f93 4017539 0 2023-12-05T13:26:50.701 INFO:tasks.workunit.client.0.smithi029.stdout:9/922: dwrite d7/d19/f1b [4194304,4194304] 0 2023-12-05T13:26:50.702 INFO:tasks.workunit.client.0.smithi029.stdout:3/857: mkdir d1/d16/d36/d3a/d6c/d7d/d95/d111 0 2023-12-05T13:26:50.705 INFO:tasks.workunit.client.0.smithi029.stdout:9/923: symlink d7/d19/d30/d40/d4e/d5e/l135 0 2023-12-05T13:26:50.708 INFO:tasks.workunit.client.0.smithi029.stdout:9/924: mkdir d7/d19/d30/d40/d4e/d5e/d10e/d133/d136 0 2023-12-05T13:26:50.708 INFO:tasks.workunit.client.0.smithi029.stdout:5/647: dwrite d1/dc/d25/d4c/d9b/d9a/fab [0,4194304] 0 2023-12-05T13:26:50.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/648: write d1/dc/f89 [4150759,85805] 0 2023-12-05T13:26:50.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/649: write d1/dc/d10/d1e/fce [1006724,113705] 0 2023-12-05T13:26:50.712 INFO:tasks.workunit.client.0.smithi029.stdout:9/925: unlink d7/d19/d28/fd2 0 2023-12-05T13:26:50.721 INFO:tasks.workunit.client.0.smithi029.stdout:3/858: rename d1/d16/d36/d3a/d6c/d7d to d1/d10/d91/d112 0 2023-12-05T13:26:50.722 INFO:tasks.workunit.client.0.smithi029.stdout:3/859: write d1/d16/d9c/feb [918582,26842] 0 2023-12-05T13:26:50.727 INFO:tasks.workunit.client.0.smithi029.stdout:0/772: dwrite dc/d23/d3a/d41/f54 [0,4194304] 0 2023-12-05T13:26:50.729 INFO:tasks.workunit.client.0.smithi029.stdout:0/773: link dc/d23/d3a/f71 dc/d33/d3d/d65/d85/ffc 0 2023-12-05T13:26:50.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/650: dwrite d1/dc/d10/d1e/d75/fc3 [0,4194304] 0 2023-12-05T13:26:50.731 INFO:tasks.workunit.client.0.smithi029.stdout:5/651: write d1/dc/d38/d3a/d5c/f69 [127907,130373] 0 2023-12-05T13:26:50.733 INFO:tasks.workunit.client.0.smithi029.stdout:0/774: dread dc/d23/f6f [0,4194304] 0 2023-12-05T13:26:50.735 INFO:tasks.workunit.client.0.smithi029.stdout:5/652: creat d1/dc/d10/d1e/d75/d7f/fdc x:0 0 0 2023-12-05T13:26:50.736 INFO:tasks.workunit.client.0.smithi029.stdout:0/775: symlink dc/d33/d3d/d65/d85/lfd 0 2023-12-05T13:26:50.739 INFO:tasks.workunit.client.0.smithi029.stdout:5/653: symlink d1/dc/d10/d1e/d33/d93/da5/ldd 0 2023-12-05T13:26:50.739 INFO:tasks.workunit.client.0.smithi029.stdout:5/654: fsync d1/dc/d38/f6c 0 2023-12-05T13:26:50.747 INFO:tasks.workunit.client.0.smithi029.stdout:3/860: dwrite d1/d16/d36/d3a/d6c/f8f [0,4194304] 0 2023-12-05T13:26:50.748 INFO:tasks.workunit.client.0.smithi029.stdout:3/861: chown d1/d16/d36/dec/ffa 0 1 2023-12-05T13:26:50.749 INFO:tasks.workunit.client.0.smithi029.stdout:3/862: link d1/d16/d36/d3a/cdf d1/d10/c113 0 2023-12-05T13:26:50.750 INFO:tasks.workunit.client.0.smithi029.stdout:3/863: symlink d1/d16/d1f/de6/l114 0 2023-12-05T13:26:50.750 INFO:tasks.workunit.client.0.smithi029.stdout:3/864: chown d1/d10/d91/f96 6784129 1 2023-12-05T13:26:50.756 INFO:tasks.workunit.client.0.smithi029.stdout:0/776: dwrite dc/d13/d4f/d91/fc3 [0,4194304] 0 2023-12-05T13:26:50.756 INFO:tasks.workunit.client.0.smithi029.stdout:0/777: chown dc/d23/d3a/d41/fe9 6378284 1 2023-12-05T13:26:50.757 INFO:tasks.workunit.client.0.smithi029.stdout:0/778: mkdir dc/d33/d3d/d7a/d84/dfe 0 2023-12-05T13:26:50.759 INFO:tasks.workunit.client.0.smithi029.stdout:0/779: write dc/f80 [1829703,38465] 0 2023-12-05T13:26:50.760 INFO:tasks.workunit.client.0.smithi029.stdout:0/780: mknod dc/d33/d3d/d65/d85/dfa/cff 0 2023-12-05T13:26:50.761 INFO:tasks.workunit.client.0.smithi029.stdout:0/781: dread dc/d23/d3a/d41/d70/f81 [0,4194304] 0 2023-12-05T13:26:50.770 INFO:tasks.workunit.client.0.smithi029.stdout:5/655: dwrite d1/dc/d10/fda [0,4194304] 0 2023-12-05T13:26:50.771 INFO:tasks.workunit.client.0.smithi029.stdout:3/865: dwrite d1/d16/d36/dec/f58 [0,4194304] 0 2023-12-05T13:26:50.775 INFO:tasks.workunit.client.0.smithi029.stdout:3/866: symlink d1/db3/dc7/l115 0 2023-12-05T13:26:50.777 INFO:tasks.workunit.client.0.smithi029.stdout:3/867: mknod d1/d10/d91/c116 0 2023-12-05T13:26:50.778 INFO:tasks.workunit.client.0.smithi029.stdout:3/868: creat d1/d16/f117 x:0 0 0 2023-12-05T13:26:50.781 INFO:tasks.workunit.client.0.smithi029.stdout:0/782: dwrite dc/d33/d3d/d7a/d84/dde/ff8 [0,4194304] 0 2023-12-05T13:26:50.783 INFO:tasks.workunit.client.0.smithi029.stdout:5/656: dwrite d1/dc/d38/f6c [4194304,4194304] 0 2023-12-05T13:26:50.786 INFO:tasks.workunit.client.0.smithi029.stdout:5/657: rename d1/dc/d11/d17/d3d/f58 to d1/dc/d10/d1e/d33/d93/da5/db2/fde 0 2023-12-05T13:26:50.787 INFO:tasks.workunit.client.0.smithi029.stdout:0/783: mknod dc/d23/d3a/d41/d57/d58/d73/c100 0 2023-12-05T13:26:50.788 INFO:tasks.workunit.client.0.smithi029.stdout:5/658: creat d1/dc/d25/d4c/d9b/fdf x:0 0 0 2023-12-05T13:26:50.789 INFO:tasks.workunit.client.0.smithi029.stdout:0/784: symlink dc/d13/l101 0 2023-12-05T13:26:50.789 INFO:tasks.workunit.client.0.smithi029.stdout:0/785: dread - dc/d33/d3d/d7a/d84/dde/ff5 zero size 2023-12-05T13:26:50.790 INFO:tasks.workunit.client.0.smithi029.stdout:0/786: write dc/d33/d3d/d7a/d84/dde/ff8 [4911311,57505] 0 2023-12-05T13:26:50.792 INFO:tasks.workunit.client.0.smithi029.stdout:5/659: write d1/dc/d25/f5e [1088588,118026] 0 2023-12-05T13:26:50.795 INFO:tasks.workunit.client.0.smithi029.stdout:5/660: creat d1/dc/d10/d1e/d33/d93/da5/db2/da6/fe0 x:0 0 0 2023-12-05T13:26:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:5/661: truncate d1/dc/d10/d1e/d75/d7f/fdc 818913 0 2023-12-05T13:26:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:5/662: chown d1/dc/d10/l31 1939 1 2023-12-05T13:26:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:5/663: write d1/dc/d25/d4c/d9b/d9a/fd0 [189979,103207] 0 2023-12-05T13:26:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:5/664: write d1/dc/d10/d1e/d33/d93/da5/db2/fde [4704388,75219] 0 2023-12-05T13:26:50.796 INFO:tasks.workunit.client.0.smithi029.stdout:3/869: dwrite d1/db3/fe8 [0,4194304] 0 2023-12-05T13:26:50.797 INFO:tasks.workunit.client.0.smithi029.stdout:5/665: unlink d1/dc/d10/d1e/f65 0 2023-12-05T13:26:50.801 INFO:tasks.workunit.client.0.smithi029.stdout:0/787: dread dc/d33/d3d/d7a/d84/fcf [0,4194304] 0 2023-12-05T13:26:50.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/666: dwrite d1/dc/d10/d1e/d33/d93/da5/db2/f4f [0,4194304] 0 2023-12-05T13:26:50.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/667: chown d1/dc/d10/d1e/d75/d7f/d8a/ca2 0 1 2023-12-05T13:26:50.819 INFO:tasks.workunit.client.0.smithi029.stdout:3/870: dwrite d1/d16/d36/dec/daf/fcc [0,4194304] 0 2023-12-05T13:26:50.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/668: mknod d1/dc/d38/ce1 0 2023-12-05T13:26:50.821 INFO:tasks.workunit.client.0.smithi029.stdout:5/669: write d1/dc/f89 [811075,13176] 0 2023-12-05T13:26:50.822 INFO:tasks.workunit.client.0.smithi029.stdout:3/871: symlink d1/d6/d11/da3/l118 0 2023-12-05T13:26:50.823 INFO:tasks.workunit.client.0.smithi029.stdout:5/670: dread d1/dc/d25/d4c/d9b/d9a/fd0 [0,4194304] 0 2023-12-05T13:26:50.824 INFO:tasks.workunit.client.0.smithi029.stdout:3/872: creat d1/d5e/d74/f119 x:0 0 0 2023-12-05T13:26:50.825 INFO:tasks.workunit.client.0.smithi029.stdout:3/873: write d1/d16/d1f/d4c/f79 [1920789,11503] 0 2023-12-05T13:26:50.825 INFO:tasks.workunit.client.0.smithi029.stdout:3/874: readlink d1/d10/d91/l70 0 2023-12-05T13:26:50.827 INFO:tasks.workunit.client.0.smithi029.stdout:3/875: mknod d1/d6/d11/d105/c11a 0 2023-12-05T13:26:50.834 INFO:tasks.workunit.client.0.smithi029.stdout:5/671: dread d1/dc/d38/d55/f96 [0,4194304] 0 2023-12-05T13:26:50.834 INFO:tasks.workunit.client.0.smithi029.stdout:5/672: read - d1/dc/d38/d55/f6e zero size 2023-12-05T13:26:50.836 INFO:tasks.workunit.client.0.smithi029.stdout:5/673: getdents d1/dc/d11/d17/d3d 0 2023-12-05T13:26:50.837 INFO:tasks.workunit.client.0.smithi029.stdout:5/674: write d1/dc/d38/d3a/d5c/d87/fb8 [188247,8366] 0 2023-12-05T13:26:50.837 INFO:tasks.workunit.client.0.smithi029.stdout:5/675: write d1/dc/d10/d1e/d33/d93/da5/db2/da6/fe0 [681737,88337] 0 2023-12-05T13:26:50.837 INFO:tasks.workunit.client.0.smithi029.stdout:5/676: chown d1/lbf 0 1 2023-12-05T13:26:50.838 INFO:tasks.workunit.client.0.smithi029.stdout:5/677: write d1/dc/d25/d4c/f7e [3291945,117393] 0 2023-12-05T13:26:50.840 INFO:tasks.workunit.client.0.smithi029.stdout:5/678: mknod d1/dc/d25/ce2 0 2023-12-05T13:26:50.840 INFO:tasks.workunit.client.0.smithi029.stdout:5/679: chown d1/dc/d38/d55/f6e 0 1 2023-12-05T13:26:50.841 INFO:tasks.workunit.client.0.smithi029.stdout:5/680: dread - d1/dc/d38/d55/f6e zero size 2023-12-05T13:26:50.841 INFO:tasks.workunit.client.0.smithi029.stdout:3/876: dwrite d1/d10/f71 [4194304,4194304] 0 2023-12-05T13:26:50.841 INFO:tasks.workunit.client.0.smithi029.stdout:5/681: creat d1/dc/d10/d1e/d33/d93/da5/db2/fe3 x:0 0 0 2023-12-05T13:26:50.843 INFO:tasks.workunit.client.0.smithi029.stdout:3/877: mkdir d1/d16/d1f/d4c/d11b 0 2023-12-05T13:26:50.844 INFO:tasks.workunit.client.0.smithi029.stdout:3/878: chown d1/d10/d91/d112/d95/la4 4586 1 2023-12-05T13:26:50.846 INFO:tasks.workunit.client.0.smithi029.stdout:3/879: truncate d1/fb0 876404 0 2023-12-05T13:26:50.846 INFO:tasks.workunit.client.0.smithi029.stdout:3/880: rmdir d1/d6/d11/da3 39 2023-12-05T13:26:50.847 INFO:tasks.workunit.client.0.smithi029.stdout:3/881: chown d1/d18/f38 4 1 2023-12-05T13:26:50.847 INFO:tasks.workunit.client.0.smithi029.stdout:3/882: write d1/d16/d1f/d4c/dae/fea [54758,77536] 0 2023-12-05T13:26:50.849 INFO:tasks.workunit.client.0.smithi029.stdout:3/883: creat d1/d16/d9c/dfc/f11c x:0 0 0 2023-12-05T13:26:50.860 INFO:tasks.workunit.client.0.smithi029.stdout:5/682: dwrite d1/dc/d38/d3a/d5c/d87/f91 [0,4194304] 0 2023-12-05T13:26:50.862 INFO:tasks.workunit.client.0.smithi029.stdout:5/683: rename d1/dc/d38/d3a/d5c/d87/la7 to d1/dc/d11/d17/d3d/le4 0 2023-12-05T13:26:51.047 INFO:tasks.workunit.client.0.smithi029.stdout:8/979: sync 2023-12-05T13:26:51.047 INFO:tasks.workunit.client.0.smithi029.stdout:1/838: sync 2023-12-05T13:26:51.047 INFO:tasks.workunit.client.0.smithi029.stdout:1/839: fsync d7/d5e/f95 0 2023-12-05T13:26:51.048 INFO:tasks.workunit.client.0.smithi029.stdout:1/840: mkdir d7/d5e/d52/d5f/d48/d10f 0 2023-12-05T13:26:51.050 INFO:tasks.workunit.client.0.smithi029.stdout:8/980: mknod d5/dbc/d53/c145 0 2023-12-05T13:26:51.058 INFO:tasks.workunit.client.0.smithi029.stdout:8/981: dread d5/d6/d59/fad [0,4194304] 0 2023-12-05T13:26:51.060 INFO:tasks.workunit.client.0.smithi029.stdout:8/982: symlink d5/l146 0 2023-12-05T13:26:51.062 INFO:tasks.workunit.client.0.smithi029.stdout:8/983: rename d5/dc/d18/d26/f94 to d5/d6/d10/d8a/f147 0 2023-12-05T13:26:51.062 INFO:tasks.workunit.client.0.smithi029.stdout:8/984: write d5/dbc/f91 [557902,99133] 0 2023-12-05T13:26:51.063 INFO:tasks.workunit.client.0.smithi029.stdout:8/985: mknod d5/dbc/c148 0 2023-12-05T13:26:51.063 INFO:tasks.workunit.client.0.smithi029.stdout:8/986: chown d5/dc/d18/dc8/l10a 4 1 2023-12-05T13:26:51.068 INFO:tasks.workunit.client.0.smithi029.stdout:1/841: dwrite d7/d5e/d52/d5f/d12/f44 [0,4194304] 0 2023-12-05T13:26:51.072 INFO:tasks.workunit.client.0.smithi029.stdout:1/842: creat d7/d5e/d52/d90/f110 x:0 0 0 2023-12-05T13:26:51.073 INFO:tasks.workunit.client.0.smithi029.stdout:1/843: mknod d7/d5e/c111 0 2023-12-05T13:26:51.075 INFO:tasks.workunit.client.0.smithi029.stdout:1/844: mknod d7/d56/da8/c112 0 2023-12-05T13:26:51.077 INFO:tasks.workunit.client.0.smithi029.stdout:1/845: dread d7/d5e/d52/d5f/d48/fde [0,4194304] 0 2023-12-05T13:26:51.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/846: creat d7/d5b/f113 x:0 0 0 2023-12-05T13:26:51.078 INFO:tasks.workunit.client.0.smithi029.stdout:1/847: stat d7/d6e/da9/d4b/c9e 0 2023-12-05T13:26:51.096 INFO:tasks.workunit.client.0.smithi029.stdout:1/848: dwrite d7/d61/d77/f105 [0,4194304] 0 2023-12-05T13:26:51.097 INFO:tasks.workunit.client.0.smithi029.stdout:1/849: write d7/d61/d77/fbd [1463398,67450] 0 2023-12-05T13:26:51.098 INFO:tasks.workunit.client.0.smithi029.stdout:1/850: truncate d7/d5e/d52/d5f/d12/f93 830131 0 2023-12-05T13:26:51.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/851: creat d7/d5e/d52/d90/f114 x:0 0 0 2023-12-05T13:26:51.099 INFO:tasks.workunit.client.0.smithi029.stdout:1/852: fdatasync d7/d6e/da9/f3c 0 2023-12-05T13:26:51.115 INFO:tasks.workunit.client.0.smithi029.stdout:1/853: dwrite d7/d61/f7e [0,4194304] 0 2023-12-05T13:26:51.119 INFO:tasks.workunit.client.0.smithi029.stdout:1/854: dread d7/d61/d4f/fe0 [0,4194304] 0 2023-12-05T13:26:51.119 INFO:tasks.workunit.client.0.smithi029.stdout:1/855: truncate d7/f13 1499045 0 2023-12-05T13:26:51.119 INFO:tasks.workunit.client.0.smithi029.stdout:1/856: unlink d7/d6e/da9/d4b/db1/dd1/fe5 0 2023-12-05T13:26:51.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/857: chown d7/d6e/da9/d4b/d72/f80 14299 1 2023-12-05T13:26:51.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/858: truncate d7/d5e/d52/d5f/d12/f46 5214337 0 2023-12-05T13:26:51.120 INFO:tasks.workunit.client.0.smithi029.stdout:1/859: mknod d7/d6e/da9/d4b/db1/c115 0 2023-12-05T13:26:51.129 INFO:tasks.workunit.client.0.smithi029.stdout:1/860: dread d7/d5e/d52/d5f/d12/f44 [0,4194304] 0 2023-12-05T13:26:51.130 INFO:tasks.workunit.client.0.smithi029.stdout:1/861: fdatasync d7/d5e/d52/d5f/d48/fde 0 2023-12-05T13:26:51.132 INFO:tasks.workunit.client.0.smithi029.stdout:1/862: dread d7/d5e/d52/d5f/f6f [0,4194304] 0 2023-12-05T13:26:51.146 INFO:tasks.workunit.client.0.smithi029.stdout:1/863: dwrite d7/d61/d77/d9f/ffa [0,4194304] 0 2023-12-05T13:26:51.155 INFO:tasks.workunit.client.0.smithi029.stdout:1/864: dread d7/f4d [0,4194304] 0 2023-12-05T13:26:51.156 INFO:tasks.workunit.client.0.smithi029.stdout:1/865: mkdir d7/d5e/d52/d5f/d12/d60/df6/d116 0 2023-12-05T13:26:51.159 INFO:tasks.workunit.client.0.smithi029.stdout:1/866: rename d7/d61/d4f/f54 to d7/d6e/da9/f117 0 2023-12-05T13:26:51.159 INFO:tasks.workunit.client.0.smithi029.stdout:1/867: write d7/fee [369894,108206] 0 2023-12-05T13:26:51.159 INFO:tasks.workunit.client.0.smithi029.stdout:1/868: truncate d7/d5b/fef 554786 0 2023-12-05T13:26:51.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/869: creat d7/d5e/d52/d5f/d12/d60/df6/d116/f118 x:0 0 0 2023-12-05T13:26:51.161 INFO:tasks.workunit.client.0.smithi029.stdout:1/870: chown d7/d5e/f50 142618138 1 2023-12-05T13:26:51.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/871: dwrite d7/d5e/f5a [0,4194304] 0 2023-12-05T13:26:51.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/872: readlink d7/d6e/da9/d4b/l82 0 2023-12-05T13:26:51.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/873: chown d7/d5e/d52/d90/f96 212904 1 2023-12-05T13:26:51.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/874: stat d7/d61/df3 0 2023-12-05T13:26:51.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/875: write d7/d61/dfb/f102 [1183708,101556] 0 2023-12-05T13:26:51.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/876: fsync d7/fb 0 2023-12-05T13:26:51.184 INFO:tasks.workunit.client.0.smithi029.stdout:1/877: dread d7/d6e/da9/d4b/d72/f83 [0,4194304] 0 2023-12-05T13:26:51.184 INFO:tasks.workunit.client.0.smithi029.stdout:1/878: chown d7/d6e/da9/d4b/d72/f9d 3492421 1 2023-12-05T13:26:51.196 INFO:tasks.workunit.client.0.smithi029.stdout:1/879: dwrite d7/d5e/d52/d5f/d48/fe1 [0,4194304] 0 2023-12-05T13:26:51.196 INFO:tasks.workunit.client.0.smithi029.stdout:1/880: readlink d7/d6e/da9/d4b/d72/ld4 0 2023-12-05T13:26:51.213 INFO:tasks.workunit.client.0.smithi029.stdout:1/881: dwrite d7/d5e/f5a [0,4194304] 0 2023-12-05T13:26:51.214 INFO:tasks.workunit.client.0.smithi029.stdout:1/882: dread d7/d61/f39 [0,4194304] 0 2023-12-05T13:26:51.215 INFO:tasks.workunit.client.0.smithi029.stdout:1/883: unlink d7/d6e/da9/d4b/l70 0 2023-12-05T13:26:51.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:50 smithi029 ceph-mon[112128]: pgmap v47: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 43 MiB/s wr, 79 op/s 2023-12-05T13:26:51.384 INFO:tasks.workunit.client.0.smithi029.stdout:7/874: sync 2023-12-05T13:26:51.384 INFO:tasks.workunit.client.0.smithi029.stdout:4/662: sync 2023-12-05T13:26:51.384 INFO:tasks.workunit.client.0.smithi029.stdout:4/663: fdatasync d0/d16/f4a 0 2023-12-05T13:26:51.385 INFO:tasks.workunit.client.0.smithi029.stdout:7/875: creat d6/d50/d5b/d1a/d26/dc9/f114 x:0 0 0 2023-12-05T13:26:51.386 INFO:tasks.workunit.client.0.smithi029.stdout:7/876: write d6/d50/d5b/d1a/d26/ff5 [565503,78013] 0 2023-12-05T13:26:51.389 INFO:tasks.workunit.client.0.smithi029.stdout:7/877: dread d6/f13 [4194304,4194304] 0 2023-12-05T13:26:51.390 INFO:tasks.workunit.client.0.smithi029.stdout:7/878: fdatasync d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/fe3 0 2023-12-05T13:26:51.391 INFO:tasks.workunit.client.0.smithi029.stdout:7/879: creat d6/d100/d2f/f115 x:0 0 0 2023-12-05T13:26:51.402 INFO:tasks.workunit.client.0.smithi029.stdout:4/664: dwrite d0/d16/d22/d4f/f5c [4194304,4194304] 0 2023-12-05T13:26:51.405 INFO:tasks.workunit.client.0.smithi029.stdout:4/665: mkdir d0/d16/d22/dda 0 2023-12-05T13:26:51.407 INFO:tasks.workunit.client.0.smithi029.stdout:4/666: write d0/de/d15/f49 [4879920,94084] 0 2023-12-05T13:26:51.408 INFO:tasks.workunit.client.0.smithi029.stdout:7/880: dwrite d6/f63 [0,4194304] 0 2023-12-05T13:26:51.409 INFO:tasks.workunit.client.0.smithi029.stdout:4/667: rename d0/d16/d22/d5f/f96 to d0/d16/d2f/d69/fdb 0 2023-12-05T13:26:51.411 INFO:tasks.workunit.client.0.smithi029.stdout:7/881: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/f116 x:0 0 0 2023-12-05T13:26:51.412 INFO:tasks.workunit.client.0.smithi029.stdout:4/668: creat d0/d16/d2f/fdc x:0 0 0 2023-12-05T13:26:51.413 INFO:tasks.workunit.client.0.smithi029.stdout:7/882: mknod d6/d50/d5b/d5f/c117 0 2023-12-05T13:26:51.418 INFO:tasks.workunit.client.0.smithi029.stdout:4/669: mknod d0/d16/d22/d5f/cdd 0 2023-12-05T13:26:51.418 INFO:tasks.workunit.client.0.smithi029.stdout:4/670: dread - d0/d3c/d85/db7/fc7 zero size 2023-12-05T13:26:51.418 INFO:tasks.workunit.client.0.smithi029.stdout:7/883: truncate d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d3e/fa8 291340 0 2023-12-05T13:26:51.418 INFO:tasks.workunit.client.0.smithi029.stdout:4/671: rename d0/de/d30/d94/fb3 to d0/d3c/d85/fde 0 2023-12-05T13:26:51.420 INFO:tasks.workunit.client.0.smithi029.stdout:4/672: read d0/da/f1b [3273776,10729] 0 2023-12-05T13:26:51.420 INFO:tasks.workunit.client.0.smithi029.stdout:7/884: mknod d6/d100/d66/c118 0 2023-12-05T13:26:51.420 INFO:tasks.workunit.client.0.smithi029.stdout:4/673: write d0/de/f45 [1746306,46963] 0 2023-12-05T13:26:51.420 INFO:tasks.workunit.client.0.smithi029.stdout:4/674: chown d0/d3c/d85/db7/fc7 23581044 1 2023-12-05T13:26:51.424 INFO:tasks.workunit.client.0.smithi029.stdout:4/675: mkdir d0/de/d30/d32/ddf 0 2023-12-05T13:26:51.428 INFO:tasks.workunit.client.0.smithi029.stdout:7/885: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d3e to d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/d119 0 2023-12-05T13:26:51.432 INFO:tasks.workunit.client.0.smithi029.stdout:4/676: dread d0/d1/f51 [0,4194304] 0 2023-12-05T13:26:51.435 INFO:tasks.workunit.client.0.smithi029.stdout:4/677: rename d0/de/d15/f99 to d0/de/d30/d32/d35/d3d/d92/da6/fe0 0 2023-12-05T13:26:51.435 INFO:tasks.workunit.client.0.smithi029.stdout:4/678: write d0/de/d30/d32/fb8 [939729,51328] 0 2023-12-05T13:26:51.437 INFO:tasks.workunit.client.0.smithi029.stdout:4/679: mknod d0/de/d15/dc0/ce1 0 2023-12-05T13:26:51.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/886: dread d6/d50/d5b/d1a/d26/f2b [0,4194304] 0 2023-12-05T13:26:51.437 INFO:tasks.workunit.client.0.smithi029.stdout:7/887: chown d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/ff4 10 1 2023-12-05T13:26:51.440 INFO:tasks.workunit.client.0.smithi029.stdout:7/888: dread d6/d50/d5b/d1a/d26/d72/f76 [0,4194304] 0 2023-12-05T13:26:51.441 INFO:tasks.workunit.client.0.smithi029.stdout:7/889: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/de0/f11a x:0 0 0 2023-12-05T13:26:51.441 INFO:tasks.workunit.client.0.smithi029.stdout:7/890: chown d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/de0/f103 56698 1 2023-12-05T13:26:51.449 INFO:tasks.workunit.client.0.smithi029.stdout:7/891: dread d6/d50/d5b/f4e [0,4194304] 0 2023-12-05T13:26:51.451 INFO:tasks.workunit.client.0.smithi029.stdout:7/892: creat d6/d100/d7e/d7b/f11b x:0 0 0 2023-12-05T13:26:51.453 INFO:tasks.workunit.client.0.smithi029.stdout:7/893: getdents d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a 0 2023-12-05T13:26:51.455 INFO:tasks.workunit.client.0.smithi029.stdout:7/894: dread d6/d100/d4f/dc5/d52/fa5 [0,4194304] 0 2023-12-05T13:26:51.455 INFO:tasks.workunit.client.0.smithi029.stdout:7/895: readlink d6/d50/d5b/d5f/d7d/d96/lc0 0 2023-12-05T13:26:51.457 INFO:tasks.workunit.client.0.smithi029.stdout:4/680: dwrite d0/d16/d22/f9e [0,4194304] 0 2023-12-05T13:26:51.457 INFO:tasks.workunit.client.0.smithi029.stdout:7/896: rename d6/d100/d71 to d6/d50/d5b/d1a/d26/d11c 0 2023-12-05T13:26:51.459 INFO:tasks.workunit.client.0.smithi029.stdout:4/681: rmdir d0/de/d15 39 2023-12-05T13:26:51.461 INFO:tasks.workunit.client.0.smithi029.stdout:7/897: rename l5 to d6/d100/d4f/dc5/d52/l11d 0 2023-12-05T13:26:51.465 INFO:tasks.workunit.client.0.smithi029.stdout:7/898: link d6/d50/c3a d6/d50/d5b/d1a/d26/dc9/c11e 0 2023-12-05T13:26:51.466 INFO:tasks.workunit.client.0.smithi029.stdout:4/682: mknod d0/ce2 0 2023-12-05T13:26:51.471 INFO:tasks.workunit.client.0.smithi029.stdout:4/683: creat d0/d16/d22/d5f/d79/dcf/fe3 x:0 0 0 2023-12-05T13:26:51.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:50 smithi052 ceph-mon[121072]: pgmap v47: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 43 MiB/s wr, 79 op/s 2023-12-05T13:26:51.473 INFO:tasks.workunit.client.0.smithi029.stdout:4/684: symlink d0/de/d30/d94/le4 0 2023-12-05T13:26:51.477 INFO:tasks.workunit.client.0.smithi029.stdout:4/685: dread d0/d16/d22/f61 [0,4194304] 0 2023-12-05T13:26:51.477 INFO:tasks.workunit.client.0.smithi029.stdout:4/686: fdatasync d0/d3c/d56/fbc 0 2023-12-05T13:26:51.477 INFO:tasks.workunit.client.0.smithi029.stdout:4/687: write d0/d3c/d85/fde [531815,2163] 0 2023-12-05T13:26:51.483 INFO:tasks.workunit.client.0.smithi029.stdout:4/688: dread d0/f1d [0,4194304] 0 2023-12-05T13:26:51.484 INFO:tasks.workunit.client.0.smithi029.stdout:4/689: write d0/d16/d22/fb4 [1383351,53371] 0 2023-12-05T13:26:51.486 INFO:tasks.workunit.client.0.smithi029.stdout:4/690: creat d0/d16/d2f/d69/d77/fe5 x:0 0 0 2023-12-05T13:26:51.490 INFO:tasks.workunit.client.0.smithi029.stdout:2/771: sync 2023-12-05T13:26:51.491 INFO:tasks.workunit.client.0.smithi029.stdout:6/912: sync 2023-12-05T13:26:51.492 INFO:tasks.workunit.client.0.smithi029.stdout:2/772: mknod de/d16/d6c/d8e/dbf/cf4 0 2023-12-05T13:26:51.492 INFO:tasks.workunit.client.0.smithi029.stdout:2/773: readlink de/d14/d24/d93/ld6 0 2023-12-05T13:26:51.493 INFO:tasks.workunit.client.0.smithi029.stdout:7/899: dwrite d6/d100/d4f/dc5/f42 [0,4194304] 0 2023-12-05T13:26:51.496 INFO:tasks.workunit.client.0.smithi029.stdout:6/913: mkdir d6/d29/dc4/d40/d74/d52/d5c/d139 0 2023-12-05T13:26:51.496 INFO:tasks.workunit.client.0.smithi029.stdout:6/914: fsync d6/d29/dc4/d40/d74/d52/d5c/f11b 0 2023-12-05T13:26:51.498 INFO:tasks.workunit.client.0.smithi029.stdout:2/774: creat de/d11/d32/ff5 x:0 0 0 2023-12-05T13:26:51.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/775: fdatasync de/d14/d24/f73 0 2023-12-05T13:26:51.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/776: fdatasync de/d16/f2c 0 2023-12-05T13:26:51.499 INFO:tasks.workunit.client.0.smithi029.stdout:2/777: fsync de/d16/d43/fa5 0 2023-12-05T13:26:51.499 INFO:tasks.workunit.client.0.smithi029.stdout:7/900: creat d6/d50/d5b/d5f/d7d/d97/f11f x:0 0 0 2023-12-05T13:26:51.501 INFO:tasks.workunit.client.0.smithi029.stdout:6/915: mkdir d6/d29/dc4/d40/d4d/d13a 0 2023-12-05T13:26:51.504 INFO:tasks.workunit.client.0.smithi029.stdout:2/778: link de/d16/d4c/l5d de/d14/d24/db7/df3/lf6 0 2023-12-05T13:26:51.506 INFO:tasks.workunit.client.0.smithi029.stdout:7/901: rmdir d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/db8 0 2023-12-05T13:26:51.507 INFO:tasks.workunit.client.0.smithi029.stdout:7/902: read d6/d100/d4f/dc5/f42 [2239383,84543] 0 2023-12-05T13:26:51.507 INFO:tasks.workunit.client.0.smithi029.stdout:7/903: chown d6/l49 180715834 1 2023-12-05T13:26:51.507 INFO:tasks.workunit.client.0.smithi029.stdout:4/691: dwrite d0/d16/d22/d5f/f91 [0,4194304] 0 2023-12-05T13:26:51.507 INFO:tasks.workunit.client.0.smithi029.stdout:6/916: creat d6/d29/dc4/d40/f13b x:0 0 0 2023-12-05T13:26:51.507 INFO:tasks.workunit.client.0.smithi029.stdout:6/917: read d6/d29/dc4/d40/db5/fe6 [2557277,69155] 0 2023-12-05T13:26:51.507 INFO:tasks.workunit.client.0.smithi029.stdout:2/779: symlink de/d16/d6c/d8e/lf7 0 2023-12-05T13:26:51.509 INFO:tasks.workunit.client.0.smithi029.stdout:6/918: dread d6/d29/dc4/d40/d74/d52/d5c/fa6 [0,4194304] 0 2023-12-05T13:26:51.509 INFO:tasks.workunit.client.0.smithi029.stdout:6/919: readlink d6/d29/dc4/d40/l73 0 2023-12-05T13:26:51.509 INFO:tasks.workunit.client.0.smithi029.stdout:6/920: truncate d6/d29/dc4/d40/d74/d52/d5c/fa6 376735 0 2023-12-05T13:26:51.510 INFO:tasks.workunit.client.0.smithi029.stdout:7/904: rmdir d6/d50/d5b/d5f/d7d/d97/d73 39 2023-12-05T13:26:51.512 INFO:tasks.workunit.client.0.smithi029.stdout:4/692: creat d0/d3c/fe6 x:0 0 0 2023-12-05T13:26:51.513 INFO:tasks.workunit.client.0.smithi029.stdout:2/780: creat de/d14/ddf/ff8 x:0 0 0 2023-12-05T13:26:51.514 INFO:tasks.workunit.client.0.smithi029.stdout:2/781: write de/d6a/fb3 [3065559,17950] 0 2023-12-05T13:26:51.514 INFO:tasks.workunit.client.0.smithi029.stdout:6/921: creat d6/d29/dc4/d40/d4d/d8f/de0/f13c x:0 0 0 2023-12-05T13:26:51.515 INFO:tasks.workunit.client.0.smithi029.stdout:6/922: read d6/d3f/db7/def/f102 [714312,37945] 0 2023-12-05T13:26:51.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/905: creat d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/f120 x:0 0 0 2023-12-05T13:26:51.516 INFO:tasks.workunit.client.0.smithi029.stdout:7/906: readlink d6/d100/d4f/dc5/d52/l11d 0 2023-12-05T13:26:51.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/693: rmdir d0/d16/d22/d5f/d79 39 2023-12-05T13:26:51.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/694: write d0/da/f73 [1892132,79187] 0 2023-12-05T13:26:51.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/695: truncate d0/d16/d2f/d69/d77/fa3 324966 0 2023-12-05T13:26:51.517 INFO:tasks.workunit.client.0.smithi029.stdout:4/696: write d0/d16/d22/dc2/fc4 [83056,114591] 0 2023-12-05T13:26:51.521 INFO:tasks.workunit.client.0.smithi029.stdout:2/782: symlink de/db8/lf9 0 2023-12-05T13:26:51.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/923: creat d6/d29/d60/f13d x:0 0 0 2023-12-05T13:26:51.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/924: chown d6/d1d/d36/fc3 9 1 2023-12-05T13:26:51.522 INFO:tasks.workunit.client.0.smithi029.stdout:6/925: write d6/d29/dc4/d40/d74/d59/f108 [903311,86302] 0 2023-12-05T13:26:51.522 INFO:tasks.workunit.client.0.smithi029.stdout:7/907: rmdir d6/d50/d5b/d5f/d7d/d97/d4a/d4b/dde 39 2023-12-05T13:26:51.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/783: mknod de/d14/d24/d93/cfa 0 2023-12-05T13:26:51.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/784: chown de/d41/d56/d58/l63 175 1 2023-12-05T13:26:51.524 INFO:tasks.workunit.client.0.smithi029.stdout:2/785: fsync de/d11/f25 0 2023-12-05T13:26:51.526 INFO:tasks.workunit.client.0.smithi029.stdout:2/786: unlink de/f5b 0 2023-12-05T13:26:51.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/787: creat de/d11/ffb x:0 0 0 2023-12-05T13:26:51.529 INFO:tasks.workunit.client.0.smithi029.stdout:2/788: readlink de/db8/lf9 0 2023-12-05T13:26:51.532 INFO:tasks.workunit.client.0.smithi029.stdout:4/697: dwrite d0/de/d30/d32/d35/f58 [0,4194304] 0 2023-12-05T13:26:51.533 INFO:tasks.workunit.client.0.smithi029.stdout:6/926: rename d6/d29/dc4/d40/d4d to d6/d1d/d39/d58/d13e 0 2023-12-05T13:26:51.534 INFO:tasks.workunit.client.0.smithi029.stdout:6/927: chown d6/d1d/d39/d58/d13e/d7f/f12a 6265 1 2023-12-05T13:26:51.536 INFO:tasks.workunit.client.0.smithi029.stdout:4/698: write d0/de/d30/d32/d35/d3d/f5a [1263690,123529] 0 2023-12-05T13:26:51.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/789: rename de/d11/d32/l9e to de/d16/d6c/d8e/lfc 0 2023-12-05T13:26:51.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/790: fsync de/d6a/fa7 0 2023-12-05T13:26:51.540 INFO:tasks.workunit.client.0.smithi029.stdout:4/699: fdatasync d0/de/d30/d32/fb8 0 2023-12-05T13:26:51.540 INFO:tasks.workunit.client.0.smithi029.stdout:4/700: chown d0/d16/d22/d98/fba 82842705 1 2023-12-05T13:26:51.541 INFO:tasks.workunit.client.0.smithi029.stdout:6/928: dread d6/fa [0,4194304] 0 2023-12-05T13:26:51.541 INFO:tasks.workunit.client.0.smithi029.stdout:7/908: truncate d6/f63 4014176 0 2023-12-05T13:26:51.545 INFO:tasks.workunit.client.0.smithi029.stdout:6/929: creat d6/d29/d60/f13f x:0 0 0 2023-12-05T13:26:51.545 INFO:tasks.workunit.client.0.smithi029.stdout:6/930: chown d6/ce4 111414 1 2023-12-05T13:26:51.547 INFO:tasks.workunit.client.0.smithi029.stdout:7/909: mkdir d6/d50/d5b/d5f/d7d/d97/d4a/d4b/d121 0 2023-12-05T13:26:51.548 INFO:tasks.workunit.client.0.smithi029.stdout:4/701: rename d0/de/d30/d32/d35/d3d/cc6 to d0/de/d15/ce7 0 2023-12-05T13:26:51.549 INFO:tasks.workunit.client.0.smithi029.stdout:4/702: read d0/de/d30/d32/fa5 [463779,50572] 0 2023-12-05T13:26:51.553 INFO:tasks.workunit.client.0.smithi029.stdout:6/931: mkdir d6/d29/dc4/d40/d74/d59/dfb/d138/d140 0 2023-12-05T13:26:51.556 INFO:tasks.workunit.client.0.smithi029.stdout:7/910: creat d6/d50/d5b/d5f/d7d/d97/d4a/d4b/dde/f122 x:0 0 0 2023-12-05T13:26:51.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/703: truncate d0/d16/d22/d4f/f71 2012442 0 2023-12-05T13:26:51.556 INFO:tasks.workunit.client.0.smithi029.stdout:4/704: write d0/d3c/d85/fde [1485377,115506] 0 2023-12-05T13:26:51.559 INFO:tasks.workunit.client.0.smithi029.stdout:6/932: symlink d6/d131/l141 0 2023-12-05T13:26:51.561 INFO:tasks.workunit.client.0.smithi029.stdout:7/911: mkdir d6/d50/d5b/d1a/d26/d72/d123 0 2023-12-05T13:26:51.565 INFO:tasks.workunit.client.0.smithi029.stdout:6/933: mknod d6/d29/c142 0 2023-12-05T13:26:51.565 INFO:tasks.workunit.client.0.smithi029.stdout:6/934: chown d6/d29/dc4/l35 26273534 1 2023-12-05T13:26:51.565 INFO:tasks.workunit.client.0.smithi029.stdout:6/935: chown d6/d1d/l12b 277918 1 2023-12-05T13:26:51.568 INFO:tasks.workunit.client.0.smithi029.stdout:6/936: dread d6/d29/f50 [0,4194304] 0 2023-12-05T13:26:51.569 INFO:tasks.workunit.client.0.smithi029.stdout:6/937: creat d6/d93/f143 x:0 0 0 2023-12-05T13:26:51.571 INFO:tasks.workunit.client.0.smithi029.stdout:6/938: rename d6/d29/dc4/d40/d74/d52/d5c/l6c to d6/d1d/d39/d58/d13e/d8f/l144 0 2023-12-05T13:26:51.573 INFO:tasks.workunit.client.0.smithi029.stdout:6/939: link d6/d29/l97 d6/d64/d10f/l145 0 2023-12-05T13:26:51.573 INFO:tasks.workunit.client.0.smithi029.stdout:6/940: mknod d6/d1d/d39/d58/d13e/d7f/c146 0 2023-12-05T13:26:51.574 INFO:tasks.workunit.client.0.smithi029.stdout:6/941: stat d6/d1d/d39/l12f 0 2023-12-05T13:26:51.575 INFO:tasks.workunit.client.0.smithi029.stdout:7/912: dwrite d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/fe3 [0,4194304] 0 2023-12-05T13:26:51.576 INFO:tasks.workunit.client.0.smithi029.stdout:7/913: read d6/d50/d5b/d1a/d26/ff5 [115072,64379] 0 2023-12-05T13:26:51.576 INFO:tasks.workunit.client.0.smithi029.stdout:7/914: chown d6/d50/d5b/d1a/d26/d11c/f10e 1430 1 2023-12-05T13:26:51.576 INFO:tasks.workunit.client.0.smithi029.stdout:7/915: write d6/d50/d5b/d5f/d7d/d97/d4a/d4b/dde/f122 [453687,44834] 0 2023-12-05T13:26:51.576 INFO:tasks.workunit.client.0.smithi029.stdout:7/916: chown c2 16746651 1 2023-12-05T13:26:51.578 INFO:tasks.workunit.client.0.smithi029.stdout:7/917: mkdir d6/d50/d5b/d5f/d7d/d97/d124 0 2023-12-05T13:26:51.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/918: rmdir d6/d50/d5b/d5f/d7d/d97/d4a 39 2023-12-05T13:26:51.581 INFO:tasks.workunit.client.0.smithi029.stdout:7/919: creat d6/d100/d4f/dc5/f125 x:0 0 0 2023-12-05T13:26:51.581 INFO:tasks.workunit.client.0.smithi029.stdout:4/705: dwrite d0/d16/d22/fb4 [0,4194304] 0 2023-12-05T13:26:51.582 INFO:tasks.workunit.client.0.smithi029.stdout:4/706: chown d0/de/d30/c7a 7 1 2023-12-05T13:26:51.582 INFO:tasks.workunit.client.0.smithi029.stdout:7/920: mkdir d6/d100/d126 0 2023-12-05T13:26:51.583 INFO:tasks.workunit.client.0.smithi029.stdout:4/707: write d0/de/d15/f49 [435501,130024] 0 2023-12-05T13:26:51.588 INFO:tasks.workunit.client.0.smithi029.stdout:7/921: mknod d6/d100/d7e/d7b/c127 0 2023-12-05T13:26:51.591 INFO:tasks.workunit.client.0.smithi029.stdout:6/942: dwrite d6/d29/d9c/f123 [0,4194304] 0 2023-12-05T13:26:51.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/708: rename d0/d3c/d85/db7/fc7 to d0/d41/fe8 0 2023-12-05T13:26:51.592 INFO:tasks.workunit.client.0.smithi029.stdout:4/709: chown d0/d16/d22/dc2/fc4 1 1 2023-12-05T13:26:51.593 INFO:tasks.workunit.client.0.smithi029.stdout:7/922: symlink d6/d100/d2f/d89/dad/l128 0 2023-12-05T13:26:51.593 INFO:tasks.workunit.client.0.smithi029.stdout:7/923: chown d6/d100/d4f/dc5/d52/l9c 1377 1 2023-12-05T13:26:51.593 INFO:tasks.workunit.client.0.smithi029.stdout:7/924: write d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/fe8 [5073538,3968] 0 2023-12-05T13:26:51.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/925: dread d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/fe8 [0,4194304] 0 2023-12-05T13:26:51.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/943: dwrite d6/d29/dc4/d40/d74/d52/d5c/f11b [0,4194304] 0 2023-12-05T13:26:51.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/944: stat d6/d29/dc4/d40/d74/d59/dfb/f10d 0 2023-12-05T13:26:51.606 INFO:tasks.workunit.client.0.smithi029.stdout:6/945: readlink d6/d64/d10f/l145 0 2023-12-05T13:26:51.607 INFO:tasks.workunit.client.0.smithi029.stdout:7/926: creat d6/d50/d5b/d1a/d26/d11c/f129 x:0 0 0 2023-12-05T13:26:51.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/710: read d0/d16/d22/d4f/f71 [1871772,22249] 0 2023-12-05T13:26:51.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/711: truncate d0/d16/d22/f61 1972018 0 2023-12-05T13:26:51.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/712: chown d0/de/d15/cb0 254 1 2023-12-05T13:26:51.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/713: chown d0/de/c1c 1697 1 2023-12-05T13:26:51.615 INFO:tasks.workunit.client.0.smithi029.stdout:4/714: truncate d0/d16/d22/d4f/f71 2304183 0 2023-12-05T13:26:51.615 INFO:tasks.workunit.client.0.smithi029.stdout:4/715: fsync d0/da/f73 0 2023-12-05T13:26:51.622 INFO:tasks.workunit.client.0.smithi029.stdout:0/788: sync 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/884: sync 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/684: sync 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:1/884: sync 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/885: readlink d1/d6/l33 0 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/926: sync 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/886: dread - d1/d16/d36/dec/ffa zero size 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/927: read - d7/d19/f83 zero size 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/887: fsync d1/d16/d9c/feb 0 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:3/888: dread - d1/d5e/f100 zero size 2023-12-05T13:26:51.623 INFO:tasks.workunit.client.0.smithi029.stdout:9/928: write d7/d19/d28/f70 [1415335,27071] 0 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:8/987: sync 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:8/988: write d5/d6/d10/d8a/db6/f12b [643115,29594] 0 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/685: mkdir d1/dc/d10/d1e/d33/de5 0 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:0/789: mknod dc/d23/dbf/c102 0 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:1/885: creat d7/d5b/dc3/f119 x:0 0 0 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:6/946: dwrite d6/d29/dc4/d40/f12c [0,4194304] 0 2023-12-05T13:26:51.624 INFO:tasks.workunit.client.0.smithi029.stdout:6/947: write d6/d1d/d39/d58/d13e/d8f/f10a [4184390,62529] 0 2023-12-05T13:26:51.625 INFO:tasks.workunit.client.0.smithi029.stdout:9/929: mknod d7/d19/d30/d99/d8d/db5/c137 0 2023-12-05T13:26:51.625 INFO:tasks.workunit.client.0.smithi029.stdout:9/930: readlink d7/d19/d30/d40/d4e/d5e/d10e/dc0/lfc 0 2023-12-05T13:26:51.627 INFO:tasks.workunit.client.0.smithi029.stdout:8/989: rename d5/dc/f87 to d5/dbc/d1d/d10f/d3c/d13a/f149 0 2023-12-05T13:26:51.634 INFO:tasks.workunit.client.0.smithi029.stdout:0/790: mknod dc/d23/d3a/d41/d57/d58/df7/c103 0 2023-12-05T13:26:51.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/686: truncate d1/dc/d10/d1e/d33/d93/da5/db2/f4f 4077248 0 2023-12-05T13:26:51.634 INFO:tasks.workunit.client.0.smithi029.stdout:5/687: chown d1/dc/d25/d4c/d9b/fd4 159839097 1 2023-12-05T13:26:51.635 INFO:tasks.workunit.client.0.smithi029.stdout:6/948: mkdir d6/d64/d6d/da3/dcf/dd4/d147 0 2023-12-05T13:26:51.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/791: read dc/d23/fbc [92932,6691] 0 2023-12-05T13:26:51.638 INFO:tasks.workunit.client.0.smithi029.stdout:9/931: mkdir d7/d19/d30/d40/d4e/d111/d138 0 2023-12-05T13:26:51.639 INFO:tasks.workunit.client.0.smithi029.stdout:9/932: chown d7/c2b 416 1 2023-12-05T13:26:51.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/688: symlink d1/dc/d38/d4b/le6 0 2023-12-05T13:26:51.642 INFO:tasks.workunit.client.0.smithi029.stdout:5/689: truncate d1/dc/d25/d4c/d9b/fbc 982605 0 2023-12-05T13:26:51.643 INFO:tasks.workunit.client.0.smithi029.stdout:8/990: dwrite d5/dbc/d1d/f2a [0,4194304] 0 2023-12-05T13:26:51.643 INFO:tasks.workunit.client.0.smithi029.stdout:4/716: dwrite d0/de/d30/f4c [0,4194304] 0 2023-12-05T13:26:51.644 INFO:tasks.workunit.client.0.smithi029.stdout:5/690: getdents d1/dc/d38 0 2023-12-05T13:26:51.646 INFO:tasks.workunit.client.0.smithi029.stdout:8/991: creat d5/dbc/d1d/d10f/f14a x:0 0 0 2023-12-05T13:26:51.646 INFO:tasks.workunit.client.0.smithi029.stdout:8/992: dread - d5/dc/d18/d26/dc0/ffa zero size 2023-12-05T13:26:51.647 INFO:tasks.workunit.client.0.smithi029.stdout:8/993: stat d5/dbc/d1d/d10f/d3c/d13a/f149 0 2023-12-05T13:26:51.648 INFO:tasks.workunit.client.0.smithi029.stdout:0/792: dread dc/d33/d3d/d65/d85/ffc [0,4194304] 0 2023-12-05T13:26:51.649 INFO:tasks.workunit.client.0.smithi029.stdout:1/886: write d7/fc [475983,41799] 0 2023-12-05T13:26:51.650 INFO:tasks.workunit.client.0.smithi029.stdout:5/691: link d1/dc/d10/d1e/d75/d7f/d8a/fd3 d1/dc/d25/d4c/d9b/d9a/fe7 0 2023-12-05T13:26:51.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/793: write dc/f14 [1353725,119855] 0 2023-12-05T13:26:51.651 INFO:tasks.workunit.client.0.smithi029.stdout:0/794: fdatasync dc/d33/d47/fd6 0 2023-12-05T13:26:51.652 INFO:tasks.workunit.client.0.smithi029.stdout:8/994: link d5/dc/c13f d5/dbc/d1d/d10f/d86/da8/c14b 0 2023-12-05T13:26:51.654 INFO:tasks.workunit.client.0.smithi029.stdout:1/887: mkdir d7/d5e/d52/d5f/d12/d60/df6/d116/d11a 0 2023-12-05T13:26:51.655 INFO:tasks.workunit.client.0.smithi029.stdout:4/717: truncate d0/f2e 988253 0 2023-12-05T13:26:51.656 INFO:tasks.workunit.client.0.smithi029.stdout:5/692: mkdir d1/dc/d10/de8 0 2023-12-05T13:26:51.658 INFO:tasks.workunit.client.0.smithi029.stdout:8/995: creat d5/d6/d10/f14c x:0 0 0 2023-12-05T13:26:51.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/888: mknod d7/d5e/d52/d5f/d12/d60/dac/c11b 0 2023-12-05T13:26:51.660 INFO:tasks.workunit.client.0.smithi029.stdout:1/889: chown d7/d56/da8/fad 1009033928 1 2023-12-05T13:26:51.661 INFO:tasks.workunit.client.0.smithi029.stdout:9/933: dwrite d7/d19/d1f/da2/de7/d125/f129 [0,4194304] 0 2023-12-05T13:26:51.662 INFO:tasks.workunit.client.0.smithi029.stdout:5/693: unlink d1/dc/d25/d4c/f7e 0 2023-12-05T13:26:51.664 INFO:tasks.workunit.client.0.smithi029.stdout:1/890: symlink d7/d5e/d52/d5f/d12/d60/df6/l11c 0 2023-12-05T13:26:51.664 INFO:tasks.workunit.client.0.smithi029.stdout:1/891: truncate d7/d5e/d52/d90/ff4 253739 0 2023-12-05T13:26:51.664 INFO:tasks.workunit.client.0.smithi029.stdout:1/892: chown d7/d5e/f28 1109 1 2023-12-05T13:26:51.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/718: mknod d0/de/d30/d32/d35/d3d/ce9 0 2023-12-05T13:26:51.668 INFO:tasks.workunit.client.0.smithi029.stdout:4/719: chown d0/d16/d2f/d69/d77/fa3 17982442 1 2023-12-05T13:26:51.668 INFO:tasks.workunit.client.0.smithi029.stdout:9/934: rmdir d7/d19/d28/d65/dbe 39 2023-12-05T13:26:51.671 INFO:tasks.workunit.client.0.smithi029.stdout:8/996: dread d5/dbc/d1d/f2a [0,4194304] 0 2023-12-05T13:26:51.671 INFO:tasks.workunit.client.0.smithi029.stdout:0/795: dwrite dc/d33/d3d/d7a/d84/da4/fd7 [0,4194304] 0 2023-12-05T13:26:51.676 INFO:tasks.workunit.client.0.smithi029.stdout:4/720: dread d0/de/d30/d32/d35/f47 [0,4194304] 0 2023-12-05T13:26:51.676 INFO:tasks.workunit.client.0.smithi029.stdout:4/721: write d0/de/d30/d32/fa5 [1574359,329] 0 2023-12-05T13:26:51.677 INFO:tasks.workunit.client.0.smithi029.stdout:0/796: mknod dc/d33/d3d/d65/c104 0 2023-12-05T13:26:51.677 INFO:tasks.workunit.client.0.smithi029.stdout:4/722: read d0/d16/d2f/fa9 [975721,66303] 0 2023-12-05T13:26:51.680 INFO:tasks.workunit.client.0.smithi029.stdout:0/797: getdents dc/d33/d3d/d7a/d84/d8d 0 2023-12-05T13:26:51.682 INFO:tasks.workunit.client.0.smithi029.stdout:4/723: truncate d0/d16/d22/d4f/f59 1964856 0 2023-12-05T13:26:51.682 INFO:tasks.workunit.client.0.smithi029.stdout:5/694: dread d1/dc/d27/f2e [0,4194304] 0 2023-12-05T13:26:51.686 INFO:tasks.workunit.client.0.smithi029.stdout:4/724: rename d0/d16/d22/d4f/l7f to d0/d41/lea 0 2023-12-05T13:26:51.687 INFO:tasks.workunit.client.0.smithi029.stdout:5/695: mknod d1/dc/d27/ce9 0 2023-12-05T13:26:51.690 INFO:tasks.workunit.client.0.smithi029.stdout:8/997: dwrite d5/d2f/d75/f33 [0,4194304] 0 2023-12-05T13:26:51.690 INFO:tasks.workunit.client.0.smithi029.stdout:4/725: write d0/da/f18 [4032219,26517] 0 2023-12-05T13:26:51.690 INFO:tasks.workunit.client.0.smithi029.stdout:9/935: dwrite d7/d19/d28/f39 [4194304,4194304] 0 2023-12-05T13:26:51.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/893: dwrite d7/d61/f92 [0,4194304] 0 2023-12-05T13:26:51.692 INFO:tasks.workunit.client.0.smithi029.stdout:1/894: readlink d7/d6e/l9a 0 2023-12-05T13:26:51.692 INFO:tasks.workunit.client.0.smithi029.stdout:5/696: dread d1/dc/d38/d3a/d5c/d87/fb0 [0,4194304] 0 2023-12-05T13:26:51.693 INFO:tasks.workunit.client.0.smithi029.stdout:8/998: unlink d5/dbc/d1d/l54 0 2023-12-05T13:26:51.695 INFO:tasks.workunit.client.0.smithi029.stdout:4/726: symlink d0/d16/d22/d5f/leb 0 2023-12-05T13:26:51.695 INFO:tasks.workunit.client.0.smithi029.stdout:4/727: write d0/de/d30/d32/d35/f58 [1070878,80571] 0 2023-12-05T13:26:51.697 INFO:tasks.workunit.client.0.smithi029.stdout:9/936: symlink d7/d19/d28/l139 0 2023-12-05T13:26:51.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/697: chown d1/dc/d11/f35 115987 1 2023-12-05T13:26:51.703 INFO:tasks.workunit.client.0.smithi029.stdout:8/999: link d5/d6/d59/f137 d5/d6/d10/d8a/db6/f14d 0 2023-12-05T13:26:51.705 INFO:tasks.workunit.client.0.smithi029.stdout:4/728: creat d0/d16/d2f/d69/fec x:0 0 0 2023-12-05T13:26:51.707 INFO:tasks.workunit.client.0.smithi029.stdout:9/937: creat d7/d19/d1f/da2/de7/d11a/d128/f13a x:0 0 0 2023-12-05T13:26:51.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/698: rename d1/dc/d25/d4c/d61/f85 to d1/dc/d10/d1e/d33/de5/fea 0 2023-12-05T13:26:51.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/938: truncate d7/d19/d1f/f46 783648 0 2023-12-05T13:26:51.711 INFO:tasks.workunit.client.0.smithi029.stdout:9/939: dread - d7/d19/d30/d40/d4e/d5e/d10e/dc0/f118 zero size 2023-12-05T13:26:51.713 INFO:tasks.workunit.client.0.smithi029.stdout:4/729: mknod d0/de/d30/d32/d35/d3d/ced 0 2023-12-05T13:26:51.719 INFO:tasks.workunit.client.0.smithi029.stdout:1/895: write d7/d6e/da9/d4b/d72/f79 [633638,111778] 0 2023-12-05T13:26:51.719 INFO:tasks.workunit.client.0.smithi029.stdout:1/896: write d7/d5e/d52/d5f/d12/f1d [4432176,89756] 0 2023-12-05T13:26:51.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/699: dread d1/dc/d38/f40 [0,4194304] 0 2023-12-05T13:26:51.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/700: read - d1/dc/d10/d1e/d33/f73 zero size 2023-12-05T13:26:51.720 INFO:tasks.workunit.client.0.smithi029.stdout:5/701: chown d1/lbf 5931 1 2023-12-05T13:26:51.723 INFO:tasks.workunit.client.0.smithi029.stdout:1/897: creat d7/d5e/d52/d5f/d48/d10f/f11d x:0 0 0 2023-12-05T13:26:51.723 INFO:tasks.workunit.client.0.smithi029.stdout:5/702: chown d1/dc/d11/l2d 1121060282 1 2023-12-05T13:26:51.723 INFO:tasks.workunit.client.0.smithi029.stdout:5/703: truncate d1/dc/d38/d3a/d5c/f63 4629952 0 2023-12-05T13:26:51.723 INFO:tasks.workunit.client.0.smithi029.stdout:5/704: chown d1/dc/d25/d4c/d61/l8d 1 1 2023-12-05T13:26:51.724 INFO:tasks.workunit.client.0.smithi029.stdout:1/898: mknod d7/d61/d4f/c11e 0 2023-12-05T13:26:51.725 INFO:tasks.workunit.client.0.smithi029.stdout:1/899: symlink d7/d61/df3/l11f 0 2023-12-05T13:26:51.726 INFO:tasks.workunit.client.0.smithi029.stdout:1/900: mknod d7/d5e/d52/d5f/d48/d10f/c120 0 2023-12-05T13:26:51.727 INFO:tasks.workunit.client.0.smithi029.stdout:1/901: creat d7/d61/d77/d9f/f121 x:0 0 0 2023-12-05T13:26:51.729 INFO:tasks.workunit.client.0.smithi029.stdout:9/940: dwrite d7/d2c/d33/f63 [0,4194304] 0 2023-12-05T13:26:51.729 INFO:tasks.workunit.client.0.smithi029.stdout:1/902: link d7/d5e/cfc d7/d56/c122 0 2023-12-05T13:26:51.729 INFO:tasks.workunit.client.0.smithi029.stdout:9/941: creat d7/d19/d1f/da2/de7/d11a/d128/f13b x:0 0 0 2023-12-05T13:26:51.729 INFO:tasks.workunit.client.0.smithi029.stdout:9/942: stat d7/d2c/d33/f63 0 2023-12-05T13:26:51.730 INFO:tasks.workunit.client.0.smithi029.stdout:1/903: mkdir d7/d61/d123 0 2023-12-05T13:26:51.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/904: rmdir d7/d6e/da9/d4b/db1 39 2023-12-05T13:26:51.731 INFO:tasks.workunit.client.0.smithi029.stdout:1/905: chown d7/d6e/da9/l33 1577621338 1 2023-12-05T13:26:51.732 INFO:tasks.workunit.client.0.smithi029.stdout:1/906: rename d7/d5e/d52/d5f/d12/d60/dac/c11b to d7/d56/da8/c124 0 2023-12-05T13:26:51.733 INFO:tasks.workunit.client.0.smithi029.stdout:4/730: dwrite d0/de/d30/d32/d35/d3d/fce [0,4194304] 0 2023-12-05T13:26:51.733 INFO:tasks.workunit.client.0.smithi029.stdout:4/731: chown d0/f23 1400 1 2023-12-05T13:26:51.738 INFO:tasks.workunit.client.0.smithi029.stdout:5/705: dread d1/dc/d11/f56 [0,4194304] 0 2023-12-05T13:26:51.739 INFO:tasks.workunit.client.0.smithi029.stdout:5/706: symlink d1/dc/d11/d17/d3d/leb 0 2023-12-05T13:26:51.741 INFO:tasks.workunit.client.0.smithi029.stdout:4/732: write d0/f23 [3761889,13263] 0 2023-12-05T13:26:51.741 INFO:tasks.workunit.client.0.smithi029.stdout:4/733: dread - d0/d3c/fe6 zero size 2023-12-05T13:26:51.741 INFO:tasks.workunit.client.0.smithi029.stdout:4/734: creat d0/d16/d2f/d69/d77/fee x:0 0 0 2023-12-05T13:26:51.742 INFO:tasks.workunit.client.0.smithi029.stdout:4/735: mknod d0/d16/d2f/d69/cef 0 2023-12-05T13:26:51.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/707: write d1/dc/f89 [2999632,54517] 0 2023-12-05T13:26:51.751 INFO:tasks.workunit.client.0.smithi029.stdout:9/943: dwrite d7/d19/d28/f39 [8388608,4194304] 0 2023-12-05T13:26:51.751 INFO:tasks.workunit.client.0.smithi029.stdout:9/944: chown d7/d19/d1f/da2/de7/f122 5400 1 2023-12-05T13:26:51.752 INFO:tasks.workunit.client.0.smithi029.stdout:9/945: getdents d7/d2c/d3a/d64/def 0 2023-12-05T13:26:51.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/946: stat d7/d19/d30/d40/l9c 0 2023-12-05T13:26:51.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/947: chown d7/d19/d28/lb0 29290751 1 2023-12-05T13:26:51.753 INFO:tasks.workunit.client.0.smithi029.stdout:9/948: mknod d7/c13c 0 2023-12-05T13:26:51.754 INFO:tasks.workunit.client.0.smithi029.stdout:9/949: mknod d7/d19/d30/d40/d4e/d111/d138/c13d 0 2023-12-05T13:26:51.759 INFO:tasks.workunit.client.0.smithi029.stdout:5/708: dread d1/dc/d10/d1e/d75/fc3 [0,4194304] 0 2023-12-05T13:26:51.768 INFO:tasks.workunit.client.0.smithi029.stdout:4/736: dwrite d0/d16/d22/d5f/d79/fbf [0,4194304] 0 2023-12-05T13:26:51.773 INFO:tasks.workunit.client.0.smithi029.stdout:4/737: rename d0/de/d30/d32/d35/d3d/l52 to d0/de/d15/lf0 0 2023-12-05T13:26:51.774 INFO:tasks.workunit.client.0.smithi029.stdout:4/738: link d0/d16/d22/l5d d0/d16/d22/d5f/lf1 0 2023-12-05T13:26:51.781 INFO:tasks.workunit.client.0.smithi029.stdout:9/950: dwrite d7/d2c/d33/f8a [0,4194304] 0 2023-12-05T13:26:51.781 INFO:tasks.workunit.client.0.smithi029.stdout:9/951: write d7/d2c/d33/f121 [1043779,103240] 0 2023-12-05T13:26:51.781 INFO:tasks.workunit.client.0.smithi029.stdout:5/709: dwrite d1/dc/d11/f56 [0,4194304] 0 2023-12-05T13:26:51.782 INFO:tasks.workunit.client.0.smithi029.stdout:9/952: write d7/d19/d30/d40/d4e/d5e/d10e/f7c [2589656,51643] 0 2023-12-05T13:26:51.782 INFO:tasks.workunit.client.0.smithi029.stdout:5/710: mkdir d1/dc/d11/dec 0 2023-12-05T13:26:51.783 INFO:tasks.workunit.client.0.smithi029.stdout:9/953: write d7/d19/d28/d65/d73/d123/f48 [3099182,100151] 0 2023-12-05T13:26:51.783 INFO:tasks.workunit.client.0.smithi029.stdout:5/711: creat d1/dc/d10/d1e/d33/d93/da5/db2/da6/fed x:0 0 0 2023-12-05T13:26:51.783 INFO:tasks.workunit.client.0.smithi029.stdout:5/712: fdatasync d1/dc/d38/d3a/d5c/d87/f91 0 2023-12-05T13:26:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:9/954: dwrite d7/d19/f131 [0,4194304] 0 2023-12-05T13:26:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/713: dwrite d1/dc/d10/d1e/d33/f4d [0,4194304] 0 2023-12-05T13:26:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/714: fdatasync d1/dc/d25/f3b 0 2023-12-05T13:26:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/715: readlink d1/dc/d38/d3a/l54 0 2023-12-05T13:26:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/716: write d1/dc/d38/d3a/d5c/fcc [905875,100857] 0 2023-12-05T13:26:51.808 INFO:tasks.workunit.client.0.smithi029.stdout:5/717: chown d1/dc/d38/d55/d57/f76 860697015 1 2023-12-05T13:26:51.811 INFO:tasks.workunit.client.0.smithi029.stdout:9/955: write d7/d2c/d33/f59 [1575100,95250] 0 2023-12-05T13:26:51.813 INFO:tasks.workunit.client.0.smithi029.stdout:5/718: dread d1/dc/d27/f2e [0,4194304] 0 2023-12-05T13:26:51.814 INFO:tasks.workunit.client.0.smithi029.stdout:9/956: write d7/d2c/d33/fae [3000545,97302] 0 2023-12-05T13:26:51.815 INFO:tasks.workunit.client.0.smithi029.stdout:9/957: write d7/d19/d30/d99/d8d/dad/fba [359495,126671] 0 2023-12-05T13:26:51.815 INFO:tasks.workunit.client.0.smithi029.stdout:9/958: fdatasync d7/d19/d30/f9d 0 2023-12-05T13:26:51.825 INFO:tasks.workunit.client.0.smithi029.stdout:9/959: symlink d7/d19/d1f/da2/de7/l13e 0 2023-12-05T13:26:51.825 INFO:tasks.workunit.client.0.smithi029.stdout:9/960: write d7/d19/d30/d99/f7d [1020668,104028] 0 2023-12-05T13:26:51.826 INFO:tasks.workunit.client.0.smithi029.stdout:5/719: rename d1/dc/d11/f79 to d1/dc/d10/d1e/d33/d93/da5/db2/da6/fee 0 2023-12-05T13:26:51.826 INFO:tasks.workunit.client.0.smithi029.stdout:5/720: write d1/dc/d27/f2a [12287,81630] 0 2023-12-05T13:26:51.828 INFO:tasks.workunit.client.0.smithi029.stdout:9/961: creat d7/d19/d1f/da2/de7/d11a/f13f x:0 0 0 2023-12-05T13:26:51.829 INFO:tasks.workunit.client.0.smithi029.stdout:5/721: unlink d1/dc/d27/f2a 0 2023-12-05T13:26:51.831 INFO:tasks.workunit.client.0.smithi029.stdout:2/791: sync 2023-12-05T13:26:51.834 INFO:tasks.workunit.client.0.smithi029.stdout:2/792: rename de/d16/l60 to de/d16/d43/lfd 0 2023-12-05T13:26:51.835 INFO:tasks.workunit.client.0.smithi029.stdout:2/793: write de/d41/d56/fc3 [255489,86426] 0 2023-12-05T13:26:51.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/794: truncate de/d16/d6c/f7c 901090 0 2023-12-05T13:26:51.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/795: truncate de/d11/d32/dbc/fee 827091 0 2023-12-05T13:26:51.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/796: write de/d16/fe2 [3383574,90639] 0 2023-12-05T13:26:51.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/797: chown de/d14/d24/d93/fb5 460 1 2023-12-05T13:26:51.849 INFO:tasks.workunit.client.0.smithi029.stdout:2/798: truncate de/d16/fe2 2243803 0 2023-12-05T13:26:51.849 INFO:tasks.workunit.client.0.smithi029.stdout:5/722: dwrite d1/dc/d10/d1e/d33/d93/da5/db2/fe3 [0,4194304] 0 2023-12-05T13:26:51.850 INFO:tasks.workunit.client.0.smithi029.stdout:2/799: creat de/d6a/ffe x:0 0 0 2023-12-05T13:26:51.855 INFO:tasks.workunit.client.0.smithi029.stdout:2/800: symlink de/d16/lff 0 2023-12-05T13:26:51.855 INFO:tasks.workunit.client.0.smithi029.stdout:9/962: dwrite d7/d19/d30/d40/d4e/d5e/d10e/f7c [4194304,4194304] 0 2023-12-05T13:26:51.856 INFO:tasks.workunit.client.0.smithi029.stdout:2/801: link de/d16/d6c/f7c de/d11/dad/f100 0 2023-12-05T13:26:51.859 INFO:tasks.workunit.client.0.smithi029.stdout:9/963: mknod d7/d2c/d3a/d64/dfa/c140 0 2023-12-05T13:26:51.863 INFO:tasks.workunit.client.0.smithi029.stdout:9/964: symlink d7/d2c/d33/d119/l141 0 2023-12-05T13:26:51.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/965: rename d7/d19/d28/d65/d73 to d7/d19/d1f/da2/de7/d125/d142 0 2023-12-05T13:26:51.864 INFO:tasks.workunit.client.0.smithi029.stdout:9/966: fsync d7/d19/d28/f37 0 2023-12-05T13:26:51.865 INFO:tasks.workunit.client.0.smithi029.stdout:9/967: mknod d7/d19/d30/d99/d8d/dad/c143 0 2023-12-05T13:26:51.881 INFO:tasks.workunit.client.0.smithi029.stdout:9/968: dwrite d7/d2c/d33/f5b [4194304,4194304] 0 2023-12-05T13:26:51.896 INFO:tasks.workunit.client.0.smithi029.stdout:9/969: dwrite d7/d2c/d33/f5b [0,4194304] 0 2023-12-05T13:26:51.897 INFO:tasks.workunit.client.0.smithi029.stdout:9/970: symlink d7/d19/d30/l144 0 2023-12-05T13:26:51.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/971: dwrite d7/d19/d30/d40/f7e [0,4194304] 0 2023-12-05T13:26:51.912 INFO:tasks.workunit.client.0.smithi029.stdout:9/972: write d7/f3c [1009882,68054] 0 2023-12-05T13:26:51.914 INFO:tasks.workunit.client.0.smithi029.stdout:9/973: rename d7/c2b to d7/d2c/d3a/d52/db9/c145 0 2023-12-05T13:26:51.915 INFO:tasks.workunit.client.0.smithi029.stdout:9/974: write d7/d19/d28/d65/fd1 [772952,77022] 0 2023-12-05T13:26:51.915 INFO:tasks.workunit.client.0.smithi029.stdout:9/975: symlink d7/d19/d1f/da2/de7/d11a/l146 0 2023-12-05T13:26:51.919 INFO:tasks.workunit.client.0.smithi029.stdout:9/976: dread d7/d19/fa5 [0,4194304] 0 2023-12-05T13:26:51.922 INFO:tasks.workunit.client.0.smithi029.stdout:9/977: dread d7/d19/d30/d99/f82 [0,4194304] 0 2023-12-05T13:26:51.922 INFO:tasks.workunit.client.0.smithi029.stdout:9/978: write d7/d19/d1f/f10c [160582,10538] 0 2023-12-05T13:26:51.922 INFO:tasks.workunit.client.0.smithi029.stdout:9/979: truncate d7/d19/d30/d40/fcd 178319 0 2023-12-05T13:26:51.924 INFO:tasks.workunit.client.0.smithi029.stdout:9/980: rename d7/d19/d30/d99/d8d/dad/c143 to d7/d2c/d3a/d64/c147 0 2023-12-05T13:26:51.924 INFO:tasks.workunit.client.0.smithi029.stdout:9/981: fdatasync d7/d19/d30/d99/d8d/dad/fba 0 2023-12-05T13:26:51.925 INFO:tasks.workunit.client.0.smithi029.stdout:9/982: symlink d7/d2c/d3a/d64/dc8/l148 0 2023-12-05T13:26:51.926 INFO:tasks.workunit.client.0.smithi029.stdout:9/983: rename d7/d19/d28/d65/fd1 to d7/d19/d30/d40/d4e/d5e/d10e/dc0/d7f/f149 0 2023-12-05T13:26:51.947 INFO:tasks.workunit.client.0.smithi029.stdout:9/984: dwrite d7/d2c/fd0 [0,4194304] 0 2023-12-05T13:26:51.947 INFO:tasks.workunit.client.0.smithi029.stdout:9/985: creat d7/d2c/d33/d119/f14a x:0 0 0 2023-12-05T13:26:51.948 INFO:tasks.workunit.client.0.smithi029.stdout:9/986: getdents d7/d19/d30/d99/d8d/d12d 0 2023-12-05T13:26:51.949 INFO:tasks.workunit.client.0.smithi029.stdout:9/987: write d7/d19/d1f/da2/de7/d125/d142/d123/f48 [4025282,76770] 0 2023-12-05T13:26:51.951 INFO:tasks.workunit.client.0.smithi029.stdout:9/988: creat d7/d2c/d3a/d64/d11d/f14b x:0 0 0 2023-12-05T13:26:51.953 INFO:tasks.workunit.client.0.smithi029.stdout:9/989: dread d7/d19/f9b [0,4194304] 0 2023-12-05T13:26:51.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/990: creat d7/d2c/d3a/d52/f14c x:0 0 0 2023-12-05T13:26:51.954 INFO:tasks.workunit.client.0.smithi029.stdout:9/991: write d7/d2c/d3a/d52/dc9/f108 [180725,26906] 0 2023-12-05T13:26:51.956 INFO:tasks.workunit.client.0.smithi029.stdout:9/992: rename d7/d5a/dd4 to d7/d19/d30/d99/d8d/d14d 0 2023-12-05T13:26:51.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/993: rename d7/d2c/d3a/c10b to d7/d19/d30/d99/d8d/d12d/c14e 0 2023-12-05T13:26:51.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/994: fsync d7/d19/d1f/da2/de7/d11a/d128/f13a 0 2023-12-05T13:26:51.958 INFO:tasks.workunit.client.0.smithi029.stdout:9/995: read - d7/d2c/d3a/d64/d11d/f14b zero size 2023-12-05T13:26:51.959 INFO:tasks.workunit.client.0.smithi029.stdout:9/996: symlink d7/d19/d30/d99/d8d/d14d/l14f 0 2023-12-05T13:26:51.973 INFO:tasks.workunit.client.0.smithi029.stdout:9/997: dwrite d7/d2c/d3a/d64/d11d/f14b [0,4194304] 0 2023-12-05T13:26:51.988 INFO:tasks.workunit.client.0.smithi029.stdout:9/998: dwrite d7/d19/f1b [4194304,4194304] 0 2023-12-05T13:26:51.990 INFO:tasks.workunit.client.0.smithi029.stdout:9/999: dread d7/d19/d30/d40/f9f [0,4194304] 0 2023-12-05T13:26:52.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/927: sync 2023-12-05T13:26:52.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/928: chown d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/dd3/ld9 162703794 1 2023-12-05T13:26:52.224 INFO:tasks.workunit.client.0.smithi029.stdout:7/929: write d6/d50/d5b/f4e [5113590,1418] 0 2023-12-05T13:26:52.226 INFO:tasks.workunit.client.0.smithi029.stdout:7/930: rename d6/d19/f25 to d6/d50/d5b/d5f/d7d/d97/d4a/f12a 0 2023-12-05T13:26:52.226 INFO:tasks.workunit.client.0.smithi029.stdout:7/931: chown d6/d50 199 1 2023-12-05T13:26:52.377 INFO:tasks.workunit.client.0.smithi029.stdout:3/889: sync 2023-12-05T13:26:52.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/949: sync 2023-12-05T13:26:52.378 INFO:tasks.workunit.client.0.smithi029.stdout:0/798: sync 2023-12-05T13:26:52.378 INFO:tasks.workunit.client.0.smithi029.stdout:6/950: chown d6/d64/d6d/da3/le8 145929436 1 2023-12-05T13:26:52.381 INFO:tasks.workunit.client.0.smithi029.stdout:6/951: rmdir d6/d64/d6d/da3/dcf/dd4/d147 0 2023-12-05T13:26:52.382 INFO:tasks.workunit.client.0.smithi029.stdout:6/952: creat d6/d1d/d39/d58/d13e/d7f/f148 x:0 0 0 2023-12-05T13:26:52.383 INFO:tasks.workunit.client.0.smithi029.stdout:6/953: truncate d6/d64/d6d/da3/dcf/f11d 536107 0 2023-12-05T13:26:52.383 INFO:tasks.workunit.client.0.smithi029.stdout:0/799: mkdir dc/d33/d3d/d7a/d84/d8d/d105 0 2023-12-05T13:26:52.384 INFO:tasks.workunit.client.0.smithi029.stdout:6/954: write d6/d1d/d39/d58/d13e/d8f/f10a [2656392,87668] 0 2023-12-05T13:26:52.386 INFO:tasks.workunit.client.0.smithi029.stdout:3/890: dread d1/d10/f51 [0,4194304] 0 2023-12-05T13:26:52.388 INFO:tasks.workunit.client.0.smithi029.stdout:3/891: rename d1/d6/d11/da3/ff9 to d1/d10/d91/dde/f11d 0 2023-12-05T13:26:52.389 INFO:tasks.workunit.client.0.smithi029.stdout:3/892: stat d1/d18/fa0 0 2023-12-05T13:26:52.389 INFO:tasks.workunit.client.0.smithi029.stdout:3/893: fsync d1/d10/d91/f68 0 2023-12-05T13:26:52.389 INFO:tasks.workunit.client.0.smithi029.stdout:3/894: write d1/d10/f51 [5193771,66420] 0 2023-12-05T13:26:52.391 INFO:tasks.workunit.client.0.smithi029.stdout:3/895: mknod d1/d10/d91/d112/c11e 0 2023-12-05T13:26:52.392 INFO:tasks.workunit.client.0.smithi029.stdout:0/800: dread dc/d33/d3d/d65/d85/ffc [0,4194304] 0 2023-12-05T13:26:52.396 INFO:tasks.workunit.client.0.smithi029.stdout:0/801: creat dc/d23/d3a/d41/d57/f106 x:0 0 0 2023-12-05T13:26:52.398 INFO:tasks.workunit.client.0.smithi029.stdout:0/802: readlink dc/l22 0 2023-12-05T13:26:52.398 INFO:tasks.workunit.client.0.smithi029.stdout:0/803: write dc/d23/d3a/d41/d70/f81 [1799223,24770] 0 2023-12-05T13:26:52.401 INFO:tasks.workunit.client.0.smithi029.stdout:0/804: truncate dc/d33/d3d/d7a/d84/d8d/ff1 1943613 0 2023-12-05T13:26:52.401 INFO:tasks.workunit.client.0.smithi029.stdout:0/805: getdents dc/d33/d3d/d7a/d84/d8d/d97 0 2023-12-05T13:26:52.409 INFO:tasks.workunit.client.0.smithi029.stdout:3/896: dwrite d1/d16/d36/dec/fe4 [0,4194304] 0 2023-12-05T13:26:52.411 INFO:tasks.workunit.client.0.smithi029.stdout:6/955: dwrite d6/d29/dc4/d40/f12c [0,4194304] 0 2023-12-05T13:26:52.412 INFO:tasks.workunit.client.0.smithi029.stdout:3/897: creat d1/d10/d91/d112/f11f x:0 0 0 2023-12-05T13:26:52.414 INFO:tasks.workunit.client.0.smithi029.stdout:3/898: write d1/d6/fe2 [2177869,19770] 0 2023-12-05T13:26:52.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/806: dwrite f0 [0,4194304] 0 2023-12-05T13:26:52.427 INFO:tasks.workunit.client.0.smithi029.stdout:0/807: rmdir dc/d23/d3a/d41/d57/d58/d73/d86 39 2023-12-05T13:26:52.428 INFO:tasks.workunit.client.0.smithi029.stdout:3/899: dread d1/d10/f8c [0,4194304] 0 2023-12-05T13:26:52.429 INFO:tasks.workunit.client.0.smithi029.stdout:0/808: rmdir dc/d23/d3a/d41/d57/d58/dcd 39 2023-12-05T13:26:52.431 INFO:tasks.workunit.client.0.smithi029.stdout:0/809: creat dc/d13/d4f/d63/f107 x:0 0 0 2023-12-05T13:26:52.437 INFO:tasks.workunit.client.0.smithi029.stdout:6/956: dwrite d6/f10 [0,4194304] 0 2023-12-05T13:26:52.437 INFO:tasks.workunit.client.0.smithi029.stdout:6/957: fdatasync d6/d29/dc4/d40/d74/d59/dfb/f10d 0 2023-12-05T13:26:52.446 INFO:tasks.workunit.client.0.smithi029.stdout:3/900: dwrite d1/d10/f87 [0,4194304] 0 2023-12-05T13:26:52.453 INFO:tasks.workunit.client.0.smithi029.stdout:3/901: rename d1/db3/dc7/ldd to d1/d6/d4a/l120 0 2023-12-05T13:26:52.456 INFO:tasks.workunit.client.0.smithi029.stdout:6/958: dwrite d6/d1d/f55 [4194304,4194304] 0 2023-12-05T13:26:52.458 INFO:tasks.workunit.client.0.smithi029.stdout:3/902: dread d1/f2 [0,4194304] 0 2023-12-05T13:26:52.465 INFO:tasks.workunit.client.0.smithi029.stdout:3/903: unlink d1/d16/d36/dec/fe4 0 2023-12-05T13:26:52.467 INFO:tasks.workunit.client.0.smithi029.stdout:3/904: mkdir d1/d5e/d121 0 2023-12-05T13:26:52.469 INFO:tasks.workunit.client.0.smithi029.stdout:0/810: fsync dc/d13/d4f/d63/f107 0 2023-12-05T13:26:52.470 INFO:tasks.workunit.client.0.smithi029.stdout:6/959: dwrite d6/d29/dc4/d40/f6b [4194304,4194304] 0 2023-12-05T13:26:52.478 INFO:tasks.workunit.client.0.smithi029.stdout:6/960: rename d6/d29/dc4/d40/fd2 to d6/d3f/db7/def/d111/f149 0 2023-12-05T13:26:52.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/961: link d6/d29/dc4/l35 d6/d1d/d39/d58/d71/dbf/l14a 0 2023-12-05T13:26:52.480 INFO:tasks.workunit.client.0.smithi029.stdout:6/962: fdatasync d6/f1c 0 2023-12-05T13:26:52.482 INFO:tasks.workunit.client.0.smithi029.stdout:6/963: link d6/d29/dc4/d40/f13b d6/d3f/db7/def/f14b 0 2023-12-05T13:26:52.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/964: read d6/d29/dc4/d40/d74/ffd [380996,98380] 0 2023-12-05T13:26:52.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/965: read d6/d29/dc4/d40/f66 [3023026,31754] 0 2023-12-05T13:26:52.483 INFO:tasks.workunit.client.0.smithi029.stdout:6/966: chown d6/d29/dc4/d40/d74/d59/l12d 3 1 2023-12-05T13:26:52.484 INFO:tasks.workunit.client.0.smithi029.stdout:6/967: mkdir d6/d64/d6d/d14c 0 2023-12-05T13:26:52.485 INFO:tasks.workunit.client.0.smithi029.stdout:6/968: write d6/d1d/fc9 [537447,87800] 0 2023-12-05T13:26:52.490 INFO:tasks.workunit.client.0.smithi029.stdout:0/811: dwrite dc/d23/d3a/f71 [0,4194304] 0 2023-12-05T13:26:52.505 INFO:tasks.workunit.client.0.smithi029.stdout:0/812: dwrite dc/d33/d3d/d7a/d84/d8d/d97/f9a [0,4194304] 0 2023-12-05T13:26:52.505 INFO:tasks.workunit.client.0.smithi029.stdout:6/969: dwrite d6/d64/d6d/da3/dcf/fd6 [0,4194304] 0 2023-12-05T13:26:52.507 INFO:tasks.workunit.client.0.smithi029.stdout:0/813: mknod dc/d33/d3d/d7a/d84/db1/dda/df6/c108 0 2023-12-05T13:26:52.507 INFO:tasks.workunit.client.0.smithi029.stdout:0/814: write dc/d23/d3a/d41/d57/d58/d73/fce [24970,114444] 0 2023-12-05T13:26:52.510 INFO:tasks.workunit.client.0.smithi029.stdout:0/815: rename dc/d23/d3a/d41/d57/d58/f5c to dc/d33/f109 0 2023-12-05T13:26:52.511 INFO:tasks.workunit.client.0.smithi029.stdout:4/739: sync 2023-12-05T13:26:52.514 INFO:tasks.workunit.client.0.smithi029.stdout:2/802: sync 2023-12-05T13:26:52.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/723: sync 2023-12-05T13:26:52.514 INFO:tasks.workunit.client.0.smithi029.stdout:7/932: sync 2023-12-05T13:26:52.514 INFO:tasks.workunit.client.0.smithi029.stdout:1/907: sync 2023-12-05T13:26:52.517 INFO:tasks.workunit.client.0.smithi029.stdout:0/816: rename dc/d23/d3a/d41/d57/d58/d73/d86 to dc/d23/d3a/d41/d57/d58/dcd/d10a 0 2023-12-05T13:26:52.519 INFO:tasks.workunit.client.0.smithi029.stdout:5/724: dread d1/dc/d10/d1e/d75/fc3 [0,4194304] 0 2023-12-05T13:26:52.519 INFO:tasks.workunit.client.0.smithi029.stdout:7/933: link d6/d50/f102 d6/d100/d2f/d89/f12b 0 2023-12-05T13:26:52.520 INFO:tasks.workunit.client.0.smithi029.stdout:4/740: write d0/d16/d22/d4f/f5c [2746550,72801] 0 2023-12-05T13:26:52.525 INFO:tasks.workunit.client.0.smithi029.stdout:5/725: rmdir d1/dc/d10 39 2023-12-05T13:26:52.527 INFO:tasks.workunit.client.0.smithi029.stdout:7/934: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/d9a/f120 to d6/d19/f12c 0 2023-12-05T13:26:52.528 INFO:tasks.workunit.client.0.smithi029.stdout:4/741: creat d0/de/d30/db5/ff2 x:0 0 0 2023-12-05T13:26:52.530 INFO:tasks.workunit.client.0.smithi029.stdout:7/935: mkdir d6/d50/d12d 0 2023-12-05T13:26:52.530 INFO:tasks.workunit.client.0.smithi029.stdout:7/936: stat d6/d50/d5b/d1a/fc4 0 2023-12-05T13:26:52.531 INFO:tasks.workunit.client.0.smithi029.stdout:7/937: chown d6/d100/d2f/f115 2009 1 2023-12-05T13:26:52.531 INFO:tasks.workunit.client.0.smithi029.stdout:4/742: creat d0/d3c/d85/ff3 x:0 0 0 2023-12-05T13:26:52.532 INFO:tasks.workunit.client.0.smithi029.stdout:6/970: dwrite d6/d1d/d39/d58/d13e/d8f/de0/f13c [0,4194304] 0 2023-12-05T13:26:52.532 INFO:tasks.workunit.client.0.smithi029.stdout:4/743: creat d0/de/d15/dc0/ff4 x:0 0 0 2023-12-05T13:26:52.533 INFO:tasks.workunit.client.0.smithi029.stdout:1/908: dwrite d7/d5e/f5a [0,4194304] 0 2023-12-05T13:26:52.534 INFO:tasks.workunit.client.0.smithi029.stdout:6/971: creat d6/d29/dc4/d40/d74/d59/f14d x:0 0 0 2023-12-05T13:26:52.536 INFO:tasks.workunit.client.0.smithi029.stdout:1/909: mkdir d7/d61/d77/d9f/db4/d125 0 2023-12-05T13:26:52.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/803: dwrite de/d41/d56/fef [0,4194304] 0 2023-12-05T13:26:52.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/804: write de/d11/ffb [816998,37307] 0 2023-12-05T13:26:52.538 INFO:tasks.workunit.client.0.smithi029.stdout:2/805: truncate f3 1768875 0 2023-12-05T13:26:52.539 INFO:tasks.workunit.client.0.smithi029.stdout:1/910: mknod d7/d61/d77/d9f/db4/c126 0 2023-12-05T13:26:52.539 INFO:tasks.workunit.client.0.smithi029.stdout:0/817: dwrite dc/d13/f2d [4194304,4194304] 0 2023-12-05T13:26:52.540 INFO:tasks.workunit.client.0.smithi029.stdout:0/818: fdatasync dc/d33/d3d/d7a/d84/d8d/fc6 0 2023-12-05T13:26:52.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/806: getdents de/d14/d24/db7 0 2023-12-05T13:26:52.542 INFO:tasks.workunit.client.0.smithi029.stdout:0/819: dread dc/d23/d3a/d41/d57/d58/d73/fce [0,4194304] 0 2023-12-05T13:26:52.542 INFO:tasks.workunit.client.0.smithi029.stdout:2/807: chown de/d11/fdd 185334976 1 2023-12-05T13:26:52.542 INFO:tasks.workunit.client.0.smithi029.stdout:1/911: write d7/d61/d77/d9f/ffa [337725,100605] 0 2023-12-05T13:26:52.547 INFO:tasks.workunit.client.0.smithi029.stdout:2/808: creat de/d14/d24/f101 x:0 0 0 2023-12-05T13:26:52.550 INFO:tasks.workunit.client.0.smithi029.stdout:1/912: creat d7/d5e/d52/d5f/d12/d60/df6/d116/d11a/f127 x:0 0 0 2023-12-05T13:26:52.550 INFO:tasks.workunit.client.0.smithi029.stdout:1/913: chown d7/d5e/l22 5916 1 2023-12-05T13:26:52.550 INFO:tasks.workunit.client.0.smithi029.stdout:2/809: rename de/d6a/d9d/la2 to de/d16/d43/l102 0 2023-12-05T13:26:52.552 INFO:tasks.workunit.client.0.smithi029.stdout:5/726: dwrite d1/dc/d38/d3a/d5c/f63 [0,4194304] 0 2023-12-05T13:26:52.552 INFO:tasks.workunit.client.0.smithi029.stdout:5/727: readlink d1/dc/d11/d17/d3d/leb 0 2023-12-05T13:26:52.553 INFO:tasks.workunit.client.0.smithi029.stdout:2/810: rename de/d11/f25 to de/d41/f103 0 2023-12-05T13:26:52.553 INFO:tasks.workunit.client.0.smithi029.stdout:2/811: dread - de/d16/d4c/fec zero size 2023-12-05T13:26:52.554 INFO:tasks.workunit.client.0.smithi029.stdout:5/728: stat d1/dc/d10/d1e/d75/d7f/d8a/ca2 0 2023-12-05T13:26:52.556 INFO:tasks.workunit.client.0.smithi029.stdout:6/972: dwrite d6/d1d/f107 [0,4194304] 0 2023-12-05T13:26:52.557 INFO:tasks.workunit.client.0.smithi029.stdout:4/744: dwrite d0/d16/d22/f61 [0,4194304] 0 2023-12-05T13:26:52.559 INFO:tasks.workunit.client.0.smithi029.stdout:5/729: rmdir d1/dc/d10/d1e/d33/de5 39 2023-12-05T13:26:52.560 INFO:tasks.workunit.client.0.smithi029.stdout:0/820: dwrite dc/d23/d3a/d41/d70/f82 [0,4194304] 0 2023-12-05T13:26:52.560 INFO:tasks.workunit.client.0.smithi029.stdout:0/821: chown dc/d23/d3a/d41/d57/d58/d73/c9e 0 1 2023-12-05T13:26:52.563 INFO:tasks.workunit.client.0.smithi029.stdout:6/973: creat d6/d1d/d39/d58/d13e/d13a/f14e x:0 0 0 2023-12-05T13:26:52.569 INFO:tasks.workunit.client.0.smithi029.stdout:0/822: creat dc/d23/d3a/f10b x:0 0 0 2023-12-05T13:26:52.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/745: mkdir d0/de/d30/d32/d35/d3d/df5 0 2023-12-05T13:26:52.573 INFO:tasks.workunit.client.0.smithi029.stdout:4/746: chown d0/f23 121 1 2023-12-05T13:26:52.574 INFO:tasks.workunit.client.0.smithi029.stdout:0/823: dread dc/d13/fb9 [0,4194304] 0 2023-12-05T13:26:52.574 INFO:tasks.workunit.client.0.smithi029.stdout:0/824: write dc/d33/f109 [8518972,11758] 0 2023-12-05T13:26:52.574 INFO:tasks.workunit.client.0.smithi029.stdout:0/825: chown dc/d33/d47 11 1 2023-12-05T13:26:52.575 INFO:tasks.workunit.client.0.smithi029.stdout:4/747: rmdir d0/d16/d22/dda 0 2023-12-05T13:26:52.576 INFO:tasks.workunit.client.0.smithi029.stdout:4/748: write d0/d16/d22/f61 [3759280,34148] 0 2023-12-05T13:26:52.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/730: dwrite d1/dc/d25/d4c/d61/f80 [0,4194304] 0 2023-12-05T13:26:52.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/731: fdatasync d1/f20 0 2023-12-05T13:26:52.577 INFO:tasks.workunit.client.0.smithi029.stdout:5/732: fdatasync d1/dc/d27/f2e 0 2023-12-05T13:26:52.577 INFO:tasks.workunit.client.0.smithi029.stdout:6/974: dwrite d6/d29/d60/f13f [0,4194304] 0 2023-12-05T13:26:52.578 INFO:tasks.workunit.client.0.smithi029.stdout:0/826: creat dc/d13/d4f/d88/dc4/f10c x:0 0 0 2023-12-05T13:26:52.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/749: dread d0/de/d30/d32/d35/d3d/f5a [0,4194304] 0 2023-12-05T13:26:52.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/750: write d0/f1d [2845052,72205] 0 2023-12-05T13:26:52.579 INFO:tasks.workunit.client.0.smithi029.stdout:4/751: chown d0/d16/d22/d4f/f71 1 1 2023-12-05T13:26:52.580 INFO:tasks.workunit.client.0.smithi029.stdout:5/733: getdents d1/dc/d11/d17/d3d 0 2023-12-05T13:26:52.580 INFO:tasks.workunit.client.0.smithi029.stdout:5/734: fdatasync d1/dc/d25/d4c/d9b/fdf 0 2023-12-05T13:26:52.583 INFO:tasks.workunit.client.0.smithi029.stdout:6/975: symlink d6/d1d/d39/d58/d71/l14f 0 2023-12-05T13:26:52.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/827: symlink dc/d33/d47/l10d 0 2023-12-05T13:26:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:4/752: stat d0/de/d15/ce7 0 2023-12-05T13:26:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:4/753: read - d0/d3c/d85/ff3 zero size 2023-12-05T13:26:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/828: dread dc/d13/d4f/d88/fab [0,4194304] 0 2023-12-05T13:26:52.586 INFO:tasks.workunit.client.0.smithi029.stdout:0/829: chown dc/d33/d3d/d65 2178 1 2023-12-05T13:26:52.588 INFO:tasks.workunit.client.0.smithi029.stdout:6/976: creat d6/d29/dc4/d40/d74/d52/d5c/d6f/ddb/f150 x:0 0 0 2023-12-05T13:26:52.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/754: symlink d0/d16/d22/d4f/lf6 0 2023-12-05T13:26:52.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/755: fsync d0/d16/d2f/d69/d77/fd5 0 2023-12-05T13:26:52.590 INFO:tasks.workunit.client.0.smithi029.stdout:4/756: read d0/d16/d22/dc2/fc4 [111625,14146] 0 2023-12-05T13:26:52.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/830: mknod dc/d13/d4f/d88/c10e 0 2023-12-05T13:26:52.592 INFO:tasks.workunit.client.0.smithi029.stdout:0/831: readlink dc/d33/d3d/d7a/lb8 0 2023-12-05T13:26:52.593 INFO:tasks.workunit.client.0.smithi029.stdout:4/757: truncate d0/d16/d22/d5f/d79/fbf 2931627 0 2023-12-05T13:26:52.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/832: rename dc/d33/f109 to dc/d13/d4f/d83/f10f 0 2023-12-05T13:26:52.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/833: write dc/d23/dbf/fd4 [248088,93178] 0 2023-12-05T13:26:52.595 INFO:tasks.workunit.client.0.smithi029.stdout:0/834: write dc/d33/d3d/d7a/d84/d8d/fb0 [96379,97855] 0 2023-12-05T13:26:52.597 INFO:tasks.workunit.client.0.smithi029.stdout:4/758: mkdir d0/de/d30/d32/d35/d3d/d92/da6/df7 0 2023-12-05T13:26:52.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/759: symlink d0/lf8 0 2023-12-05T13:26:52.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/760: chown d0/de/l8a 8078 1 2023-12-05T13:26:52.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/761: getdents d0/de/d30/d32/d35/d3d/d92/da6/df7 0 2023-12-05T13:26:52.601 INFO:tasks.workunit.client.0.smithi029.stdout:4/762: fsync d0/d3c/d56/fbc 0 2023-12-05T13:26:52.601 INFO:tasks.workunit.client.0.smithi029.stdout:5/735: dwrite d1/dc/d25/d4c/d9b/d9a/fab [0,4194304] 0 2023-12-05T13:26:52.602 INFO:tasks.workunit.client.0.smithi029.stdout:4/763: creat d0/d16/d22/d5f/d79/dcf/ff9 x:0 0 0 2023-12-05T13:26:52.606 INFO:tasks.workunit.client.0.smithi029.stdout:5/736: creat d1/dc/d38/d3a/d5c/fef x:0 0 0 2023-12-05T13:26:52.609 INFO:tasks.workunit.client.0.smithi029.stdout:4/764: creat d0/de/d30/d94/ffa x:0 0 0 2023-12-05T13:26:52.610 INFO:tasks.workunit.client.0.smithi029.stdout:5/737: mknod d1/dc/d10/d1e/d33/d93/da5/db2/da6/cf0 0 2023-12-05T13:26:52.611 INFO:tasks.workunit.client.0.smithi029.stdout:4/765: dread d0/de/d30/d32/d35/f47 [0,4194304] 0 2023-12-05T13:26:52.612 INFO:tasks.workunit.client.0.smithi029.stdout:5/738: unlink d1/dc/d38/d3a/d5c/d87/f91 0 2023-12-05T13:26:52.613 INFO:tasks.workunit.client.0.smithi029.stdout:4/766: stat d0/d3c/d56/l6a 0 2023-12-05T13:26:52.614 INFO:tasks.workunit.client.0.smithi029.stdout:4/767: stat d0/d1 0 2023-12-05T13:26:52.614 INFO:tasks.workunit.client.0.smithi029.stdout:4/768: chown d0/de/d30/d32/d35/ld1 473527 1 2023-12-05T13:26:52.614 INFO:tasks.workunit.client.0.smithi029.stdout:5/739: stat d1/dc/d11/fbe 0 2023-12-05T13:26:52.618 INFO:tasks.workunit.client.0.smithi029.stdout:5/740: creat d1/dc/d10/ff1 x:0 0 0 2023-12-05T13:26:52.619 INFO:tasks.workunit.client.0.smithi029.stdout:2/812: dwrite de/d14/d24/f89 [0,4194304] 0 2023-12-05T13:26:52.620 INFO:tasks.workunit.client.0.smithi029.stdout:5/741: creat d1/dc/d11/d17/ff2 x:0 0 0 2023-12-05T13:26:52.622 INFO:tasks.workunit.client.0.smithi029.stdout:2/813: link de/d14/c4b de/d14/d24/d93/c104 0 2023-12-05T13:26:52.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/742: truncate d1/dc/d10/d1e/d33/d93/da5/db2/f4f 1495534 0 2023-12-05T13:26:52.627 INFO:tasks.workunit.client.0.smithi029.stdout:2/814: dread de/d16/f2b [0,4194304] 0 2023-12-05T13:26:52.627 INFO:tasks.workunit.client.0.smithi029.stdout:0/835: dwrite dc/d13/d4f/d63/f87 [0,4194304] 0 2023-12-05T13:26:52.627 INFO:tasks.workunit.client.0.smithi029.stdout:6/977: dwrite d6/d1d/d36/ff4 [0,4194304] 0 2023-12-05T13:26:52.627 INFO:tasks.workunit.client.0.smithi029.stdout:6/978: chown d6/d29/dc4/d40/d74/d52/d5c/d6f/f88 1573542 1 2023-12-05T13:26:52.632 INFO:tasks.workunit.client.0.smithi029.stdout:0/836: unlink dc/d13/l21 0 2023-12-05T13:26:52.633 INFO:tasks.workunit.client.0.smithi029.stdout:6/979: getdents d6/d64 0 2023-12-05T13:26:52.633 INFO:tasks.workunit.client.0.smithi029.stdout:6/980: dread - d6/d1d/d39/d58/d13e/d7f/f12a zero size 2023-12-05T13:26:52.633 INFO:tasks.workunit.client.0.smithi029.stdout:2/815: dread de/d16/f47 [0,4194304] 0 2023-12-05T13:26:52.634 INFO:tasks.workunit.client.0.smithi029.stdout:4/769: dwrite d0/d16/d22/d4f/f71 [0,4194304] 0 2023-12-05T13:26:52.636 INFO:tasks.workunit.client.0.smithi029.stdout:0/837: dread dc/d33/d3d/d7a/d84/d8d/ff1 [0,4194304] 0 2023-12-05T13:26:52.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/981: rmdir d6/d29/dc4/d40/d74 39 2023-12-05T13:26:52.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/982: chown d6/d3f/f9a 382 1 2023-12-05T13:26:52.638 INFO:tasks.workunit.client.0.smithi029.stdout:6/983: write d6/d1d/d39/f95 [733983,77132] 0 2023-12-05T13:26:52.639 INFO:tasks.workunit.client.0.smithi029.stdout:4/770: dread d0/d16/d22/d4f/f59 [0,4194304] 0 2023-12-05T13:26:52.641 INFO:tasks.workunit.client.0.smithi029.stdout:2/816: unlink de/d16/f31 0 2023-12-05T13:26:52.642 INFO:tasks.workunit.client.0.smithi029.stdout:2/817: chown de/d6a/ffe 555847286 1 2023-12-05T13:26:52.645 INFO:tasks.workunit.client.0.smithi029.stdout:0/838: unlink dc/d23/d3a/d41/d70/cf2 0 2023-12-05T13:26:52.650 INFO:tasks.workunit.client.0.smithi029.stdout:0/839: write dc/d33/f38 [4595239,2440] 0 2023-12-05T13:26:52.650 INFO:tasks.workunit.client.0.smithi029.stdout:2/818: dread de/d14/d24/f2e [0,4194304] 0 2023-12-05T13:26:52.650 INFO:tasks.workunit.client.0.smithi029.stdout:6/984: mkdir d6/d64/d6d/d85/d151 0 2023-12-05T13:26:52.651 INFO:tasks.workunit.client.0.smithi029.stdout:4/771: creat d0/d1/da1/ffb x:0 0 0 2023-12-05T13:26:52.651 INFO:tasks.workunit.client.0.smithi029.stdout:4/772: rename d0/de to d0/de/d30/db5/dfc 22 2023-12-05T13:26:52.652 INFO:tasks.workunit.client.0.smithi029.stdout:6/985: creat d6/d29/dc4/d125/f152 x:0 0 0 2023-12-05T13:26:52.654 INFO:tasks.workunit.client.0.smithi029.stdout:4/773: creat d0/d3c/d85/db7/ffd x:0 0 0 2023-12-05T13:26:52.656 INFO:tasks.workunit.client.0.smithi029.stdout:6/986: creat d6/d29/dc4/f153 x:0 0 0 2023-12-05T13:26:52.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/840: dread dc/d23/d3a/d41/d57/f59 [0,4194304] 0 2023-12-05T13:26:52.659 INFO:tasks.workunit.client.0.smithi029.stdout:0/841: write dc/d23/f6a [229825,63371] 0 2023-12-05T13:26:52.661 INFO:tasks.workunit.client.0.smithi029.stdout:0/842: unlink dc/d13/d4f/d83/cb6 0 2023-12-05T13:26:52.666 INFO:tasks.workunit.client.0.smithi029.stdout:4/774: dread d0/d16/f4a [0,4194304] 0 2023-12-05T13:26:52.666 INFO:tasks.workunit.client.0.smithi029.stdout:2/819: dwrite de/d16/fe2 [0,4194304] 0 2023-12-05T13:26:52.667 INFO:tasks.workunit.client.0.smithi029.stdout:4/775: mkdir d0/d1/dfe 0 2023-12-05T13:26:52.670 INFO:tasks.workunit.client.0.smithi029.stdout:6/987: dwrite d6/f4f [4194304,4194304] 0 2023-12-05T13:26:52.671 INFO:tasks.workunit.client.0.smithi029.stdout:0/843: dread dc/d33/d3d/d7a/fb4 [0,4194304] 0 2023-12-05T13:26:52.672 INFO:tasks.workunit.client.0.smithi029.stdout:4/776: write d0/da/f73 [183895,80352] 0 2023-12-05T13:26:52.673 INFO:tasks.workunit.client.0.smithi029.stdout:0/844: creat dc/d33/d3d/f110 x:0 0 0 2023-12-05T13:26:52.674 INFO:tasks.workunit.client.0.smithi029.stdout:2/820: dread de/d16/f1b [0,4194304] 0 2023-12-05T13:26:52.676 INFO:tasks.workunit.client.0.smithi029.stdout:2/821: rename de/d6a/d9d/cc1 to de/d14/d24/c105 0 2023-12-05T13:26:52.676 INFO:tasks.workunit.client.0.smithi029.stdout:0/845: write dc/d23/f6f [471328,71336] 0 2023-12-05T13:26:52.678 INFO:tasks.workunit.client.0.smithi029.stdout:0/846: mkdir dc/d13/d4f/d83/d111 0 2023-12-05T13:26:52.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/988: dread d6/d1d/d36/f4c [4194304,4194304] 0 2023-12-05T13:26:52.680 INFO:tasks.workunit.client.0.smithi029.stdout:6/989: write d6/d3f/f9d [1609577,61690] 0 2023-12-05T13:26:52.681 INFO:tasks.workunit.client.0.smithi029.stdout:6/990: creat d6/d29/dc4/d40/d74/d52/d5c/d6f/f154 x:0 0 0 2023-12-05T13:26:52.682 INFO:tasks.workunit.client.0.smithi029.stdout:6/991: chown d6/d1d/d39/d58/d13e/d7f/l136 54243 1 2023-12-05T13:26:52.682 INFO:tasks.workunit.client.0.smithi029.stdout:6/992: chown d6/d64/d6d/d85/l130 0 1 2023-12-05T13:26:52.688 INFO:tasks.workunit.client.0.smithi029.stdout:2/822: dread de/d14/d24/f1c [0,4194304] 0 2023-12-05T13:26:52.689 INFO:tasks.workunit.client.0.smithi029.stdout:2/823: creat de/d11/f106 x:0 0 0 2023-12-05T13:26:52.691 INFO:tasks.workunit.client.0.smithi029.stdout:2/824: unlink de/d11/f4f 0 2023-12-05T13:26:52.691 INFO:tasks.workunit.client.0.smithi029.stdout:4/777: dwrite d0/da/f1b [0,4194304] 0 2023-12-05T13:26:52.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/825: mknod de/d14/d24/db7/c107 0 2023-12-05T13:26:52.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/826: fsync de/d11/fdd 0 2023-12-05T13:26:52.692 INFO:tasks.workunit.client.0.smithi029.stdout:2/827: truncate de/d41/f51 2711948 0 2023-12-05T13:26:52.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/778: rmdir d0/d16/d2f 39 2023-12-05T13:26:52.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/779: dread - d0/de/d30/d32/fc5 zero size 2023-12-05T13:26:52.693 INFO:tasks.workunit.client.0.smithi029.stdout:4/780: write d0/d1/da1/ffb [43803,7799] 0 2023-12-05T13:26:52.693 INFO:tasks.workunit.client.0.smithi029.stdout:2/828: symlink de/d14/d24/d93/dc5/l108 0 2023-12-05T13:26:52.696 INFO:tasks.workunit.client.0.smithi029.stdout:4/781: link d0/d16/d22/d5f/d79/dcf/fe3 d0/de/d30/d32/ddf/fff 0 2023-12-05T13:26:52.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/829: getdents de/d14/ddf 0 2023-12-05T13:26:52.697 INFO:tasks.workunit.client.0.smithi029.stdout:2/830: fdatasync de/d16/d6c/fcc 0 2023-12-05T13:26:52.702 INFO:tasks.workunit.client.0.smithi029.stdout:0/847: dwrite f9 [4194304,4194304] 0 2023-12-05T13:26:52.706 INFO:tasks.workunit.client.0.smithi029.stdout:0/848: unlink f9 0 2023-12-05T13:26:52.706 INFO:tasks.workunit.client.0.smithi029.stdout:0/849: chown dc/d23/d3a/d41/d57/d58/d73/c100 625256 1 2023-12-05T13:26:52.708 INFO:tasks.workunit.client.0.smithi029.stdout:6/993: dwrite d6/d1d/d36/f7d [0,4194304] 0 2023-12-05T13:26:52.711 INFO:tasks.workunit.client.0.smithi029.stdout:0/850: dread dc/d33/d3d/d7a/d84/d8d/d97/fa3 [0,4194304] 0 2023-12-05T13:26:52.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/782: dwrite d0/de/d30/d32/fa5 [0,4194304] 0 2023-12-05T13:26:52.716 INFO:tasks.workunit.client.0.smithi029.stdout:4/783: write d0/d41/fe8 [895682,123609] 0 2023-12-05T13:26:52.719 INFO:tasks.workunit.client.0.smithi029.stdout:0/851: dread dc/d33/d3d/d7a/d84/d8d/d97/f9a [0,4194304] 0 2023-12-05T13:26:52.721 INFO:tasks.workunit.client.0.smithi029.stdout:4/784: creat d0/d16/db6/f100 x:0 0 0 2023-12-05T13:26:52.721 INFO:tasks.workunit.client.0.smithi029.stdout:4/785: fdatasync d0/de/d30/d94/ffa 0 2023-12-05T13:26:52.722 INFO:tasks.workunit.client.0.smithi029.stdout:2/831: write de/d41/f78 [3981881,92805] 0 2023-12-05T13:26:52.722 INFO:tasks.workunit.client.0.smithi029.stdout:0/852: creat dc/d33/d3d/d7a/d84/d8d/d105/f112 x:0 0 0 2023-12-05T13:26:52.723 INFO:tasks.workunit.client.0.smithi029.stdout:2/832: dread de/d16/d6c/d8e/dbf/ff2 [0,4194304] 0 2023-12-05T13:26:52.723 INFO:tasks.workunit.client.0.smithi029.stdout:4/786: creat d0/d16/d22/d5f/d79/dcf/f101 x:0 0 0 2023-12-05T13:26:52.725 INFO:tasks.workunit.client.0.smithi029.stdout:2/833: rmdir de/d14/d24/d93/dc5 39 2023-12-05T13:26:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:4/787: dread d0/de/d30/d32/fb8 [0,4194304] 0 2023-12-05T13:26:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:4/788: chown d0/d3c/d85/db7 6927 1 2023-12-05T13:26:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:4/789: chown d0/de/d30/d32 964 1 2023-12-05T13:26:52.726 INFO:tasks.workunit.client.0.smithi029.stdout:4/790: write d0/de/d30/d32/fb8 [1447037,73447] 0 2023-12-05T13:26:52.728 INFO:tasks.workunit.client.0.smithi029.stdout:2/834: creat de/d14/d24/db7/f109 x:0 0 0 2023-12-05T13:26:52.729 INFO:tasks.workunit.client.0.smithi029.stdout:4/791: symlink d0/de/d30/d32/d35/d3d/d92/da6/l102 0 2023-12-05T13:26:52.730 INFO:tasks.workunit.client.0.smithi029.stdout:2/835: symlink de/d16/l10a 0 2023-12-05T13:26:52.734 INFO:tasks.workunit.client.0.smithi029.stdout:4/792: unlink d0/d16/d2f/fa9 0 2023-12-05T13:26:52.736 INFO:tasks.workunit.client.0.smithi029.stdout:4/793: write d0/d3c/d56/fbc [1903300,86620] 0 2023-12-05T13:26:52.737 INFO:tasks.workunit.client.0.smithi029.stdout:4/794: creat d0/d3c/d85/db7/f103 x:0 0 0 2023-12-05T13:26:52.737 INFO:tasks.workunit.client.0.smithi029.stdout:4/795: stat d0/f23 0 2023-12-05T13:26:52.738 INFO:tasks.workunit.client.0.smithi029.stdout:4/796: write d0/d16/d22/f61 [3306854,130542] 0 2023-12-05T13:26:52.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/797: truncate d0/de/d30/db5/ff2 134403 0 2023-12-05T13:26:52.739 INFO:tasks.workunit.client.0.smithi029.stdout:4/798: creat d0/f104 x:0 0 0 2023-12-05T13:26:52.740 INFO:tasks.workunit.client.0.smithi029.stdout:4/799: creat d0/d16/d22/f105 x:0 0 0 2023-12-05T13:26:52.749 INFO:tasks.workunit.client.0.smithi029.stdout:2/836: dwrite de/d14/d24/d93/dc5/dc9/fd3 [0,4194304] 0 2023-12-05T13:26:52.750 INFO:tasks.workunit.client.0.smithi029.stdout:2/837: write de/d41/f78 [3267179,125755] 0 2023-12-05T13:26:52.753 INFO:tasks.workunit.client.0.smithi029.stdout:2/838: dread de/d14/d24/d93/dc5/dc9/f6e [0,4194304] 0 2023-12-05T13:26:52.754 INFO:tasks.workunit.client.0.smithi029.stdout:2/839: unlink de/d16/d6c/d8e/ldb 0 2023-12-05T13:26:52.756 INFO:tasks.workunit.client.0.smithi029.stdout:2/840: mknod de/d11/d32/dbc/c10b 0 2023-12-05T13:26:52.757 INFO:tasks.workunit.client.0.smithi029.stdout:2/841: rename de/d14/d24/d93/dc5/dc9/c87 to de/d14/d24/d93/dc5/dc9/c10c 0 2023-12-05T13:26:52.758 INFO:tasks.workunit.client.0.smithi029.stdout:4/800: dwrite d0/d3c/d56/f67 [0,4194304] 0 2023-12-05T13:26:52.758 INFO:tasks.workunit.client.0.smithi029.stdout:2/842: mknod de/d11/d32/c10d 0 2023-12-05T13:26:52.759 INFO:tasks.workunit.client.0.smithi029.stdout:2/843: creat de/f10e x:0 0 0 2023-12-05T13:26:52.760 INFO:tasks.workunit.client.0.smithi029.stdout:2/844: truncate de/d16/f2c 3545910 0 2023-12-05T13:26:52.761 INFO:tasks.workunit.client.0.smithi029.stdout:4/801: rmdir d0/de/d30/d32/d35/d3d/d92/da6/df7 0 2023-12-05T13:26:52.761 INFO:tasks.workunit.client.0.smithi029.stdout:4/802: write d0/d3c/d85/db7/f103 [775804,61845] 0 2023-12-05T13:26:52.761 INFO:tasks.workunit.client.0.smithi029.stdout:2/845: getdents de/d16/d6c/d90 0 2023-12-05T13:26:52.762 INFO:tasks.workunit.client.0.smithi029.stdout:4/803: mkdir d0/de/d30/d94/d106 0 2023-12-05T13:26:52.771 INFO:tasks.workunit.client.0.smithi029.stdout:4/804: dread d0/f23 [0,4194304] 0 2023-12-05T13:26:52.773 INFO:tasks.workunit.client.0.smithi029.stdout:4/805: unlink d0/d16/d22/d5f/f91 0 2023-12-05T13:26:52.775 INFO:tasks.workunit.client.0.smithi029.stdout:2/846: rmdir de/d14/da3 0 2023-12-05T13:26:52.775 INFO:tasks.workunit.client.0.smithi029.stdout:2/847: write de/d41/d56/fd7 [393296,6918] 0 2023-12-05T13:26:52.778 INFO:tasks.workunit.client.0.smithi029.stdout:2/848: mkdir de/d14/d24/d93/dc5/dc9/d10f 0 2023-12-05T13:26:52.780 INFO:tasks.workunit.client.0.smithi029.stdout:4/806: symlink d0/l107 0 2023-12-05T13:26:52.780 INFO:tasks.workunit.client.0.smithi029.stdout:4/807: fsync d0/d3c/d56/f67 0 2023-12-05T13:26:52.781 INFO:tasks.workunit.client.0.smithi029.stdout:2/849: rmdir de/d14/ddf 39 2023-12-05T13:26:52.785 INFO:tasks.workunit.client.0.smithi029.stdout:4/808: creat d0/d16/f108 x:0 0 0 2023-12-05T13:26:52.787 INFO:tasks.workunit.client.0.smithi029.stdout:2/850: link de/d41/d56/fc3 de/d41/d56/f110 0 2023-12-05T13:26:52.790 INFO:tasks.workunit.client.0.smithi029.stdout:4/809: creat d0/de/d30/d32/f109 x:0 0 0 2023-12-05T13:26:52.790 INFO:tasks.workunit.client.0.smithi029.stdout:4/810: chown d0/d41/lab 1 1 2023-12-05T13:26:52.790 INFO:tasks.workunit.client.0.smithi029.stdout:4/811: fsync d0/de/d15/dc0/ff4 0 2023-12-05T13:26:52.790 INFO:tasks.workunit.client.0.smithi029.stdout:4/812: chown d0/d16/dd0 69 1 2023-12-05T13:26:52.790 INFO:tasks.workunit.client.0.smithi029.stdout:4/813: chown d0/d16/dd0 321436 1 2023-12-05T13:26:52.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/814: write d0/de/d30/f4c [3897507,88204] 0 2023-12-05T13:26:52.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/815: fsync d0/d16/d2f/d69/d77/fd5 0 2023-12-05T13:26:52.796 INFO:tasks.workunit.client.0.smithi029.stdout:4/816: readlink d0/de/d30/d94/le4 0 2023-12-05T13:26:52.799 INFO:tasks.workunit.client.0.smithi029.stdout:4/817: mknod d0/de/d30/d32/d35/dca/c10a 0 2023-12-05T13:26:52.807 INFO:tasks.workunit.client.0.smithi029.stdout:2/851: dwrite de/d16/d6c/d8e/fb6 [0,4194304] 0 2023-12-05T13:26:52.807 INFO:tasks.workunit.client.0.smithi029.stdout:2/852: chown de/d41/d56/fd7 1428326 1 2023-12-05T13:26:52.820 INFO:tasks.workunit.client.0.smithi029.stdout:4/818: dwrite d0/de/d15/f49 [0,4194304] 0 2023-12-05T13:26:52.822 INFO:tasks.workunit.client.0.smithi029.stdout:4/819: mkdir d0/d16/d22/d5f/d79/d10b 0 2023-12-05T13:26:52.829 INFO:tasks.workunit.client.0.smithi029.stdout:2/853: dwrite de/d14/d24/f19 [0,4194304] 0 2023-12-05T13:26:52.829 INFO:tasks.workunit.client.0.smithi029.stdout:2/854: fsync de/d16/d43/f92 0 2023-12-05T13:26:52.829 INFO:tasks.workunit.client.0.smithi029.stdout:4/820: dread d0/f1d [0,4194304] 0 2023-12-05T13:26:52.830 INFO:tasks.workunit.client.0.smithi029.stdout:2/855: symlink de/d16/d4c/l111 0 2023-12-05T13:26:52.830 INFO:tasks.workunit.client.0.smithi029.stdout:4/821: write d0/d16/d2f/d69/fdb [495846,111980] 0 2023-12-05T13:26:52.831 INFO:tasks.workunit.client.0.smithi029.stdout:2/856: rmdir de/d11/d32/dbc 39 2023-12-05T13:26:52.833 INFO:tasks.workunit.client.0.smithi029.stdout:2/857: symlink de/d14/d24/d93/dc5/dc9/d10f/l112 0 2023-12-05T13:26:52.834 INFO:tasks.workunit.client.0.smithi029.stdout:2/858: dread de/d11/f30 [0,4194304] 0 2023-12-05T13:26:52.834 INFO:tasks.workunit.client.0.smithi029.stdout:2/859: chown de/d6a/la4 753 1 2023-12-05T13:26:52.836 INFO:tasks.workunit.client.0.smithi029.stdout:2/860: creat de/d14/ddf/f113 x:0 0 0 2023-12-05T13:26:52.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/861: creat de/d11/dad/f114 x:0 0 0 2023-12-05T13:26:52.837 INFO:tasks.workunit.client.0.smithi029.stdout:2/862: chown de/d14/d24/l22 58117 1 2023-12-05T13:26:52.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/863: creat de/d16/df0/f115 x:0 0 0 2023-12-05T13:26:52.838 INFO:tasks.workunit.client.0.smithi029.stdout:2/864: readlink de/d16/d6c/d8e/lfc 0 2023-12-05T13:26:52.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/865: creat de/d41/d56/d58/f116 x:0 0 0 2023-12-05T13:26:52.839 INFO:tasks.workunit.client.0.smithi029.stdout:2/866: readlink de/d14/l52 0 2023-12-05T13:26:52.840 INFO:tasks.workunit.client.0.smithi029.stdout:2/867: mknod de/d14/d24/d93/dc5/dc9/d10f/c117 0 2023-12-05T13:26:52.843 INFO:tasks.workunit.client.0.smithi029.stdout:2/868: truncate de/d14/d24/d93/dc5/dc9/f68 419699 0 2023-12-05T13:26:52.843 INFO:tasks.workunit.client.0.smithi029.stdout:4/822: dread d0/d16/d22/d4f/f5c [0,4194304] 0 2023-12-05T13:26:52.844 INFO:tasks.workunit.client.0.smithi029.stdout:4/823: mknod d0/d1/c10c 0 2023-12-05T13:26:52.846 INFO:tasks.workunit.client.0.smithi029.stdout:4/824: rename d0/d41/f9d to d0/de/d30/d32/d35/d3d/df5/f10d 0 2023-12-05T13:26:52.853 INFO:tasks.workunit.client.0.smithi029.stdout:4/825: dread d0/da/f73 [0,4194304] 0 2023-12-05T13:26:52.854 INFO:tasks.workunit.client.0.smithi029.stdout:4/826: mkdir d0/de/d15/dc0/d10e 0 2023-12-05T13:26:52.856 INFO:tasks.workunit.client.0.smithi029.stdout:4/827: mknod d0/d1/c10f 0 2023-12-05T13:26:52.856 INFO:tasks.workunit.client.0.smithi029.stdout:4/828: dread - d0/d3c/d85/ff3 zero size 2023-12-05T13:26:52.857 INFO:tasks.workunit.client.0.smithi029.stdout:4/829: mkdir d0/d3c/d56/d110 0 2023-12-05T13:26:52.858 INFO:tasks.workunit.client.0.smithi029.stdout:4/830: truncate d0/d3c/d56/f74 4437413 0 2023-12-05T13:26:52.859 INFO:tasks.workunit.client.0.smithi029.stdout:4/831: creat d0/de/d15/dc0/d10e/f111 x:0 0 0 2023-12-05T13:26:52.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/832: truncate d0/da/f18 4009242 0 2023-12-05T13:26:52.860 INFO:tasks.workunit.client.0.smithi029.stdout:4/833: write d0/d16/d22/dc2/fc4 [977496,76418] 0 2023-12-05T13:26:52.863 INFO:tasks.workunit.client.0.smithi029.stdout:2/869: dwrite de/d16/f47 [4194304,4194304] 0 2023-12-05T13:26:52.868 INFO:tasks.workunit.client.0.smithi029.stdout:2/870: rename de/d16/d4c/fed to de/d16/d6c/d8e/dbf/f118 0 2023-12-05T13:26:52.874 INFO:tasks.workunit.client.0.smithi029.stdout:4/834: dwrite d0/de/d30/f4c [4194304,4194304] 0 2023-12-05T13:26:52.874 INFO:tasks.workunit.client.0.smithi029.stdout:2/871: symlink de/d11/d32/dbc/l119 0 2023-12-05T13:26:52.880 INFO:tasks.workunit.client.0.smithi029.stdout:4/835: rename d0/d16/d22/d4f/f5c to d0/de/d30/d94/d106/f112 0 2023-12-05T13:26:52.881 INFO:tasks.workunit.client.0.smithi029.stdout:2/872: truncate de/d16/d6c/d8e/dbf/ff2 116259 0 2023-12-05T13:26:52.886 INFO:tasks.workunit.client.0.smithi029.stdout:2/873: unlink de/d14/f99 0 2023-12-05T13:26:52.893 INFO:tasks.workunit.client.0.smithi029.stdout:4/836: write d0/f2e [1226752,111772] 0 2023-12-05T13:26:52.896 INFO:tasks.workunit.client.0.smithi029.stdout:4/837: unlink d0/d3c/d56/f67 0 2023-12-05T13:26:52.896 INFO:tasks.workunit.client.0.smithi029.stdout:4/838: chown d0/de/d15/l1f 808078 1 2023-12-05T13:26:52.898 INFO:tasks.workunit.client.0.smithi029.stdout:4/839: mkdir d0/de/d30/d32/d35/d113 0 2023-12-05T13:26:52.901 INFO:tasks.workunit.client.0.smithi029.stdout:2/874: dwrite de/d14/d24/f89 [4194304,4194304] 0 2023-12-05T13:26:52.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/840: link d0/d1/c10c d0/de/d30/d94/da4/dd4/c114 0 2023-12-05T13:26:52.901 INFO:tasks.workunit.client.0.smithi029.stdout:4/841: write d0/d16/d2f/d69/d77/fee [186454,78794] 0 2023-12-05T13:26:52.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/875: creat de/d14/d24/d93/dc5/f11a x:0 0 0 2023-12-05T13:26:52.904 INFO:tasks.workunit.client.0.smithi029.stdout:2/876: dread - de/d16/fc8 zero size 2023-12-05T13:26:52.907 INFO:tasks.workunit.client.0.smithi029.stdout:4/842: unlink d0/d16/d22/dc2/fc4 0 2023-12-05T13:26:52.909 INFO:tasks.workunit.client.0.smithi029.stdout:4/843: unlink d0/de/d30/f68 0 2023-12-05T13:26:52.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/844: rename d0/d16/d22/d4f/cc3 to d0/d16/d22/d5f/d79/dcf/c115 0 2023-12-05T13:26:52.914 INFO:tasks.workunit.client.0.smithi029.stdout:4/845: chown d0/d16/d22/d5f/lf1 127 1 2023-12-05T13:26:52.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/846: dread d0/d16/d2f/f76 [0,4194304] 0 2023-12-05T13:26:52.916 INFO:tasks.workunit.client.0.smithi029.stdout:4/847: dread - d0/de/d30/d32/fc5 zero size 2023-12-05T13:26:52.920 INFO:tasks.workunit.client.0.smithi029.stdout:2/877: dwrite f4 [4194304,4194304] 0 2023-12-05T13:26:52.921 INFO:tasks.workunit.client.0.smithi029.stdout:2/878: rmdir de/d11/d32 39 2023-12-05T13:26:52.922 INFO:tasks.workunit.client.0.smithi029.stdout:2/879: truncate de/d11/fab 217325 0 2023-12-05T13:26:52.935 INFO:tasks.workunit.client.0.smithi029.stdout:2/880: dwrite de/d16/d6c/f7d [0,4194304] 0 2023-12-05T13:26:52.937 INFO:tasks.workunit.client.0.smithi029.stdout:2/881: creat de/d16/d6c/d90/f11b x:0 0 0 2023-12-05T13:26:52.937 INFO:tasks.workunit.client.0.smithi029.stdout:4/848: dwrite d0/de/d30/d32/d35/f58 [0,4194304] 0 2023-12-05T13:26:52.938 INFO:tasks.workunit.client.0.smithi029.stdout:2/882: mknod de/d16/d6c/d8e/dbf/c11c 0 2023-12-05T13:26:52.939 INFO:tasks.workunit.client.0.smithi029.stdout:4/849: creat d0/de/d30/d94/f116 x:0 0 0 2023-12-05T13:26:52.939 INFO:tasks.workunit.client.0.smithi029.stdout:4/850: chown d0/d41/lcd 192 1 2023-12-05T13:26:52.940 INFO:tasks.workunit.client.0.smithi029.stdout:2/883: mkdir de/d41/d56/d58/d11d 0 2023-12-05T13:26:52.940 INFO:tasks.workunit.client.0.smithi029.stdout:2/884: readlink de/d16/d43/lfd 0 2023-12-05T13:26:52.940 INFO:tasks.workunit.client.0.smithi029.stdout:4/851: unlink d0/d41/lcd 0 2023-12-05T13:26:52.941 INFO:tasks.workunit.client.0.smithi029.stdout:2/885: symlink de/d41/d56/d58/d11d/l11e 0 2023-12-05T13:26:52.942 INFO:tasks.workunit.client.0.smithi029.stdout:2/886: mknod de/d14/d24/d93/dc5/dc9/c11f 0 2023-12-05T13:26:52.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/852: dread d0/d41/f53 [0,4194304] 0 2023-12-05T13:26:52.950 INFO:tasks.workunit.client.0.smithi029.stdout:4/853: truncate d0/de/d30/d32/d35/d3d/d92/da6/fe0 933733 0 2023-12-05T13:26:52.950 INFO:tasks.workunit.client.0.smithi029.stdout:2/887: write de/d41/f51 [156680,13746] 0 2023-12-05T13:26:52.951 INFO:tasks.workunit.client.0.smithi029.stdout:4/854: symlink d0/de/d15/dc0/l117 0 2023-12-05T13:26:52.953 INFO:tasks.workunit.client.0.smithi029.stdout:4/855: mknod d0/d16/d22/d5f/c118 0 2023-12-05T13:26:52.953 INFO:tasks.workunit.client.0.smithi029.stdout:4/856: write d0/d16/d2f/fdc [15795,45604] 0 2023-12-05T13:26:52.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/905: sync 2023-12-05T13:26:52.953 INFO:tasks.workunit.client.0.smithi029.stdout:3/906: truncate d1/d10/d91/d112/f11f 615568 0 2023-12-05T13:26:52.955 INFO:tasks.workunit.client.0.smithi029.stdout:3/907: creat d1/d10/d91/f122 x:0 0 0 2023-12-05T13:26:52.955 INFO:tasks.workunit.client.0.smithi029.stdout:4/857: dread d0/d16/d2f/f76 [0,4194304] 0 2023-12-05T13:26:52.955 INFO:tasks.workunit.client.0.smithi029.stdout:4/858: write d0/de/d30/d32/f109 [322002,121465] 0 2023-12-05T13:26:52.956 INFO:tasks.workunit.client.0.smithi029.stdout:3/908: mkdir d1/d6/d11/d105/d123 0 2023-12-05T13:26:52.957 INFO:tasks.workunit.client.0.smithi029.stdout:4/859: mknod d0/da/c119 0 2023-12-05T13:26:52.961 INFO:tasks.workunit.client.0.smithi029.stdout:3/909: rename d1/d18/fa5 to d1/d10/d91/d112/d95/f124 0 2023-12-05T13:26:52.961 INFO:tasks.workunit.client.0.smithi029.stdout:4/860: mknod d0/de/d30/d32/d35/c11a 0 2023-12-05T13:26:52.964 INFO:tasks.workunit.client.0.smithi029.stdout:3/910: unlink d1/d10/l64 0 2023-12-05T13:26:52.964 INFO:tasks.workunit.client.0.smithi029.stdout:3/911: write d1/d16/fd7 [1522704,91285] 0 2023-12-05T13:26:52.966 INFO:tasks.workunit.client.0.smithi029.stdout:4/861: mkdir d0/d16/d11b 0 2023-12-05T13:26:52.966 INFO:tasks.workunit.client.0.smithi029.stdout:4/862: dread - d0/de/d15/dc0/ff4 zero size 2023-12-05T13:26:52.969 INFO:tasks.workunit.client.0.smithi029.stdout:3/912: unlink d1/d10/d91/c61 0 2023-12-05T13:26:52.969 INFO:tasks.workunit.client.0.smithi029.stdout:3/913: fsync d1/d5e/d74/fc5 0 2023-12-05T13:26:52.969 INFO:tasks.workunit.client.0.smithi029.stdout:3/914: stat d1/d5e/l88 0 2023-12-05T13:26:52.971 INFO:tasks.workunit.client.0.smithi029.stdout:2/888: dwrite de/d11/d32/dbc/fee [0,4194304] 0 2023-12-05T13:26:52.972 INFO:tasks.workunit.client.0.smithi029.stdout:3/915: unlink d1/d16/d36/d3a/fba 0 2023-12-05T13:26:52.983 INFO:tasks.workunit.client.0.smithi029.stdout:4/863: dwrite d0/d16/d22/d4f/f71 [4194304,4194304] 0 2023-12-05T13:26:52.993 INFO:tasks.workunit.client.0.smithi029.stdout:3/916: creat d1/d10/d10b/f125 x:0 0 0 2023-12-05T13:26:53.000 INFO:tasks.workunit.client.0.smithi029.stdout:4/864: mkdir d0/de/d30/d94/da4/dd4/d11c 0 2023-12-05T13:26:53.010 INFO:tasks.workunit.client.0.smithi029.stdout:4/865: dread d0/da/fb [4194304,4194304] 0 2023-12-05T13:26:53.010 INFO:tasks.workunit.client.0.smithi029.stdout:4/866: dread - d0/d41/fc9 zero size 2023-12-05T13:26:53.010 INFO:tasks.workunit.client.0.smithi029.stdout:4/867: readlink d0/d41/l8f 0 2023-12-05T13:26:53.010 INFO:tasks.workunit.client.0.smithi029.stdout:4/868: symlink d0/de/d30/d94/da4/dd4/d11c/l11d 0 2023-12-05T13:26:53.012 INFO:tasks.workunit.client.0.smithi029.stdout:4/869: getdents d0/de/d30/d32/d35/d3d/df5 0 2023-12-05T13:26:53.014 INFO:tasks.workunit.client.0.smithi029.stdout:2/889: dwrite de/d11/ffb [0,4194304] 0 2023-12-05T13:26:53.014 INFO:tasks.workunit.client.0.smithi029.stdout:4/870: rename d0/de/d30/d32/d35/d3d/d92 to d0/d16/d2f/d69/d11e 0 2023-12-05T13:26:53.014 INFO:tasks.workunit.client.0.smithi029.stdout:3/917: dwrite d1/d16/d1f/de6/f92 [0,4194304] 0 2023-12-05T13:26:53.015 INFO:tasks.workunit.client.0.smithi029.stdout:2/890: write de/d14/d24/d93/dc5/fe1 [3848235,24169] 0 2023-12-05T13:26:53.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/871: mknod d0/d16/d2f/c11f 0 2023-12-05T13:26:53.017 INFO:tasks.workunit.client.0.smithi029.stdout:4/872: dread - d0/d16/d22/d5f/d79/dcf/f101 zero size 2023-12-05T13:26:53.018 INFO:tasks.workunit.client.0.smithi029.stdout:3/918: write d1/d5e/d74/f81 [1668773,99743] 0 2023-12-05T13:26:53.019 INFO:tasks.workunit.client.0.smithi029.stdout:2/891: creat de/d16/df0/f120 x:0 0 0 2023-12-05T13:26:53.020 INFO:tasks.workunit.client.0.smithi029.stdout:4/873: creat d0/d16/d22/d5f/d79/dcf/f120 x:0 0 0 2023-12-05T13:26:53.023 INFO:tasks.workunit.client.0.smithi029.stdout:2/892: mkdir de/d121 0 2023-12-05T13:26:53.025 INFO:tasks.workunit.client.0.smithi029.stdout:4/874: creat d0/de/d15/d2b/f121 x:0 0 0 2023-12-05T13:26:53.026 INFO:tasks.workunit.client.0.smithi029.stdout:3/919: dread d1/d16/d1f/d4c/dae/fea [0,4194304] 0 2023-12-05T13:26:53.028 INFO:tasks.workunit.client.0.smithi029.stdout:2/893: getdents de/d16/d6c/d90 0 2023-12-05T13:26:53.028 INFO:tasks.workunit.client.0.smithi029.stdout:2/894: chown de/d41/f78 109084 1 2023-12-05T13:26:53.030 INFO:tasks.workunit.client.0.smithi029.stdout:2/895: dread de/d16/fcb [0,4194304] 0 2023-12-05T13:26:53.030 INFO:tasks.workunit.client.0.smithi029.stdout:4/875: mkdir d0/de/d30/d32/d35/d3d/df5/d122 0 2023-12-05T13:26:53.031 INFO:tasks.workunit.client.0.smithi029.stdout:2/896: write de/d11/d32/dbc/fee [1154727,23649] 0 2023-12-05T13:26:53.031 INFO:tasks.workunit.client.0.smithi029.stdout:2/897: chown de/d6a/la4 7 1 2023-12-05T13:26:53.031 INFO:tasks.workunit.client.0.smithi029.stdout:4/876: mkdir d0/de/d15/d123 0 2023-12-05T13:26:53.033 INFO:tasks.workunit.client.0.smithi029.stdout:2/898: creat de/f122 x:0 0 0 2023-12-05T13:26:53.036 INFO:tasks.workunit.client.0.smithi029.stdout:3/920: dread d1/d6/d4a/f97 [0,4194304] 0 2023-12-05T13:26:53.036 INFO:tasks.workunit.client.0.smithi029.stdout:3/921: truncate d1/d16/d9c/dfc/f11c 196030 0 2023-12-05T13:26:53.036 INFO:tasks.workunit.client.0.smithi029.stdout:3/922: readlink d1/d16/d1f/de6/l114 0 2023-12-05T13:26:53.037 INFO:tasks.workunit.client.0.smithi029.stdout:2/899: mkdir de/d14/d24/d123 0 2023-12-05T13:26:53.039 INFO:tasks.workunit.client.0.smithi029.stdout:2/900: mkdir de/d16/d6c/d8e/d124 0 2023-12-05T13:26:53.046 INFO:tasks.workunit.client.0.smithi029.stdout:2/901: creat de/d14/d24/d93/dc5/dc9/d10f/f125 x:0 0 0 2023-12-05T13:26:53.046 INFO:tasks.workunit.client.0.smithi029.stdout:2/902: fdatasync de/d11/d32/ff5 0 2023-12-05T13:26:53.048 INFO:tasks.workunit.client.0.smithi029.stdout:2/903: unlink de/d14/d24/d93/dc5/dc9/c11f 0 2023-12-05T13:26:53.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/904: link de/d14/c4b de/c126 0 2023-12-05T13:26:53.050 INFO:tasks.workunit.client.0.smithi029.stdout:2/905: chown de/d14/d24/c48 0 1 2023-12-05T13:26:53.051 INFO:tasks.workunit.client.0.smithi029.stdout:4/877: write d0/d1/f51 [2961925,58653] 0 2023-12-05T13:26:53.053 INFO:tasks.workunit.client.0.smithi029.stdout:3/923: dwrite d1/d6/fe2 [0,4194304] 0 2023-12-05T13:26:53.054 INFO:tasks.workunit.client.0.smithi029.stdout:3/924: truncate d1/d16/f49 4478551 0 2023-12-05T13:26:53.054 INFO:tasks.workunit.client.0.smithi029.stdout:3/925: write d1/d16/d1f/d4c/fcb [484853,68043] 0 2023-12-05T13:26:53.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/906: dwrite de/d11/d32/ff5 [0,4194304] 0 2023-12-05T13:26:53.068 INFO:tasks.workunit.client.0.smithi029.stdout:2/907: chown de/d16/l10a 1 1 2023-12-05T13:26:53.069 INFO:tasks.workunit.client.0.smithi029.stdout:2/908: read de/d16/d43/f72 [107608,96425] 0 2023-12-05T13:26:53.070 INFO:tasks.workunit.client.0.smithi029.stdout:3/926: write d1/d6/d4a/db8/ff4 [542174,58864] 0 2023-12-05T13:26:53.071 INFO:tasks.workunit.client.0.smithi029.stdout:2/909: creat de/d41/d56/d58/d11d/f127 x:0 0 0 2023-12-05T13:26:53.071 INFO:tasks.workunit.client.0.smithi029.stdout:1/914: sync 2023-12-05T13:26:53.071 INFO:tasks.workunit.client.0.smithi029.stdout:7/938: sync 2023-12-05T13:26:53.072 INFO:tasks.workunit.client.0.smithi029.stdout:3/927: creat d1/d5e/d74/dab/f126 x:0 0 0 2023-12-05T13:26:53.072 INFO:tasks.workunit.client.0.smithi029.stdout:7/939: read d6/d50/d5b/d1a/d26/d6e/f86 [3786279,30443] 0 2023-12-05T13:26:53.072 INFO:tasks.workunit.client.0.smithi029.stdout:7/940: fdatasync d6/d100/d4f/dc5/f125 0 2023-12-05T13:26:53.073 INFO:tasks.workunit.client.0.smithi029.stdout:4/878: dwrite d0/d16/d2f/d69/fdb [0,4194304] 0 2023-12-05T13:26:53.074 INFO:tasks.workunit.client.0.smithi029.stdout:1/915: creat d7/d5e/d52/d5f/d48/d10f/f128 x:0 0 0 2023-12-05T13:26:53.077 INFO:tasks.workunit.client.0.smithi029.stdout:3/928: unlink d1/d6/d4a/f9b 0 2023-12-05T13:26:53.077 INFO:tasks.workunit.client.0.smithi029.stdout:1/916: dread d7/d61/dfb/f102 [0,4194304] 0 2023-12-05T13:26:53.078 INFO:tasks.workunit.client.0.smithi029.stdout:7/941: creat d6/d50/d5b/d1a/d26/d6e/d8b/f12e x:0 0 0 2023-12-05T13:26:53.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/942: chown d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/dd3 2864066 1 2023-12-05T13:26:53.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/943: chown d6/d50/d5b/d5f/d7d/d97/d4a/d4b/dde/fb3 210 1 2023-12-05T13:26:53.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/944: fsync d6/d100/d4f/dc5/f125 0 2023-12-05T13:26:53.079 INFO:tasks.workunit.client.0.smithi029.stdout:7/945: dread - d6/d50/d5b/d5f/f10f zero size 2023-12-05T13:26:53.081 INFO:tasks.workunit.client.0.smithi029.stdout:3/929: rmdir d1/d16/d36/dec/db9 39 2023-12-05T13:26:53.082 INFO:tasks.workunit.client.0.smithi029.stdout:1/917: symlink d7/d6e/da9/d4b/db1/dd1/l129 0 2023-12-05T13:26:53.083 INFO:tasks.workunit.client.0.smithi029.stdout:7/946: mknod d6/d100/d4f/c12f 0 2023-12-05T13:26:53.086 INFO:tasks.workunit.client.0.smithi029.stdout:1/918: rename d7/d6e/da9/d4b/d72/f83 to d7/d61/d77/d9f/db4/f12a 0 2023-12-05T13:26:53.092 INFO:tasks.workunit.client.0.smithi029.stdout:2/910: dread de/d14/d24/d93/dc5/dc9/fd3 [0,4194304] 0 2023-12-05T13:26:53.095 INFO:tasks.workunit.client.0.smithi029.stdout:1/919: rename d7/d5e/fcc to d7/d61/f12b 0 2023-12-05T13:26:53.097 INFO:tasks.workunit.client.0.smithi029.stdout:2/911: dread de/d16/f2b [0,4194304] 0 2023-12-05T13:26:53.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/879: dwrite d0/d41/fc9 [0,4194304] 0 2023-12-05T13:26:53.097 INFO:tasks.workunit.client.0.smithi029.stdout:4/880: fsync d0/d16/d2f/d69/d77/fe5 0 2023-12-05T13:26:53.100 INFO:tasks.workunit.client.0.smithi029.stdout:4/881: mkdir d0/de/d30/d32/d35/d113/d124 0 2023-12-05T13:26:53.102 INFO:tasks.workunit.client.0.smithi029.stdout:4/882: creat d0/d3c/d85/db7/f125 x:0 0 0 2023-12-05T13:26:53.102 INFO:tasks.workunit.client.0.smithi029.stdout:1/920: write d7/f8f [1353584,126918] 0 2023-12-05T13:26:53.102 INFO:tasks.workunit.client.0.smithi029.stdout:4/883: truncate d0/d16/d2f/d69/d77/fee 1247087 0 2023-12-05T13:26:53.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/912: write de/d41/f103 [2674191,62197] 0 2023-12-05T13:26:53.106 INFO:tasks.workunit.client.0.smithi029.stdout:2/913: chown de/d16/fe2 10549 1 2023-12-05T13:26:53.106 INFO:tasks.workunit.client.0.smithi029.stdout:1/921: dread d7/f4d [8388608,4194304] 0 2023-12-05T13:26:53.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/914: mknod de/d16/d4c/c128 0 2023-12-05T13:26:53.110 INFO:tasks.workunit.client.0.smithi029.stdout:3/930: dwrite d1/d10/d91/dde/f10f [0,4194304] 0 2023-12-05T13:26:53.110 INFO:tasks.workunit.client.0.smithi029.stdout:3/931: chown d1/db3 61306 1 2023-12-05T13:26:53.113 INFO:tasks.workunit.client.0.smithi029.stdout:1/922: mkdir d7/d5e/d52/d5f/d12/d12c 0 2023-12-05T13:26:53.113 INFO:tasks.workunit.client.0.smithi029.stdout:3/932: mkdir d1/d5e/d121/d127 0 2023-12-05T13:26:53.114 INFO:tasks.workunit.client.0.smithi029.stdout:1/923: link d7/d5e/d52/d5f/d48/d10f/f128 d7/d61/d77/d9f/db4/d125/f12d 0 2023-12-05T13:26:53.116 INFO:tasks.workunit.client.0.smithi029.stdout:3/933: creat d1/d6/d4a/db6/f128 x:0 0 0 2023-12-05T13:26:53.117 INFO:tasks.workunit.client.0.smithi029.stdout:4/884: dwrite d0/d16/d22/d5f/d79/dcf/ff9 [0,4194304] 0 2023-12-05T13:26:53.120 INFO:tasks.workunit.client.0.smithi029.stdout:4/885: read d0/de/d30/d32/d35/f58 [3364960,32990] 0 2023-12-05T13:26:53.120 INFO:tasks.workunit.client.0.smithi029.stdout:3/934: mknod d1/d5e/d74/c129 0 2023-12-05T13:26:53.121 INFO:tasks.workunit.client.0.smithi029.stdout:4/886: creat d0/d16/d2f/d69/f126 x:0 0 0 2023-12-05T13:26:53.123 INFO:tasks.workunit.client.0.smithi029.stdout:4/887: rename d0/d1/f51 to d0/d1/f127 0 2023-12-05T13:26:53.125 INFO:tasks.workunit.client.0.smithi029.stdout:3/935: dread d1/d16/fd7 [0,4194304] 0 2023-12-05T13:26:53.125 INFO:tasks.workunit.client.0.smithi029.stdout:3/936: fsync d1/d16/f49 0 2023-12-05T13:26:53.125 INFO:tasks.workunit.client.0.smithi029.stdout:3/937: write d1/d16/d9c/fd1 [938154,120417] 0 2023-12-05T13:26:53.125 INFO:tasks.workunit.client.0.smithi029.stdout:3/938: read d1/d10/d91/dde/f10f [3863841,52741] 0 2023-12-05T13:26:53.128 INFO:tasks.workunit.client.0.smithi029.stdout:3/939: rmdir d1/d16/d1f/de6/d108 0 2023-12-05T13:26:53.128 INFO:tasks.workunit.client.0.smithi029.stdout:3/940: fsync d1/d16/d36/f66 0 2023-12-05T13:26:53.130 INFO:tasks.workunit.client.0.smithi029.stdout:3/941: getdents d1/d5e 0 2023-12-05T13:26:53.134 INFO:tasks.workunit.client.0.smithi029.stdout:1/924: dwrite d7/f13 [0,4194304] 0 2023-12-05T13:26:53.137 INFO:tasks.workunit.client.0.smithi029.stdout:1/925: symlink d7/d61/df3/l12e 0 2023-12-05T13:26:53.138 INFO:tasks.workunit.client.0.smithi029.stdout:4/888: dwrite d0/de/d15/d2b/f121 [0,4194304] 0 2023-12-05T13:26:53.138 INFO:tasks.workunit.client.0.smithi029.stdout:4/889: chown d0/d16/d22/fb4 174778 1 2023-12-05T13:26:53.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/926: link d7/f53 d7/d6e/da9/d4b/db1/dd1/f12f 0 2023-12-05T13:26:53.139 INFO:tasks.workunit.client.0.smithi029.stdout:1/927: chown d7/d5e/d52/d5f/d48/fb6 65949014 1 2023-12-05T13:26:53.142 INFO:tasks.workunit.client.0.smithi029.stdout:4/890: mknod d0/d16/d2f/d69/d11e/da6/c128 0 2023-12-05T13:26:53.143 INFO:tasks.workunit.client.0.smithi029.stdout:1/928: rename d7/d61/f92 to d7/d61/d77/d9f/db4/d125/f130 0 2023-12-05T13:26:53.145 INFO:tasks.workunit.client.0.smithi029.stdout:1/929: mknod d7/d61/d77/d10e/c131 0 2023-12-05T13:26:53.146 INFO:tasks.workunit.client.0.smithi029.stdout:4/891: dread d0/d16/f4a [0,4194304] 0 2023-12-05T13:26:53.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/930: mkdir d7/d61/dfb/d132 0 2023-12-05T13:26:53.148 INFO:tasks.workunit.client.0.smithi029.stdout:1/931: creat d7/d5b/f133 x:0 0 0 2023-12-05T13:26:53.149 INFO:tasks.workunit.client.0.smithi029.stdout:3/942: dwrite d1/d10/d91/f84 [0,4194304] 0 2023-12-05T13:26:53.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/892: dread d0/f2e [0,4194304] 0 2023-12-05T13:26:53.151 INFO:tasks.workunit.client.0.smithi029.stdout:4/893: write d0/d16/d22/d4f/f59 [2411650,120016] 0 2023-12-05T13:26:53.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/943: symlink d1/d10/d91/d112/d95/l12a 0 2023-12-05T13:26:53.151 INFO:tasks.workunit.client.0.smithi029.stdout:3/944: write d1/d16/d9c/dfc/f11c [576301,91890] 0 2023-12-05T13:26:53.155 INFO:tasks.workunit.client.0.smithi029.stdout:3/945: creat d1/d16/d36/dec/db9/f12b x:0 0 0 2023-12-05T13:26:53.158 INFO:tasks.workunit.client.0.smithi029.stdout:3/946: rename d1/d6/d11/d105/c11a to d1/d16/d36/d3a/d6c/c12c 0 2023-12-05T13:26:53.160 INFO:tasks.workunit.client.0.smithi029.stdout:4/894: mkdir d0/d16/d22/d5f/d79/d129 0 2023-12-05T13:26:53.160 INFO:tasks.workunit.client.0.smithi029.stdout:3/947: rename d1/d6/d4a/db6/ld8 to d1/d10/d91/d112/d95/l12d 0 2023-12-05T13:26:53.161 INFO:tasks.workunit.client.0.smithi029.stdout:4/895: mknod d0/d41/c12a 0 2023-12-05T13:26:53.161 INFO:tasks.workunit.client.0.smithi029.stdout:3/948: creat d1/d10/d10b/f12e x:0 0 0 2023-12-05T13:26:53.163 INFO:tasks.workunit.client.0.smithi029.stdout:3/949: mkdir d1/d5e/d74/d12f 0 2023-12-05T13:26:53.164 INFO:tasks.workunit.client.0.smithi029.stdout:1/932: dwrite d7/d61/d77/d9f/db4/f12a [0,4194304] 0 2023-12-05T13:26:53.164 INFO:tasks.workunit.client.0.smithi029.stdout:3/950: write d1/d18/f45 [3790092,107936] 0 2023-12-05T13:26:53.165 INFO:tasks.workunit.client.0.smithi029.stdout:1/933: creat d7/d61/d123/f134 x:0 0 0 2023-12-05T13:26:53.167 INFO:tasks.workunit.client.0.smithi029.stdout:4/896: dread d0/d16/d22/d4f/f6d [0,4194304] 0 2023-12-05T13:26:53.167 INFO:tasks.workunit.client.0.smithi029.stdout:3/951: link d1/f2 d1/d5e/d74/ded/f130 0 2023-12-05T13:26:53.167 INFO:tasks.workunit.client.0.smithi029.stdout:3/952: getdents d1/d10/d91/d112/d95/d111 0 2023-12-05T13:26:53.167 INFO:tasks.workunit.client.0.smithi029.stdout:3/953: chown d1/d16/d1f/fbf 25084068 1 2023-12-05T13:26:53.168 INFO:tasks.workunit.client.0.smithi029.stdout:1/934: symlink d7/d5e/l135 0 2023-12-05T13:26:53.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/954: write d1/d5e/d74/fd4 [309961,100469] 0 2023-12-05T13:26:53.169 INFO:tasks.workunit.client.0.smithi029.stdout:3/955: write d1/f101 [679479,112859] 0 2023-12-05T13:26:53.169 INFO:tasks.workunit.client.0.smithi029.stdout:4/897: mknod d0/d3c/d56/d110/c12b 0 2023-12-05T13:26:53.170 INFO:tasks.workunit.client.0.smithi029.stdout:1/935: rename d7/f13 to d7/d56/f136 0 2023-12-05T13:26:53.171 INFO:tasks.workunit.client.0.smithi029.stdout:3/956: mknod d1/d10/d10b/c131 0 2023-12-05T13:26:53.171 INFO:tasks.workunit.client.0.smithi029.stdout:3/957: readlink d1/db3/d72/l77 0 2023-12-05T13:26:53.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/898: creat d0/d3c/d85/f12c x:0 0 0 2023-12-05T13:26:53.172 INFO:tasks.workunit.client.0.smithi029.stdout:4/899: chown d0/de/d30/d32/ddf/fff 6551 1 2023-12-05T13:26:53.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/936: creat d7/d5e/d52/d5f/d12/d60/df6/f137 x:0 0 0 2023-12-05T13:26:53.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/937: stat d7/d56/ff0 0 2023-12-05T13:26:53.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/938: readlink d7/d5e/leb 0 2023-12-05T13:26:53.174 INFO:tasks.workunit.client.0.smithi029.stdout:1/939: stat d7/d6e/da9/d4b/d72/fbe 0 2023-12-05T13:26:53.174 INFO:tasks.workunit.client.0.smithi029.stdout:4/900: mkdir d0/de/d15/dc0/d12d 0 2023-12-05T13:26:53.176 INFO:tasks.workunit.client.0.smithi029.stdout:4/901: read d0/d41/f53 [270216,94030] 0 2023-12-05T13:26:53.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/958: dread d1/d10/d91/f96 [0,4194304] 0 2023-12-05T13:26:53.176 INFO:tasks.workunit.client.0.smithi029.stdout:4/902: chown d0/d16/d22 3 1 2023-12-05T13:26:53.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/959: fsync d1/d16/d36/f66 0 2023-12-05T13:26:53.176 INFO:tasks.workunit.client.0.smithi029.stdout:3/960: getdents d1/d16/d1f/d4c/d11b 0 2023-12-05T13:26:53.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/940: rename d7/d56/lce to d7/d5e/d52/l138 0 2023-12-05T13:26:53.177 INFO:tasks.workunit.client.0.smithi029.stdout:1/941: readlink d7/d5e/d52/d5f/d48/lf8 0 2023-12-05T13:26:53.178 INFO:tasks.workunit.client.0.smithi029.stdout:3/961: symlink d1/d5e/d74/ded/l132 0 2023-12-05T13:26:53.179 INFO:tasks.workunit.client.0.smithi029.stdout:4/903: dread d0/d3c/d85/fde [0,4194304] 0 2023-12-05T13:26:53.179 INFO:tasks.workunit.client.0.smithi029.stdout:3/962: unlink d1/d16/f117 0 2023-12-05T13:26:53.186 INFO:tasks.workunit.client.0.smithi029.stdout:1/942: dread d7/d5e/d52/d5f/d48/f98 [0,4194304] 0 2023-12-05T13:26:53.187 INFO:tasks.workunit.client.0.smithi029.stdout:3/963: dread d1/d5e/f6d [0,4194304] 0 2023-12-05T13:26:53.188 INFO:tasks.workunit.client.0.smithi029.stdout:1/943: symlink d7/d61/d77/d9f/db4/d125/l139 0 2023-12-05T13:26:53.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/944: fsync d7/d5e/d52/d90/f9b 0 2023-12-05T13:26:53.189 INFO:tasks.workunit.client.0.smithi029.stdout:1/945: truncate d7/d5e/d52/d5f/d12/f93 1436735 0 2023-12-05T13:26:53.191 INFO:tasks.workunit.client.0.smithi029.stdout:3/964: creat d1/d6/f133 x:0 0 0 2023-12-05T13:26:53.191 INFO:tasks.workunit.client.0.smithi029.stdout:3/965: write d1/d10/d91/d112/d95/f124 [997399,52084] 0 2023-12-05T13:26:53.191 INFO:tasks.workunit.client.0.smithi029.stdout:3/966: fdatasync d1/d10/d91/dde/f11d 0 2023-12-05T13:26:53.193 INFO:tasks.workunit.client.0.smithi029.stdout:3/967: mkdir d1/d134 0 2023-12-05T13:26:53.194 INFO:tasks.workunit.client.0.smithi029.stdout:3/968: symlink d1/d16/d36/dec/l135 0 2023-12-05T13:26:53.195 INFO:tasks.workunit.client.0.smithi029.stdout:4/904: dwrite d0/d16/d22/d5f/d79/dcf/f101 [0,4194304] 0 2023-12-05T13:26:53.199 INFO:tasks.workunit.client.0.smithi029.stdout:3/969: link d1/db3/dc7/fe5 d1/d6/f136 0 2023-12-05T13:26:53.201 INFO:tasks.workunit.client.0.smithi029.stdout:3/970: unlink d1/d16/d1f/d4c/ce9 0 2023-12-05T13:26:53.223 INFO:tasks.workunit.client.0.smithi029.stdout:3/971: dwrite d1/d10/d91/d112/d95/f124 [0,4194304] 0 2023-12-05T13:26:53.228 INFO:tasks.workunit.client.0.smithi029.stdout:3/972: truncate d1/d16/d1f/de6/f92 4043705 0 2023-12-05T13:26:53.229 INFO:tasks.workunit.client.0.smithi029.stdout:3/973: read d1/d16/d9c/dfc/f11c [66872,99928] 0 2023-12-05T13:26:53.230 INFO:tasks.workunit.client.0.smithi029.stdout:3/974: mknod d1/d16/d36/dec/db9/c137 0 2023-12-05T13:26:53.230 INFO:tasks.workunit.client.0.smithi029.stdout:3/975: getdents d1/d6/d4a/db6/d10e 0 2023-12-05T13:26:53.231 INFO:tasks.workunit.client.0.smithi029.stdout:3/976: write d1/d16/f110 [199688,34210] 0 2023-12-05T13:26:53.236 INFO:tasks.workunit.client.0.smithi029.stdout:4/905: dwrite d0/d16/d2f/d69/d77/fa3 [0,4194304] 0 2023-12-05T13:26:53.250 INFO:tasks.workunit.client.0.smithi029.stdout:3/977: dwrite d1/d10/d91/d112/d95/f124 [0,4194304] 0 2023-12-05T13:26:53.251 INFO:tasks.workunit.client.0.smithi029.stdout:4/906: dwrite d0/f23 [4194304,4194304] 0 2023-12-05T13:26:53.251 INFO:tasks.workunit.client.0.smithi029.stdout:4/907: chown d0/de/d30/d32/d35/d3d/df5 23 1 2023-12-05T13:26:53.251 INFO:tasks.workunit.client.0.smithi029.stdout:4/908: write d0/de/d30/d32/fa5 [4342165,27159] 0 2023-12-05T13:26:53.251 INFO:tasks.workunit.client.0.smithi029.stdout:4/909: readlink d0/de/d15/l90 0 2023-12-05T13:26:53.251 INFO:tasks.workunit.client.0.smithi029.stdout:3/978: unlink d1/d6/d4a/db6/lcf 0 2023-12-05T13:26:53.252 INFO:tasks.workunit.client.0.smithi029.stdout:5/743: sync 2023-12-05T13:26:53.252 INFO:tasks.workunit.client.0.smithi029.stdout:6/994: sync 2023-12-05T13:26:53.252 INFO:tasks.workunit.client.0.smithi029.stdout:0/853: sync 2023-12-05T13:26:53.253 INFO:tasks.workunit.client.0.smithi029.stdout:3/979: getdents d1/d6/d11 0 2023-12-05T13:26:53.254 INFO:tasks.workunit.client.0.smithi029.stdout:4/910: creat d0/d16/d2f/d69/f12e x:0 0 0 2023-12-05T13:26:53.256 INFO:tasks.workunit.client.0.smithi029.stdout:0/854: rename dc/d13/d4f/d91/fd1 to dc/d23/f113 0 2023-12-05T13:26:53.256 INFO:tasks.workunit.client.0.smithi029.stdout:0/855: stat dc/d13/d4f/d63/f87 0 2023-12-05T13:26:53.261 INFO:tasks.workunit.client.0.smithi029.stdout:5/744: symlink d1/dc/d10/d1e/d33/d93/da5/db2/da6/dd6/lf3 0 2023-12-05T13:26:53.261 INFO:tasks.workunit.client.0.smithi029.stdout:3/980: creat d1/d16/d36/d3a/d6c/f138 x:0 0 0 2023-12-05T13:26:53.261 INFO:tasks.workunit.client.0.smithi029.stdout:4/911: symlink d0/de/d30/d94/l12f 0 2023-12-05T13:26:53.262 INFO:tasks.workunit.client.0.smithi029.stdout:4/912: truncate d0/d16/d2f/d69/f12e 117821 0 2023-12-05T13:26:53.262 INFO:tasks.workunit.client.0.smithi029.stdout:0/856: rename dc/d33/d3d/d65/de8 to dc/d23/d3a/d41/d57/d58/dcd/d114 0 2023-12-05T13:26:53.268 INFO:tasks.workunit.client.0.smithi029.stdout:3/981: mknod d1/d6/d4a/db6/d10e/c139 0 2023-12-05T13:26:53.268 INFO:tasks.workunit.client.0.smithi029.stdout:4/913: mknod d0/d16/c130 0 2023-12-05T13:26:53.269 INFO:tasks.workunit.client.0.smithi029.stdout:3/982: write d1/d16/fb2 [2181969,124637] 0 2023-12-05T13:26:53.269 INFO:tasks.workunit.client.0.smithi029.stdout:3/983: readlink d1/d6/d4a/db6/ld9 0 2023-12-05T13:26:53.272 INFO:tasks.workunit.client.0.smithi029.stdout:4/914: link d0/d16/c130 d0/d16/dd0/c131 0 2023-12-05T13:26:53.272 INFO:tasks.workunit.client.0.smithi029.stdout:4/915: write d0/d3c/d85/ff3 [271005,57110] 0 2023-12-05T13:26:53.273 INFO:tasks.workunit.client.0.smithi029.stdout:4/916: fdatasync d0/d16/d2f/d69/d77/fa3 0 2023-12-05T13:26:53.273 INFO:tasks.workunit.client.0.smithi029.stdout:4/917: truncate d0/d16/d22/d98/fba 4377212 0 2023-12-05T13:26:53.273 INFO:tasks.workunit.client.0.smithi029.stdout:4/918: fsync d0/d16/d2f/d69/fec 0 2023-12-05T13:26:53.274 INFO:tasks.workunit.client.0.smithi029.stdout:4/919: symlink d0/de/d30/d32/ddf/l132 0 2023-12-05T13:26:53.275 INFO:tasks.workunit.client.0.smithi029.stdout:3/984: write d1/d18/f45 [2438208,114670] 0 2023-12-05T13:26:53.275 INFO:tasks.workunit.client.0.smithi029.stdout:3/985: fdatasync d1/d6/d4a/db8/ff4 0 2023-12-05T13:26:53.275 INFO:tasks.workunit.client.0.smithi029.stdout:3/986: stat d1/d5e/d74/c7a 0 2023-12-05T13:26:53.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/920: getdents d0/d41 0 2023-12-05T13:26:53.278 INFO:tasks.workunit.client.0.smithi029.stdout:4/921: dread - d0/d16/d22/d5f/d79/dcf/f120 zero size 2023-12-05T13:26:53.278 INFO:tasks.workunit.client.0.smithi029.stdout:5/745: dwrite d1/dc/d11/f35 [0,4194304] 0 2023-12-05T13:26:53.279 INFO:tasks.workunit.client.0.smithi029.stdout:6/995: dwrite d6/d1d/d36/f120 [0,4194304] 0 2023-12-05T13:26:53.280 INFO:tasks.workunit.client.0.smithi029.stdout:3/987: creat d1/d5e/d121/d127/f13a x:0 0 0 2023-12-05T13:26:53.282 INFO:tasks.workunit.client.0.smithi029.stdout:0/857: dwrite dc/d33/d3d/d7a/d84/db1/fbd [4194304,4194304] 0 2023-12-05T13:26:53.286 INFO:tasks.workunit.client.0.smithi029.stdout:5/746: unlink d1/dc/d38/d3a/l54 0 2023-12-05T13:26:53.286 INFO:tasks.workunit.client.0.smithi029.stdout:5/747: dread - d1/dc/d38/d3a/d5c/fef zero size 2023-12-05T13:26:53.289 INFO:tasks.workunit.client.0.smithi029.stdout:6/996: creat d6/d29/dc4/d125/f155 x:0 0 0 2023-12-05T13:26:53.290 INFO:tasks.workunit.client.0.smithi029.stdout:4/922: dwrite d0/d16/d22/f105 [0,4194304] 0 2023-12-05T13:26:53.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/923: read d0/d3c/d85/fde [257569,99756] 0 2023-12-05T13:26:53.291 INFO:tasks.workunit.client.0.smithi029.stdout:3/988: unlink d1/d5e/d74/dab/f126 0 2023-12-05T13:26:53.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/989: write d1/d16/d9c/dfc/f11c [769991,101175] 0 2023-12-05T13:26:53.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/990: truncate d1/d6/f133 502528 0 2023-12-05T13:26:53.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/991: chown d1/d10/d91/d112/fa1 664 1 2023-12-05T13:26:53.292 INFO:tasks.workunit.client.0.smithi029.stdout:3/992: dread d1/d18/fa0 [0,4194304] 0 2023-12-05T13:26:53.293 INFO:tasks.workunit.client.0.smithi029.stdout:3/993: fdatasync d1/d5e/d74/fd4 0 2023-12-05T13:26:53.293 INFO:tasks.workunit.client.0.smithi029.stdout:0/858: mkdir dc/d33/d3d/d7a/d84/d8d/d105/d115 0 2023-12-05T13:26:53.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/748: rename d1/dc/d10/d1e/d33/f6b to d1/dc/d10/d1e/ff4 0 2023-12-05T13:26:53.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/749: dread - d1/dc/d25/d4c/d61/f90 zero size 2023-12-05T13:26:53.295 INFO:tasks.workunit.client.0.smithi029.stdout:5/750: stat d1/dc/d11/d17/d3d/leb 0 2023-12-05T13:26:53.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/997: creat d6/d29/dc4/d40/d74/d59/dfb/d138/f156 x:0 0 0 2023-12-05T13:26:53.296 INFO:tasks.workunit.client.0.smithi029.stdout:6/998: chown d6/d1d/l12b 1 1 2023-12-05T13:26:53.298 INFO:tasks.workunit.client.0.smithi029.stdout:4/924: mkdir d0/de/d30/d94/d106/d133 0 2023-12-05T13:26:53.300 INFO:tasks.workunit.client.0.smithi029.stdout:3/994: creat d1/d5e/d74/d12f/f13b x:0 0 0 2023-12-05T13:26:53.301 INFO:tasks.workunit.client.0.smithi029.stdout:3/995: write d1/d10/f8c [1404351,130870] 0 2023-12-05T13:26:53.301 INFO:tasks.workunit.client.0.smithi029.stdout:3/996: fsync d1/d16/d36/dec/fac 0 2023-12-05T13:26:53.304 INFO:tasks.workunit.client.0.smithi029.stdout:0/859: creat dc/d33/d3d/d7a/d84/dfe/f116 x:0 0 0 2023-12-05T13:26:53.306 INFO:tasks.workunit.client.0.smithi029.stdout:5/751: mkdir d1/dc/d10/d1e/d33/d93/da5/df5 0 2023-12-05T13:26:53.309 INFO:tasks.workunit.client.0.smithi029.stdout:6/999: mkdir d6/d3f/db7/def/d157 0 2023-12-05T13:26:53.311 INFO:tasks.workunit.client.0.smithi029.stdout:3/997: symlink d1/d5e/d74/ded/l13c 0 2023-12-05T13:26:53.314 INFO:tasks.workunit.client.0.smithi029.stdout:5/752: getdents d1/dc/d10/d1e/d75 0 2023-12-05T13:26:53.318 INFO:tasks.workunit.client.0.smithi029.stdout:4/925: dwrite d0/de/d30/d32/fa5 [0,4194304] 0 2023-12-05T13:26:53.322 INFO:tasks.workunit.client.0.smithi029.stdout:0/860: rename dc/d33/d3d/d7a/d84/d8d/d105 to dc/d33/d3d/d65/d85/d117 0 2023-12-05T13:26:53.322 INFO:tasks.workunit.client.0.smithi029.stdout:0/861: readlink dc/d33/d47/l68 0 2023-12-05T13:26:53.322 INFO:tasks.workunit.client.0.smithi029.stdout:0/862: stat dc/l22 0 2023-12-05T13:26:53.322 INFO:tasks.workunit.client.0.smithi029.stdout:0/863: read - dc/d23/d3a/f10b zero size 2023-12-05T13:26:53.325 INFO:tasks.workunit.client.0.smithi029.stdout:3/998: creat d1/d16/d9c/dfc/f13d x:0 0 0 2023-12-05T13:26:53.328 INFO:tasks.workunit.client.0.smithi029.stdout:5/753: symlink d1/dc/lf6 0 2023-12-05T13:26:53.333 INFO:tasks.workunit.client.0.smithi029.stdout:4/926: rename d0/d16/d2f to d0/de/d30/d94/d106/d134 0 2023-12-05T13:26:53.334 INFO:tasks.workunit.client.0.smithi029.stdout:0/864: symlink dc/d33/d3d/d7a/d84/db1/l118 0 2023-12-05T13:26:53.335 INFO:tasks.workunit.client.0.smithi029.stdout:5/754: write d1/dc/d10/d1e/d9c/fdb [841119,121704] 0 2023-12-05T13:26:53.335 INFO:tasks.workunit.client.0.smithi029.stdout:0/865: dread dc/d23/d3a/d41/d57/d58/d73/fce [0,4194304] 0 2023-12-05T13:26:53.336 INFO:tasks.workunit.client.0.smithi029.stdout:4/927: mknod d0/de/d30/d94/d106/d134/dd7/c135 0 2023-12-05T13:26:53.338 INFO:tasks.workunit.client.0.smithi029.stdout:3/999: rename d1/d6/c17 to d1/d6/d4a/db6/d10e/c13e 0 2023-12-05T13:26:53.341 INFO:tasks.workunit.client.0.smithi029.stdout:5/755: fdatasync d1/dc/d27/f49 0 2023-12-05T13:26:53.346 INFO:tasks.workunit.client.0.smithi029.stdout:4/928: creat d0/de/d30/d32/d35/d3d/df5/d122/f136 x:0 0 0 2023-12-05T13:26:53.349 INFO:tasks.workunit.client.0.smithi029.stdout:5/756: dread - d1/dc/d25/d4c/d9b/d9a/fe7 zero size 2023-12-05T13:26:53.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/866: dwrite dc/d23/dbf/fd4 [0,4194304] 0 2023-12-05T13:26:53.353 INFO:tasks.workunit.client.0.smithi029.stdout:5/757: unlink d1/dc/d10/d1e/d33/d93/da5/db2/fde 0 2023-12-05T13:26:53.361 INFO:tasks.workunit.client.0.smithi029.stdout:0/867: creat dc/d23/d3a/d41/d57/d58/f119 x:0 0 0 2023-12-05T13:26:53.363 INFO:tasks.workunit.client.0.smithi029.stdout:4/929: dwrite d0/de/d30/d94/d106/d134/d69/d77/fe5 [0,4194304] 0 2023-12-05T13:26:53.364 INFO:tasks.workunit.client.0.smithi029.stdout:5/758: dread d1/dc/d25/d4c/d9b/d9a/fab [0,4194304] 0 2023-12-05T13:26:53.366 INFO:tasks.workunit.client.0.smithi029.stdout:0/868: write dc/d23/d3a/d41/f4b [3072721,91651] 0 2023-12-05T13:26:53.367 INFO:tasks.workunit.client.0.smithi029.stdout:5/759: creat d1/dc/d10/d1e/d33/ff7 x:0 0 0 2023-12-05T13:26:53.368 INFO:tasks.workunit.client.0.smithi029.stdout:0/869: mkdir dc/d23/d3a/d11a 0 2023-12-05T13:26:53.368 INFO:tasks.workunit.client.0.smithi029.stdout:0/870: fdatasync dc/d13/f34 0 2023-12-05T13:26:53.369 INFO:tasks.workunit.client.0.smithi029.stdout:5/760: chown d1/dc/d11/d17/d3d/leb 37 1 2023-12-05T13:26:53.371 INFO:tasks.workunit.client.0.smithi029.stdout:5/761: rename d1/dc/d11/d17/d3d/le4 to d1/lf8 0 2023-12-05T13:26:53.372 INFO:tasks.workunit.client.0.smithi029.stdout:5/762: readlink d1/dc/lf6 0 2023-12-05T13:26:53.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/930: dread d0/d16/d22/f105 [0,4194304] 0 2023-12-05T13:26:53.372 INFO:tasks.workunit.client.0.smithi029.stdout:4/931: fdatasync d0/d16/d22/d5f/d79/fbf 0 2023-12-05T13:26:53.375 INFO:tasks.workunit.client.0.smithi029.stdout:5/763: link d1/dc/d11/f12 d1/dc/d25/d4c/ff9 0 2023-12-05T13:26:53.375 INFO:tasks.workunit.client.0.smithi029.stdout:5/764: stat d1/dc/d25/d4c/d9b/fdf 0 2023-12-05T13:26:53.376 INFO:tasks.workunit.client.0.smithi029.stdout:4/932: dread d0/de/d15/f49 [4194304,4194304] 0 2023-12-05T13:26:53.377 INFO:tasks.workunit.client.0.smithi029.stdout:4/933: creat d0/d16/db6/f137 x:0 0 0 2023-12-05T13:26:53.378 INFO:tasks.workunit.client.0.smithi029.stdout:4/934: mknod d0/d1/dfe/c138 0 2023-12-05T13:26:53.379 INFO:tasks.workunit.client.0.smithi029.stdout:4/935: unlink d0/de/d30/d94/lac 0 2023-12-05T13:26:53.380 INFO:tasks.workunit.client.0.smithi029.stdout:4/936: rename d0/de/d30/d94/da4 to d0/de/d30/d32/dbd/d139 0 2023-12-05T13:26:53.393 INFO:tasks.workunit.client.0.smithi029.stdout:4/937: dwrite d0/d41/fe8 [0,4194304] 0 2023-12-05T13:26:53.394 INFO:tasks.workunit.client.0.smithi029.stdout:4/938: mknod d0/d41/c13a 0 2023-12-05T13:26:53.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:53 smithi029 ceph-mon[112128]: pgmap v48: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 43 MiB/s wr, 79 op/s 2023-12-05T13:26:53.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:53 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:53.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:53 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:53.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:53 smithi029 ceph-mon[112128]: Reconfiguring prometheus.smithi029 (dependencies changed)... 2023-12-05T13:26:53.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:53 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:53.754 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:53 smithi029 ceph-mon[112128]: Reconfiguring daemon prometheus.smithi029 on smithi029 2023-12-05T13:26:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:53 smithi052 ceph-mon[121072]: pgmap v48: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 43 MiB/s wr, 79 op/s 2023-12-05T13:26:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:53 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:53 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:53 smithi052 ceph-mon[121072]: Reconfiguring prometheus.smithi029 (dependencies changed)... 2023-12-05T13:26:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:53 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:26:53.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:53 smithi052 ceph-mon[121072]: Reconfiguring daemon prometheus.smithi029 on smithi029 2023-12-05T13:26:54.661 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:54 smithi029 ceph-mon[112128]: mgrmap e26: smithi052.ocazcp(active, since 91s), standbys: smithi029.eekhlu 2023-12-05T13:26:54.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:54 smithi052 ceph-mon[121072]: mgrmap e26: smithi052.ocazcp(active, since 91s), standbys: smithi029.eekhlu 2023-12-05T13:26:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:55 smithi029 ceph-mon[112128]: pgmap v49: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 134 MiB/s wr, 210 op/s 2023-12-05T13:26:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:55 smithi052 ceph-mon[121072]: pgmap v49: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 134 MiB/s wr, 210 op/s 2023-12-05T13:26:57.372 INFO:tasks.workunit.client.0.smithi029.stdout:2/915: sync 2023-12-05T13:26:57.372 INFO:tasks.workunit.client.0.smithi029.stdout:7/947: sync 2023-12-05T13:26:57.372 INFO:tasks.workunit.client.0.smithi029.stdout:0/871: sync 2023-12-05T13:26:57.372 INFO:tasks.workunit.client.0.smithi029.stdout:1/946: sync 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:5/765: sync 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:4/939: sync 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:5/766: fdatasync d1/dc/d25/d4c/d9b/d9a/fab 0 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:1/947: dread - d7/d56/f108 zero size 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:7/948: fsync d6/d100/d4f/d93/fa3 0 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:2/916: readlink de/d41/l6d 0 2023-12-05T13:26:57.373 INFO:tasks.workunit.client.0.smithi029.stdout:5/767: stat d1/dc/d10/d1e/d33 0 2023-12-05T13:26:57.374 INFO:tasks.workunit.client.0.smithi029.stdout:2/917: read de/d41/d56/d58/fce [1481744,53291] 0 2023-12-05T13:26:57.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/949: dread d6/d50/d5b/d1a/d26/ff5 [0,4194304] 0 2023-12-05T13:26:57.376 INFO:tasks.workunit.client.0.smithi029.stdout:7/950: chown d6/d50/l80 19487 1 2023-12-05T13:26:57.377 INFO:tasks.workunit.client.0.smithi029.stdout:5/768: creat d1/dc/d25/d4c/d9b/d9a/ffa x:0 0 0 2023-12-05T13:26:57.378 INFO:tasks.workunit.client.0.smithi029.stdout:7/951: truncate d6/f22 1880813 0 2023-12-05T13:26:57.378 INFO:tasks.workunit.client.0.smithi029.stdout:7/952: readlink d6/d50/d5b/d5f/d7d/d97/db2/lb7 0 2023-12-05T13:26:57.381 INFO:tasks.workunit.client.0.smithi029.stdout:7/953: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/d119/fa8 to d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/dca/f130 0 2023-12-05T13:26:57.381 INFO:tasks.workunit.client.0.smithi029.stdout:7/954: readlink d6/d50/d5b/d5f/d7d/d96/lc0 0 2023-12-05T13:26:57.381 INFO:tasks.workunit.client.0.smithi029.stdout:5/769: write d1/dc/f89 [99355,99062] 0 2023-12-05T13:26:57.381 INFO:tasks.workunit.client.0.smithi029.stdout:5/770: stat d1/dc/d25/d4c/d61/f90 0 2023-12-05T13:26:57.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/771: getdents d1/dc/d25/d4c 0 2023-12-05T13:26:57.382 INFO:tasks.workunit.client.0.smithi029.stdout:5/772: stat d1/dc/d11/d17/lb7 0 2023-12-05T13:26:57.383 INFO:tasks.workunit.client.0.smithi029.stdout:5/773: write d1/dc/d11/f12 [2686261,74061] 0 2023-12-05T13:26:57.402 INFO:tasks.workunit.client.0.smithi029.stdout:0/872: dwrite dc/d13/d4f/d88/dc4/f10c [0,4194304] 0 2023-12-05T13:26:57.410 INFO:tasks.workunit.client.0.smithi029.stdout:5/774: fsync d1/dc/d10/d1e/d33/fc5 0 2023-12-05T13:26:57.410 INFO:tasks.workunit.client.0.smithi029.stdout:1/948: dwrite d7/d5e/d52/d5f/d48/f67 [4194304,4194304] 0 2023-12-05T13:26:57.411 INFO:tasks.workunit.client.0.smithi029.stdout:5/775: read d1/dc/d25/d4c/f52 [618390,115730] 0 2023-12-05T13:26:57.412 INFO:tasks.workunit.client.0.smithi029.stdout:4/940: dwrite d0/de/d30/d94/d106/d134/d69/d77/fee [0,4194304] 0 2023-12-05T13:26:57.415 INFO:tasks.workunit.client.0.smithi029.stdout:5/776: getdents d1/dc/d10/d1e/d33/d93 0 2023-12-05T13:26:57.428 INFO:tasks.workunit.client.0.smithi029.stdout:1/949: dwrite d7/fcd [0,4194304] 0 2023-12-05T13:26:57.449 INFO:tasks.workunit.client.0.smithi029.stdout:5/777: dwrite d1/dc/d38/f22 [0,4194304] 0 2023-12-05T13:26:57.450 INFO:tasks.workunit.client.0.smithi029.stdout:5/778: mknod d1/dc/d10/cfb 0 2023-12-05T13:26:57.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/779: getdents d1/dc/d25 0 2023-12-05T13:26:57.451 INFO:tasks.workunit.client.0.smithi029.stdout:5/780: chown d1/dc/d38/c99 0 1 2023-12-05T13:26:57.454 INFO:tasks.workunit.client.0.smithi029.stdout:5/781: dread d1/dc/d10/d1e/d9c/fdb [0,4194304] 0 2023-12-05T13:26:57.470 INFO:tasks.workunit.client.0.smithi029.stdout:7/955: mkdir d6/d100/d131 0 2023-12-05T13:26:57.471 INFO:tasks.workunit.client.0.smithi029.stdout:7/956: dread d6/d50/d5b/d1a/d26/d72/f76 [0,4194304] 0 2023-12-05T13:26:57.505 INFO:tasks.workunit.client.0.smithi029.stdout:5/782: creat d1/dc/d25/ffc x:0 0 0 2023-12-05T13:26:57.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/783: unlink d1/dc/d11/d17/ff2 0 2023-12-05T13:26:57.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/784: dread - d1/dc/d27/fbb zero size 2023-12-05T13:26:57.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/785: read d1/dc/d25/d4c/d9b/d9a/fab [672813,50149] 0 2023-12-05T13:26:57.510 INFO:tasks.workunit.client.0.smithi029.stdout:5/786: read d1/dc/d11/d17/f9f [3854565,42165] 0 2023-12-05T13:26:57.510 INFO:tasks.workunit.client.0.smithi029.stdout:5/787: chown d1/dc/d10/fda 14774 1 2023-12-05T13:26:57.510 INFO:tasks.workunit.client.0.smithi029.stdout:5/788: stat d1/dc/d38/f40 0 2023-12-05T13:26:57.512 INFO:tasks.workunit.client.0.smithi029.stdout:5/789: creat d1/dc/d10/d1e/d33/d93/da5/db2/da6/dd6/ffd x:0 0 0 2023-12-05T13:26:57.512 INFO:tasks.workunit.client.0.smithi029.stdout:5/790: chown d1/dc/d25/d4c/d61 9 1 2023-12-05T13:26:57.512 INFO:tasks.workunit.client.0.smithi029.stdout:5/791: readlink d1/dc/d11/d17/lb7 0 2023-12-05T13:26:57.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/792: mkdir d1/dc/d10/d1e/d33/dfe 0 2023-12-05T13:26:57.514 INFO:tasks.workunit.client.0.smithi029.stdout:5/793: mkdir d1/dc/d38/d4b/dff 0 2023-12-05T13:26:57.522 INFO:tasks.workunit.client.0.smithi029.stdout:1/950: unlink d7/c6a 0 2023-12-05T13:26:57.522 INFO:tasks.workunit.client.0.smithi029.stdout:4/941: rmdir d0/de/d30/d32 39 2023-12-05T13:26:57.523 INFO:tasks.workunit.client.0.smithi029.stdout:4/942: getdents d0/d16/d22/d98 0 2023-12-05T13:26:57.523 INFO:tasks.workunit.client.0.smithi029.stdout:4/943: stat d0/d16/c87 0 2023-12-05T13:26:57.525 INFO:tasks.workunit.client.0.smithi029.stdout:4/944: unlink d0/de/d30/d94/d106/d134/d69/fec 0 2023-12-05T13:26:57.525 INFO:tasks.workunit.client.0.smithi029.stdout:4/945: write d0/de/d30/d32/fb8 [1447819,27993] 0 2023-12-05T13:26:57.525 INFO:tasks.workunit.client.0.smithi029.stdout:4/946: chown d0/lcc 496963147 1 2023-12-05T13:26:57.528 INFO:tasks.workunit.client.0.smithi029.stdout:0/873: symlink dc/d23/d3a/d41/d57/d58/l11b 0 2023-12-05T13:26:57.528 INFO:tasks.workunit.client.0.smithi029.stdout:0/874: stat dc/d23/dbf/fd4 0 2023-12-05T13:26:57.528 INFO:tasks.workunit.client.0.smithi029.stdout:0/875: fsync dc/d33/d3d/d65/d85/d117/f112 0 2023-12-05T13:26:57.529 INFO:tasks.workunit.client.0.smithi029.stdout:0/876: write dc/d13/d4f/d63/f107 [728814,77408] 0 2023-12-05T13:26:57.530 INFO:tasks.workunit.client.0.smithi029.stdout:1/951: dread d7/d5e/f28 [0,4194304] 0 2023-12-05T13:26:57.539 INFO:tasks.workunit.client.0.smithi029.stdout:0/877: dread dc/d23/d3a/d41/d57/f77 [0,4194304] 0 2023-12-05T13:26:57.539 INFO:tasks.workunit.client.0.smithi029.stdout:2/918: link de/d14/fe5 de/d14/d24/f129 0 2023-12-05T13:26:57.540 INFO:tasks.workunit.client.0.smithi029.stdout:2/919: dread - de/f122 zero size 2023-12-05T13:26:57.547 INFO:tasks.workunit.client.0.smithi029.stdout:0/878: dread dc/f35 [0,4194304] 0 2023-12-05T13:26:57.547 INFO:tasks.workunit.client.0.smithi029.stdout:0/879: chown dc/d13/d4f/d91/lb5 14092983 1 2023-12-05T13:26:57.548 INFO:tasks.workunit.client.0.smithi029.stdout:0/880: creat dc/d33/d3d/d7a/d84/db1/dda/df6/f11c x:0 0 0 2023-12-05T13:26:57.549 INFO:tasks.workunit.client.0.smithi029.stdout:0/881: symlink dc/d33/d3d/d7a/d84/dde/l11d 0 2023-12-05T13:26:57.557 INFO:tasks.workunit.client.0.smithi029.stdout:0/882: dread dc/d13/f2d [4194304,4194304] 0 2023-12-05T13:26:57.558 INFO:tasks.workunit.client.0.smithi029.stdout:7/957: rename d6/d100/d7e/d7b/f99 to d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d5c/f132 0 2023-12-05T13:26:57.559 INFO:tasks.workunit.client.0.smithi029.stdout:0/883: mknod dc/d33/d3d/d7a/d84/d8d/d97/d98/c11e 0 2023-12-05T13:26:57.559 INFO:tasks.workunit.client.0.smithi029.stdout:0/884: readlink dc/d33/d3d/d7e/de1/le3 0 2023-12-05T13:26:57.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/920: dwrite de/d11/d32/fb1 [0,4194304] 0 2023-12-05T13:26:57.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/921: chown de/d14/c2d 180911 1 2023-12-05T13:26:57.562 INFO:tasks.workunit.client.0.smithi029.stdout:2/922: readlink de/d41/d56/d58/l63 0 2023-12-05T13:26:57.563 INFO:tasks.workunit.client.0.smithi029.stdout:0/885: unlink dc/d33/d3d/d7e/fa6 0 2023-12-05T13:26:57.568 INFO:tasks.workunit.client.0.smithi029.stdout:4/947: rename d0/d1 to d0/de/d30/d32/d35/d3d/df5/d13b 0 2023-12-05T13:26:57.574 INFO:tasks.workunit.client.0.smithi029.stdout:0/886: creat dc/d33/d3d/d65/d85/f11f x:0 0 0 2023-12-05T13:26:57.576 INFO:tasks.workunit.client.0.smithi029.stdout:1/952: rename d7/d56/le7 to d7/d6e/da9/d4b/db1/l13a 0 2023-12-05T13:26:57.577 INFO:tasks.workunit.client.0.smithi029.stdout:4/948: symlink d0/de/d15/d123/l13c 0 2023-12-05T13:26:57.579 INFO:tasks.workunit.client.0.smithi029.stdout:7/958: creat d6/f133 x:0 0 0 2023-12-05T13:26:57.581 INFO:tasks.workunit.client.0.smithi029.stdout:4/949: write d0/de/d30/d32/d35/f47 [308322,43508] 0 2023-12-05T13:26:57.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/887: unlink dc/d33/d3d/d65/d85/d117/f112 0 2023-12-05T13:26:57.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/888: readlink dc/d33/d3d/d7a/d84/d8d/d97/d98/lae 0 2023-12-05T13:26:57.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/950: read d0/de/d30/d94/d106/d134/d69/d11e/da6/fe0 [238908,45658] 0 2023-12-05T13:26:57.584 INFO:tasks.workunit.client.0.smithi029.stdout:4/951: truncate d0/de/d30/d32/d35/d3d/f5a 1515228 0 2023-12-05T13:26:57.584 INFO:tasks.workunit.client.0.smithi029.stdout:0/889: write dc/d23/d3a/d41/d57/d58/fd8 [353517,104297] 0 2023-12-05T13:26:57.586 INFO:tasks.workunit.client.0.smithi029.stdout:4/952: link d0/d3c/c8c d0/de/d15/c13d 0 2023-12-05T13:26:57.586 INFO:tasks.workunit.client.0.smithi029.stdout:4/953: chown d0/d16 6008831 1 2023-12-05T13:26:57.589 INFO:tasks.workunit.client.0.smithi029.stdout:0/890: link dc/d13/d4f/d83/f10f dc/d23/d3a/d41/d57/d58/df7/f120 0 2023-12-05T13:26:57.590 INFO:tasks.workunit.client.0.smithi029.stdout:1/953: dwrite d7/d61/d77/d9f/db4/f12a [0,4194304] 0 2023-12-05T13:26:57.590 INFO:tasks.workunit.client.0.smithi029.stdout:7/959: dread d6/d50/d5b/d5f/f84 [0,4194304] 0 2023-12-05T13:26:57.592 INFO:tasks.workunit.client.0.smithi029.stdout:7/960: mkdir d6/d134 0 2023-12-05T13:26:57.594 INFO:tasks.workunit.client.0.smithi029.stdout:1/954: mkdir d7/d61/d77/d13b 0 2023-12-05T13:26:57.595 INFO:tasks.workunit.client.0.smithi029.stdout:7/961: mknod d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/c135 0 2023-12-05T13:26:57.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/955: unlink d7/fcd 0 2023-12-05T13:26:57.597 INFO:tasks.workunit.client.0.smithi029.stdout:1/956: fdatasync d7/d5e/d52/d5f/d12/f46 0 2023-12-05T13:26:57.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/891: dread dc/d23/d3a/d41/fca [0,4194304] 0 2023-12-05T13:26:57.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/892: stat dc/d23/d3a/d41/d57/f59 0 2023-12-05T13:26:57.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/893: write dc/d23/d3a/d41/d57/f106 [212849,7881] 0 2023-12-05T13:26:57.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/894: chown dc/d33/d3d/d7a/d84/fc0 3425 1 2023-12-05T13:26:57.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/895: chown dc/d33/d3d/d7a/d84/da4 1831 1 2023-12-05T13:26:57.599 INFO:tasks.workunit.client.0.smithi029.stdout:0/896: stat dc/d23/d3a/fd3 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/897: fsync dc/d33/d3d/d7a/d84/d8d/fc6 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:0/898: stat dc/d33/d3d/d7a/d84/d8d 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/962: rename d6/d50/d5b/d1a/d26/d72/cd6 to d6/d100/d4f/dc5/d52/c136 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/963: write d6/d50/d5b/d1a/fc4 [521602,63627] 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/964: chown d6/d50/d5b/d1a/d26/d6e/d8b/da9/dda/d70/fb0 3 1 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/965: write d6/d50/d5b/d1a/fc4 [100399,121428] 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/966: write d6/d50/d5b/d1a/d26/d11c/f10e [165619,122288] 0 2023-12-05T13:26:57.600 INFO:tasks.workunit.client.0.smithi029.stdout:7/967: fdatasync d6/d100/d2f/f115 0 2023-12-05T13:26:57.602 INFO:tasks.workunit.client.0.smithi029.stdout:1/957: unlink d7/d5e/d52/d5f/d48/caf 0 2023-12-05T13:26:57.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/899: creat dc/d33/d3d/d7a/d84/db1/dda/f121 x:0 0 0 2023-12-05T13:26:57.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/900: chown f1 0 1 2023-12-05T13:26:57.604 INFO:tasks.workunit.client.0.smithi029.stdout:0/901: fsync dc/d33/d3d/d7a/fb4 0 2023-12-05T13:26:57.605 INFO:tasks.workunit.client.0.smithi029.stdout:7/968: symlink d6/d50/d5b/d5f/d7d/d96/l137 0 2023-12-05T13:26:57.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/969: dread - d6/d100/d66/fd0 zero size 2023-12-05T13:26:57.606 INFO:tasks.workunit.client.0.smithi029.stdout:7/970: write d6/d50/d5b/d1a/d26/d11c/f10e [45827,61220] 0 2023-12-05T13:26:57.607 INFO:tasks.workunit.client.0.smithi029.stdout:1/958: creat d7/d61/d77/d9f/db4/f13c x:0 0 0 2023-12-05T13:26:57.608 INFO:tasks.workunit.client.0.smithi029.stdout:0/902: rmdir dc/d23/d3a/d41/d57/d58/d73 39 2023-12-05T13:26:57.609 INFO:tasks.workunit.client.0.smithi029.stdout:0/903: write dc/d13/d4f/d91/fc3 [1074461,49471] 0 2023-12-05T13:26:57.613 INFO:tasks.workunit.client.0.smithi029.stdout:1/959: truncate d7/d56/f136 751326 0 2023-12-05T13:26:57.615 INFO:tasks.workunit.client.0.smithi029.stdout:1/960: creat d7/d5e/d52/d5f/d12/d60/f13d x:0 0 0 2023-12-05T13:26:57.618 INFO:tasks.workunit.client.0.smithi029.stdout:1/961: rename d7/d6e/da9/f51 to d7/d61/dfb/d132/f13e 0 2023-12-05T13:26:57.619 INFO:tasks.workunit.client.0.smithi029.stdout:1/962: link d7/d5e/d52/c10a d7/d6e/da9/d4b/db1/c13f 0 2023-12-05T13:26:57.621 INFO:tasks.workunit.client.0.smithi029.stdout:1/963: rmdir d7/d56 39 2023-12-05T13:26:57.624 INFO:tasks.workunit.client.0.smithi029.stdout:1/964: link d7/fc d7/d61/f140 0 2023-12-05T13:26:57.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/965: mknod d7/d61/da0/c141 0 2023-12-05T13:26:57.625 INFO:tasks.workunit.client.0.smithi029.stdout:1/966: truncate d7/d61/df3/ff5 739761 0 2023-12-05T13:26:57.626 INFO:tasks.workunit.client.0.smithi029.stdout:1/967: mkdir d7/d5e/d52/d5f/d12/d142 0 2023-12-05T13:26:57.628 INFO:tasks.workunit.client.0.smithi029.stdout:1/968: creat d7/d5e/d52/d5f/d48/d10f/f143 x:0 0 0 2023-12-05T13:26:57.628 INFO:tasks.workunit.client.0.smithi029.stdout:0/904: dwrite dc/ff [4194304,4194304] 0 2023-12-05T13:26:57.629 INFO:tasks.workunit.client.0.smithi029.stdout:1/969: mknod d7/d5e/d52/c144 0 2023-12-05T13:26:57.631 INFO:tasks.workunit.client.0.smithi029.stdout:0/905: fdatasync dc/d13/d4f/d91/fc3 0 2023-12-05T13:26:57.633 INFO:tasks.workunit.client.0.smithi029.stdout:0/906: truncate dc/d33/d3d/d7a/d84/da4/fd7 3440317 0 2023-12-05T13:26:57.633 INFO:tasks.workunit.client.0.smithi029.stdout:0/907: dread - dc/d23/dbf/fc9 zero size 2023-12-05T13:26:57.637 INFO:tasks.workunit.client.0.smithi029.stdout:0/908: rename dc/d13/d4f/d63/caf to dc/d33/d47/c122 0 2023-12-05T13:26:57.637 INFO:tasks.workunit.client.0.smithi029.stdout:0/909: stat dc/d33/d3d/d65/c90 0 2023-12-05T13:26:57.637 INFO:tasks.workunit.client.0.smithi029.stdout:0/910: write dc/d13/fb9 [581903,731] 0 2023-12-05T13:26:57.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/911: mkdir dc/d23/dbf/d123 0 2023-12-05T13:26:57.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/912: dread - dc/d33/d3d/d7a/d84/dfe/f116 zero size 2023-12-05T13:26:57.639 INFO:tasks.workunit.client.0.smithi029.stdout:0/913: stat dc/l1d 0 2023-12-05T13:26:57.640 INFO:tasks.workunit.client.0.smithi029.stdout:0/914: readlink dc/d23/dbf/le0 0 2023-12-05T13:26:57.650 INFO:tasks.workunit.client.0.smithi029.stdout:1/970: dwrite d7/d5e/d52/d90/dd6/fec [0,4194304] 0 2023-12-05T13:26:57.656 INFO:tasks.workunit.client.0.smithi029.stdout:1/971: dread d7/d61/f140 [0,4194304] 0 2023-12-05T13:26:57.658 INFO:tasks.workunit.client.0.smithi029.stdout:0/915: dwrite dc/d33/d3d/d7a/d84/dfe/f116 [0,4194304] 0 2023-12-05T13:26:57.667 INFO:tasks.workunit.client.0.smithi029.stdout:7/971: dwrite d6/d50/d5b/d1a/d26/d72/f76 [0,4194304] 0 2023-12-05T13:26:57.667 INFO:tasks.workunit.client.0.smithi029.stdout:0/916: dread dc/d33/d3d/d7a/d84/dfe/f116 [0,4194304] 0 2023-12-05T13:26:57.668 INFO:tasks.workunit.client.0.smithi029.stdout:0/917: write dc/d33/d3d/d65/d85/f8e [2606823,13304] 0 2023-12-05T13:26:57.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/972: creat d6/d100/d4f/dc5/d52/db4/f138 x:0 0 0 2023-12-05T13:26:57.669 INFO:tasks.workunit.client.0.smithi029.stdout:7/973: truncate d6/d50/d5b/d5f/d7d/d97/db2/fed 1039849 0 2023-12-05T13:26:57.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/974: mkdir d6/d100/d4f/d93/d139 0 2023-12-05T13:26:57.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/975: fsync d6/d50/d5b/d1a/d26/d6e/f86 0 2023-12-05T13:26:57.671 INFO:tasks.workunit.client.0.smithi029.stdout:7/976: fsync d6/d50/d5b/d5f/d7d/d97/fd7 0 2023-12-05T13:26:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/972: dwrite d7/d6e/da9/fda [0,4194304] 0 2023-12-05T13:26:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/973: readlink d7/d56/l32 0 2023-12-05T13:26:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/974: chown d7/d5e/d52/l138 58686 1 2023-12-05T13:26:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/975: fdatasync d7/d6e/da9/d4b/fba 0 2023-12-05T13:26:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/976: dread - d7/d5e/d52/d90/ff2 zero size 2023-12-05T13:26:57.672 INFO:tasks.workunit.client.0.smithi029.stdout:1/977: fsync d7/d61/d77/d9f/db4/d125/f130 0 2023-12-05T13:26:57.673 INFO:tasks.workunit.client.0.smithi029.stdout:1/978: creat d7/d6e/da9/f145 x:0 0 0 2023-12-05T13:26:57.674 INFO:tasks.workunit.client.0.smithi029.stdout:1/979: creat d7/d61/d77/d9f/db4/d125/f146 x:0 0 0 2023-12-05T13:26:57.681 INFO:tasks.workunit.client.0.smithi029.stdout:0/918: write dc/d23/d3a/fcb [7330006,27437] 0 2023-12-05T13:26:57.690 INFO:tasks.workunit.client.0.smithi029.stdout:7/977: dwrite d6/d50/d5b/d1a/d26/f31 [0,4194304] 0 2023-12-05T13:26:57.692 INFO:tasks.workunit.client.0.smithi029.stdout:7/978: truncate d6/d50/d5b/d5f/d7d/d97/d4a/fc7 2187532 0 2023-12-05T13:26:57.693 INFO:tasks.workunit.client.0.smithi029.stdout:7/979: write d6/d50/d5b/d1a/d26/d6e/d8b/ff2 [377671,65052] 0 2023-12-05T13:26:57.695 INFO:tasks.workunit.client.0.smithi029.stdout:1/980: dwrite d7/d5e/f95 [0,4194304] 0 2023-12-05T13:26:57.697 INFO:tasks.workunit.client.0.smithi029.stdout:7/980: rename d6/d50/d5b/d1a/d26/d6e/d8b/da9 to d6/d100/d7e/d7b/d85/d13a 0 2023-12-05T13:26:57.699 INFO:tasks.workunit.client.0.smithi029.stdout:1/981: mkdir d7/d5e/d52/d5f/d12/d60/df6/d116/d11a/d147 0 2023-12-05T13:26:57.704 INFO:tasks.workunit.client.0.smithi029.stdout:7/981: dread d6/d100/d4f/dc5/f42 [0,4194304] 0 2023-12-05T13:26:57.705 INFO:tasks.workunit.client.0.smithi029.stdout:7/982: mknod d6/d50/d5b/d5f/d7d/d97/d4a/d4b/d121/c13b 0 2023-12-05T13:26:57.706 INFO:tasks.workunit.client.0.smithi029.stdout:7/983: dread d6/d50/d5b/d1a/d26/d72/f81 [0,4194304] 0 2023-12-05T13:26:57.707 INFO:tasks.workunit.client.0.smithi029.stdout:7/984: creat d6/d50/d5b/d1a/d26/d6e/f13c x:0 0 0 2023-12-05T13:26:57.708 INFO:tasks.workunit.client.0.smithi029.stdout:7/985: mkdir d6/d50/d5b/d1a/d26/d6e/d13d 0 2023-12-05T13:26:57.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/986: creat d6/d100/d7e/d7b/d85/d13a/dda/d5c/d119/f13e x:0 0 0 2023-12-05T13:26:57.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/987: truncate d6/d100/d2f/fec 1489571 0 2023-12-05T13:26:57.710 INFO:tasks.workunit.client.0.smithi029.stdout:7/988: dread - d6/d100/d7e/d7b/d85/d13a/fb1 zero size 2023-12-05T13:26:57.711 INFO:tasks.workunit.client.0.smithi029.stdout:7/989: creat d6/d50/d5b/d5f/d7d/d97/d4a/d4b/f13f x:0 0 0 2023-12-05T13:26:57.711 INFO:tasks.workunit.client.0.smithi029.stdout:7/990: truncate d6/d50/f102 654911 0 2023-12-05T13:26:57.711 INFO:tasks.workunit.client.0.smithi029.stdout:7/991: creat d6/d50/d5b/d1a/d26/d6e/f140 x:0 0 0 2023-12-05T13:26:57.711 INFO:tasks.workunit.client.0.smithi029.stdout:7/992: fdatasync d6/d100/d2f/f115 0 2023-12-05T13:26:57.712 INFO:tasks.workunit.client.0.smithi029.stdout:7/993: truncate d6/d100/d4f/dc5/f42 3965384 0 2023-12-05T13:26:57.713 INFO:tasks.workunit.client.0.smithi029.stdout:7/994: creat d6/d50/d5b/d5f/d7d/d97/d51/f141 x:0 0 0 2023-12-05T13:26:57.714 INFO:tasks.workunit.client.0.smithi029.stdout:7/995: write d6/d50/d5b/d1a/d26/ff5 [1045555,85575] 0 2023-12-05T13:26:57.714 INFO:tasks.workunit.client.0.smithi029.stdout:7/996: mknod d6/d50/d5b/d5f/d7d/d96/c142 0 2023-12-05T13:26:57.715 INFO:tasks.workunit.client.0.smithi029.stdout:1/982: dwrite d7/d5e/d52/d90/f110 [0,4194304] 0 2023-12-05T13:26:57.716 INFO:tasks.workunit.client.0.smithi029.stdout:7/997: creat d6/d100/d4f/dc5/f143 x:0 0 0 2023-12-05T13:26:57.720 INFO:tasks.workunit.client.0.smithi029.stdout:7/998: mknod d6/d100/d2f/d89/dad/c144 0 2023-12-05T13:26:57.721 INFO:tasks.workunit.client.0.smithi029.stdout:7/999: symlink d6/d100/d7e/d7b/l145 0 2023-12-05T13:26:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:57 smithi052 ceph-mon[121072]: pgmap v50: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 120 MiB/s wr, 182 op/s 2023-12-05T13:26:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:57 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:57 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:57 smithi052 ceph-mon[121072]: Reconfiguring node-exporter.smithi052 (dependencies changed)... 2023-12-05T13:26:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:57 smithi052 ceph-mon[121072]: Reconfiguring daemon node-exporter.smithi052 on smithi052 2023-12-05T13:26:57.738 INFO:tasks.workunit.client.0.smithi029.stdout:1/983: dwrite d7/d6e/da9/d4b/d72/fbe [0,4194304] 0 2023-12-05T13:26:57.739 INFO:tasks.workunit.client.0.smithi029.stdout:1/984: mkdir d7/d61/d123/d148 0 2023-12-05T13:26:57.746 INFO:tasks.workunit.client.0.smithi029.stdout:1/985: dread d7/d5e/fe9 [0,4194304] 0 2023-12-05T13:26:57.748 INFO:tasks.workunit.client.0.smithi029.stdout:1/986: creat d7/d61/d4f/f149 x:0 0 0 2023-12-05T13:26:57.748 INFO:tasks.workunit.client.0.smithi029.stdout:1/987: chown d7/d5e 479940039 1 2023-12-05T13:26:57.749 INFO:tasks.workunit.client.0.smithi029.stdout:1/988: mknod d7/d61/d77/d9f/db4/c14a 0 2023-12-05T13:26:57.751 INFO:tasks.workunit.client.0.smithi029.stdout:1/989: unlink d7/d5e/d52/d5f/d48/lf8 0 2023-12-05T13:26:57.751 INFO:tasks.workunit.client.0.smithi029.stdout:1/990: write d7/d5e/d52/d5f/d12/d60/fc9 [861095,108668] 0 2023-12-05T13:26:57.752 INFO:tasks.workunit.client.0.smithi029.stdout:1/991: getdents d7/d56/da8 0 2023-12-05T13:26:57.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:57 smithi029 ceph-mon[112128]: pgmap v50: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 120 MiB/s wr, 182 op/s 2023-12-05T13:26:57.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:57 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:57.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:57 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:57.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:57 smithi029 ceph-mon[112128]: Reconfiguring node-exporter.smithi052 (dependencies changed)... 2023-12-05T13:26:57.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:57 smithi029 ceph-mon[112128]: Reconfiguring daemon node-exporter.smithi052 on smithi052 2023-12-05T13:26:58.289 INFO:tasks.workunit.client.0.smithi029.stdout:5/794: sync 2023-12-05T13:26:58.289 INFO:tasks.workunit.client.0.smithi029.stdout:5/795: readlink d1/dc/d10/d1e/l6d 0 2023-12-05T13:26:58.290 INFO:tasks.workunit.client.0.smithi029.stdout:5/796: write d1/dc/d25/d4c/ff9 [710329,73883] 0 2023-12-05T13:26:58.290 INFO:tasks.workunit.client.0.smithi029.stdout:5/797: fsync d1/dc/d10/fda 0 2023-12-05T13:26:58.290 INFO:tasks.workunit.client.0.smithi029.stdout:0/919: sync 2023-12-05T13:26:58.290 INFO:tasks.workunit.client.0.smithi029.stdout:2/923: sync 2023-12-05T13:26:58.290 INFO:tasks.workunit.client.0.smithi029.stdout:1/992: sync 2023-12-05T13:26:58.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/954: sync 2023-12-05T13:26:58.291 INFO:tasks.workunit.client.0.smithi029.stdout:0/920: fdatasync dc/d13/f34 0 2023-12-05T13:26:58.291 INFO:tasks.workunit.client.0.smithi029.stdout:4/955: fdatasync d0/de/d30/d32/ddf/fff 0 2023-12-05T13:26:58.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/798: symlink d1/dc/d38/d3a/db3/l100 0 2023-12-05T13:26:58.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/799: chown d1/dc/d11 661631 1 2023-12-05T13:26:58.291 INFO:tasks.workunit.client.0.smithi029.stdout:5/800: getdents d1/dc/d38/d4b/dff 0 2023-12-05T13:26:58.292 INFO:tasks.workunit.client.0.smithi029.stdout:2/924: unlink de/d6a/fc0 0 2023-12-05T13:26:58.292 INFO:tasks.workunit.client.0.smithi029.stdout:2/925: dread - de/d6a/fa7 zero size 2023-12-05T13:26:58.292 INFO:tasks.workunit.client.0.smithi029.stdout:2/926: dread - de/d16/d43/fe8 zero size 2023-12-05T13:26:58.292 INFO:tasks.workunit.client.0.smithi029.stdout:2/927: chown de 112 1 2023-12-05T13:26:58.293 INFO:tasks.workunit.client.0.smithi029.stdout:1/993: mkdir d7/d61/da0/d14b 0 2023-12-05T13:26:58.293 INFO:tasks.workunit.client.0.smithi029.stdout:1/994: truncate d7/d61/d77/d9f/db4/d125/f130 4738163 0 2023-12-05T13:26:58.293 INFO:tasks.workunit.client.0.smithi029.stdout:1/995: truncate d7/d6e/da9/fda 4451359 0 2023-12-05T13:26:58.295 INFO:tasks.workunit.client.0.smithi029.stdout:4/956: mkdir d0/d16/d22/dc2/d13e 0 2023-12-05T13:26:58.295 INFO:tasks.workunit.client.0.smithi029.stdout:4/957: chown d0/de/c9f 347269 1 2023-12-05T13:26:58.297 INFO:tasks.workunit.client.0.smithi029.stdout:5/801: rename d1/dc/d38/d55/f81 to d1/dc/d27/f101 0 2023-12-05T13:26:58.298 INFO:tasks.workunit.client.0.smithi029.stdout:5/802: symlink d1/dc/d10/d1e/d33/d93/da5/db2/da6/dd6/l102 0 2023-12-05T13:26:58.299 INFO:tasks.workunit.client.0.smithi029.stdout:4/958: mknod d0/c13f 0 2023-12-05T13:26:58.300 INFO:tasks.workunit.client.0.smithi029.stdout:5/803: creat d1/dc/d38/d4b/f103 x:0 0 0 2023-12-05T13:26:58.300 INFO:tasks.workunit.client.0.smithi029.stdout:5/804: dread - d1/dc/d38/d4b/f103 zero size 2023-12-05T13:26:58.301 INFO:tasks.workunit.client.0.smithi029.stdout:4/959: truncate d0/de/d30/d94/d106/d134/d69/d77/fee 3112025 0 2023-12-05T13:26:58.302 INFO:tasks.workunit.client.0.smithi029.stdout:5/805: creat d1/dc/d10/d1e/d33/f104 x:0 0 0 2023-12-05T13:26:58.303 INFO:tasks.workunit.client.0.smithi029.stdout:5/806: mknod d1/dc/d38/d3a/c105 0 2023-12-05T13:26:58.304 INFO:tasks.workunit.client.0.smithi029.stdout:2/928: dread de/d14/d24/f2e [0,4194304] 0 2023-12-05T13:26:58.305 INFO:tasks.workunit.client.0.smithi029.stdout:5/807: truncate d1/dc/d10/d1e/d75/fc3 3324285 0 2023-12-05T13:26:58.307 INFO:tasks.workunit.client.0.smithi029.stdout:5/808: symlink d1/dc/d10/d1e/d33/de5/l106 0 2023-12-05T13:26:58.309 INFO:tasks.workunit.client.0.smithi029.stdout:2/929: creat de/d11/dad/f12a x:0 0 0 2023-12-05T13:26:58.309 INFO:tasks.workunit.client.0.smithi029.stdout:2/930: fdatasync de/d41/d56/d58/d11d/f127 0 2023-12-05T13:26:58.310 INFO:tasks.workunit.client.0.smithi029.stdout:5/809: getdents d1/dc/d11 0 2023-12-05T13:26:58.312 INFO:tasks.workunit.client.0.smithi029.stdout:2/931: mknod de/d16/d43/c12b 0 2023-12-05T13:26:58.314 INFO:tasks.workunit.client.0.smithi029.stdout:2/932: stat de/d14/d24/d93/dc5/dc9/c10c 0 2023-12-05T13:26:58.315 INFO:tasks.workunit.client.0.smithi029.stdout:0/921: dread dc/d23/d3a/d41/d57/d58/f61 [0,4194304] 0 2023-12-05T13:26:58.315 INFO:tasks.workunit.client.0.smithi029.stdout:1/996: dwrite d7/d5e/d52/d90/fd7 [0,4194304] 0 2023-12-05T13:26:58.317 INFO:tasks.workunit.client.0.smithi029.stdout:2/933: link de/d11/d32/ff5 de/d16/d6c/ddc/f12c 0 2023-12-05T13:26:58.318 INFO:tasks.workunit.client.0.smithi029.stdout:0/922: symlink dc/d13/l124 0 2023-12-05T13:26:58.319 INFO:tasks.workunit.client.0.smithi029.stdout:0/923: chown dc/d33/d3d/d7a/d84/fcf 119831 1 2023-12-05T13:26:58.320 INFO:tasks.workunit.client.0.smithi029.stdout:0/924: creat dc/d33/d3d/d7e/f125 x:0 0 0 2023-12-05T13:26:58.321 INFO:tasks.workunit.client.0.smithi029.stdout:0/925: rmdir dc/d33 39 2023-12-05T13:26:58.322 INFO:tasks.workunit.client.0.smithi029.stdout:0/926: mkdir dc/d33/d3d/d7a/d84/dfe/d126 0 2023-12-05T13:26:58.330 INFO:tasks.workunit.client.0.smithi029.stdout:2/934: dread de/d14/d24/f2e [0,4194304] 0 2023-12-05T13:26:58.333 INFO:tasks.workunit.client.0.smithi029.stdout:4/960: dread d0/d16/d22/f61 [0,4194304] 0 2023-12-05T13:26:58.333 INFO:tasks.workunit.client.0.smithi029.stdout:4/961: chown d0/d16/c130 293 1 2023-12-05T13:26:58.339 INFO:tasks.workunit.client.0.smithi029.stdout:4/962: link d0/f1d d0/d16/d22/d5f/f140 0 2023-12-05T13:26:58.342 INFO:tasks.workunit.client.0.smithi029.stdout:5/810: dwrite d1/dc/d38/d3a/d5c/fcc [0,4194304] 0 2023-12-05T13:26:58.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/963: mkdir d0/d16/d22/d5f/d79/d129/d141 0 2023-12-05T13:26:58.342 INFO:tasks.workunit.client.0.smithi029.stdout:4/964: dread - d0/de/d30/d94/ffa zero size 2023-12-05T13:26:58.343 INFO:tasks.workunit.client.0.smithi029.stdout:2/935: dread de/d16/d43/f92 [0,4194304] 0 2023-12-05T13:26:58.343 INFO:tasks.workunit.client.0.smithi029.stdout:5/811: write d1/dc/fd8 [720488,81621] 0 2023-12-05T13:26:58.345 INFO:tasks.workunit.client.0.smithi029.stdout:4/965: mkdir d0/de/d15/d2b/d142 0 2023-12-05T13:26:58.346 INFO:tasks.workunit.client.0.smithi029.stdout:2/936: getdents de/d14/d24/db7/df3 0 2023-12-05T13:26:58.347 INFO:tasks.workunit.client.0.smithi029.stdout:1/997: dwrite d7/d5e/d52/d5f/d48/f98 [0,4194304] 0 2023-12-05T13:26:58.349 INFO:tasks.workunit.client.0.smithi029.stdout:0/927: dwrite dc/d13/d4f/f8c [0,4194304] 0 2023-12-05T13:26:58.350 INFO:tasks.workunit.client.0.smithi029.stdout:5/812: rename d1/dc/d38/lad to d1/dc/d25/l107 0 2023-12-05T13:26:58.350 INFO:tasks.workunit.client.0.smithi029.stdout:1/998: dread d7/d61/f140 [0,4194304] 0 2023-12-05T13:26:58.351 INFO:tasks.workunit.client.0.smithi029.stdout:0/928: read dc/f35 [2573134,21505] 0 2023-12-05T13:26:58.352 INFO:tasks.workunit.client.0.smithi029.stdout:0/929: read dc/d33/d3d/d7a/d84/d8d/d97/faa [1270333,5749] 0 2023-12-05T13:26:58.355 INFO:tasks.workunit.client.0.smithi029.stdout:2/937: mkdir de/d14/d24/d93/dc5/d12d 0 2023-12-05T13:26:58.355 INFO:tasks.workunit.client.0.smithi029.stdout:2/938: write de/d16/d43/f72 [1116964,27320] 0 2023-12-05T13:26:58.361 INFO:tasks.workunit.client.0.smithi029.stdout:0/930: symlink dc/d23/d3a/d41/d57/d58/dcd/d114/l127 0 2023-12-05T13:26:58.362 INFO:tasks.workunit.client.0.smithi029.stdout:1/999: dread d7/d5e/d52/d5f/d12/d60/fd8 [0,4194304] 0 2023-12-05T13:26:58.362 INFO:tasks.workunit.client.0.smithi029.stdout:0/931: mkdir dc/d13/d4f/d128 0 2023-12-05T13:26:58.364 INFO:tasks.workunit.client.0.smithi029.stdout:0/932: mknod dc/d33/d3d/d7a/d84/d8d/d97/d98/c129 0 2023-12-05T13:26:58.364 INFO:tasks.workunit.client.0.smithi029.stdout:0/933: fdatasync dc/d13/f2d 0 2023-12-05T13:26:58.366 INFO:tasks.workunit.client.0.smithi029.stdout:2/939: dread de/d16/d43/fa5 [0,4194304] 0 2023-12-05T13:26:58.368 INFO:tasks.workunit.client.0.smithi029.stdout:5/813: dwrite d1/dc/d25/fa8 [0,4194304] 0 2023-12-05T13:26:58.368 INFO:tasks.workunit.client.0.smithi029.stdout:4/966: dwrite d0/d16/d22/d5f/d79/fbf [0,4194304] 0 2023-12-05T13:26:58.368 INFO:tasks.workunit.client.0.smithi029.stdout:4/967: stat d0/d41/l8f 0 2023-12-05T13:26:58.368 INFO:tasks.workunit.client.0.smithi029.stdout:2/940: getdents de/db8/dda 0 2023-12-05T13:26:58.372 INFO:tasks.workunit.client.0.smithi029.stdout:5/814: symlink d1/dc/d10/d1e/d33/d93/l108 0 2023-12-05T13:26:58.373 INFO:tasks.workunit.client.0.smithi029.stdout:5/815: mkdir d1/dc/d38/d4b/d109 0 2023-12-05T13:26:58.378 INFO:tasks.workunit.client.0.smithi029.stdout:4/968: dread d0/de/d30/d94/d106/d134/d69/d77/fa3 [0,4194304] 0 2023-12-05T13:26:58.378 INFO:tasks.workunit.client.0.smithi029.stdout:2/941: dread f4 [4194304,4194304] 0 2023-12-05T13:26:58.381 INFO:tasks.workunit.client.0.smithi029.stdout:4/969: creat d0/d41/f143 x:0 0 0 2023-12-05T13:26:58.381 INFO:tasks.workunit.client.0.smithi029.stdout:4/970: dread - d0/de/d30/d94/d106/d134/d69/d77/fd5 zero size 2023-12-05T13:26:58.382 INFO:tasks.workunit.client.0.smithi029.stdout:2/942: creat de/d11/d32/f12e x:0 0 0 2023-12-05T13:26:58.384 INFO:tasks.workunit.client.0.smithi029.stdout:2/943: creat de/d14/d24/d93/dc5/dc9/d10f/f12f x:0 0 0 2023-12-05T13:26:58.384 INFO:tasks.workunit.client.0.smithi029.stdout:0/934: dwrite dc/d23/f2e [0,4194304] 0 2023-12-05T13:26:58.386 INFO:tasks.workunit.client.0.smithi029.stdout:2/944: getdents de/d16/df0 0 2023-12-05T13:26:58.387 INFO:tasks.workunit.client.0.smithi029.stdout:0/935: truncate dc/d23/d3a/d41/d57/d58/df7/f120 5468028 0 2023-12-05T13:26:58.388 INFO:tasks.workunit.client.0.smithi029.stdout:2/945: mknod de/d41/c130 0 2023-12-05T13:26:58.390 INFO:tasks.workunit.client.0.smithi029.stdout:2/946: rename de/d11/d32/caf to de/d41/c131 0 2023-12-05T13:26:58.408 INFO:tasks.workunit.client.0.smithi029.stdout:4/971: dwrite d0/de/d30/d32/d35/d3d/df5/d13b/da1/ffb [0,4194304] 0 2023-12-05T13:26:58.410 INFO:tasks.workunit.client.0.smithi029.stdout:4/972: truncate d0/de/f45 70196 0 2023-12-05T13:26:58.410 INFO:tasks.workunit.client.0.smithi029.stdout:4/973: fdatasync d0/d3c/d56/fbc 0 2023-12-05T13:26:58.412 INFO:tasks.workunit.client.0.smithi029.stdout:4/974: creat d0/de/d30/d32/d35/d3d/df5/d13b/dfe/f144 x:0 0 0 2023-12-05T13:26:58.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/947: dwrite de/d11/d32/f5a [0,4194304] 0 2023-12-05T13:26:58.413 INFO:tasks.workunit.client.0.smithi029.stdout:2/948: truncate de/d6a/fd9 1028030 0 2023-12-05T13:26:58.414 INFO:tasks.workunit.client.0.smithi029.stdout:4/975: rename d0/d3c/d85/fde to d0/de/d30/f145 0 2023-12-05T13:26:58.415 INFO:tasks.workunit.client.0.smithi029.stdout:0/936: dwrite dc/d33/d3d/d7a/d84/dde/ddf/ff9 [0,4194304] 0 2023-12-05T13:26:58.417 INFO:tasks.workunit.client.0.smithi029.stdout:4/976: creat d0/de/d30/d32/ddf/f146 x:0 0 0 2023-12-05T13:26:58.421 INFO:tasks.workunit.client.0.smithi029.stdout:0/937: creat dc/d23/d3a/d41/f12a x:0 0 0 2023-12-05T13:26:58.422 INFO:tasks.workunit.client.0.smithi029.stdout:4/977: mknod d0/de/d30/db5/c147 0 2023-12-05T13:26:58.425 INFO:tasks.workunit.client.0.smithi029.stdout:0/938: rename dc/d33/c95 to dc/d13/d4f/d63/c12b 0 2023-12-05T13:26:58.426 INFO:tasks.workunit.client.0.smithi029.stdout:0/939: write dc/d13/d4f/d88/dc4/f10c [3284870,38637] 0 2023-12-05T13:26:58.430 INFO:tasks.workunit.client.0.smithi029.stdout:0/940: link dc/d33/f38 dc/d23/d3a/d41/d57/f12c 0 2023-12-05T13:26:58.430 INFO:tasks.workunit.client.0.smithi029.stdout:0/941: chown dc/d23/d3a/d41/fca 1 1 2023-12-05T13:26:58.430 INFO:tasks.workunit.client.0.smithi029.stdout:0/942: fsync dc/d33/d3d/d7e/de1/fe5 0 2023-12-05T13:26:58.434 INFO:tasks.workunit.client.0.smithi029.stdout:0/943: truncate dc/d23/d3a/d41/f5e 2598809 0 2023-12-05T13:26:58.436 INFO:tasks.workunit.client.0.smithi029.stdout:2/949: dwrite de/d14/d24/f2e [0,4194304] 0 2023-12-05T13:26:58.436 INFO:tasks.workunit.client.0.smithi029.stdout:0/944: mknod dc/d33/d3d/d65/d85/d117/d115/c12d 0 2023-12-05T13:26:58.437 INFO:tasks.workunit.client.0.smithi029.stdout:0/945: write dc/d33/d3d/d7a/d84/dfe/f116 [2844977,60899] 0 2023-12-05T13:26:58.437 INFO:tasks.workunit.client.0.smithi029.stdout:0/946: dread - dc/d23/d3a/f10b zero size 2023-12-05T13:26:58.439 INFO:tasks.workunit.client.0.smithi029.stdout:2/950: symlink de/d16/d6c/d8e/l132 0 2023-12-05T13:26:58.440 INFO:tasks.workunit.client.0.smithi029.stdout:0/947: dread dc/d33/d3d/d7a/d84/d8d/d97/fa3 [0,4194304] 0 2023-12-05T13:26:58.440 INFO:tasks.workunit.client.0.smithi029.stdout:2/951: rename de/d41/d56/d58/ff1 to de/d121/f133 0 2023-12-05T13:26:58.443 INFO:tasks.workunit.client.0.smithi029.stdout:0/948: rmdir dc/d23/dbf 39 2023-12-05T13:26:58.443 INFO:tasks.workunit.client.0.smithi029.stdout:0/949: chown dc/d33/d3d/d7a/d84/da4 480 1 2023-12-05T13:26:58.443 INFO:tasks.workunit.client.0.smithi029.stdout:2/952: mknod de/d16/c134 0 2023-12-05T13:26:58.459 INFO:tasks.workunit.client.0.smithi029.stdout:4/978: dwrite d0/d16/d22/d98/fba [4194304,4194304] 0 2023-12-05T13:26:58.459 INFO:tasks.workunit.client.0.smithi029.stdout:0/950: dwrite dc/d23/d3a/fd3 [0,4194304] 0 2023-12-05T13:26:58.460 INFO:tasks.workunit.client.0.smithi029.stdout:0/951: write dc/d13/d4f/d91/fc3 [3436725,117687] 0 2023-12-05T13:26:58.461 INFO:tasks.workunit.client.0.smithi029.stdout:4/979: creat d0/de/d30/d32/dbd/d139/dd4/f148 x:0 0 0 2023-12-05T13:26:58.463 INFO:tasks.workunit.client.0.smithi029.stdout:0/952: link dc/d33/l9b dc/d33/d3d/d7a/d84/dfe/l12e 0 2023-12-05T13:26:58.478 INFO:tasks.workunit.client.0.smithi029.stdout:4/980: dwrite d0/d16/d22/d4f/f59 [0,4194304] 0 2023-12-05T13:26:58.482 INFO:tasks.workunit.client.0.smithi029.stdout:4/981: rename d0/de/d30/d94/d106/d134/d69/d11e/da6/fe0 to d0/d16/d22/dc2/f149 0 2023-12-05T13:26:58.482 INFO:tasks.workunit.client.0.smithi029.stdout:0/953: dwrite dc/d13/d4f/f6b [0,4194304] 0 2023-12-05T13:26:58.484 INFO:tasks.workunit.client.0.smithi029.stdout:4/982: link d0/de/d15/f49 d0/d3c/d85/f14a 0 2023-12-05T13:26:58.485 INFO:tasks.workunit.client.0.smithi029.stdout:4/983: write d0/da/f18 [3966335,99311] 0 2023-12-05T13:26:58.486 INFO:tasks.workunit.client.0.smithi029.stdout:0/954: unlink dc/d33/d3d/d7a/d84/db1/dda/df6/f11c 0 2023-12-05T13:26:58.488 INFO:tasks.workunit.client.0.smithi029.stdout:4/984: rename d0/de/l93 to d0/d16/d22/d5f/l14b 0 2023-12-05T13:26:58.488 INFO:tasks.workunit.client.0.smithi029.stdout:0/955: symlink dc/d33/d3d/d7a/d84/d8d/d97/l12f 0 2023-12-05T13:26:58.488 INFO:tasks.workunit.client.0.smithi029.stdout:0/956: fdatasync dc/d23/d3a/d41/d70/f81 0 2023-12-05T13:26:58.489 INFO:tasks.workunit.client.0.smithi029.stdout:4/985: truncate d0/d16/d22/d4f/f6d 318596 0 2023-12-05T13:26:58.491 INFO:tasks.workunit.client.0.smithi029.stdout:0/957: mkdir dc/d33/d3d/d7a/d84/dfe/d126/d130 0 2023-12-05T13:26:58.492 INFO:tasks.workunit.client.0.smithi029.stdout:0/958: symlink dc/d33/d3d/d7e/de1/l131 0 2023-12-05T13:26:58.493 INFO:tasks.workunit.client.0.smithi029.stdout:0/959: creat dc/d23/d3a/d41/d57/d58/d73/f132 x:0 0 0 2023-12-05T13:26:58.495 INFO:tasks.workunit.client.0.smithi029.stdout:0/960: link dc/d23/d3a/d41/d57/d58/fd8 dc/d13/f133 0 2023-12-05T13:26:58.495 INFO:tasks.workunit.client.0.smithi029.stdout:0/961: write dc/d23/d3a/d41/d57/f5b [2593461,45354] 0 2023-12-05T13:26:58.496 INFO:tasks.workunit.client.0.smithi029.stdout:0/962: creat dc/d33/d3d/d7a/d84/dde/ddf/f134 x:0 0 0 2023-12-05T13:26:58.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/963: dwrite dc/d13/d4f/d63/f87 [0,4194304] 0 2023-12-05T13:26:58.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/964: dread - dc/d33/d3d/d7a/d84/dde/ddf/f134 zero size 2023-12-05T13:26:58.512 INFO:tasks.workunit.client.0.smithi029.stdout:0/965: chown dc/d23/d3a/d41/d57/d58/dcd/d10a 2942194 1 2023-12-05T13:26:58.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/966: creat dc/d13/d4f/d83/d111/f135 x:0 0 0 2023-12-05T13:26:58.513 INFO:tasks.workunit.client.0.smithi029.stdout:0/967: stat dc/d33/d3d 0 2023-12-05T13:26:58.514 INFO:tasks.workunit.client.0.smithi029.stdout:0/968: creat dc/d33/d3d/d7a/d84/dfe/d126/f136 x:0 0 0 2023-12-05T13:26:58.515 INFO:tasks.workunit.client.0.smithi029.stdout:0/969: rename dc/d33/d3d/d7a/d84/db1/dda/f121 to dc/d33/d3d/d7a/f137 0 2023-12-05T13:26:58.516 INFO:tasks.workunit.client.0.smithi029.stdout:0/970: symlink dc/d23/d3a/l138 0 2023-12-05T13:26:58.516 INFO:tasks.workunit.client.0.smithi029.stdout:0/971: truncate dc/d13/d4f/d83/d111/f135 150330 0 2023-12-05T13:26:58.519 INFO:tasks.workunit.client.0.smithi029.stdout:0/972: dread dc/d23/f6f [0,4194304] 0 2023-12-05T13:26:58.668 INFO:tasks.workunit.client.0.smithi029.stdout:5/816: sync 2023-12-05T13:26:58.669 INFO:tasks.workunit.client.0.smithi029.stdout:5/817: mknod d1/dc/d10/d1e/d33/c10a 0 2023-12-05T13:26:58.670 INFO:tasks.workunit.client.0.smithi029.stdout:5/818: symlink d1/dc/d25/d4c/d9b/l10b 0 2023-12-05T13:26:58.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/819: mknod d1/dc/d38/d4b/d109/c10c 0 2023-12-05T13:26:58.671 INFO:tasks.workunit.client.0.smithi029.stdout:5/820: write d1/dc/d38/d55/f96 [4481835,47222] 0 2023-12-05T13:26:58.672 INFO:tasks.workunit.client.0.smithi029.stdout:5/821: creat d1/dc/d38/d3a/d5c/f10d x:0 0 0 2023-12-05T13:26:58.672 INFO:tasks.workunit.client.0.smithi029.stdout:5/822: chown d1/dc/d10/d1e/d33/d93/da5 13041174 1 2023-12-05T13:26:58.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/823: rename d1/dc/d11/f12 to d1/dc/d25/d4c/d61/f10e 0 2023-12-05T13:26:58.674 INFO:tasks.workunit.client.0.smithi029.stdout:5/824: readlink d1/dc/d10/d1e/l9e 0 2023-12-05T13:26:58.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/825: mkdir d1/dc/d10/d10f 0 2023-12-05T13:26:58.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/826: dread - d1/dc/d10/d1e/d33/f73 zero size 2023-12-05T13:26:58.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/827: mknod d1/dc/d10/d1e/d33/d93/c110 0 2023-12-05T13:26:58.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/828: rename d1/dc/d38/d3a/d5c/lcb to d1/dc/d10/d1e/d33/d93/da5/df5/l111 0 2023-12-05T13:26:58.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/829: write d1/dc/d11/f35 [1633688,47017] 0 2023-12-05T13:26:58.680 INFO:tasks.workunit.client.0.smithi029.stdout:5/830: link d1/dc/d27/f2e d1/dc/d10/d1e/d33/d93/f112 0 2023-12-05T13:26:58.682 INFO:tasks.workunit.client.0.smithi029.stdout:5/831: rename d1/dc/c97 to d1/dc/d38/d3a/db3/c113 0 2023-12-05T13:26:58.766 INFO:tasks.workunit.client.0.smithi029.stdout:2/953: sync 2023-12-05T13:26:58.767 INFO:tasks.workunit.client.0.smithi029.stdout:2/954: write de/d11/d32/ff5 [5079874,98539] 0 2023-12-05T13:26:58.767 INFO:tasks.workunit.client.0.smithi029.stdout:2/955: mkdir de/d14/d24/d93/dc5/d135 0 2023-12-05T13:26:58.769 INFO:tasks.workunit.client.0.smithi029.stdout:2/956: symlink de/d14/d24/d123/l136 0 2023-12-05T13:26:58.976 INFO:tasks.workunit.client.0.smithi029.stdout:0/973: sync 2023-12-05T13:26:58.976 INFO:tasks.workunit.client.0.smithi029.stdout:4/986: sync 2023-12-05T13:26:58.976 INFO:tasks.workunit.client.0.smithi029.stdout:4/987: chown d0/de/d30/d32/d35/ld1 1869 1 2023-12-05T13:26:58.977 INFO:tasks.workunit.client.0.smithi029.stdout:0/974: rmdir dc/d13/d4f/d91 39 2023-12-05T13:26:58.979 INFO:tasks.workunit.client.0.smithi029.stdout:0/975: mkdir dc/d23/d3a/d41/d57/d58/dcd/d114/d139 0 2023-12-05T13:26:58.981 INFO:tasks.workunit.client.0.smithi029.stdout:0/976: symlink dc/d13/d4f/d83/l13a 0 2023-12-05T13:26:58.984 INFO:tasks.workunit.client.0.smithi029.stdout:0/977: write dc/d33/d3d/d7a/fb4 [3511695,106475] 0 2023-12-05T13:26:58.986 INFO:tasks.workunit.client.0.smithi029.stdout:0/978: rmdir dc/d33/d3d/d65/d85 39 2023-12-05T13:26:58.986 INFO:tasks.workunit.client.0.smithi029.stdout:0/979: fdatasync dc/fb7 0 2023-12-05T13:26:58.986 INFO:tasks.workunit.client.0.smithi029.stdout:0/980: chown dc/d33/d3d/d7a/d84/da4/fd7 0 1 2023-12-05T13:26:58.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/981: rmdir dc/d23/d3a/d41/d57/d58/dcd/d114 39 2023-12-05T13:26:58.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/982: fsync dc/d23/d3a/fcb 0 2023-12-05T13:26:58.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/983: rename dc/d23/d3a/d41/d57/d58/dcd/d10a to dc/d23/d3a/d41/d57/d58/dcd/d10a/d13b 22 2023-12-05T13:26:58.987 INFO:tasks.workunit.client.0.smithi029.stdout:0/984: chown dc/d13/d4f/d83/d111/f135 0 1 2023-12-05T13:26:58.988 INFO:tasks.workunit.client.0.smithi029.stdout:0/985: creat dc/d13/d4f/d83/f13c x:0 0 0 2023-12-05T13:26:58.990 INFO:tasks.workunit.client.0.smithi029.stdout:0/986: mkdir dc/d33/d3d/d65/d85/d117/d115/d13d 0 2023-12-05T13:26:58.992 INFO:tasks.workunit.client.0.smithi029.stdout:0/987: chown dc/d23/d3a/d41/d57/d58/ca7 59313577 1 2023-12-05T13:26:58.994 INFO:tasks.workunit.client.0.smithi029.stdout:4/988: dwrite d0/d3c/fe6 [0,4194304] 0 2023-12-05T13:26:58.995 INFO:tasks.workunit.client.0.smithi029.stdout:4/989: chown d0/da/c40 14656004 1 2023-12-05T13:26:59.011 INFO:tasks.workunit.client.0.smithi029.stdout:0/988: dwrite dc/d33/d3d/d65/d85/dfa/fee [0,4194304] 0 2023-12-05T13:26:59.013 INFO:tasks.workunit.client.0.smithi029.stdout:0/989: truncate dc/d13/d4f/f6b 4447867 0 2023-12-05T13:26:59.030 INFO:tasks.workunit.client.0.smithi029.stdout:0/990: dwrite dc/d33/d3d/d7a/d84/dde/ddf/f134 [0,4194304] 0 2023-12-05T13:26:59.032 INFO:tasks.workunit.client.0.smithi029.stdout:0/991: creat dc/d23/d3a/d41/d70/f13e x:0 0 0 2023-12-05T13:26:59.034 INFO:tasks.workunit.client.0.smithi029.stdout:0/992: dread dc/d13/f133 [0,4194304] 0 2023-12-05T13:26:59.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/993: dwrite dc/d33/d3d/d7a/d84/fcf [0,4194304] 0 2023-12-05T13:26:59.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/994: truncate dc/d23/d3a/d41/fe9 510771 0 2023-12-05T13:26:59.047 INFO:tasks.workunit.client.0.smithi029.stdout:0/995: chown dc/d23/dbf/d123 67579 1 2023-12-05T13:26:59.059 INFO:tasks.workunit.client.0.smithi029.stdout:0/996: dwrite dc/d23/d3a/f71 [4194304,4194304] 0 2023-12-05T13:26:59.059 INFO:tasks.workunit.client.0.smithi029.stdout:0/997: chown dc/d33/d3d/d7a/d84/d8d/d97/d98/fef 3498 1 2023-12-05T13:26:59.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/998: mknod dc/d23/d3a/d41/d57/d58/df7/c13f 0 2023-12-05T13:26:59.060 INFO:tasks.workunit.client.0.smithi029.stdout:0/999: mknod dc/d33/d47/c140 0 2023-12-05T13:26:59.107 INFO:tasks.workunit.client.0.smithi029.stdout:5/832: sync 2023-12-05T13:26:59.107 INFO:tasks.workunit.client.0.smithi029.stdout:2/957: sync 2023-12-05T13:26:59.109 INFO:tasks.workunit.client.0.smithi029.stdout:2/958: dread de/d41/d56/fba [0,4194304] 0 2023-12-05T13:26:59.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/959: creat de/d14/d24/d93/dc5/d135/f137 x:0 0 0 2023-12-05T13:26:59.110 INFO:tasks.workunit.client.0.smithi029.stdout:2/960: stat de/d14/d24/d93/cfa 0 2023-12-05T13:26:59.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/961: symlink de/d16/d43/l138 0 2023-12-05T13:26:59.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/962: fsync de/f27 0 2023-12-05T13:26:59.111 INFO:tasks.workunit.client.0.smithi029.stdout:2/963: dread - de/d14/d24/f129 zero size 2023-12-05T13:26:59.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/964: mkdir de/d6a/d139 0 2023-12-05T13:26:59.112 INFO:tasks.workunit.client.0.smithi029.stdout:2/965: truncate de/d14/d24/d93/dc5/dc9/d10f/f125 606539 0 2023-12-05T13:26:59.114 INFO:tasks.workunit.client.0.smithi029.stdout:2/966: read de/d14/f35 [511018,97947] 0 2023-12-05T13:26:59.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/967: chown de/d16/d6c/d8e/dbf/f118 1660 1 2023-12-05T13:26:59.115 INFO:tasks.workunit.client.0.smithi029.stdout:2/968: fdatasync de/d14/d24/f101 0 2023-12-05T13:26:59.116 INFO:tasks.workunit.client.0.smithi029.stdout:2/969: rename de/d16/c36 to de/d6a/c13a 0 2023-12-05T13:26:59.118 INFO:tasks.workunit.client.0.smithi029.stdout:2/970: mkdir de/d14/d24/db7/df3/d13b 0 2023-12-05T13:26:59.120 INFO:tasks.workunit.client.0.smithi029.stdout:2/971: symlink de/d16/l13c 0 2023-12-05T13:26:59.120 INFO:tasks.workunit.client.0.smithi029.stdout:2/972: mknod de/d14/ddf/c13d 0 2023-12-05T13:26:59.121 INFO:tasks.workunit.client.0.smithi029.stdout:2/973: mknod de/d11/dad/c13e 0 2023-12-05T13:26:59.122 INFO:tasks.workunit.client.0.smithi029.stdout:2/974: symlink de/d14/ddf/l13f 0 2023-12-05T13:26:59.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/975: mkdir de/d140 0 2023-12-05T13:26:59.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/976: stat de/d16/d43/l138 0 2023-12-05T13:26:59.124 INFO:tasks.workunit.client.0.smithi029.stdout:2/977: getdents de/d11 0 2023-12-05T13:26:59.131 INFO:tasks.workunit.client.0.smithi029.stdout:5/833: dwrite d1/dc/d10/d1e/f5f [0,4194304] 0 2023-12-05T13:26:59.133 INFO:tasks.workunit.client.0.smithi029.stdout:5/834: rename d1/dc/d25/d4c/d61 to d1/dc/d38/d3a/d5c/d114 0 2023-12-05T13:26:59.134 INFO:tasks.workunit.client.0.smithi029.stdout:5/835: write d1/dc/d38/f40 [3350795,25605] 0 2023-12-05T13:26:59.144 INFO:tasks.workunit.client.0.smithi029.stdout:5/836: dread d1/dc/d10/d1e/d33/f4d [0,4194304] 0 2023-12-05T13:26:59.144 INFO:tasks.workunit.client.0.smithi029.stdout:2/978: dwrite de/d16/d4c/fec [0,4194304] 0 2023-12-05T13:26:59.148 INFO:tasks.workunit.client.0.smithi029.stdout:2/979: unlink de/d14/d24/db7/df3/lf6 0 2023-12-05T13:26:59.157 INFO:tasks.workunit.client.0.smithi029.stdout:2/980: write de/d11/fab [643062,4816] 0 2023-12-05T13:26:59.157 INFO:tasks.workunit.client.0.smithi029.stdout:5/837: write d1/dc/d25/d4c/f52 [738954,1035] 0 2023-12-05T13:26:59.158 INFO:tasks.workunit.client.0.smithi029.stdout:2/981: creat de/d41/f141 x:0 0 0 2023-12-05T13:26:59.158 INFO:tasks.workunit.client.0.smithi029.stdout:2/982: chown de/d14/d24/d93/dc5/f11a 527907 1 2023-12-05T13:26:59.159 INFO:tasks.workunit.client.0.smithi029.stdout:5/838: link d1/dc/d25/l107 d1/dc/d10/d1e/d33/d93/da5/df5/l115 0 2023-12-05T13:26:59.160 INFO:tasks.workunit.client.0.smithi029.stdout:5/839: creat d1/dc/d10/d1e/d33/f116 x:0 0 0 2023-12-05T13:26:59.163 INFO:tasks.workunit.client.0.smithi029.stdout:5/840: dread d1/dc/d10/d1e/d33/d93/da5/db2/f43 [0,4194304] 0 2023-12-05T13:26:59.163 INFO:tasks.workunit.client.0.smithi029.stdout:5/841: truncate d1/dc/d10/d1e/d33/f73 748169 0 2023-12-05T13:26:59.163 INFO:tasks.workunit.client.0.smithi029.stdout:5/842: fsync d1/dc/d25/d4c/d9b/d9a/fab 0 2023-12-05T13:26:59.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/990: sync 2023-12-05T13:26:59.164 INFO:tasks.workunit.client.0.smithi029.stdout:4/991: write d0/de/d30/d94/d106/d134/d69/d77/fee [3293198,84906] 0 2023-12-05T13:26:59.165 INFO:tasks.workunit.client.0.smithi029.stdout:5/843: creat d1/dc/d38/d55/d57/f117 x:0 0 0 2023-12-05T13:26:59.165 INFO:tasks.workunit.client.0.smithi029.stdout:5/844: write d1/dc/d38/d55/d57/f117 [76261,29993] 0 2023-12-05T13:26:59.165 INFO:tasks.workunit.client.0.smithi029.stdout:4/992: write d0/d16/d22/d5f/d79/dcf/ff9 [1732485,28945] 0 2023-12-05T13:26:59.166 INFO:tasks.workunit.client.0.smithi029.stdout:5/845: mkdir d1/dc/d10/d1e/d33/dfe/d118 0 2023-12-05T13:26:59.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/846: unlink d1/dc/d10/cac 0 2023-12-05T13:26:59.169 INFO:tasks.workunit.client.0.smithi029.stdout:5/847: chown d1/dc/d38/l8c 1 1 2023-12-05T13:26:59.187 INFO:tasks.workunit.client.0.smithi029.stdout:4/993: dwrite d0/de/d30/d32/d35/d3d/df5/d13b/f127 [0,4194304] 0 2023-12-05T13:26:59.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/994: symlink d0/de/d30/d32/d35/d3d/df5/l14c 0 2023-12-05T13:26:59.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/995: chown d0/de/d30/db5 479369 1 2023-12-05T13:26:59.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/996: write d0/de/d30/d32/dbd/d139/dd4/f148 [589332,94981] 0 2023-12-05T13:26:59.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/997: dread - d0/de/d30/d94/d106/d134/d69/f126 zero size 2023-12-05T13:26:59.189 INFO:tasks.workunit.client.0.smithi029.stdout:4/998: readlink d0/d16/d22/d4f/lf6 0 2023-12-05T13:26:59.190 INFO:tasks.workunit.client.0.smithi029.stdout:5/848: dwrite d1/dc/d25/d4c/d9b/fd4 [0,4194304] 0 2023-12-05T13:26:59.191 INFO:tasks.workunit.client.0.smithi029.stdout:4/999: creat d0/de/d30/d94/d106/d133/f14d x:0 0 0 2023-12-05T13:26:59.195 INFO:tasks.workunit.client.0.smithi029.stdout:5/849: creat d1/dc/d10/d1e/d33/d93/f119 x:0 0 0 2023-12-05T13:26:59.196 INFO:tasks.workunit.client.0.smithi029.stdout:5/850: getdents d1/dc/d10/d1e 0 2023-12-05T13:26:59.196 INFO:tasks.workunit.client.0.smithi029.stdout:5/851: fdatasync d1/dc/d38/d3a/d5c/d87/fba 0 2023-12-05T13:26:59.197 INFO:tasks.workunit.client.0.smithi029.stdout:5/852: mkdir d1/dc/d38/d3a/d5c/d87/d11a 0 2023-12-05T13:26:59.200 INFO:tasks.workunit.client.0.smithi029.stdout:5/853: dread d1/dc/d10/d1e/d33/d93/da5/db2/f43 [0,4194304] 0 2023-12-05T13:26:59.318 INFO:tasks.workunit.client.0.smithi029.stdout:2/983: sync 2023-12-05T13:26:59.318 INFO:tasks.workunit.client.0.smithi029.stdout:2/984: chown de/d14/l34 17446725 1 2023-12-05T13:26:59.320 INFO:tasks.workunit.client.0.smithi029.stdout:2/985: rename de/d41/d56/d58/fce to de/d16/d6c/d90/f142 0 2023-12-05T13:26:59.320 INFO:tasks.workunit.client.0.smithi029.stdout:2/986: fdatasync de/d16/fc8 0 2023-12-05T13:26:59.320 INFO:tasks.workunit.client.0.smithi029.stdout:2/987: mknod de/d14/d24/d93/c143 0 2023-12-05T13:26:59.322 INFO:tasks.workunit.client.0.smithi029.stdout:2/988: creat de/d14/d24/d93/dc5/dc9/f144 x:0 0 0 2023-12-05T13:26:59.323 INFO:tasks.workunit.client.0.smithi029.stdout:2/989: unlink de/d14/d24/cc7 0 2023-12-05T13:26:59.332 INFO:tasks.workunit.client.0.smithi029.stdout:2/990: dread de/db8/fde [0,4194304] 0 2023-12-05T13:26:59.334 INFO:tasks.workunit.client.0.smithi029.stdout:2/991: unlink de/d16/d43/ccd 0 2023-12-05T13:26:59.334 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:59.334 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:59.334 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: Upgrade: Need to upgrade myself (mgr.smithi052.ocazcp) 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: Upgrade: Need to upgrade myself (mgr.smithi052.ocazcp) 2023-12-05T13:26:59.335 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:26:59 smithi029 ceph-mon[112128]: pgmap v51: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 59 MiB/s rd, 126 MiB/s wr, 211 op/s 2023-12-05T13:26:59.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/992: getdents de/d16/d6c/ddc 0 2023-12-05T13:26:59.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/993: symlink de/d14/d24/d93/dc5/l145 0 2023-12-05T13:26:59.336 INFO:tasks.workunit.client.0.smithi029.stdout:2/994: write de/d14/d24/d93/fb5 [169174,47292] 0 2023-12-05T13:26:59.337 INFO:tasks.workunit.client.0.smithi029.stdout:2/995: truncate de/d41/d56/f67 359949 0 2023-12-05T13:26:59.338 INFO:tasks.workunit.client.0.smithi029.stdout:2/996: mkdir de/d14/d24/d93/dc5/d135/d146 0 2023-12-05T13:26:59.338 INFO:tasks.workunit.client.0.smithi029.stdout:2/997: readlink de/d16/d43/l61 0 2023-12-05T13:26:59.338 INFO:tasks.workunit.client.0.smithi029.stdout:2/998: getdents de/db8 0 2023-12-05T13:26:59.356 INFO:tasks.workunit.client.0.smithi029.stdout:2/999: dwrite de/d11/f26 [0,4194304] 0 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:26:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:26:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:26:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:26:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: Upgrade: Need to upgrade myself (mgr.smithi052.ocazcp) 2023-12-05T13:26:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: Upgrade: Need to upgrade myself (mgr.smithi052.ocazcp) 2023-12-05T13:26:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:26:59 smithi052 ceph-mon[121072]: pgmap v51: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 59 MiB/s rd, 126 MiB/s wr, 211 op/s 2023-12-05T13:26:59.492 INFO:tasks.workunit.client.0.smithi029.stdout:5/854: sync 2023-12-05T13:26:59.506 INFO:tasks.workunit.client.0.smithi029.stdout:5/855: dwrite d1/dc/d38/d55/f96 [4194304,4194304] 0 2023-12-05T13:26:59.506 INFO:tasks.workunit.client.0.smithi029.stdout:5/856: chown d1/dc/d10/d1e/f5f 64927 1 2023-12-05T13:26:59.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/857: mkdir d1/dc/d11/d17/d11b 0 2023-12-05T13:26:59.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/858: chown d1/dc/d27/l2b 977134 1 2023-12-05T13:26:59.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/859: write d1/dc/d38/d55/d57/f117 [758838,90915] 0 2023-12-05T13:26:59.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/860: dread - d1/dc/d10/d1e/d33/d93/da5/db2/da6/fed zero size 2023-12-05T13:26:59.507 INFO:tasks.workunit.client.0.smithi029.stdout:5/861: write d1/dc/d38/d3a/d5c/d114/f90 [240758,12601] 0 2023-12-05T13:26:59.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/862: creat d1/dc/d10/d1e/d33/d93/da5/db2/da6/f11c x:0 0 0 2023-12-05T13:26:59.508 INFO:tasks.workunit.client.0.smithi029.stdout:5/863: rmdir d1/dc/d10/d1e 39 2023-12-05T13:26:59.509 INFO:tasks.workunit.client.0.smithi029.stdout:5/864: mkdir d1/dc/d11/d17/d11b/d11d 0 2023-12-05T13:26:59.526 INFO:tasks.workunit.client.0.smithi029.stdout:5/865: dwrite d1/dc/d25/d4c/d9b/d9a/f88 [4194304,4194304] 0 2023-12-05T13:26:59.527 INFO:tasks.workunit.client.0.smithi029.stdout:5/866: write d1/dc/d10/d1e/d75/d7f/fb1 [889700,29408] 0 2023-12-05T13:26:59.527 INFO:tasks.workunit.client.0.smithi029.stdout:5/867: truncate d1/dc/d10/d1e/d33/de5/fea 255224 0 2023-12-05T13:26:59.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/868: rename d1/dc/d11/d17/d11b to d1/dc/d10/d10f/d11e 0 2023-12-05T13:26:59.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/869: chown d1/dc/d38/d55/d57/f117 0 1 2023-12-05T13:26:59.532 INFO:tasks.workunit.client.0.smithi029.stdout:5/870: truncate d1/dc/d10/d1e/d33/d93/f119 198557 0 2023-12-05T13:26:59.546 INFO:tasks.workunit.client.0.smithi029.stdout:5/871: dwrite d1/dc/d10/d1e/d33/d93/da5/db2/da6/fed [0,4194304] 0 2023-12-05T13:26:59.548 INFO:tasks.workunit.client.0.smithi029.stdout:5/872: mknod d1/dc/d10/d1e/d75/d7f/c11f 0 2023-12-05T13:26:59.563 INFO:tasks.workunit.client.0.smithi029.stdout:5/873: dwrite d1/dc/d38/d3a/d5c/d87/fba [0,4194304] 0 2023-12-05T13:26:59.563 INFO:tasks.workunit.client.0.smithi029.stdout:5/874: chown d1/dc/d38/d3a/db3/c113 16229322 1 2023-12-05T13:26:59.564 INFO:tasks.workunit.client.0.smithi029.stdout:5/875: write d1/dc/d10/d1e/d75/d7f/d8a/fd3 [194487,57708] 0 2023-12-05T13:26:59.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/876: readlink d1/dc/d11/d17/lb7 0 2023-12-05T13:26:59.565 INFO:tasks.workunit.client.0.smithi029.stdout:5/877: mkdir d1/dc/d10/d1e/d33/d93/da5/db2/da6/d120 0 2023-12-05T13:26:59.566 INFO:tasks.workunit.client.0.smithi029.stdout:5/878: write d1/dc/d10/d1e/d33/f116 [604363,69011] 0 2023-12-05T13:26:59.566 INFO:tasks.workunit.client.0.smithi029.stdout:5/879: symlink d1/dc/d10/d1e/d33/dfe/l121 0 2023-12-05T13:26:59.569 INFO:tasks.workunit.client.0.smithi029.stdout:5/880: dread d1/dc/d10/d1e/d33/d93/da5/db2/da6/fe0 [0,4194304] 0 2023-12-05T13:26:59.571 INFO:tasks.workunit.client.0.smithi029.stdout:5/881: dread d1/dc/d10/d1e/d9c/fdb [0,4194304] 0 2023-12-05T13:26:59.572 INFO:tasks.workunit.client.0.smithi029.stdout:5/882: mkdir d1/dc/d38/d55/d122 0 2023-12-05T13:26:59.589 INFO:tasks.workunit.client.0.smithi029.stdout:5/883: dwrite d1/dc/d25/fa8 [4194304,4194304] 0 2023-12-05T13:26:59.590 INFO:tasks.workunit.client.0.smithi029.stdout:5/884: read d1/dc/d10/d1e/d33/fc5 [3135018,90595] 0 2023-12-05T13:26:59.591 INFO:tasks.workunit.client.0.smithi029.stdout:5/885: creat d1/dc/d11/d17/f123 x:0 0 0 2023-12-05T13:26:59.607 INFO:tasks.workunit.client.0.smithi029.stdout:5/886: dwrite d1/dc/d11/f56 [8388608,4194304] 0 2023-12-05T13:26:59.607 INFO:tasks.workunit.client.0.smithi029.stdout:5/887: stat d1/dc/d10/l31 0 2023-12-05T13:26:59.608 INFO:tasks.workunit.client.0.smithi029.stdout:5/888: unlink d1/dc/d25/fa8 0 2023-12-05T13:26:59.611 INFO:tasks.workunit.client.0.smithi029.stdout:5/889: rmdir d1/dc/d10 39 2023-12-05T13:26:59.613 INFO:tasks.workunit.client.0.smithi029.stdout:5/890: symlink d1/dc/d10/d1e/d33/d93/da5/db2/l124 0 2023-12-05T13:26:59.621 INFO:tasks.workunit.client.0.smithi029.stdout:5/891: dread d1/dc/d38/d3a/d5c/d114/f10e [0,4194304] 0 2023-12-05T13:26:59.622 INFO:tasks.workunit.client.0.smithi029.stdout:5/892: creat d1/dc/d11/f125 x:0 0 0 2023-12-05T13:26:59.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/893: link d1/dc/d25/d4c/cc4 d1/dc/d38/d3a/d5c/d114/c126 0 2023-12-05T13:26:59.623 INFO:tasks.workunit.client.0.smithi029.stdout:5/894: chown d1/dc/d25/d4c/d9b/d9a/l51 0 1 2023-12-05T13:26:59.624 INFO:tasks.workunit.client.0.smithi029.stdout:5/895: unlink d1/dc/d38/d3a/d5c/d114/c126 0 2023-12-05T13:26:59.625 INFO:tasks.workunit.client.0.smithi029.stdout:5/896: creat d1/dc/d10/d1e/d33/d93/da5/db2/da6/f127 x:0 0 0 2023-12-05T13:26:59.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/897: truncate d1/dc/d10/d1e/d33/fc5 1126553 0 2023-12-05T13:26:59.626 INFO:tasks.workunit.client.0.smithi029.stdout:5/898: chown d1/dc/d38/d3a/d5c/c8e 10 1 2023-12-05T13:26:59.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/899: fsync d1/dc/d38/d4b/fcd 0 2023-12-05T13:26:59.627 INFO:tasks.workunit.client.0.smithi029.stdout:5/900: creat d1/dc/d38/d4b/f128 x:0 0 0 2023-12-05T13:26:59.628 INFO:tasks.workunit.client.0.smithi029.stdout:5/901: rmdir d1/dc/d38/d55/d122 0 2023-12-05T13:26:59.639 INFO:tasks.workunit.client.0.smithi029.stdout:5/902: dread d1/dc/d10/d1e/d75/d7f/fb1 [0,4194304] 0 2023-12-05T13:26:59.640 INFO:tasks.workunit.client.0.smithi029.stdout:5/903: write d1/dc/d10/d1e/d33/d93/da5/db2/f43 [590276,86243] 0 2023-12-05T13:26:59.658 INFO:tasks.workunit.client.0.smithi029.stdout:5/904: dwrite d1/dc/d38/d55/f96 [0,4194304] 0 2023-12-05T13:26:59.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/905: getdents d1/dc/d10/d1e/d9c 0 2023-12-05T13:26:59.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/906: write d1/dc/d10/d1e/f5f [5174603,8325] 0 2023-12-05T13:26:59.659 INFO:tasks.workunit.client.0.smithi029.stdout:5/907: symlink d1/dc/d27/l129 0 2023-12-05T13:26:59.660 INFO:tasks.workunit.client.0.smithi029.stdout:5/908: write d1/dc/d10/d1e/d75/d7f/d8a/fd3 [137616,60883] 0 2023-12-05T13:26:59.660 INFO:tasks.workunit.client.0.smithi029.stdout:5/909: write d1/dc/d27/f49 [3630037,2549] 0 2023-12-05T13:26:59.666 INFO:tasks.workunit.client.0.smithi029.stdout:5/910: dread d1/dc/d10/d1e/d33/d93/f112 [0,4194304] 0 2023-12-05T13:26:59.666 INFO:tasks.workunit.client.0.smithi029.stdout:5/911: chown d1/dc/d10/d1e/d33/de5 364058 1 2023-12-05T13:26:59.666 INFO:tasks.workunit.client.0.smithi029.stdout:5/912: chown d1/dc/d10/d1e/d33/de5/l106 33 1 2023-12-05T13:26:59.670 INFO:tasks.workunit.client.0.smithi029.stdout:5/913: dread d1/dc/d10/d1e/d75/d7f/d8a/fd3 [0,4194304] 0 2023-12-05T13:26:59.675 INFO:tasks.workunit.client.0.smithi029.stdout:5/914: dread d1/dc/d11/d17/d3d/f62 [0,4194304] 0 2023-12-05T13:26:59.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/915: mknod d1/dc/d27/c12a 0 2023-12-05T13:26:59.676 INFO:tasks.workunit.client.0.smithi029.stdout:5/916: dread - d1/dc/d10/d1e/d33/ff7 zero size 2023-12-05T13:26:59.677 INFO:tasks.workunit.client.0.smithi029.stdout:5/917: symlink d1/dc/d10/de8/l12b 0 2023-12-05T13:26:59.677 INFO:tasks.workunit.client.0.smithi029.stdout:5/918: write d1/dc/d10/d1e/d33/d93/da5/db2/da6/f127 [981771,13474] 0 2023-12-05T13:26:59.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/919: write d1/dc/d38/f22 [1119763,130064] 0 2023-12-05T13:26:59.678 INFO:tasks.workunit.client.0.smithi029.stdout:5/920: truncate d1/dc/d38/d3a/d5c/d87/fba 166278 0 2023-12-05T13:26:59.679 INFO:tasks.workunit.client.0.smithi029.stdout:5/921: write d1/dc/d10/d1e/d75/d7f/fb1 [62380,64781] 0 2023-12-05T13:26:59.680 INFO:tasks.workunit.client.0.smithi029.stdout:5/922: symlink d1/dc/d10/l12c 0 2023-12-05T13:26:59.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/923: read d1/dc/d10/fda [1203323,114833] 0 2023-12-05T13:26:59.681 INFO:tasks.workunit.client.0.smithi029.stdout:5/924: readlink d1/dc/d11/d17/d3d/leb 0 2023-12-05T13:26:59.699 INFO:tasks.workunit.client.0.smithi029.stdout:5/925: dwrite d1/dc/d38/d55/f96 [0,4194304] 0 2023-12-05T13:26:59.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/926: creat d1/f12d x:0 0 0 2023-12-05T13:26:59.701 INFO:tasks.workunit.client.0.smithi029.stdout:5/927: readlink d1/dc/d11/d17/lb7 0 2023-12-05T13:26:59.703 INFO:tasks.workunit.client.0.smithi029.stdout:5/928: rename d1/dc/d10/d1e/d33/d93/da5/db2 to d1/d12e 0 2023-12-05T13:26:59.705 INFO:tasks.workunit.client.0.smithi029.stdout:5/929: link d1/dc/d10/d1e/d75/lae d1/dc/d10/d10f/l12f 0 2023-12-05T13:26:59.708 INFO:tasks.workunit.client.0.smithi029.stdout:5/930: rename d1/dc/d38/d3a/d5c/d87 to d1/d12e/da6/d130 0 2023-12-05T13:26:59.708 INFO:tasks.workunit.client.0.smithi029.stdout:5/931: dread - d1/dc/d38/d3a/d5c/f10d zero size 2023-12-05T13:26:59.709 INFO:tasks.workunit.client.0.smithi029.stdout:5/932: mkdir d1/dc/d27/d131 0 2023-12-05T13:26:59.710 INFO:tasks.workunit.client.0.smithi029.stdout:5/933: read d1/dc/d11/d17/f9f [3339823,130049] 0 2023-12-05T13:26:59.711 INFO:tasks.workunit.client.0.smithi029.stdout:5/934: symlink d1/d12e/da6/dd6/l132 0 2023-12-05T13:26:59.712 INFO:tasks.workunit.client.0.smithi029.stdout:5/935: rmdir d1/dc/d25/d4c/d9b/d9a 39 2023-12-05T13:26:59.713 INFO:tasks.workunit.client.0.smithi029.stdout:5/936: rename d1/dc/d10/d1e to d1/dc/d10/d10f/d133 0 2023-12-05T13:26:59.715 INFO:tasks.workunit.client.0.smithi029.stdout:5/937: creat d1/dc/d10/d10f/d133/d33/d93/da5/f134 x:0 0 0 2023-12-05T13:26:59.716 INFO:tasks.workunit.client.0.smithi029.stdout:5/938: getdents d1/d12e/da6 0 2023-12-05T13:26:59.734 INFO:tasks.workunit.client.0.smithi029.stdout:5/939: dwrite d1/d12e/da6/d130/fb8 [0,4194304] 0 2023-12-05T13:26:59.737 INFO:tasks.workunit.client.0.smithi029.stdout:5/940: dread d1/dc/d10/d10f/d133/fce [0,4194304] 0 2023-12-05T13:26:59.737 INFO:tasks.workunit.client.0.smithi029.stdout:5/941: write d1/dc/d25/d4c/d9b/fd4 [5079247,32686] 0 2023-12-05T13:26:59.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/942: dread d1/d12e/da6/fee [0,4194304] 0 2023-12-05T13:26:59.745 INFO:tasks.workunit.client.0.smithi029.stdout:5/943: fsync d1/dc/d38/d4b/f103 0 2023-12-05T13:26:59.746 INFO:tasks.workunit.client.0.smithi029.stdout:5/944: mknod d1/dc/d10/c135 0 2023-12-05T13:26:59.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/945: mkdir d1/dc/d38/d4b/d136 0 2023-12-05T13:26:59.747 INFO:tasks.workunit.client.0.smithi029.stdout:5/946: stat d1/dc/d10/d10f/l12f 0 2023-12-05T13:26:59.748 INFO:tasks.workunit.client.0.smithi029.stdout:5/947: symlink d1/dc/d10/d10f/l137 0 2023-12-05T13:26:59.749 INFO:tasks.workunit.client.0.smithi029.stdout:5/948: creat d1/dc/d10/d10f/d133/d33/f138 x:0 0 0 2023-12-05T13:26:59.750 INFO:tasks.workunit.client.0.smithi029.stdout:5/949: mkdir d1/d12e/da6/d130/d139 0 2023-12-05T13:26:59.761 INFO:tasks.workunit.client.0.smithi029.stdout:5/950: dread d1/dc/d38/d55/f96 [0,4194304] 0 2023-12-05T13:26:59.761 INFO:tasks.workunit.client.0.smithi029.stdout:5/951: fdatasync d1/dc/d10/d10f/d133/d75/d7f/d8a/fc2 0 2023-12-05T13:26:59.762 INFO:tasks.workunit.client.0.smithi029.stdout:5/952: creat d1/dc/d10/d10f/d133/d9c/f13a x:0 0 0 2023-12-05T13:26:59.762 INFO:tasks.workunit.client.0.smithi029.stdout:5/953: mkdir d1/dc/d38/d4b/dff/d13b 0 2023-12-05T13:26:59.763 INFO:tasks.workunit.client.0.smithi029.stdout:5/954: write d1/dc/d27/f49 [1102999,108066] 0 2023-12-05T13:26:59.764 INFO:tasks.workunit.client.0.smithi029.stdout:5/955: symlink d1/dc/d10/d10f/d133/d9c/l13c 0 2023-12-05T13:26:59.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/956: write d1/dc/d38/d3a/d5c/fcc [3788620,2681] 0 2023-12-05T13:26:59.766 INFO:tasks.workunit.client.0.smithi029.stdout:5/957: write d1/dc/d38/d55/f96 [8526048,71222] 0 2023-12-05T13:26:59.768 INFO:tasks.workunit.client.0.smithi029.stdout:5/958: rename d1/dc/d38/d3a/d5c/d114/f80 to d1/dc/d38/d4b/d136/f13d 0 2023-12-05T13:26:59.769 INFO:tasks.workunit.client.0.smithi029.stdout:5/959: unlink d1/d12e/da6/f11c 0 2023-12-05T13:26:59.771 INFO:tasks.workunit.client.0.smithi029.stdout:5/960: creat d1/d12e/f13e x:0 0 0 2023-12-05T13:26:59.773 INFO:tasks.workunit.client.0.smithi029.stdout:5/961: creat d1/dc/d38/d4b/dff/d13b/f13f x:0 0 0 2023-12-05T13:26:59.774 INFO:tasks.workunit.client.0.smithi029.stdout:5/962: rename d1/dc/d11/d17/lb7 to d1/dc/d27/d131/l140 0 2023-12-05T13:26:59.787 INFO:tasks.workunit.client.0.smithi029.stdout:5/963: dwrite d1/dc/d25/f3b [4194304,4194304] 0 2023-12-05T13:26:59.789 INFO:tasks.workunit.client.0.smithi029.stdout:5/964: symlink d1/dc/d27/d131/l141 0 2023-12-05T13:26:59.791 INFO:tasks.workunit.client.0.smithi029.stdout:5/965: fdatasync d1/dc/d38/d55/f96 0 2023-12-05T13:26:59.791 INFO:tasks.workunit.client.0.smithi029.stdout:5/966: chown d1/dc/d11/d17/f64 4240561 1 2023-12-05T13:26:59.792 INFO:tasks.workunit.client.0.smithi029.stdout:5/967: write d1/dc/d25/d4c/d9b/fdf [1010972,27776] 0 2023-12-05T13:26:59.792 INFO:tasks.workunit.client.0.smithi029.stdout:5/968: write d1/dc/d25/d4c/f52 [191899,79052] 0 2023-12-05T13:26:59.812 INFO:tasks.workunit.client.0.smithi029.stdout:5/969: dwrite d1/dc/d25/d4c/d9b/fdf [0,4194304] 0 2023-12-05T13:26:59.812 INFO:tasks.workunit.client.0.smithi029.stdout:5/970: write d1/dc/d11/f125 [423127,4442] 0 2023-12-05T13:26:59.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/971: creat d1/dc/d38/d55/d57/d98/f142 x:0 0 0 2023-12-05T13:26:59.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/972: fsync d1/dc/d11/f56 0 2023-12-05T13:26:59.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/973: read - d1/dc/d38/d55/f6e zero size 2023-12-05T13:26:59.814 INFO:tasks.workunit.client.0.smithi029.stdout:5/974: fdatasync d1/dc/d10/d10f/d133/d33/f4d 0 2023-12-05T13:26:59.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/975: mknod d1/d12e/c143 0 2023-12-05T13:26:59.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/976: chown d1/dc/d10/d10f/d133/d75/d7f/fb1 1132617 1 2023-12-05T13:26:59.815 INFO:tasks.workunit.client.0.smithi029.stdout:5/977: symlink d1/dc/d38/d3a/l144 0 2023-12-05T13:26:59.816 INFO:tasks.workunit.client.0.smithi029.stdout:5/978: rmdir d1/dc/d10/d10f/d133/d33 39 2023-12-05T13:26:59.816 INFO:tasks.workunit.client.0.smithi029.stdout:5/979: read - d1/dc/d38/d55/f6e zero size 2023-12-05T13:26:59.817 INFO:tasks.workunit.client.0.smithi029.stdout:5/980: rename d1/f12d to d1/d12e/da6/d120/f145 0 2023-12-05T13:26:59.818 INFO:tasks.workunit.client.0.smithi029.stdout:5/981: mknod d1/dc/d38/d55/c146 0 2023-12-05T13:26:59.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/982: creat d1/dc/d11/d17/d3d/f147 x:0 0 0 2023-12-05T13:26:59.819 INFO:tasks.workunit.client.0.smithi029.stdout:5/983: readlink d1/dc/d25/l107 0 2023-12-05T13:26:59.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/984: write d1/dc/d11/f125 [67374,1854] 0 2023-12-05T13:26:59.820 INFO:tasks.workunit.client.0.smithi029.stdout:5/985: chown d1/d12e 1062290571 1 2023-12-05T13:26:59.826 INFO:tasks.workunit.client.0.smithi029.stdout:5/986: truncate d1/dc/d10/d10f/d133/d33/de5/fea 240161 0 2023-12-05T13:26:59.826 INFO:tasks.workunit.client.0.smithi029.stdout:5/987: fdatasync d1/dc/d25/d4c/d9b/d9a/ffa 0 2023-12-05T13:26:59.827 INFO:tasks.workunit.client.0.smithi029.stdout:5/988: unlink d1/d12e/da6/dd6/ffd 0 2023-12-05T13:26:59.827 INFO:tasks.workunit.client.0.smithi029.stdout:5/989: getdents d1/dc/d10/d10f/d133/d33/dfe 0 2023-12-05T13:26:59.829 INFO:tasks.workunit.client.0.smithi029.stdout:5/990: unlink d1/dc/d38/d3a/l144 0 2023-12-05T13:26:59.829 INFO:tasks.workunit.client.0.smithi029.stdout:5/991: write d1/dc/d10/d10f/d133/d75/d7f/fb1 [1428636,57389] 0 2023-12-05T13:26:59.829 INFO:tasks.workunit.client.0.smithi029.stdout:5/992: chown d1/dc/d10/de8/l12b 0 1 2023-12-05T13:26:59.844 INFO:tasks.workunit.client.0.smithi029.stdout:5/993: dwrite d1/dc/d25/d4c/ff9 [0,4194304] 0 2023-12-05T13:26:59.845 INFO:tasks.workunit.client.0.smithi029.stdout:5/994: truncate d1/d12e/da6/fe0 556944 0 2023-12-05T13:26:59.847 INFO:tasks.workunit.client.0.smithi029.stdout:5/995: creat d1/d12e/da6/d120/f148 x:0 0 0 2023-12-05T13:26:59.847 INFO:tasks.workunit.client.0.smithi029.stdout:5/996: write d1/dc/d38/f44 [569466,20789] 0 2023-12-05T13:26:59.866 INFO:tasks.workunit.client.0.smithi029.stdout:5/997: dwrite d1/dc/d11/fbe [0,4194304] 0 2023-12-05T13:26:59.867 INFO:tasks.workunit.client.0.smithi029.stdout:5/998: mkdir d1/dc/d11/d17/d149 0 2023-12-05T13:26:59.868 INFO:tasks.workunit.client.0.smithi029.stdout:5/999: getdents d1/dc/d38/d3a 0 2023-12-05T13:26:59.871 INFO:tasks.workunit.client.0.smithi029.stderr:+ rm -rf -- ./tmp.nMPhzWxL2m 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: Upgrade: Updating mgr.smithi029.eekhlu 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: Deploying daemon mgr.smithi029.eekhlu on smithi029 2023-12-05T13:27:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:01 smithi029 ceph-mon[112128]: pgmap v52: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 99 MiB/s wr, 162 op/s 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: Upgrade: Updating mgr.smithi029.eekhlu 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:01.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: Deploying daemon mgr.smithi029.eekhlu on smithi029 2023-12-05T13:27:01.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:01 smithi052 ceph-mon[121072]: pgmap v52: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 99 MiB/s wr, 162 op/s 2023-12-05T13:27:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:03 smithi029 ceph-mon[112128]: pgmap v53: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 99 MiB/s wr, 162 op/s 2023-12-05T13:27:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:03 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:03 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:03.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:03 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:03.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:03 smithi052 ceph-mon[121072]: pgmap v53: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 43 MiB/s rd, 99 MiB/s wr, 162 op/s 2023-12-05T13:27:03.700 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:03 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:03.700 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:03 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:03.700 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:03 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:05 smithi052 ceph-mon[121072]: pgmap v54: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 111 MiB/s wr, 218 op/s 2023-12-05T13:27:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:05 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:05 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:05.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:05 smithi029 ceph-mon[112128]: pgmap v54: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 111 MiB/s wr, 218 op/s 2023-12-05T13:27:05.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:05 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:05.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:05 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.565+0000 7f776e749700 1 -- 172.21.15.29:0/227229377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806e210 msgr2=0x7f776806e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.565+0000 7f776e749700 1 --2- 172.21.15.29:0/227229377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806e210 0x7f776806e620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7758004940 tx=0x7f7758009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.565+0000 7f776e749700 1 -- 172.21.15.29:0/227229377 shutdown_connections 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.565+0000 7f776e749700 1 --2- 172.21.15.29:0/227229377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776806eb60 0x7f7768108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.565+0000 7f776e749700 1 --2- 172.21.15.29:0/227229377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806e210 0x7f776806e620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.565+0000 7f776e749700 1 -- 172.21.15.29:0/227229377 >> 172.21.15.29:0/227229377 conn(0x7f7768069b20 msgr2=0x7f776806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.566+0000 7f776e749700 1 -- 172.21.15.29:0/227229377 shutdown_connections 2023-12-05T13:27:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.566+0000 7f776e749700 1 -- 172.21.15.29:0/227229377 wait complete. 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.566+0000 7f776e749700 1 Processor -- start 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.567+0000 7f776e749700 1 -- start start 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.567+0000 7f776e749700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776806e210 0x7f776811c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.567+0000 7f776e749700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 0x7f776811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.567+0000 7f776e749700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776811cec0 con 0x7f776806eb60 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.567+0000 7f776e749700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776811d760 con 0x7f776806e210 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.567+0000 7f77677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 0x7f776811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.568+0000 7f77677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 0x7f776811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45826/0 (socket says 172.21.15.29:45826) 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.568+0000 7f77677fe700 1 -- 172.21.15.29:0/3735617708 learned_addr learned my addr 172.21.15.29:0/3735617708 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.568+0000 7f7767fff700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776806e210 0x7f776811c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.568+0000 7f77677fe700 1 -- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776806e210 msgr2=0x7f776811c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.568+0000 7f77677fe700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776806e210 0x7f776811c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:07.574 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.568+0000 7f77677fe700 1 -- 172.21.15.29:0/3735617708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7758005040 con 0x7f776806eb60 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.569+0000 7f77677fe700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 0x7f776811c8c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f775c002a80 tx=0x7f775c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.572+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775c007cc0 con 0x7f776806eb60 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.572+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f775c00f040 con 0x7f776806eb60 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.572+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775c00d900 con 0x7f776806eb60 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.572+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776811d9c0 con 0x7f776806eb60 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.572+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776811df00 con 0x7f776806eb60 2023-12-05T13:27:07.575 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.574+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7768116400 con 0x7f776806eb60 2023-12-05T13:27:07.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.577+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 26) v1 ==== 88622+0+0 (secure 0 0 0) 0x7f775c009680 con 0x7f776806eb60 2023-12-05T13:27:07.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.578+0000 7f7764ff9700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f775006af10 0x7f775006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:07.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.578+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f775c088ad0 con 0x7f776806eb60 2023-12-05T13:27:07.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.579+0000 7f7767fff700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f775006af10 0x7f775006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:07.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.584+0000 7f7767fff700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f775006af10 0x7f775006d3c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f775800b3b0 tx=0x7f7758009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:07.592 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.590+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f775c04dce0 con 0x7f776806eb60 2023-12-05T13:27:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:07 smithi052 ceph-mon[121072]: pgmap v55: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 9.6 MiB/s rd, 19 MiB/s wr, 88 op/s 2023-12-05T13:27:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:07 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:07 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:07.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:07 smithi029 ceph-mon[112128]: pgmap v55: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 9.6 MiB/s rd, 19 MiB/s wr, 88 op/s 2023-12-05T13:27:07.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:07 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:07 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:07.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.993+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f776811e2f0 con 0x7f775006af10 2023-12-05T13:27:07.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.994+0000 7f7764ff9700 1 -- 172.21.15.29:0/3735617708 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f776811e2f0 con 0x7f775006af10 2023-12-05T13:27:07.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.998+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f775006af10 msgr2=0x7f775006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:07.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.998+0000 7f776e749700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f775006af10 0x7f775006d3c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f775800b3b0 tx=0x7f7758009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:07.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.998+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 msgr2=0x7f776811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:07.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.998+0000 7f776e749700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 0x7f776811c8c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f775c002a80 tx=0x7f775c004600 comp rx=0 tx=0).stop 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 shutdown_connections 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f775006af10 0x7f775006d3c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f776806e210 0x7f776811c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 --2- 172.21.15.29:0/3735617708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f776806eb60 0x7f776811c8c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 >> 172.21.15.29:0/3735617708 conn(0x7f7768069b20 msgr2=0x7f77681074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 shutdown_connections 2023-12-05T13:27:08.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:07.999+0000 7f776e749700 1 -- 172.21.15.29:0/3735617708 wait complete. 2023-12-05T13:27:08.019 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:27:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 -- 172.21.15.29:0/1582991925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fcd00 msgr2=0x7f364c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 --2- 172.21.15.29:0/1582991925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fcd00 0x7f364c0fd150 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f363c004940 tx=0x7f363c009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:08.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 -- 172.21.15.29:0/1582991925 shutdown_connections 2023-12-05T13:27:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 --2- 172.21.15.29:0/1582991925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fcd00 0x7f364c0fd150 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 --2- 172.21.15.29:0/1582991925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fbaf0 0x7f364c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 -- 172.21.15.29:0/1582991925 >> 172.21.15.29:0/1582991925 conn(0x7f364c0f7190 msgr2=0x7f364c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 -- 172.21.15.29:0/1582991925 shutdown_connections 2023-12-05T13:27:08.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.132+0000 7f36541b6700 1 -- 172.21.15.29:0/1582991925 wait complete. 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.133+0000 7f36541b6700 1 Processor -- start 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.133+0000 7f36541b6700 1 -- start start 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f36541b6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fbaf0 0x7f364c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f36541b6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 0x7f364c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f36541b6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c10e010 con 0x7f364c0fbaf0 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f36541b6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c10e8b0 con 0x7f364c0fcd00 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f3651751700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 0x7f364c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f3651751700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 0x7f364c10da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:43100/0 (socket says 172.21.15.29:43100) 2023-12-05T13:27:08.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f3651751700 1 -- 172.21.15.29:0/1500858479 learned_addr learned my addr 172.21.15.29:0/1500858479 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.134+0000 7f3651f52700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fbaf0 0x7f364c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f3651751700 1 -- 172.21.15.29:0/1500858479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fbaf0 msgr2=0x7f364c10d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f3651751700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fbaf0 0x7f364c10d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f3651751700 1 -- 172.21.15.29:0/1500858479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c005040 con 0x7f364c0fcd00 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f3651751700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 0x7f364c10da10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f363c008f90 tx=0x7f363c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363c021070 con 0x7f364c0fcd00 2023-12-05T13:27:08.136 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c10eb30 con 0x7f364c0fcd00 2023-12-05T13:27:08.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c10f070 con 0x7f364c0fcd00 2023-12-05T13:27:08.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f363c01c400 con 0x7f364c0fcd00 2023-12-05T13:27:08.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.135+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363c00e030 con 0x7f364c0fcd00 2023-12-05T13:27:08.137 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.137+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300052e0 con 0x7f364c0fcd00 2023-12-05T13:27:08.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.137+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 26) v1 ==== 88622+0+0 (secure 0 0 0) 0x7f363c013a30 con 0x7f364c0fcd00 2023-12-05T13:27:08.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.138+0000 7f36427fc700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f363806ad30 0x7f363806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:08.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.138+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f363c08a610 con 0x7f364c0fcd00 2023-12-05T13:27:08.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.138+0000 7f3651f52700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f363806ad30 0x7f363806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:08.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.139+0000 7f3651f52700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f363806ad30 0x7f363806d1e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3648009b80 tx=0x7f364800b040 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:08.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.143+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f363c0587f0 con 0x7f364c0fcd00 2023-12-05T13:27:08.462 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:08 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:08.462 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:08 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:08.463 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:08 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:08.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.525+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3630000bf0 con 0x7f363806ad30 2023-12-05T13:27:08.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.529+0000 7f36427fc700 1 -- 172.21.15.29:0/1500858479 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f3630000bf0 con 0x7f363806ad30 2023-12-05T13:27:08.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.543+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f363806ad30 msgr2=0x7f363806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:08.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.543+0000 7f36541b6700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f363806ad30 0x7f363806d1e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3648009b80 tx=0x7f364800b040 comp rx=0 tx=0).stop 2023-12-05T13:27:08.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.543+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 msgr2=0x7f364c10da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:08.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.543+0000 7f36541b6700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 0x7f364c10da10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f363c008f90 tx=0x7f363c009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:08.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.544+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 shutdown_connections 2023-12-05T13:27:08.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.544+0000 7f36541b6700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f363806ad30 0x7f363806d1e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.544+0000 7f36541b6700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f364c0fbaf0 0x7f364c10d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.544+0000 7f36541b6700 1 --2- 172.21.15.29:0/1500858479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f364c0fcd00 0x7f364c10da10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.544+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 >> 172.21.15.29:0/1500858479 conn(0x7f364c0f7190 msgr2=0x7f364c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:08.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.546+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 shutdown_connections 2023-12-05T13:27:08.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.547+0000 7f36541b6700 1 -- 172.21.15.29:0/1500858479 wait complete. 2023-12-05T13:27:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:08 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:08 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:08 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:08.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 -- 172.21.15.29:0/3846269440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fbaf0 msgr2=0x7fb5c00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:08.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 --2- 172.21.15.29:0/3846269440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c00fbf00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc004940 tx=0x7fb5bc009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:08.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 -- 172.21.15.29:0/3846269440 shutdown_connections 2023-12-05T13:27:08.747 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 --2- 172.21.15.29:0/3846269440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fcd00 0x7fb5c00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 --2- 172.21.15.29:0/3846269440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c00fbf00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 -- 172.21.15.29:0/3846269440 >> 172.21.15.29:0/3846269440 conn(0x7fb5c00f71b0 msgr2=0x7fb5c00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 -- 172.21.15.29:0/3846269440 shutdown_connections 2023-12-05T13:27:08.748 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.746+0000 7fb5c8283700 1 -- 172.21.15.29:0/3846269440 wait complete. 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.747+0000 7fb5c8283700 1 Processor -- start 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.747+0000 7fb5c8283700 1 -- start start 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.747+0000 7fb5c8283700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c010d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.747+0000 7fb5c8283700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 0x7fb5c010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c8283700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c010dff0 con 0x7fb5c00fcd00 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c8283700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c010e890 con 0x7fb5c00fbaf0 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c581e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 0x7fb5c010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c581e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 0x7fb5c010d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47358/0 (socket says 172.21.15.29:47358) 2023-12-05T13:27:08.749 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c581e700 1 -- 172.21.15.29:0/270647779 learned_addr learned my addr 172.21.15.29:0/270647779 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:08.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c601f700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c010d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:08.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c581e700 1 -- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fbaf0 msgr2=0x7fb5c010d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:08.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c581e700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c010d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:08.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c581e700 1 -- 172.21.15.29:0/270647779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc005040 con 0x7fb5c00fcd00 2023-12-05T13:27:08.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.748+0000 7fb5c601f700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c010d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:27:08.750 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.749+0000 7fb5c581e700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 0x7fb5c010d9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000eb40 tx=0x7fb5b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:08.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.750+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b0007cc0 con 0x7fb5c00fcd00 2023-12-05T13:27:08.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.750+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5b000f040 con 0x7fb5c00fcd00 2023-12-05T13:27:08.751 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.750+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c010eb10 con 0x7fb5c00fcd00 2023-12-05T13:27:08.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.750+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b000c990 con 0x7fb5c00fcd00 2023-12-05T13:27:08.752 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.750+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c010f050 con 0x7fb5c00fcd00 2023-12-05T13:27:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.752+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c004bb80 con 0x7fb5c00fcd00 2023-12-05T13:27:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.753+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 26) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fb5b000caf0 con 0x7fb5c00fcd00 2023-12-05T13:27:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.753+0000 7fb5b6ffd700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fb5ac06ad30 0x7fb5ac06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.753+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fb5b0089270 con 0x7fb5c00fcd00 2023-12-05T13:27:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.754+0000 7fb5c601f700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fb5ac06ad30 0x7fb5ac06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.754+0000 7fb5c601f700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fb5ac06ad30 0x7fb5ac06d1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b0d0 tx=0x7fb5bc009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:08.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:08.761+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb5b00573e0 con 0x7fb5c00fcd00 2023-12-05T13:27:09.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.082+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c010f520 con 0x7fb5ac06ad30 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.094+0000 7fb5b6ffd700 1 -- 172.21.15.29:0/270647779 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb5c010f520 con 0x7fb5ac06ad30 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (26s) 1s ago 8m 15.8M - 0.25.0 c8568f914cd2 54afa17f1b04 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (8m) 1s ago 8m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (7m) 4s ago 7m 7490k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (18s) 1s ago 8m 70.2M - 9.4.7 2c41d148cca3 7d9c49cae626 2023-12-05T13:27:09.095 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (4m) 1s ago 4m 7775M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (4m) 1s ago 4m 17.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (4m) 4s ago 4m 17.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (4m) 4s ago 4m 17.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (6s) 1s ago 9m 49.1M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283 running (115s) 4s ago 7m 505M - 19.0.0-13-ge6605fb8 104f332cd0a9 33d25b025398 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (9m) 1s ago 9m 89.8M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (7m) 4s ago 7m 60.1M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (29s) 1s ago 8m 17.7M - 1.5.0 0da6a335fe13 593e1fa46f84 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (11s) 4s ago 7m 5725k - 1.5.0 0da6a335fe13 cb406286050f 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (6m) 1s ago 6m 613M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (6m) 1s ago 6m 690M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (6m) 1s ago 6m 545M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (5m) 4s ago 5m 837M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:27:09.096 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (5m) 4s ago 5m 615M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (5m) 4s ago 5m 761M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (13s) 1s ago 7m 38.3M - 2.43.0 a07b618ecd1d 4def7a66288a 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fb5ac06ad30 msgr2=0x7fb5ac06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fb5ac06ad30 0x7fb5ac06d1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b0d0 tx=0x7fb5bc009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 msgr2=0x7fb5c010d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 0x7fb5c010d9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000eb40 tx=0x7fb5b000b040 comp rx=0 tx=0).stop 2023-12-05T13:27:09.097 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 shutdown_connections 2023-12-05T13:27:09.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fb5ac06ad30 0x7fb5ac06d1e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5c00fbaf0 0x7fb5c010d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 --2- 172.21.15.29:0/270647779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5c00fcd00 0x7fb5c010d9f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 >> 172.21.15.29:0/270647779 conn(0x7fb5c00f71b0 msgr2=0x7fb5c0065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:09.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 shutdown_connections 2023-12-05T13:27:09.098 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.097+0000 7fb5c8283700 1 -- 172.21.15.29:0/270647779 wait complete. 2023-12-05T13:27:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 -- 172.21.15.29:0/508182380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 msgr2=0x7fcf2c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 --2- 172.21.15.29:0/508182380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c1021d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c004940 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 -- 172.21.15.29:0/508182380 shutdown_connections 2023-12-05T13:27:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 --2- 172.21.15.29:0/508182380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c1021d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 --2- 172.21.15.29:0/508182380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 -- 172.21.15.29:0/508182380 >> 172.21.15.29:0/508182380 conn(0x7fcf2c0f71b0 msgr2=0x7fcf2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:09.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 -- 172.21.15.29:0/508182380 shutdown_connections 2023-12-05T13:27:09.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.248+0000 7fcf3472d700 1 -- 172.21.15.29:0/508182380 wait complete. 2023-12-05T13:27:09.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.249+0000 7fcf3472d700 1 Processor -- start 2023-12-05T13:27:09.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.249+0000 7fcf3472d700 1 -- start start 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.249+0000 7fcf3472d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.249+0000 7fcf3472d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.249+0000 7fcf3472d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c114600 con 0x7fcf2c0ffd90 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.249+0000 7fcf3472d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c114ea0 con 0x7fcf2c066900 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf324c9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf31cc8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf324c9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:38528/0 (socket says 172.21.15.29:38528) 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf324c9700 1 -- 172.21.15.29:0/945122327 learned_addr learned my addr 172.21.15.29:0/945122327 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:09.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf31cc8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47382/0 (socket says 172.21.15.29:47382) 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf324c9700 1 -- 172.21.15.29:0/945122327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 msgr2=0x7fcf2c114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf324c9700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.250+0000 7fcf324c9700 1 -- 172.21.15.29:0/945122327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c005040 con 0x7fcf2c066900 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.251+0000 7fcf324c9700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c113ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800eb40 tx=0x7fcf2800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.251+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf28007cc0 con 0x7fcf2c066900 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.251+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c115120 con 0x7fcf2c066900 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.251+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf2800f040 con 0x7fcf2c066900 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.251+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2800c990 con 0x7fcf2c066900 2023-12-05T13:27:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.251+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c115660 con 0x7fcf2c066900 2023-12-05T13:27:09.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.252+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 26) v1 ==== 88622+0+0 (secure 0 0 0) 0x7fcf2800cc00 con 0x7fcf2c066900 2023-12-05T13:27:09.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.253+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0f8d30 con 0x7fcf2c066900 2023-12-05T13:27:09.253 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.253+0000 7fcf22ffd700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1806ad20 0x7fcf1806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.253+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcf28089140 con 0x7fcf2c066900 2023-12-05T13:27:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.253+0000 7fcf31cc8700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1806ad20 0x7fcf1806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.254+0000 7fcf31cc8700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1806ad20 0x7fcf1806d1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c013680 tx=0x7fcf1c009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:09.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.258+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcf2804ece0 con 0x7fcf2c066900 2023-12-05T13:27:09.721 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.720+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf2c02b0e0 con 0x7fcf2c066900 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.721+0000 7fcf22ffd700 1 -- 172.21.15.29:0/945122327 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7fcf28057190 con 0x7fcf2c066900 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:27:09.722 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:27:09.723 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:27:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:09 smithi052 ceph-mon[121072]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:09 smithi052 ceph-mon[121072]: pgmap v56: 65 pgs: 65 active+clean; 837 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 9.6 MiB/s rd, 20 MiB/s wr, 147 op/s 2023-12-05T13:27:09.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:09 smithi052 ceph-mon[121072]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:09.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1806ad20 msgr2=0x7fcf1806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1806ad20 0x7fcf1806d1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c013680 tx=0x7fcf1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:09.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 msgr2=0x7fcf2c113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c113ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800eb40 tx=0x7fcf2800b040 comp rx=0 tx=0).stop 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 shutdown_connections 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7fcf1806ad20 0x7fcf1806d1d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c066900 0x7fcf2c113ac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 --2- 172.21.15.29:0/945122327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf2c0ffd90 0x7fcf2c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 >> 172.21.15.29:0/945122327 conn(0x7fcf2c0f71b0 msgr2=0x7fcf2c100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 shutdown_connections 2023-12-05T13:27:09.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.725+0000 7fcf3472d700 1 -- 172.21.15.29:0/945122327 wait complete. 2023-12-05T13:27:09.789 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:09 smithi029 ceph-mon[112128]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:09.789 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:09 smithi029 ceph-mon[112128]: pgmap v56: 65 pgs: 65 active+clean; 837 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 9.6 MiB/s rd, 20 MiB/s wr, 147 op/s 2023-12-05T13:27:09.789 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:09 smithi029 ceph-mon[112128]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 -- 172.21.15.29:0/1794807582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740faed0 msgr2=0x7f65740fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 --2- 172.21.15.29:0/1794807582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740faed0 0x7f65740fb2e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6570004940 tx=0x7f6570009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 -- 172.21.15.29:0/1794807582 shutdown_connections 2023-12-05T13:27:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 --2- 172.21.15.29:0/1794807582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65740fdf60 0x7f65740fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 --2- 172.21.15.29:0/1794807582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740faed0 0x7f65740fb2e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 -- 172.21.15.29:0/1794807582 >> 172.21.15.29:0/1794807582 conn(0x7f65740f6950 msgr2=0x7f65740f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:09.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 -- 172.21.15.29:0/1794807582 shutdown_connections 2023-12-05T13:27:09.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.864+0000 7f657b9b4700 1 -- 172.21.15.29:0/1794807582 wait complete. 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f657b9b4700 1 Processor -- start 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f657b9b4700 1 -- start start 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f657b9b4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65740faed0 0x7f65740fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f657b9b4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 0x7f65740fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f657b9b4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65740fc470 con 0x7f65740fdf60 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f657b9b4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65740fc5e0 con 0x7f65740faed0 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f6578f4f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 0x7f65740fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f6578f4f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 0x7f65740fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47404/0 (socket says 172.21.15.29:47404) 2023-12-05T13:27:09.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.865+0000 7f6578f4f700 1 -- 172.21.15.29:0/3643687067 learned_addr learned my addr 172.21.15.29:0/3643687067 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6579750700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65740faed0 0x7f65740fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6578f4f700 1 -- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65740faed0 msgr2=0x7f65740fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6578f4f700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65740faed0 0x7f65740fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6578f4f700 1 -- 172.21.15.29:0/3643687067 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570005040 con 0x7f65740fdf60 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6578f4f700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 0x7f65740fbe70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f656400eb40 tx=0x7f656400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6564007cc0 con 0x7f65740fdf60 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65740fc860 con 0x7f65740fdf60 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f656400f040 con 0x7f65740fdf60 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.866+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656400c990 con 0x7f65740fdf60 2023-12-05T13:27:09.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.867+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65741155e0 con 0x7f65740fdf60 2023-12-05T13:27:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.869+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657404bb80 con 0x7f65740fdf60 2023-12-05T13:27:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.869+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 26) v1 ==== 88622+0+0 (secure 0 0 0) 0x7f656400cc00 con 0x7f65740fdf60 2023-12-05T13:27:09.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.870+0000 7f6569ffb700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f656006ad30 0x7f656006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:09.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.870+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f65640890e0 con 0x7f65740fdf60 2023-12-05T13:27:09.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.871+0000 7f6579750700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f656006ad30 0x7f656006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:09.873 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.871+0000 7f6579750700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f656006ad30 0x7f656006d1e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6570009fd0 tx=0x7f6570009e30 comp rx=0 tx=0).ready entity=mgr.24427 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:09.878 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:09.877+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f656408e060 con 0x7f65740fdf60 2023-12-05T13:27:10.178 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.177+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 --> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65741028b0 con 0x7f656006ad30 2023-12-05T13:27:10.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.179+0000 7f6569ffb700 1 -- 172.21.15.29:0/3643687067 <== mgr.24427 v2:172.21.15.52:6828/1600520660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f65741028b0 con 0x7f656006ad30 2023-12-05T13:27:10.179 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:27:10.179 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:27:10.179 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:27:10.179 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr" 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading mgr daemons", 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:27:10.180 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:27:10.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f656006ad30 msgr2=0x7f656006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:10.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f656006ad30 0x7f656006d1e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6570009fd0 tx=0x7f6570009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:10.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 msgr2=0x7f65740fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:10.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 0x7f65740fbe70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f656400eb40 tx=0x7f656400b040 comp rx=0 tx=0).stop 2023-12-05T13:27:10.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 shutdown_connections 2023-12-05T13:27:10.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:6828/1600520660,v1:172.21.15.52:6829/1600520660] conn(0x7f656006ad30 0x7f656006d1e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65740faed0 0x7f65740fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 --2- 172.21.15.29:0/3643687067 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65740fdf60 0x7f65740fbe70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.181+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 >> 172.21.15.29:0/3643687067 conn(0x7f65740f6950 msgr2=0x7f6574101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.182+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 shutdown_connections 2023-12-05T13:27:10.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:10.183+0000 7f657b9b4700 1 -- 172.21.15.29:0/3643687067 wait complete. 2023-12-05T13:27:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:10 smithi052 ceph-mon[121072]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:10 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/945122327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:10.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:10 smithi029 ceph-mon[112128]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:10.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:10 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/945122327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:10.886 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-05T13:27:10.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-05T13:27:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:11 smithi052 ceph-mon[121072]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:11 smithi052 ceph-mon[121072]: pgmap v57: 65 pgs: 65 active+clean; 837 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 117 op/s 2023-12-05T13:27:11.763 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:11 smithi029 ceph-mon[112128]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:11.764 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:11 smithi029 ceph-mon[112128]: pgmap v57: 65 pgs: 65 active+clean; 837 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 117 op/s 2023-12-05T13:27:12.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:12.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr fail", "who": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr fail", "who": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: osdmap e46: 6 total, 6 up, 6 in 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd='[{"prefix": "mgr fail", "who": "smithi052.ocazcp"}]': finished 2023-12-05T13:27:12.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:12 smithi029 ceph-mon[112128]: mgrmap e27: smithi029.eekhlu(active, starting, since 0.00644465s) 2023-12-05T13:27:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 172.21.15.52:0/2547741261' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr fail", "who": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "mgr fail", "who": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: osdmap e46: 6 total, 6 up, 6 in 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: from='mgr.24427 ' entity='mgr.smithi052.ocazcp' cmd='[{"prefix": "mgr fail", "who": "smithi052.ocazcp"}]': finished 2023-12-05T13:27:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:12 smithi052 ceph-mon[121072]: mgrmap e27: smithi029.eekhlu(active, starting, since 0.00644465s) 2023-12-05T13:27:13.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:27:13.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:27:13.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: mgrmap e28: smithi029.eekhlu(active, starting, since 0.00606023s) 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/crt"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/crt"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:27:13.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/key"}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:27:13.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:13 smithi029 ceph-mon[112128]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: mgrmap e28: smithi029.eekhlu(active, starting, since 0.00606023s) 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/crt"}]: dispatch 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/crt"}]: dispatch 2023-12-05T13:27:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:27:13.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:27:13.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:27:13.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi029.eekhlu/key"}]: dispatch 2023-12-05T13:27:13.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:27:13.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:13 smithi052 ceph-mon[121072]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:27:14.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:14 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:14.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:14 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:14.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:14 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:14.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:14 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:27:14.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:14 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:27:14.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:14 smithi029 ceph-mon[112128]: mgrmap e29: smithi029.eekhlu(active, since 1.00899s) 2023-12-05T13:27:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:27:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:27:14.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:14 smithi052 ceph-mon[121072]: mgrmap e29: smithi029.eekhlu(active, since 1.00899s) 2023-12-05T13:27:15.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:15 smithi029 ceph-mon[112128]: [05/Dec/2023:13:27:14] ENGINE Bus STARTING 2023-12-05T13:27:15.854 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:15 smithi052 ceph-mon[121072]: [05/Dec/2023:13:27:14] ENGINE Bus STARTING 2023-12-05T13:27:16.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: [05/Dec/2023:13:27:14] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:27:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: [05/Dec/2023:13:27:14] ENGINE Serving on http://172.21.15.29:8765 2023-12-05T13:27:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: [05/Dec/2023:13:27:14] ENGINE Bus STARTED 2023-12-05T13:27:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: pgmap v4: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:27:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: mgrmap e30: smithi029.eekhlu(active, since 2s) 2023-12-05T13:27:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:16.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:16 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: [05/Dec/2023:13:27:14] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: [05/Dec/2023:13:27:14] ENGINE Serving on http://172.21.15.29:8765 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: [05/Dec/2023:13:27:14] ENGINE Bus STARTED 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: pgmap v4: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: mgrmap e30: smithi029.eekhlu(active, since 2s) 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:16.971 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:16 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:18 smithi052 ceph-mon[121072]: pgmap v5: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:27:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:18 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:18 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:18 smithi052 ceph-mon[121072]: mgrmap e31: smithi029.eekhlu(active, since 4s) 2023-12-05T13:27:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:18 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:18 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:18 smithi029 ceph-mon[112128]: pgmap v5: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:27:18.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:18 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:18 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:18 smithi029 ceph-mon[112128]: mgrmap e31: smithi029.eekhlu(active, since 4s) 2023-12-05T13:27:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:18 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:18.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:18 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:20.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:20 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:20.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:20 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:20.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:20 smithi052 ceph-mon[121072]: pgmap v6: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.1 MiB/s wr, 199 op/s 2023-12-05T13:27:20.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:20 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:20.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:20 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:20.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:20 smithi029 ceph-mon[112128]: pgmap v6: 65 pgs: 65 active+clean; 332 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.1 MiB/s wr, 199 op/s 2023-12-05T13:27:21.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:21 smithi029 ceph-mon[112128]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:27:21.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:21 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:27:21.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:21 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:27:21.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:21 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:27:21.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:21 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:27:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:21 smithi052 ceph-mon[121072]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:27:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:21 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:27:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:21 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:27:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:21 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:27:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:21 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1034417037' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:27:22.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:22 smithi029 ceph-mon[112128]: mgrmap e32: smithi029.eekhlu(active, since 7s), standbys: smithi052.ocazcp 2023-12-05T13:27:22.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:22 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:22.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:22 smithi029 ceph-mon[112128]: pgmap v7: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 176 op/s 2023-12-05T13:27:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:22 smithi052 ceph-mon[121072]: mgrmap e32: smithi029.eekhlu(active, since 7s), standbys: smithi052.ocazcp 2023-12-05T13:27:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:22 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:22 smithi052 ceph-mon[121072]: pgmap v7: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.4 MiB/s wr, 176 op/s 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:27:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:23 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:27:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:23.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:23.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:23.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:27:23.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:27:23.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:27:23.855 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:23 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: pgmap v8: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 137 op/s 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:24.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:25.046 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: pgmap v8: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 137 op/s 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:25.047 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:25.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:25 smithi052 ceph-mon[121072]: Reconfiguring prometheus.smithi029 (dependencies changed)... 2023-12-05T13:27:25.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:25 smithi052 ceph-mon[121072]: Reconfiguring daemon prometheus.smithi029 on smithi029 2023-12-05T13:27:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:25 smithi029 ceph-mon[112128]: Reconfiguring prometheus.smithi029 (dependencies changed)... 2023-12-05T13:27:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:25 smithi029 ceph-mon[112128]: Reconfiguring daemon prometheus.smithi029 on smithi029 2023-12-05T13:27:26.943 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:26 smithi029 ceph-mon[112128]: pgmap v9: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 271 op/s 2023-12-05T13:27:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:26 smithi052 ceph-mon[121072]: pgmap v9: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.7 MiB/s wr, 271 op/s 2023-12-05T13:27:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:28 smithi052 ceph-mon[121072]: pgmap v10: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.5 MiB/s wr, 248 op/s 2023-12-05T13:27:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:27:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:28 smithi029 ceph-mon[112128]: pgmap v10: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.5 MiB/s wr, 248 op/s 2023-12-05T13:27:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:27:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:29.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:29 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:27:29.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:29 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:27:29.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:29 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:27:29.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:29 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:30.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:29 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:27:30.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:29 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:27:30.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:29 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:27:30.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:29 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:30.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:30 smithi052 ceph-mon[121072]: Upgrade: Updating mgr.smithi052.ocazcp 2023-12-05T13:27:30.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:30 smithi052 ceph-mon[121072]: Deploying daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:27:30.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:30 smithi052 ceph-mon[121072]: pgmap v11: 65 pgs: 65 active+clean; 261 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 568 op/s 2023-12-05T13:27:31.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:30 smithi029 ceph-mon[112128]: Upgrade: Updating mgr.smithi052.ocazcp 2023-12-05T13:27:31.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:30 smithi029 ceph-mon[112128]: Deploying daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:27:31.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:30 smithi029 ceph-mon[112128]: pgmap v11: 65 pgs: 65 active+clean; 261 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 568 op/s 2023-12-05T13:27:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:32 smithi052 ceph-mon[121072]: pgmap v12: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.8 MiB/s wr, 582 op/s 2023-12-05T13:27:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:32 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:32 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:32 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:33.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:32 smithi029 ceph-mon[112128]: pgmap v12: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.8 MiB/s wr, 582 op/s 2023-12-05T13:27:33.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:32 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:33.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:32 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:33.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:32 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:34.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:34 smithi029 ceph-mon[112128]: pgmap v13: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 562 op/s 2023-12-05T13:27:34.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:34 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:34.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:34 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:35.148 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:34 smithi052 ceph-mon[121072]: pgmap v13: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 562 op/s 2023-12-05T13:27:35.149 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:34 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:35.149 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:34 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:36.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:36 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:36.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:36 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:36.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:36 smithi029 ceph-mon[112128]: pgmap v14: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 874 op/s 2023-12-05T13:27:36.537 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:36 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:36.537 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:36 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:36.537 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:36 smithi052 ceph-mon[121072]: pgmap v14: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 874 op/s 2023-12-05T13:27:37.976 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:37.976 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:38.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:38 smithi052 ceph-mon[121072]: pgmap v15: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 728 op/s 2023-12-05T13:27:39.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:38 smithi029 ceph-mon[112128]: pgmap v15: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 728 op/s 2023-12-05T13:27:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.328+0000 7f4f22b08700 1 -- 172.21.15.29:0/1859495361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 msgr2=0x7f4f1c0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.328+0000 7f4f22b08700 1 --2- 172.21.15.29:0/1859495361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c0fb2e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4f10004940 tx=0x7f4f10009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 -- 172.21.15.29:0/1859495361 shutdown_connections 2023-12-05T13:27:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 --2- 172.21.15.29:0/1859495361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 0x7f4f1c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 --2- 172.21.15.29:0/1859495361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c0fb2e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 -- 172.21.15.29:0/1859495361 >> 172.21.15.29:0/1859495361 conn(0x7f4f1c0f6950 msgr2=0x7f4f1c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:40.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 -- 172.21.15.29:0/1859495361 shutdown_connections 2023-12-05T13:27:40.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 -- 172.21.15.29:0/1859495361 wait complete. 2023-12-05T13:27:40.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.329+0000 7f4f22b08700 1 Processor -- start 2023-12-05T13:27:40.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f22b08700 1 -- start start 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f22b08700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f22b08700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 0x7f4f1c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f22b08700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c06e350 con 0x7f4f1c0faed0 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f22b08700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c06ec20 con 0x7f4f1c0fdf60 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f208a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f208a4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c06d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51116/0 (socket says 172.21.15.29:51116) 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f208a4700 1 -- 172.21.15.29:0/3156217891 learned_addr learned my addr 172.21.15.29:0/3156217891 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.330+0000 7f4f1bfff700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 0x7f4f1c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:40.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f208a4700 1 -- 172.21.15.29:0/3156217891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 msgr2=0x7f4f1c06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f208a4700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 0x7f4f1c06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f208a4700 1 -- 172.21.15.29:0/3156217891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08005040 con 0x7f4f1c0faed0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f1bfff700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 0x7f4f1c06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f208a4700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c06d810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009fd0 tx=0x7f4f10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f10021070 con 0x7f4f1c0faed0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f10005040 con 0x7f4f1c0faed0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c06f250 con 0x7f4f1c0faed0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f100093b0 con 0x7f4f1c0faed0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.331+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1000e070 con 0x7f4f1c0faed0 2023-12-05T13:27:40.334 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.332+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f000052e0 con 0x7f4f1c0faed0 2023-12-05T13:27:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.334+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f4f10013a50 con 0x7f4f1c0faed0 2023-12-05T13:27:40.335 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.334+0000 7f4f197fa700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f0c06cc00 0x7f4f0c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.334+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f4f1008d180 con 0x7f4f1c0faed0 2023-12-05T13:27:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.334+0000 7f4f1bfff700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f0c06cc00 0x7f4f0c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:40.336 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.335+0000 7f4f1bfff700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f0c06cc00 0x7f4f0c06f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009fd0 tx=0x7f4f0800b040 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:40.341 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.340+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4f1005ae80 con 0x7f4f1c0faed0 2023-12-05T13:27:40.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.624+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f00000bf0 con 0x7f4f0c06cc00 2023-12-05T13:27:40.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.625+0000 7f4f197fa700 1 -- 172.21.15.29:0/3156217891 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f4f00000bf0 con 0x7f4f0c06cc00 2023-12-05T13:27:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.627+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f0c06cc00 msgr2=0x7f4f0c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.627+0000 7f4f22b08700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f0c06cc00 0x7f4f0c06f0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009fd0 tx=0x7f4f0800b040 comp rx=0 tx=0).stop 2023-12-05T13:27:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.627+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 msgr2=0x7f4f1c06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.627+0000 7f4f22b08700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c06d810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009fd0 tx=0x7f4f10009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:40.628 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 shutdown_connections 2023-12-05T13:27:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f0c06cc00 0x7f4f0c06f0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f1c0faed0 0x7f4f1c06d810 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 --2- 172.21.15.29:0/3156217891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f1c0fdf60 0x7f4f1c06dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 >> 172.21.15.29:0/3156217891 conn(0x7f4f1c0f6950 msgr2=0x7f4f1c0ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 shutdown_connections 2023-12-05T13:27:40.629 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.628+0000 7f4f22b08700 1 -- 172.21.15.29:0/3156217891 wait complete. 2023-12-05T13:27:40.643 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:27:40.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.760+0000 7fcec6571700 1 -- 172.21.15.29:0/2128635153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 msgr2=0x7fcec0101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:40.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.760+0000 7fcec6571700 1 --2- 172.21.15.29:0/2128635153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec0101bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fceb0004940 tx=0x7fceb0009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:40.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.760+0000 7fcec6571700 1 -- 172.21.15.29:0/2128635153 shutdown_connections 2023-12-05T13:27:40.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.760+0000 7fcec6571700 1 --2- 172.21.15.29:0/2128635153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec01044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.760+0000 7fcec6571700 1 --2- 172.21.15.29:0/2128635153 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec0101bc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.761+0000 7fcec6571700 1 -- 172.21.15.29:0/2128635153 >> 172.21.15.29:0/2128635153 conn(0x7fcec00f7190 msgr2=0x7fcec00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:40.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.761+0000 7fcec6571700 1 -- 172.21.15.29:0/2128635153 shutdown_connections 2023-12-05T13:27:40.762 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.761+0000 7fcec6571700 1 -- 172.21.15.29:0/2128635153 wait complete. 2023-12-05T13:27:40.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.761+0000 7fcec6571700 1 Processor -- start 2023-12-05T13:27:40.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.761+0000 7fcec6571700 1 -- start start 2023-12-05T13:27:40.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fcec6571700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:40.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fcec6571700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:40.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fcec6571700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec0110230 con 0x7fcec0066070 2023-12-05T13:27:40.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fcec6571700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec0110ad0 con 0x7fcec0102100 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fcebffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fceb7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec010fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:56132/0 (socket says 172.21.15.29:56132) 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fceb7fff700 1 -- 172.21.15.29:0/2329175631 learned_addr learned my addr 172.21.15.29:0/2329175631 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fceb7fff700 1 -- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 msgr2=0x7fcec010f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fceb7fff700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec010f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fceb7fff700 1 -- 172.21.15.29:0/2329175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0005040 con 0x7fcec0102100 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.762+0000 7fcebffff700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.763+0000 7fceb7fff700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec010fc30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcea800eb40 tx=0x7fcea800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:40.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.763+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcea8007cc0 con 0x7fcec0102100 2023-12-05T13:27:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.763+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec0110d50 con 0x7fcec0102100 2023-12-05T13:27:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.763+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcea800f040 con 0x7fcec0102100 2023-12-05T13:27:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.763+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcea800c8f0 con 0x7fcec0102100 2023-12-05T13:27:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.763+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec0111290 con 0x7fcec0102100 2023-12-05T13:27:40.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.764+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec004bb80 con 0x7fcec0102100 2023-12-05T13:27:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.765+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fcea800cb60 con 0x7fcec0102100 2023-12-05T13:27:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.766+0000 7fcebd7fa700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fceac06cc00 0x7fceac06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.766+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fcea808b9e0 con 0x7fcec0102100 2023-12-05T13:27:40.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.766+0000 7fcebffff700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fceac06cc00 0x7fceac06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:40.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.766+0000 7fcebffff700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fceac06cc00 0x7fceac06f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fceb0013680 tx=0x7fceb0009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:40.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:40.775+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcea80596b0 con 0x7fcec0102100 2023-12-05T13:27:40.927 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:40 smithi052 ceph-mon[121072]: pgmap v16: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.8 MiB/s wr, 1.42k op/s 2023-12-05T13:27:41.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:40 smithi029 ceph-mon[112128]: pgmap v16: 65 pgs: 65 active+clean; 233 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.8 MiB/s wr, 1.42k op/s 2023-12-05T13:27:41.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.132+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcec01116e0 con 0x7fceac06cc00 2023-12-05T13:27:41.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.134+0000 7fcebd7fa700 1 -- 172.21.15.29:0/2329175631 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fcec01116e0 con 0x7fceac06cc00 2023-12-05T13:27:41.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.138+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fceac06cc00 msgr2=0x7fceac06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.138+0000 7fcec6571700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fceac06cc00 0x7fceac06f0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fceb0013680 tx=0x7fceb0009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:41.138 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.138+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 msgr2=0x7fcec010fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.138+0000 7fcec6571700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec010fc30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcea800eb40 tx=0x7fcea800b040 comp rx=0 tx=0).stop 2023-12-05T13:27:41.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.141+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 shutdown_connections 2023-12-05T13:27:41.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.141+0000 7fcec6571700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fceac06cc00 0x7fceac06f0b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.141+0000 7fcec6571700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec0066070 0x7fcec010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.141+0000 7fcec6571700 1 --2- 172.21.15.29:0/2329175631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcec0102100 0x7fcec010fc30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.141+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 >> 172.21.15.29:0/2329175631 conn(0x7fcec00f7190 msgr2=0x7fcec00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:41.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.146+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 shutdown_connections 2023-12-05T13:27:41.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.147+0000 7fcec6571700 1 -- 172.21.15.29:0/2329175631 wait complete. 2023-12-05T13:27:41.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 -- 172.21.15.29:0/499989711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fcd00 msgr2=0x7f58c40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 --2- 172.21.15.29:0/499989711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fcd00 0x7f58c40fd150 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f58ac004940 tx=0x7f58ac009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:41.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 -- 172.21.15.29:0/499989711 shutdown_connections 2023-12-05T13:27:41.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 --2- 172.21.15.29:0/499989711 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fcd00 0x7f58c40fd150 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.277 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 --2- 172.21.15.29:0/499989711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40fbaf0 0x7f58c40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 -- 172.21.15.29:0/499989711 >> 172.21.15.29:0/499989711 conn(0x7f58c40f7190 msgr2=0x7f58c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:41.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 -- 172.21.15.29:0/499989711 shutdown_connections 2023-12-05T13:27:41.278 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.276+0000 7f58c9527700 1 -- 172.21.15.29:0/499989711 wait complete. 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.277+0000 7f58c9527700 1 Processor -- start 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.277+0000 7f58c9527700 1 -- start start 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.277+0000 7f58c9527700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 0x7f58c410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.277+0000 7f58c9527700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40fcd00 0x7f58c410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.277+0000 7f58c9527700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c410e010 con 0x7f58c40fbaf0 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.277+0000 7f58c9527700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c410e8b0 con 0x7f58c40fcd00 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 0x7f58c410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 0x7f58c410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51156/0 (socket says 172.21.15.29:51156) 2023-12-05T13:27:41.279 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 -- 172.21.15.29:0/350353176 learned_addr learned my addr 172.21.15.29:0/350353176 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58ba7fc700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40fcd00 0x7f58c410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 -- 172.21.15.29:0/350353176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40fcd00 msgr2=0x7f58c410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40fcd00 0x7f58c410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 -- 172.21.15.29:0/350353176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac005040 con 0x7f58c40fbaf0 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58c2ffd700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 0x7f58c410d4d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f58b400eb70 tx=0x7f58b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.278+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b4007cc0 con 0x7f58c40fbaf0 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.279+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c410eb30 con 0x7f58c40fbaf0 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.279+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58b400f040 con 0x7f58c40fbaf0 2023-12-05T13:27:41.280 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.279+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b400c9d0 con 0x7f58c40fbaf0 2023-12-05T13:27:41.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.279+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c410f070 con 0x7f58c40fbaf0 2023-12-05T13:27:41.281 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.280+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c404bb80 con 0x7f58c40fbaf0 2023-12-05T13:27:41.282 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.281+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f58b400cc40 con 0x7f58c40fbaf0 2023-12-05T13:27:41.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.282+0000 7f58bbfff700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f58b006cc00 0x7f58b006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:41.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.282+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f58b408baf0 con 0x7f58c40fbaf0 2023-12-05T13:27:41.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.282+0000 7f58ba7fc700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f58b006cc00 0x7f58b006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:41.283 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.282+0000 7f58ba7fc700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f58b006cc00 0x7f58b006f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f58ac000c00 tx=0x7f58ac009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:41.286 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.286+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f58b404ece0 con 0x7f58c40fbaf0 2023-12-05T13:27:41.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.626+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58c410f6d0 con 0x7f58b006cc00 2023-12-05T13:27:41.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.646+0000 7f58bbfff700 1 -- 172.21.15.29:0/350353176 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f58c410f6d0 con 0x7f58b006cc00 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (59s) 5s ago 8m 24.9M - 0.25.0 c8568f914cd2 54afa17f1b04 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (9m) 5s ago 9m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (8m) 7s ago 8m 7490k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (51s) 5s ago 8m 80.0M - 9.4.7 2c41d148cca3 7d9c49cae626 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (4m) 5s ago 4m 9414M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (4m) 5s ago 4m 17.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (4m) 7s ago 4m 17.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (4m) 7s ago 4m 17.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:27:41.647 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (39s) 5s ago 10m 498M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (10s) 7s ago 8m 48.3M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (10m) 5s ago 10m 95.8M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (8m) 7s ago 8m 64.8M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (62s) 5s ago 8m 18.0M - 1.5.0 0da6a335fe13 593e1fa46f84 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (43s) 7s ago 8m 17.2M - 1.5.0 0da6a335fe13 cb406286050f 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (7m) 5s ago 7m 696M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (7m) 5s ago 7m 788M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (6m) 5s ago 6m 624M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (6m) 7s ago 6m 953M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (6m) 7s ago 6m 691M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (5m) 7s ago 5m 836M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:27:41.648 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (14s) 5s ago 8m 38.7M - 2.43.0 a07b618ecd1d a69cf512a160 2023-12-05T13:27:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f58b006cc00 msgr2=0x7f58b006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f58b006cc00 0x7f58b006f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f58ac000c00 tx=0x7f58ac009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 msgr2=0x7f58c410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 0x7f58c410d4d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f58b400eb70 tx=0x7f58b400b040 comp rx=0 tx=0).stop 2023-12-05T13:27:41.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 shutdown_connections 2023-12-05T13:27:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f58b006cc00 0x7f58b006f0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c40fbaf0 0x7f58c410d4d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 --2- 172.21.15.29:0/350353176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40fcd00 0x7f58c410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.649+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 >> 172.21.15.29:0/350353176 conn(0x7f58c40f7190 msgr2=0x7f58c4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.650+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 shutdown_connections 2023-12-05T13:27:41.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.650+0000 7f58c9527700 1 -- 172.21.15.29:0/350353176 wait complete. 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 -- 172.21.15.29:0/1588661344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 msgr2=0x7f87740fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 --2- 172.21.15.29:0/1588661344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f87740fbf00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8770004940 tx=0x7f8770009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 -- 172.21.15.29:0/1588661344 shutdown_connections 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 --2- 172.21.15.29:0/1588661344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87740fcd00 0x7f87740fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 --2- 172.21.15.29:0/1588661344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f87740fbf00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 -- 172.21.15.29:0/1588661344 >> 172.21.15.29:0/1588661344 conn(0x7f87740f71b0 msgr2=0x7f87740f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 -- 172.21.15.29:0/1588661344 shutdown_connections 2023-12-05T13:27:41.775 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.774+0000 7f877c6c8700 1 -- 172.21.15.29:0/1588661344 wait complete. 2023-12-05T13:27:41.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877c6c8700 1 Processor -- start 2023-12-05T13:27:41.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877c6c8700 1 -- start start 2023-12-05T13:27:41.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877c6c8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f877410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:41.776 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877c6c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87740fcd00 0x7f87741105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877c6c8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740669c0 con 0x7f87740fbaf0 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877c6c8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8774066b00 con 0x7f87740fcd00 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877a464700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f877410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877a464700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f877410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51170/0 (socket says 172.21.15.29:51170) 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.775+0000 7f877a464700 1 -- 172.21.15.29:0/243610572 learned_addr learned my addr 172.21.15.29:0/243610572 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f8779c63700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87740fcd00 0x7f87741105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f877a464700 1 -- 172.21.15.29:0/243610572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87740fcd00 msgr2=0x7f87741105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f877a464700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87740fcd00 0x7f87741105d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f877a464700 1 -- 172.21.15.29:0/243610572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770005040 con 0x7f87740fbaf0 2023-12-05T13:27:41.777 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f877a464700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f877410e080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8770000c00 tx=0x7f8770009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:41.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f877000e040 con 0x7f87740fbaf0 2023-12-05T13:27:41.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f877c6c8700 1 -- 172.21.15.29:0/243610572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8774110bd0 con 0x7f87740fbaf0 2023-12-05T13:27:41.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8770009af0 con 0x7f87740fbaf0 2023-12-05T13:27:41.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f877001c630 con 0x7f87740fbaf0 2023-12-05T13:27:41.778 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.776+0000 7f877c6c8700 1 -- 172.21.15.29:0/243610572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87741110c0 con 0x7f87740fbaf0 2023-12-05T13:27:41.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.778+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875c0052b0 con 0x7f87740fbaf0 2023-12-05T13:27:41.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.785+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f877001c8a0 con 0x7f87740fbaf0 2023-12-05T13:27:41.786 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.786+0000 7f876affd700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f876006cc00 0x7f876006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:41.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.786+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f877008d440 con 0x7f87740fbaf0 2023-12-05T13:27:41.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.786+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f877008d8a0 con 0x7f87740fbaf0 2023-12-05T13:27:41.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.786+0000 7f8779c63700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f876006cc00 0x7f876006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:41.787 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:41.787+0000 7f8779c63700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f876006cc00 0x7f876006f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8764004f60 tx=0x7f876400b040 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:41.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:41.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: Standby manager daemon smithi052.ocazcp restarted 2023-12-05T13:27:41.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:27:41.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:27:41.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:27:41.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:27:41.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:27:41.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:41.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:41.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:41.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:41.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:41 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: Standby manager daemon smithi052.ocazcp restarted 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.? 172.21.15.52:0/1208140344' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:42.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:41 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.262+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f875c005830 con 0x7f87740fbaf0 2023-12-05T13:27:42.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.263+0000 7f876affd700 1 -- 172.21.15.29:0/243610572 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f87700576d0 con 0x7f87740fbaf0 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:27:42.264 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:27:42.265 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:27:42.265 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:27:42.265 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T13:27:42.265 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:27:42.265 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:27:42.265 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:27:42.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f876006cc00 msgr2=0x7f876006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f876006cc00 0x7f876006f0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8764004f60 tx=0x7f876400b040 comp rx=0 tx=0).stop 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 msgr2=0x7f877410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f877410e080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8770000c00 tx=0x7f8770009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 shutdown_connections 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f876006cc00 0x7f876006f0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87740fbaf0 0x7f877410e080 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 --2- 172.21.15.29:0/243610572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87740fcd00 0x7f87741105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 >> 172.21.15.29:0/243610572 conn(0x7f87740f71b0 msgr2=0x7f87740f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:42.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 shutdown_connections 2023-12-05T13:27:42.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.267+0000 7f8768ff9700 1 -- 172.21.15.29:0/243610572 wait complete. 2023-12-05T13:27:42.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.411+0000 7f74cf1d3700 1 -- 172.21.15.29:0/3798640037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c81020e0 msgr2=0x7f74c81044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:42.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.411+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/3798640037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c81020e0 0x7f74c81044c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f74b4004940 tx=0x7f74b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:42.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.411+0000 7f74cf1d3700 1 -- 172.21.15.29:0/3798640037 shutdown_connections 2023-12-05T13:27:42.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.411+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/3798640037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c81020e0 0x7f74c81044c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.411+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/3798640037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c8066090 0x7f74c8101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.411+0000 7f74cf1d3700 1 -- 172.21.15.29:0/3798640037 >> 172.21.15.29:0/3798640037 conn(0x7f74c80f7190 msgr2=0x7f74c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.412+0000 7f74cf1d3700 1 -- 172.21.15.29:0/3798640037 shutdown_connections 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.412+0000 7f74cf1d3700 1 -- 172.21.15.29:0/3798640037 wait complete. 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.413+0000 7f74cf1d3700 1 Processor -- start 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.413+0000 7f74cf1d3700 1 -- start start 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74cf1d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 0x7f74c810f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74cf1d3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81020e0 0x7f74c810fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74cf1d3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8110300 con 0x7f74c8066090 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74cf1d3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8110b40 con 0x7f74c81020e0 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74ccf6f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 0x7f74c810f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74ccf6f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 0x7f74c810f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51184/0 (socket says 172.21.15.29:51184) 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74ccf6f700 1 -- 172.21.15.29:0/1704075462 learned_addr learned my addr 172.21.15.29:0/1704075462 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74c7fff700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81020e0 0x7f74c810fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:42.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74ccf6f700 1 -- 172.21.15.29:0/1704075462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81020e0 msgr2=0x7f74c810fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74ccf6f700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81020e0 0x7f74c810fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.414+0000 7f74ccf6f700 1 -- 172.21.15.29:0/1704075462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4005040 con 0x7f74c8066090 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.415+0000 7f74ccf6f700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 0x7f74c810f730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00b790 tx=0x7f74bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.415+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc00f6f0 con 0x7f74c8066090 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.415+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74bc00fd00 con 0x7f74c8066090 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.415+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc0103a0 con 0x7f74c8066090 2023-12-05T13:27:42.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.415+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c8110e20 con 0x7f74c8066090 2023-12-05T13:27:42.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.415+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c8111360 con 0x7f74c8066090 2023-12-05T13:27:42.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.417+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c804bb80 con 0x7f74c8066090 2023-12-05T13:27:42.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.417+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f74bc00f850 con 0x7f74c8066090 2023-12-05T13:27:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.417+0000 7f74c57fa700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f74b806cc00 0x7f74b806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:27:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.418+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f74bc08bc00 con 0x7f74c8066090 2023-12-05T13:27:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.418+0000 7f74c7fff700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f74b806cc00 0x7f74b806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:27:42.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.419+0000 7f74c7fff700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f74b806cc00 0x7f74b806f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f74b400b7d0 tx=0x7f74b4009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:27:42.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.422+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f74bc091020 con 0x7f74c8066090 2023-12-05T13:27:42.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.724+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74c8110fb0 con 0x7f74b806cc00 2023-12-05T13:27:42.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.726+0000 7f74c57fa700 1 -- 172.21.15.29:0/1704075462 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f74c8110fb0 con 0x7f74b806cc00 2023-12-05T13:27:42.726 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:27:42.726 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr" 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading node-exporter daemons", 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:27:42.727 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:27:42.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f74b806cc00 msgr2=0x7f74b806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:42.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f74b806cc00 0x7f74b806f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f74b400b7d0 tx=0x7f74b4009e30 comp rx=0 tx=0).stop 2023-12-05T13:27:42.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 msgr2=0x7f74c810f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:27:42.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 0x7f74c810f730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00b790 tx=0x7f74bc009250 comp rx=0 tx=0).stop 2023-12-05T13:27:42.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 shutdown_connections 2023-12-05T13:27:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f74b806cc00 0x7f74b806f0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74c8066090 0x7f74c810f730 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 --2- 172.21.15.29:0/1704075462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74c81020e0 0x7f74c810fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:27:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 >> 172.21.15.29:0/1704075462 conn(0x7f74c80f7190 msgr2=0x7f74c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:27:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 shutdown_connections 2023-12-05T13:27:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:27:42.729+0000 7f74cf1d3700 1 -- 172.21.15.29:0/1704075462 wait complete. 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: pgmap v17: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 1.23k op/s 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: mgrmap e33: smithi029.eekhlu(active, since 28s), standbys: smithi052.ocazcp 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all mgr 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi029.eekhlu"}]: dispatch 2023-12-05T13:27:42.957 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi029.eekhlu"}]': finished 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.ocazcp"}]': finished 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all rgw 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all rbd-mirror 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all ceph-exporter 2023-12-05T13:27:42.958 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all iscsi 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all nfs 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all nvmeof 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.959 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:42 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/243610572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: pgmap v17: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 1.23k op/s 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: mgrmap e33: smithi029.eekhlu(active, since 28s), standbys: smithi052.ocazcp 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all mgr 2023-12-05T13:27:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi029.eekhlu"}]: dispatch 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi029.eekhlu"}]': finished 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.ocazcp"}]: dispatch 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.ocazcp"}]': finished 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all rgw 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all rbd-mirror 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all ceph-exporter 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all iscsi 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all nfs 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all nvmeof 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:42.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:42 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/243610572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:43.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:43 smithi029 ceph-mon[112128]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:43.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:43 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:43.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:43 smithi052 ceph-mon[121072]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:27:43.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:43 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:44.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:44 smithi052 ceph-mon[121072]: Upgrade: Updating node-exporter.smithi029 (1/2) 2023-12-05T13:27:44.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:44 smithi052 ceph-mon[121072]: Deploying daemon node-exporter.smithi029 on smithi029 2023-12-05T13:27:44.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:44 smithi052 ceph-mon[121072]: pgmap v18: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 1.13k op/s 2023-12-05T13:27:45.056 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:44 smithi029 ceph-mon[112128]: Upgrade: Updating node-exporter.smithi029 (1/2) 2023-12-05T13:27:45.056 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:44 smithi029 ceph-mon[112128]: Deploying daemon node-exporter.smithi029 on smithi029 2023-12-05T13:27:45.056 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:44 smithi029 ceph-mon[112128]: pgmap v18: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.4 MiB/s wr, 1.13k op/s 2023-12-05T13:27:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:46 smithi052 ceph-mon[121072]: pgmap v19: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 1.28k op/s 2023-12-05T13:27:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:46 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:46 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:46.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:46 smithi029 ceph-mon[112128]: pgmap v19: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 1.28k op/s 2023-12-05T13:27:46.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:46 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:46.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:46 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:48.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:48 smithi029 ceph-mon[112128]: Upgrade: Updating node-exporter.smithi052 (2/2) 2023-12-05T13:27:48.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:48 smithi029 ceph-mon[112128]: Deploying daemon node-exporter.smithi052 on smithi052 2023-12-05T13:27:48.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:48 smithi029 ceph-mon[112128]: pgmap v20: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.2 MiB/s wr, 970 op/s 2023-12-05T13:27:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:48 smithi052 ceph-mon[121072]: Upgrade: Updating node-exporter.smithi052 (2/2) 2023-12-05T13:27:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:48 smithi052 ceph-mon[121072]: Deploying daemon node-exporter.smithi052 on smithi052 2023-12-05T13:27:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:48 smithi052 ceph-mon[121072]: pgmap v20: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.2 MiB/s wr, 970 op/s 2023-12-05T13:27:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:49 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:49 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:49 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:50.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:49 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:50.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:49 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:50.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:49 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:50.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:50 smithi052 ceph-mon[121072]: pgmap v21: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.8 MiB/s wr, 1.10k op/s 2023-12-05T13:27:51.082 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:50 smithi029 ceph-mon[112128]: pgmap v21: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.8 MiB/s wr, 1.10k op/s 2023-12-05T13:27:52.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:51 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:51 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:51 smithi052 ceph-mon[121072]: pgmap v22: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2023-12-05T13:27:52.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:51 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:51 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:51 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:51 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:51 smithi029 ceph-mon[112128]: pgmap v22: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2023-12-05T13:27:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:51 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:52.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:51 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:54 smithi052 ceph-mon[121072]: pgmap v23: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-12-05T13:27:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:54 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:54.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:54 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:54.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:54 smithi029 ceph-mon[112128]: pgmap v23: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-12-05T13:27:54.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:54 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:54 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.692 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-05T13:27:55.693 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-05T13:27:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:55 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:55 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:55 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:55 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:55 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:55 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:55 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:55.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:55 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:56.034 DEBUG:teuthology.parallel:result is None 2023-12-05T13:27:56.042 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-05T13:27:56.119 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-05T13:27:56.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-05T13:27:56.167 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-05T13:27:56.167 DEBUG:teuthology.parallel:result is None 2023-12-05T13:27:56.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:56 smithi029 ceph-mon[112128]: pgmap v24: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.7 MiB/s wr, 443 op/s 2023-12-05T13:27:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:56 smithi052 ceph-mon[121072]: pgmap v24: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.7 MiB/s wr, 443 op/s 2023-12-05T13:27:58.794 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:58 smithi029 ceph-mon[112128]: pgmap v25: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2023-12-05T13:27:58.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:58 smithi052 ceph-mon[121072]: pgmap v25: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 293 op/s 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.834 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.835 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.835 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.835 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.835 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:27:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:27:59.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:27:59.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:27:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:00.715 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:00 smithi029 ceph-mon[112128]: pgmap v26: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 340 op/s 2023-12-05T13:28:00.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:00 smithi052 ceph-mon[121072]: pgmap v26: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 340 op/s 2023-12-05T13:28:01.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:01 smithi029 ceph-mon[112128]: Upgrade: Updating prometheus.smithi029 2023-12-05T13:28:01.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:01 smithi029 ceph-mon[112128]: Deploying daemon prometheus.smithi029 on smithi029 2023-12-05T13:28:01.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:01 smithi052 ceph-mon[121072]: Upgrade: Updating prometheus.smithi029 2023-12-05T13:28:01.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:01 smithi052 ceph-mon[121072]: Deploying daemon prometheus.smithi029 on smithi029 2023-12-05T13:28:02.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:02 smithi029 ceph-mon[112128]: pgmap v27: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 765 KiB/s wr, 210 op/s 2023-12-05T13:28:02.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:02 smithi052 ceph-mon[121072]: pgmap v27: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 765 KiB/s wr, 210 op/s 2023-12-05T13:28:04.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:04 smithi029 ceph-mon[112128]: pgmap v28: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 738 KiB/s wr, 191 op/s 2023-12-05T13:28:04.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:04 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:04.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:04 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:04.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:04 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:04.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:04 smithi052 ceph-mon[121072]: pgmap v28: 65 pgs: 65 active+clean; 195 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 738 KiB/s wr, 191 op/s 2023-12-05T13:28:04.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:04 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:04.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:04 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:04.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:04 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:06.315 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:06 smithi029 ceph-mon[112128]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 746 KiB/s wr, 203 op/s 2023-12-05T13:28:06.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:06 smithi052 ceph-mon[121072]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 746 KiB/s wr, 203 op/s 2023-12-05T13:28:09.064 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:08 smithi029 ceph-mon[112128]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 195 KiB/s wr, 59 op/s 2023-12-05T13:28:09.064 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.064 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.064 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.064 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:08 smithi052 ceph-mon[121072]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 195 KiB/s wr, 59 op/s 2023-12-05T13:28:09.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:09.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:11.075 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:10 smithi029 ceph-mon[112128]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 195 KiB/s wr, 59 op/s 2023-12-05T13:28:11.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:10 smithi052 ceph-mon[121072]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.6 KiB/s rd, 195 KiB/s wr, 59 op/s 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:28:12.678 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.679 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:12 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1421521405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4102100 msgr2=0x7f8ea41044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1421521405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4102100 0x7f8ea41044e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e98004940 tx=0x7f8e98009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1421521405 shutdown_connections 2023-12-05T13:28:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1421521405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4102100 0x7f8ea41044e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1421521405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea4066070 0x7f8ea4101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:12.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1421521405 >> 172.21.15.29:0/1421521405 conn(0x7f8ea40f7190 msgr2=0x7f8ea40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1421521405 shutdown_connections 2023-12-05T13:28:12.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.860+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1421521405 wait complete. 2023-12-05T13:28:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea90c5700 1 Processor -- start 2023-12-05T13:28:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea90c5700 1 -- start start 2023-12-05T13:28:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea90c5700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 0x7f8ea410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea90c5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea4102100 0x7f8ea410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea90c5700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41103a0 con 0x7f8ea4066070 2023-12-05T13:28:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea90c5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4110c40 con 0x7f8ea4102100 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 0x7f8ea410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 0x7f8ea410f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33480/0 (socket says 172.21.15.29:33480) 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea2d9d700 1 -- 172.21.15.29:0/1500080432 learned_addr learned my addr 172.21.15.29:0/1500080432 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.861+0000 7f8ea259c700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea4102100 0x7f8ea410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8ea2d9d700 1 -- 172.21.15.29:0/1500080432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea4102100 msgr2=0x7f8ea410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8ea2d9d700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea4102100 0x7f8ea410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8ea2d9d700 1 -- 172.21.15.29:0/1500080432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98005040 con 0x7f8ea4066070 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8ea2d9d700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 0x7f8ea410f860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400c8c0 tx=0x7f8e940044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9400a760 con 0x7f8ea4066070 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e9400ad70 con 0x7f8ea4066070 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e940113a0 con 0x7f8ea4066070 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4110f20 con 0x7f8ea4066070 2023-12-05T13:28:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.862+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4111460 con 0x7f8ea4066070 2023-12-05T13:28:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.863+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4109700 con 0x7f8ea4066070 2023-12-05T13:28:12.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.864+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f8e94012400 con 0x7f8ea4066070 2023-12-05T13:28:12.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.865+0000 7f8e8b7fe700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8e8c06cc00 0x7f8e8c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:12.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.865+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f8e9408bdc0 con 0x7f8ea4066070 2023-12-05T13:28:12.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.865+0000 7f8ea259c700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8e8c06cc00 0x7f8e8c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:12.866 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.865+0000 7f8ea259c700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8e8c06cc00 0x7f8e8c06f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e98004890 tx=0x7f8e98009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:12.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:12.870+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8e94059c70 con 0x7f8ea4066070 2023-12-05T13:28:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2023-12-05T13:28:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:12.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:12 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:13.103 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.102+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ea4111740 con 0x7f8e8c06cc00 2023-12-05T13:28:13.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.104+0000 7f8e8b7fe700 1 -- 172.21.15.29:0/1500080432 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8ea4111740 con 0x7f8e8c06cc00 2023-12-05T13:28:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8e8c06cc00 msgr2=0x7f8e8c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8e8c06cc00 0x7f8e8c06f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e98004890 tx=0x7f8e98009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 msgr2=0x7f8ea410f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 0x7f8ea410f860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400c8c0 tx=0x7f8e940044c0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.107 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 shutdown_connections 2023-12-05T13:28:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8e8c06cc00 0x7f8e8c06f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ea4066070 0x7f8ea410f860 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 --2- 172.21.15.29:0/1500080432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea4102100 0x7f8ea410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 >> 172.21.15.29:0/1500080432 conn(0x7f8ea40f7190 msgr2=0x7f8ea40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 shutdown_connections 2023-12-05T13:28:13.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.106+0000 7f8ea90c5700 1 -- 172.21.15.29:0/1500080432 wait complete. 2023-12-05T13:28:13.120 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:28:13.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 -- 172.21.15.29:0/561338380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 msgr2=0x7f3b2c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/561338380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c0fbf00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3b20004940 tx=0x7f3b20009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 -- 172.21.15.29:0/561338380 shutdown_connections 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/561338380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2c0fcd00 0x7f3b2c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/561338380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c0fbf00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 -- 172.21.15.29:0/561338380 >> 172.21.15.29:0/561338380 conn(0x7f3b2c0f7190 msgr2=0x7f3b2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 -- 172.21.15.29:0/561338380 shutdown_connections 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 -- 172.21.15.29:0/561338380 wait complete. 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.227+0000 7f3b32e9e700 1 Processor -- start 2023-12-05T13:28:13.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b32e9e700 1 -- start start 2023-12-05T13:28:13.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b32e9e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b32e9e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2c0fcd00 0x7f3b2c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b32e9e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c10e0c0 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b32e9e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c10e960 con 0x7f3b2c0fcd00 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b30c3a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b30c3a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c10d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33498/0 (socket says 172.21.15.29:33498) 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b30c3a700 1 -- 172.21.15.29:0/2233486895 learned_addr learned my addr 172.21.15.29:0/2233486895 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b2bfff700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2c0fcd00 0x7f3b2c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b30c3a700 1 -- 172.21.15.29:0/2233486895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2c0fcd00 msgr2=0x7f3b2c10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b30c3a700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2c0fcd00 0x7f3b2c10dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.228+0000 7f3b30c3a700 1 -- 172.21.15.29:0/2233486895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20005040 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.229+0000 7f3b30c3a700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c10d580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009360 tx=0x7f3b20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.229+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2000e040 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.229+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c10ebe0 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.229+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b20004290 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.229+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2001c3f0 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.229+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c10f120 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.230+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c04bb80 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.231+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f3b200137e0 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.231+0000 7f3b297fa700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f3b1c06cc00 0x7f3b1c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.232 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.231+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f3b2008d300 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.231+0000 7f3b2bfff700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f3b1c06cc00 0x7f3b1c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.233 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.232+0000 7f3b2bfff700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f3b1c06cc00 0x7f3b1c06f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b18004f40 tx=0x7f3b1800b040 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:13.236 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.236+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3b2005af80 con 0x7f3b2c0fbaf0 2023-12-05T13:28:13.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.487+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b2c10f530 con 0x7f3b1c06cc00 2023-12-05T13:28:13.489 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.488+0000 7f3b297fa700 1 -- 172.21.15.29:0/2233486895 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3b2c10f530 con 0x7f3b1c06cc00 2023-12-05T13:28:13.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f3b1c06cc00 msgr2=0x7f3b1c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f3b1c06cc00 0x7f3b1c06f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b18004f40 tx=0x7f3b1800b040 comp rx=0 tx=0).stop 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 msgr2=0x7f3b2c10d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c10d580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009360 tx=0x7f3b20009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 shutdown_connections 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f3b1c06cc00 0x7f3b1c06f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c0fbaf0 0x7f3b2c10d580 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 --2- 172.21.15.29:0/2233486895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b2c0fcd00 0x7f3b2c10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 >> 172.21.15.29:0/2233486895 conn(0x7f3b2c0f7190 msgr2=0x7f3b2c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 shutdown_connections 2023-12-05T13:28:13.492 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.491+0000 7f3b32e9e700 1 -- 172.21.15.29:0/2233486895 wait complete. 2023-12-05T13:28:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:13 smithi029 ceph-mon[112128]: Upgrade: Updating alertmanager.smithi029 2023-12-05T13:28:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:13 smithi029 ceph-mon[112128]: Deploying daemon alertmanager.smithi029 on smithi029 2023-12-05T13:28:13.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 -- 172.21.15.29:0/3711739316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c80fd730 msgr2=0x7f66c80ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/3711739316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c80fd730 0x7f66c80ffb10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66b8004940 tx=0x7f66b8009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:13.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 -- 172.21.15.29:0/3711739316 shutdown_connections 2023-12-05T13:28:13.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/3711739316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c8100050 0x7f66c8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/3711739316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c80fd730 0x7f66c80ffb10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 -- 172.21.15.29:0/3711739316 >> 172.21.15.29:0/3711739316 conn(0x7f66c80f7190 msgr2=0x7f66c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 -- 172.21.15.29:0/3711739316 shutdown_connections 2023-12-05T13:28:13.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 -- 172.21.15.29:0/3711739316 wait complete. 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.609+0000 7f66cdb8a700 1 Processor -- start 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66cdb8a700 1 -- start start 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66cdb8a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80fd730 0x7f66c80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66cdb8a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 0x7f66c80fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66cdb8a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80fbc40 con 0x7f66c8100050 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66cdb8a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80fbdb0 con 0x7f66c80fd730 2023-12-05T13:28:13.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 0x7f66c80fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 0x7f66c80fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33516/0 (socket says 172.21.15.29:33516) 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 -- 172.21.15.29:0/1080906438 learned_addr learned my addr 172.21.15.29:0/1080906438 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c77fe700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80fd730 0x7f66c80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 -- 172.21.15.29:0/1080906438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80fd730 msgr2=0x7f66c80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80fd730 0x7f66c80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 -- 172.21.15.29:0/1080906438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8005040 con 0x7f66c8100050 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.610+0000 7f66c6ffd700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 0x7f66c80fb640 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66bc002a50 tx=0x7f66bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.611+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66bc007cc0 con 0x7f66c8100050 2023-12-05T13:28:13.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.611+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80fc090 con 0x7f66c8100050 2023-12-05T13:28:13.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.611+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66bc00f040 con 0x7f66c8100050 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.611+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66bc00d9c0 con 0x7f66c8100050 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.611+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c8115530 con 0x7f66c8100050 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.612+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c804bb80 con 0x7f66c8100050 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.612+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f66bc009070 con 0x7f66c8100050 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.613+0000 7f66affff700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f66b006cc00 0x7f66b006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.613+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f66bc08bd00 con 0x7f66c8100050 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.613+0000 7f66c77fe700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f66b006cc00 0x7f66b006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.613+0000 7f66c77fe700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f66b006cc00 0x7f66b006f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66b8004890 tx=0x7f66b8009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:13.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.620+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f66bc08f030 con 0x7f66c8100050 2023-12-05T13:28:13.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.845+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66c8100cb0 con 0x7f66b006cc00 2023-12-05T13:28:13.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.857+0000 7f66affff700 1 -- 172.21.15.29:0/1080906438 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f66c8100cb0 con 0x7f66b006cc00 2023-12-05T13:28:13.857 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:28:13.857 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (91s) 6s ago 9m 27.0M - 0.25.0 c8568f914cd2 54afa17f1b04 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (9m) 6s ago 9m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (8m) 22s ago 8m 7495k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (83s) 6s ago 9m 83.5M - 9.4.7 2c41d148cca3 7d9c49cae626 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (5m) 6s ago 5m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (5m) 6s ago 5m 17.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (5m) 22s ago 5m 17.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (5m) 22s ago 5m 17.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (71s) 6s ago 10m 504M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (42s) 22s ago 8m 446M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (10m) 6s ago 10m 98.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (8m) 22s ago 8m 67.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (29s) 6s ago 9m 8548k - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:28:13.858 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (25s) 22s ago 8m 5968k - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (8m) 6s ago 8m 834M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (7m) 6s ago 7m 939M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (7m) 6s ago 7m 748M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (7m) 22s ago 7m 1082M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (6m) 22s ago 6m 774M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (6m) 22s ago 6m 945M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:28:13.859 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (9s) 6s ago 9m 40.6M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f66b006cc00 msgr2=0x7f66b006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f66b006cc00 0x7f66b006f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66b8004890 tx=0x7f66b8009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 msgr2=0x7f66c80fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 0x7f66c80fb640 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f66bc002a50 tx=0x7f66bc0046b0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 shutdown_connections 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f66b006cc00 0x7f66b006f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66c80fd730 0x7f66c80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 --2- 172.21.15.29:0/1080906438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66c8100050 0x7f66c80fb640 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 >> 172.21.15.29:0/1080906438 conn(0x7f66c80f7190 msgr2=0x7f66c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 shutdown_connections 2023-12-05T13:28:13.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.859+0000 7f66cdb8a700 1 -- 172.21.15.29:0/1080906438 wait complete. 2023-12-05T13:28:13.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:13 smithi052 ceph-mon[121072]: Upgrade: Updating alertmanager.smithi029 2023-12-05T13:28:13.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:13 smithi052 ceph-mon[121072]: Deploying daemon alertmanager.smithi029 on smithi029 2023-12-05T13:28:13.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 -- 172.21.15.29:0/1608841237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1280ffd70 msgr2=0x7fb1281021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 --2- 172.21.15.29:0/1608841237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1280ffd70 0x7fb1281021d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb11c004940 tx=0x7fb11c009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:13.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 -- 172.21.15.29:0/1608841237 shutdown_connections 2023-12-05T13:28:13.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 --2- 172.21.15.29:0/1608841237 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1280ffd70 0x7fb1281021d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 --2- 172.21.15.29:0/1608841237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb128066090 0x7fb1280ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 -- 172.21.15.29:0/1608841237 >> 172.21.15.29:0/1608841237 conn(0x7fb1280f7190 msgr2=0x7fb1280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:13.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 -- 172.21.15.29:0/1608841237 shutdown_connections 2023-12-05T13:28:13.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 -- 172.21.15.29:0/1608841237 wait complete. 2023-12-05T13:28:13.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.976+0000 7fb12db97700 1 Processor -- start 2023-12-05T13:28:13.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb12db97700 1 -- start start 2023-12-05T13:28:13.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb12db97700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 0x7fb1280fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb12db97700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1280ffd70 0x7fb1280fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb12db97700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280fbca0 con 0x7fb128066090 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb12db97700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280fbe10 con 0x7fb1280ffd70 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb1277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 0x7fb1280fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb1277fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 0x7fb1280fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33544/0 (socket says 172.21.15.29:33544) 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb1277fe700 1 -- 172.21.15.29:0/4197908679 learned_addr learned my addr 172.21.15.29:0/4197908679 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb126ffd700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1280ffd70 0x7fb1280fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb1277fe700 1 -- 172.21.15.29:0/4197908679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1280ffd70 msgr2=0x7fb1280fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb1277fe700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1280ffd70 0x7fb1280fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.977+0000 7fb1277fe700 1 -- 172.21.15.29:0/4197908679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c005040 con 0x7fb128066090 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.978+0000 7fb1277fe700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 0x7fb1280fd220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb11800eb70 tx=0x7fb11800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.978+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb118007cc0 con 0x7fb128066090 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.978+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280fc090 con 0x7fb128066090 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.978+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb11800f040 con 0x7fb128066090 2023-12-05T13:28:13.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.978+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb11800c9f0 con 0x7fb128066090 2023-12-05T13:28:13.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.978+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128115530 con 0x7fb128066090 2023-12-05T13:28:13.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.979+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12804bb80 con 0x7fb128066090 2023-12-05T13:28:13.980 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.980+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fb11800cb50 con 0x7fb128066090 2023-12-05T13:28:13.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.980+0000 7fb10ffff700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fb11006cc00 0x7fb11006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:13.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.981+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb11808bed0 con 0x7fb128066090 2023-12-05T13:28:13.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.981+0000 7fb126ffd700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fb11006cc00 0x7fb11006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:13.981 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.981+0000 7fb126ffd700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fb11006cc00 0x7fb11006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb11c013680 tx=0x7fb11c009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:13.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:13.984+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb118059bd0 con 0x7fb128066090 2023-12-05T13:28:14.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.314+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb128115880 con 0x7fb128066090 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.314+0000 7fb10ffff700 1 -- 172.21.15.29:0/4197908679 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fb118059760 con 0x7fb128066090 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:28:14.315 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:28:14.316 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fb11006cc00 msgr2=0x7fb11006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fb11006cc00 0x7fb11006f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb11c013680 tx=0x7fb11c009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 msgr2=0x7fb1280fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 0x7fb1280fd220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb11800eb70 tx=0x7fb11800b040 comp rx=0 tx=0).stop 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 shutdown_connections 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fb11006cc00 0x7fb11006f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb128066090 0x7fb1280fd220 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 --2- 172.21.15.29:0/4197908679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1280ffd70 0x7fb1280fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.317 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.316+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 >> 172.21.15.29:0/4197908679 conn(0x7fb1280f7190 msgr2=0x7fb1280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:14.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.317+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 shutdown_connections 2023-12-05T13:28:14.318 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.317+0000 7fb12db97700 1 -- 172.21.15.29:0/4197908679 wait complete. 2023-12-05T13:28:14.433 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 -- 172.21.15.29:0/3249385788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 msgr2=0x7f3400102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 --2- 172.21.15.29:0/3249385788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f3400102430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f33f4004940 tx=0x7f33f4009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 -- 172.21.15.29:0/3249385788 shutdown_connections 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 --2- 172.21.15.29:0/3249385788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f3400102430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 --2- 172.21.15.29:0/3249385788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34000fd730 0x7f34000ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 -- 172.21.15.29:0/3249385788 >> 172.21.15.29:0/3249385788 conn(0x7f34000f71d0 msgr2=0x7f34000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 -- 172.21.15.29:0/3249385788 shutdown_connections 2023-12-05T13:28:14.434 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.433+0000 7f3405413700 1 -- 172.21.15.29:0/3249385788 wait complete. 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f3405413700 1 Processor -- start 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f3405413700 1 -- start start 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f3405413700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34000fd730 0x7f340010f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f3405413700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f340010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f3405413700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400110240 con 0x7f3400100050 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f3405413700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400110ae0 con 0x7f34000fd730 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33fe7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f340010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33fe7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f340010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33572/0 (socket says 172.21.15.29:33572) 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33fe7fc700 1 -- 172.21.15.29:0/2122711740 learned_addr learned my addr 172.21.15.29:0/2122711740 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:14.436 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33feffd700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34000fd730 0x7f340010f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33fe7fc700 1 -- 172.21.15.29:0/2122711740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34000fd730 msgr2=0x7f340010f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33fe7fc700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34000fd730 0x7f340010f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.434+0000 7f33fe7fc700 1 -- 172.21.15.29:0/2122711740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4005040 con 0x7f3400100050 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.435+0000 7f33fe7fc700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f340010fc40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009380 tx=0x7f33f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.435+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f400e040 con 0x7f3400100050 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.435+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3400110d60 con 0x7f3400100050 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.435+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33f400bd20 con 0x7f3400100050 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.435+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f401c630 con 0x7f3400100050 2023-12-05T13:28:14.437 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.435+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34001112a0 con 0x7f3400100050 2023-12-05T13:28:14.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.436+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340004bb80 con 0x7f3400100050 2023-12-05T13:28:14.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.437+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f33f4013420 con 0x7f3400100050 2023-12-05T13:28:14.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.437+0000 7f33e77fe700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f33e806cc00 0x7f33e806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:14.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.437+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f33f408d280 con 0x7f3400100050 2023-12-05T13:28:14.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.437+0000 7f33feffd700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f33e806cc00 0x7f33e806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:14.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.438+0000 7f33feffd700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f33e806cc00 0x7f33e806f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f33f00041d0 tx=0x7f33f00043c0 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:14.442 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.442+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f33f405b020 con 0x7f3400100050 2023-12-05T13:28:14.671 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:14 smithi029 ceph-mon[112128]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:14.672 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:14 smithi029 ceph-mon[112128]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2023-12-05T13:28:14.672 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:14 smithi029 ceph-mon[112128]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:14.672 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:14 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:14.672 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:14 smithi029 ceph-mon[112128]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:14.672 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:14 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/4197908679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:14.672 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.671+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34001117b0 con 0x7f33e806cc00 2023-12-05T13:28:14.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.673+0000 7f33e77fe700 1 -- 172.21.15.29:0/2122711740 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f34001117b0 con 0x7f33e806cc00 2023-12-05T13:28:14.673 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:28:14.673 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:28:14.673 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:28:14.673 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr" 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading alertmanager daemons", 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:28:14.674 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:28:14.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f33e806cc00 msgr2=0x7f33e806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f33e806cc00 0x7f33e806f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f33f00041d0 tx=0x7f33f00043c0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 msgr2=0x7f340010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f340010fc40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009380 tx=0x7f33f4009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 shutdown_connections 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f33e806cc00 0x7f33e806f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34000fd730 0x7f340010f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 --2- 172.21.15.29:0/2122711740 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3400100050 0x7f340010fc40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 >> 172.21.15.29:0/2122711740 conn(0x7f34000f71d0 msgr2=0x7f34000fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 shutdown_connections 2023-12-05T13:28:14.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:14.675+0000 7f3405413700 1 -- 172.21.15.29:0/2122711740 wait complete. 2023-12-05T13:28:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:14 smithi052 ceph-mon[121072]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:14 smithi052 ceph-mon[121072]: pgmap v33: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2023-12-05T13:28:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:14 smithi052 ceph-mon[121072]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:14 smithi052 ceph-mon[121072]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:14.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:14 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/4197908679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:15.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:15 smithi029 ceph-mon[112128]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:15.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:15 smithi052 ceph-mon[121072]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:16.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:16 smithi029 ceph-mon[112128]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2023-12-05T13:28:16.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:16 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:16.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:16 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:16.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:16 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:16.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:16 smithi052 ceph-mon[121072]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2023-12-05T13:28:16.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:16 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:16.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:16 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:16.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:16 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:18.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:17 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:18.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:17 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:18.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:17 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:18.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:17 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:19.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:18 smithi029 ceph-mon[112128]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:28:19.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:18 smithi052 ceph-mon[121072]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:28:21.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:20 smithi029 ceph-mon[112128]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:28:21.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:20 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:21.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:20 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:21.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:20 smithi052 ceph-mon[121072]: pgmap v36: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2023-12-05T13:28:21.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:20 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:21.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:20 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:22.323 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:22 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:22.324 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:22 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:22.324 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:22 smithi029 ceph-mon[112128]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:22 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:22 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:22 smithi052 ceph-mon[121072]: pgmap v37: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:24 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: pgmap v38: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:24.774 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:24 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:25.704 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:25 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:28:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:25 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T13:28:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:26 smithi052 ceph-mon[121072]: Upgrade: Updating grafana.smithi029 2023-12-05T13:28:26.760 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:26 smithi052 ceph-mon[121072]: Deploying daemon grafana.smithi029 on smithi029 2023-12-05T13:28:26.760 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:26 smithi052 ceph-mon[121072]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:26.768 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:26 smithi029 ceph-mon[112128]: Upgrade: Updating grafana.smithi029 2023-12-05T13:28:26.768 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:26 smithi029 ceph-mon[112128]: Deploying daemon grafana.smithi029 on smithi029 2023-12-05T13:28:26.768 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:26 smithi029 ceph-mon[112128]: pgmap v39: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:28.536 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:28 smithi029 ceph-mon[112128]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:28.536 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:28.536 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:28.536 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:28 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:28 smithi052 ceph-mon[121072]: pgmap v40: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:28 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:29 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:29.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:29 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:30.715 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:30 smithi029 ceph-mon[112128]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:30 smithi052 ceph-mon[121072]: pgmap v41: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:32.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:32 smithi052 ceph-mon[121072]: pgmap v42: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:32 smithi029 ceph-mon[112128]: pgmap v42: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:33.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:33 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:33 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:33 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:33 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:33 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:33 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:33 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:33.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:33 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:34.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:34 smithi029 ceph-mon[112128]: pgmap v43: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:34.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:34 smithi052 ceph-mon[121072]: pgmap v43: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:36.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:36 smithi029 ceph-mon[112128]: pgmap v44: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:36.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:36 smithi052 ceph-mon[121072]: pgmap v44: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: Upgrade: Finalizing container_image settings 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-05T13:28:37.478 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-05T13:28:37.478 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-05T13:28:37.478 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-05T13:28:37.478 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-05T13:28:37.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.480 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: Upgrade: Complete! 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:37.481 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:37 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T13:28:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: Upgrade: Finalizing container_image settings 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-05T13:28:37.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: Upgrade: Complete! 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-05T13:28:37.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:28:37.609 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:37 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:38.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:38 smithi052 ceph-mon[121072]: pgmap v45: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:38.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:38 smithi029 ceph-mon[112128]: pgmap v45: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:39.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:39 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:40.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:39 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:28:40.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:40 smithi052 ceph-mon[121072]: pgmap v46: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:41.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:40 smithi029 ceph-mon[112128]: pgmap v46: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:42 smithi052 ceph-mon[121072]: pgmap v47: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:43.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:42 smithi029 ceph-mon[112128]: pgmap v47: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 -- 172.21.15.29:0/329187488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51800fd730 msgr2=0x7f51800ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 --2- 172.21.15.29:0/329187488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51800fd730 0x7f51800ffb10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5170004940 tx=0x7f5170009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 -- 172.21.15.29:0/329187488 shutdown_connections 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 --2- 172.21.15.29:0/329187488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5180100050 0x7f5180102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 --2- 172.21.15.29:0/329187488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51800fd730 0x7f51800ffb10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 -- 172.21.15.29:0/329187488 >> 172.21.15.29:0/329187488 conn(0x7f51800f7190 msgr2=0x7f51800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:44.805 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 -- 172.21.15.29:0/329187488 shutdown_connections 2023-12-05T13:28:44.806 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.804+0000 7f5185a20700 1 -- 172.21.15.29:0/329187488 wait complete. 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f5185a20700 1 Processor -- start 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f5185a20700 1 -- start start 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f5185a20700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51800fd730 0x7f518010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f5185a20700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 0x7f518010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f5185a20700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518010dfd0 con 0x7f5180100050 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f5185a20700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518010e870 con 0x7f51800fd730 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f517e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 0x7f518010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:44.807 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f517e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 0x7f518010d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48504/0 (socket says 172.21.15.29:48504) 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.805+0000 7f517e7fc700 1 -- 172.21.15.29:0/2232619296 learned_addr learned my addr 172.21.15.29:0/2232619296 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f517effd700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51800fd730 0x7f518010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f517e7fc700 1 -- 172.21.15.29:0/2232619296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51800fd730 msgr2=0x7f518010d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f517e7fc700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51800fd730 0x7f518010d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f517e7fc700 1 -- 172.21.15.29:0/2232619296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170005040 con 0x7f5180100050 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f517e7fc700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 0x7f518010d9d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5174002a80 tx=0x7f51740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5174007cc0 con 0x7f5180100050 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f517400f040 con 0x7f5180100050 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518010eb50 con 0x7f5180100050 2023-12-05T13:28:44.808 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5174009640 con 0x7f5180100050 2023-12-05T13:28:44.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.806+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518010f090 con 0x7f5180100050 2023-12-05T13:28:44.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.807+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518004bb80 con 0x7f5180100050 2023-12-05T13:28:44.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.808+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f51740097a0 con 0x7f5180100050 2023-12-05T13:28:44.809 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.808+0000 7f51677fe700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f516806cc00 0x7f516806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:44.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.808+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f517408b820 con 0x7f5180100050 2023-12-05T13:28:44.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.808+0000 7f517effd700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f516806cc00 0x7f516806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:44.810 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.809+0000 7f517effd700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f516806cc00 0x7f516806f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5170004f90 tx=0x7f5170009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:44.813 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:44.813+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5174059400 con 0x7f5180100050 2023-12-05T13:28:44.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:44 smithi052 ceph-mon[121072]: pgmap v48: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:44.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:44 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.041+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f518010f4e0 con 0x7f516806cc00 2023-12-05T13:28:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.042+0000 7f51677fe700 1 -- 172.21.15.29:0/2232619296 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f518010f4e0 con 0x7f516806cc00 2023-12-05T13:28:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f516806cc00 msgr2=0x7f516806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f516806cc00 0x7f516806f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5170004f90 tx=0x7f5170009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 msgr2=0x7f518010d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 0x7f518010d9d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5174002a80 tx=0x7f51740046b0 comp rx=0 tx=0).stop 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 shutdown_connections 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f516806cc00 0x7f516806f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51800fd730 0x7f518010d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 --2- 172.21.15.29:0/2232619296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5180100050 0x7f518010d9d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 >> 172.21.15.29:0/2232619296 conn(0x7f51800f7190 msgr2=0x7f51800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 shutdown_connections 2023-12-05T13:28:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:45.044+0000 7f5185a20700 1 -- 172.21.15.29:0/2232619296 wait complete. 2023-12-05T13:28:45.073 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:44 smithi029 ceph-mon[112128]: pgmap v48: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:45.073 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:44 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:45.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-05T13:28:45.713 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:28:46.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:46 smithi029 ceph-mon[112128]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:46.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:46 smithi029 ceph-mon[112128]: pgmap v49: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:46.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:46 smithi052 ceph-mon[121072]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:46.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:46 smithi052 ceph-mon[121072]: pgmap v49: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:46.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 -- 172.21.15.29:0/1460972526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 msgr2=0x7f2b4c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:46.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 --2- 172.21.15.29:0/1460972526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c101ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c004940 tx=0x7f2b3c009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:46.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 -- 172.21.15.29:0/1460972526 shutdown_connections 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 --2- 172.21.15.29:0/1460972526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b4c0fbb40 0x7f2b4c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 --2- 172.21.15.29:0/1460972526 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c101ed0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 -- 172.21.15.29:0/1460972526 >> 172.21.15.29:0/1460972526 conn(0x7f2b4c0719b0 msgr2=0x7f2b4c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 -- 172.21.15.29:0/1460972526 shutdown_connections 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.825+0000 7f2b52d14700 1 -- 172.21.15.29:0/1460972526 wait complete. 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b52d14700 1 Processor -- start 2023-12-05T13:28:46.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b52d14700 1 -- start start 2023-12-05T13:28:46.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b52d14700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b4c0fbb40 0x7f2b4c113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:46.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b52d14700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:46.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b52d14700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c114200 con 0x7f2b4c101b00 2023-12-05T13:28:46.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b52d14700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c10d4f0 con 0x7f2b4c0fbb40 2023-12-05T13:28:46.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:46.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48520/0 (socket says 172.21.15.29:48520) 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.826+0000 7f2b4bfff700 1 -- 172.21.15.29:0/3538724599 learned_addr learned my addr 172.21.15.29:0/3538724599 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b50ab0700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b4c0fbb40 0x7f2b4c113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b4bfff700 1 -- 172.21.15.29:0/3538724599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b4c0fbb40 msgr2=0x7f2b4c113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b4bfff700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b4c0fbb40 0x7f2b4c113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b4bfff700 1 -- 172.21.15.29:0/3538724599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c005040 con 0x7f2b4c101b00 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b4bfff700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c113bb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c8c0 tx=0x7f2b400044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4000a980 con 0x7f2b4c101b00 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b4000ce60 con 0x7f2b4c101b00 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c10d780 con 0x7f2b4c101b00 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b400113a0 con 0x7f2b4c101b00 2023-12-05T13:28:46.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.827+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c10dcc0 con 0x7f2b4c101b00 2023-12-05T13:28:46.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.829+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c0734d0 con 0x7f2b4c101b00 2023-12-05T13:28:46.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.829+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f2b40012400 con 0x7f2b4c101b00 2023-12-05T13:28:46.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.829+0000 7f2b497fa700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2b3406cae0 0x7f2b3406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:46.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.829+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f2b4008bec0 con 0x7f2b4c101b00 2023-12-05T13:28:46.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.829+0000 7f2b50ab0700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2b3406cae0 0x7f2b3406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:46.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.830+0000 7f2b50ab0700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2b3406cae0 0x7f2b3406ef90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c004f90 tx=0x7f2b3c009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:46.834 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:46.834+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2b40059d40 con 0x7f2b4c101b00 2023-12-05T13:28:47.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.130+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2b4c10ec10 con 0x7f2b4c101b00 2023-12-05T13:28:47.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.131+0000 7f2b497fa700 1 -- 172.21.15.29:0/3538724599 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f2b400598d0 con 0x7f2b4c101b00 2023-12-05T13:28:47.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2b3406cae0 msgr2=0x7f2b3406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:47.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2b3406cae0 0x7f2b3406ef90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c004f90 tx=0x7f2b3c009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 msgr2=0x7f2b4c113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c113bb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c8c0 tx=0x7f2b400044c0 comp rx=0 tx=0).stop 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 shutdown_connections 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2b3406cae0 0x7f2b3406ef90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b4c0fbb40 0x7f2b4c113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 --2- 172.21.15.29:0/3538724599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b4c101b00 0x7f2b4c113bb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 >> 172.21.15.29:0/3538724599 conn(0x7f2b4c0719b0 msgr2=0x7f2b4c065490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 shutdown_connections 2023-12-05T13:28:47.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:47.133+0000 7f2b52d14700 1 -- 172.21.15.29:0/3538724599 wait complete. 2023-12-05T13:28:47.145 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:28:47.319 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:47 smithi029 ceph-mon[112128]: mgrmap e34: smithi029.eekhlu(active, since 92s), standbys: smithi052.ocazcp 2023-12-05T13:28:47.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:47 smithi052 ceph-mon[121072]: mgrmap e34: smithi029.eekhlu(active, since 92s), standbys: smithi052.ocazcp 2023-12-05T13:28:47.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-05T13:28:47.857 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:28:48.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:48 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3538724599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:48.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:48 smithi029 ceph-mon[112128]: pgmap v50: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:48.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:48 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3538724599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:48.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:48 smithi052 ceph-mon[121072]: pgmap v50: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.982+0000 7fef03d26700 1 -- 172.21.15.29:0/4215214318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc101b00 msgr2=0x7feefc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.982+0000 7fef03d26700 1 --2- 172.21.15.29:0/4215214318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc101b00 0x7feefc101ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feef0004940 tx=0x7feef0009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.982+0000 7fef03d26700 1 -- 172.21.15.29:0/4215214318 shutdown_connections 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.982+0000 7fef03d26700 1 --2- 172.21.15.29:0/4215214318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feefc0fbb40 0x7feefc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.982+0000 7fef03d26700 1 --2- 172.21.15.29:0/4215214318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc101b00 0x7feefc101ed0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.982+0000 7fef03d26700 1 -- 172.21.15.29:0/4215214318 >> 172.21.15.29:0/4215214318 conn(0x7feefc0719b0 msgr2=0x7feefc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 -- 172.21.15.29:0/4215214318 shutdown_connections 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 -- 172.21.15.29:0/4215214318 wait complete. 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 Processor -- start 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 -- start start 2023-12-05T13:28:48.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 0x7feefc115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:48.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feefc101b00 0x7feefc115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:48.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc1163f0 con 0x7feefc0fbb40 2023-12-05T13:28:48.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.983+0000 7fef03d26700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc10f720 con 0x7feefc101b00 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 0x7feefc115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 0x7feefc115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41220/0 (socket says 172.21.15.29:41220) 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 -- 172.21.15.29:0/3354044566 learned_addr learned my addr 172.21.15.29:0/3354044566 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef012c1700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feefc101b00 0x7feefc115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 -- 172.21.15.29:0/3354044566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feefc101b00 msgr2=0x7feefc115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feefc101b00 0x7feefc115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 -- 172.21.15.29:0/3354044566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0005040 con 0x7feefc0fbb40 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef01ac2700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 0x7feefc115860 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feef0009180 tx=0x7feef0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef000e040 con 0x7feefc0fbb40 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feef0004290 con 0x7feefc0fbb40 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef001c3f0 con 0x7feefc0fbb40 2023-12-05T13:28:48.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc10f9a0 con 0x7feefc0fbb40 2023-12-05T13:28:48.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.984+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc10fee0 con 0x7feefc0fbb40 2023-12-05T13:28:48.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.985+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0734d0 con 0x7feefc0fbb40 2023-12-05T13:28:48.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.986+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7feef0013420 con 0x7feefc0fbb40 2023-12-05T13:28:48.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.986+0000 7feeee7fc700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7feee806cae0 0x7feee806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:48.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.986+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7feef008cf20 con 0x7feefc0fbb40 2023-12-05T13:28:48.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.986+0000 7fef012c1700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7feee806cae0 0x7feee806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:48.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.987+0000 7fef012c1700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7feee806cae0 0x7feee806ef90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feefc111090 tx=0x7feef80043c0 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:48.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:48.991+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7feef00bfce0 con 0x7feefc0fbb40 2023-12-05T13:28:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.289+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feefc110e40 con 0x7feefc0fbb40 2023-12-05T13:28:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.290+0000 7feeee7fc700 1 -- 172.21.15.29:0/3354044566 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7feef005af90 con 0x7feefc0fbb40 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7feee806cae0 msgr2=0x7feee806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7feee806cae0 0x7feee806ef90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feefc111090 tx=0x7feef80043c0 comp rx=0 tx=0).stop 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 msgr2=0x7feefc115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 0x7feefc115860 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feef0009180 tx=0x7feef0009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 shutdown_connections 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7feee806cae0 0x7feee806ef90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feefc0fbb40 0x7feefc115860 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 --2- 172.21.15.29:0/3354044566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feefc101b00 0x7feefc115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 >> 172.21.15.29:0/3354044566 conn(0x7feefc0719b0 msgr2=0x7feefc065490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 shutdown_connections 2023-12-05T13:28:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:49.292+0000 7fef03d26700 1 -- 172.21.15.29:0/3354044566 wait complete. 2023-12-05T13:28:49.305 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)" 2023-12-05T13:28:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:49 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/3354044566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:49 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/3354044566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:49.766 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-05T13:28:50.070 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:28:50.569 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:50 smithi029 ceph-mon[112128]: pgmap v51: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:50 smithi052 ceph-mon[121072]: pgmap v51: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:51.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 -- 172.21.15.29:0/3185980519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 msgr2=0x7fabdc102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:51.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 --2- 172.21.15.29:0/3185980519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc102fd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fabcc004940 tx=0x7fabcc009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:51.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 -- 172.21.15.29:0/3185980519 shutdown_connections 2023-12-05T13:28:51.221 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 --2- 172.21.15.29:0/3185980519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabdc1035a0 0x7fabdc0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:51.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 --2- 172.21.15.29:0/3185980519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc102fd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:51.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 -- 172.21.15.29:0/3185980519 >> 172.21.15.29:0/3185980519 conn(0x7fabdc0f8790 msgr2=0x7fabdc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:51.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 -- 172.21.15.29:0/3185980519 shutdown_connections 2023-12-05T13:28:51.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 -- 172.21.15.29:0/3185980519 wait complete. 2023-12-05T13:28:51.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.220+0000 7fabe22c6700 1 Processor -- start 2023-12-05T13:28:51.222 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabe22c6700 1 -- start start 2023-12-05T13:28:51.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabe22c6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:51.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabe22c6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabdc1035a0 0x7fabdc113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:51.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabe22c6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc114200 con 0x7fabdc102c00 2023-12-05T13:28:51.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabe22c6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc10d4f0 con 0x7fabdc1035a0 2023-12-05T13:28:51.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:51.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41224/0 (socket says 172.21.15.29:41224) 2023-12-05T13:28:51.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdbfff700 1 -- 172.21.15.29:0/498247022 learned_addr learned my addr 172.21.15.29:0/498247022 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:51.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdb7fe700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabdc1035a0 0x7fabdc113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:51.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdbfff700 1 -- 172.21.15.29:0/498247022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabdc1035a0 msgr2=0x7fabdc113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdbfff700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabdc1035a0 0x7fabdc113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.221+0000 7fabdbfff700 1 -- 172.21.15.29:0/498247022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc005040 con 0x7fabdc102c00 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.222+0000 7fabdbfff700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc113630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009180 tx=0x7fabcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.222+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabcc00e040 con 0x7fabdc102c00 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.222+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabcc013420 con 0x7fabdc102c00 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.222+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc10d720 con 0x7fabdc102c00 2023-12-05T13:28:51.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.222+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabcc01c630 con 0x7fabdc102c00 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.222+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc10dc60 con 0x7fabdc102c00 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.223+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc0fff10 con 0x7fabdc102c00 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.224+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fabcc0139e0 con 0x7fabdc102c00 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.224+0000 7fabd8ff9700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fabc806cae0 0x7fabc806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.224+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fabcc08d060 con 0x7fabdc102c00 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.224+0000 7fabdb7fe700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fabc806cae0 0x7fabc806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:51.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.225+0000 7fabdb7fe700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fabc806cae0 0x7fabc806ef90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009fd0 tx=0x7fabc4009f20 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:51.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.229+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fabcc05af80 con 0x7fabdc102c00 2023-12-05T13:28:51.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.529+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fabdc10ec10 con 0x7fabdc102c00 2023-12-05T13:28:51.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.529+0000 7fabd8ff9700 1 -- 172.21.15.29:0/498247022 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fabcc05ab10 con 0x7fabdc102c00 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fabc806cae0 msgr2=0x7fabc806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fabc806cae0 0x7fabc806ef90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009fd0 tx=0x7fabc4009f20 comp rx=0 tx=0).stop 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 msgr2=0x7fabdc113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc113630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009180 tx=0x7fabcc009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 shutdown_connections 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fabc806cae0 0x7fabc806ef90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:51.532 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fabdc102c00 0x7fabdc113630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 --2- 172.21.15.29:0/498247022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabdc1035a0 0x7fabdc113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.531+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 >> 172.21.15.29:0/498247022 conn(0x7fabdc0f8790 msgr2=0x7fabdc0fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.532+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 shutdown_connections 2023-12-05T13:28:51.533 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:51.532+0000 7fabe22c6700 1 -- 172.21.15.29:0/498247022 wait complete. 2023-12-05T13:28:51.544 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:28:51.934 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-05T13:28:52.238 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:28:52.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:52 smithi029 ceph-mon[112128]: pgmap v52: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:52.719 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:52 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/498247022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:52 smithi052 ceph-mon[121072]: pgmap v52: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:52 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/498247022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 -- 172.21.15.29:0/3434540725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 msgr2=0x7faa840fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/3434540725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa840fb630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa80004940 tx=0x7faa80009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 -- 172.21.15.29:0/3434540725 shutdown_connections 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/3434540725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa840fb630 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/3434540725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa84102c70 0x7faa84103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 -- 172.21.15.29:0/3434540725 >> 172.21.15.29:0/3434540725 conn(0x7faa840711a0 msgr2=0x7faa840715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:53.324 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 -- 172.21.15.29:0/3434540725 shutdown_connections 2023-12-05T13:28:53.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.323+0000 7faa8b9f8700 1 -- 172.21.15.29:0/3434540725 wait complete. 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa8b9f8700 1 Processor -- start 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa8b9f8700 1 -- start start 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa8b9f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa84113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa8b9f8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa84102c70 0x7faa84113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa8b9f8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa84114260 con 0x7faa840fb1e0 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa8b9f8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8410d550 con 0x7faa84102c70 2023-12-05T13:28:53.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa89794700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa84113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa89794700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa84113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41236/0 (socket says 172.21.15.29:41236) 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.324+0000 7faa89794700 1 -- 172.21.15.29:0/1801249252 learned_addr learned my addr 172.21.15.29:0/1801249252 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa88f93700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa84102c70 0x7faa84113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa89794700 1 -- 172.21.15.29:0/1801249252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa84102c70 msgr2=0x7faa84113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa89794700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa84102c70 0x7faa84113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa89794700 1 -- 172.21.15.29:0/1801249252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80005040 con 0x7faa840fb1e0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa89794700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa84113690 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c810 tx=0x7faa78004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa78012810 con 0x7faa840fb1e0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8410d7e0 con 0x7faa840fb1e0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa78012e20 con 0x7faa840fb1e0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.325+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7800a370 con 0x7faa840fb1e0 2023-12-05T13:28:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.326+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8410dd20 con 0x7faa840fb1e0 2023-12-05T13:28:53.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.327+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa84105050 con 0x7faa840fb1e0 2023-12-05T13:28:53.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.327+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7faa78011780 con 0x7faa840fb1e0 2023-12-05T13:28:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.327+0000 7faa75ffb700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7faa7006cae0 0x7faa7006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.328+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7faa7808c1c0 con 0x7faa840fb1e0 2023-12-05T13:28:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.328+0000 7faa88f93700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7faa7006cae0 0x7faa7006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.328+0000 7faa88f93700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7faa7006cae0 0x7faa7006ef90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa80004f90 tx=0x7faa80009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:53.333 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.332+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7faa7805a060 con 0x7faa840fb1e0 2023-12-05T13:28:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:53.558+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}) v1 -- 0x7faa8410ec70 con 0x7faa7006cae0 2023-12-05T13:28:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:54 smithi052 ceph-mon[121072]: pgmap v53: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:54 smithi052 ceph-mon[121072]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:54.768 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:54 smithi029 ceph-mon[112128]: pgmap v53: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:54.768 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:54 smithi029 ceph-mon[112128]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:55.179 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.178+0000 7faa75ffb700 1 -- 172.21.15.29:0/1801249252 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5089 (secure 0 0 0) 0x7faa8410ec70 con 0x7faa7006cae0 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7faa7006cae0 msgr2=0x7faa7006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7faa7006cae0 0x7faa7006ef90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa80004f90 tx=0x7faa80009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 msgr2=0x7faa84113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa84113690 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c810 tx=0x7faa78004470 comp rx=0 tx=0).stop 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 shutdown_connections 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7faa7006cae0 0x7faa7006ef90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:55.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faa840fb1e0 0x7faa84113690 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:55.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 --2- 172.21.15.29:0/1801249252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa84102c70 0x7faa84113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:55.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 >> 172.21.15.29:0/1801249252 conn(0x7faa840711a0 msgr2=0x7faa840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:55.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 shutdown_connections 2023-12-05T13:28:55.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:55.181+0000 7faa8b9f8700 1 -- 172.21.15.29:0/1801249252 wait complete. 2023-12-05T13:28:55.195 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:28:55.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch ps' 2023-12-05T13:28:55.875 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:28:56.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:56 smithi029 ceph-mon[112128]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:56 smithi052 ceph-mon[121072]: pgmap v54: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:28:56.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 -- 172.21.15.29:0/542314506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 msgr2=0x7f2d840fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:56.982 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 --2- 172.21.15.29:0/542314506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d840fb630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c004940 tx=0x7f2d6c009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 -- 172.21.15.29:0/542314506 shutdown_connections 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 --2- 172.21.15.29:0/542314506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d840fb630 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 --2- 172.21.15.29:0/542314506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 0x7f2d84103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 -- 172.21.15.29:0/542314506 >> 172.21.15.29:0/542314506 conn(0x7f2d840711a0 msgr2=0x7f2d840715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 -- 172.21.15.29:0/542314506 shutdown_connections 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.981+0000 7f2d8a140700 1 -- 172.21.15.29:0/542314506 wait complete. 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.982+0000 7f2d8a140700 1 Processor -- start 2023-12-05T13:28:56.983 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.982+0000 7f2d8a140700 1 -- start start 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.982+0000 7f2d8a140700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d84113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.982+0000 7f2d8a140700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 0x7f2d84113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.982+0000 7f2d8a140700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84114200 con 0x7f2d840fb1e0 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.982+0000 7f2d8a140700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8410d4f0 con 0x7f2d84102c70 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d84113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d84113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41246/0 (socket says 172.21.15.29:41246) 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 -- 172.21.15.29:0/4238191791 learned_addr learned my addr 172.21.15.29:0/4238191791 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d82ffd700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 0x7f2d84113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 -- 172.21.15.29:0/4238191791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 msgr2=0x7f2d84113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 0x7f2d84113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 -- 172.21.15.29:0/4238191791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c005040 con 0x7f2d840fb1e0 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d82ffd700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 0x7f2d84113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:28:56.985 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d837fe700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d84113630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c8c0 tx=0x7f2d740044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:56.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d7400a980 con 0x7f2d840fb1e0 2023-12-05T13:28:56.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8410d780 con 0x7f2d840fb1e0 2023-12-05T13:28:56.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d7400ce60 con 0x7f2d840fb1e0 2023-12-05T13:28:56.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d740113a0 con 0x7f2d840fb1e0 2023-12-05T13:28:56.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.983+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8410dcc0 con 0x7f2d840fb1e0 2023-12-05T13:28:56.986 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.984+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84105050 con 0x7f2d840fb1e0 2023-12-05T13:28:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.985+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f2d74012400 con 0x7f2d840fb1e0 2023-12-05T13:28:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.985+0000 7f2d7bfff700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2d7006cae0 0x7f2d7006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.985+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f2d7408be20 con 0x7f2d840fb1e0 2023-12-05T13:28:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.986+0000 7f2d82ffd700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2d7006cae0 0x7f2d7006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:56.987 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.986+0000 7f2d82ffd700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2d7006cae0 0x7f2d7006ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009fd0 tx=0x7f2d6c009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:56.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:56.990+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2d74059d40 con 0x7f2d840fb1e0 2023-12-05T13:28:57.213 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.212+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d8410ec10 con 0x7f2d7006cae0 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.223+0000 7f2d7bfff700 1 -- 172.21.15.29:0/4238191791 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2d8410ec10 con 0x7f2d7006cae0 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (41s) 24s ago 10m 17.7M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (10m) 24s ago 10m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (9m) 66s ago 9m 7495k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (29s) 24s ago 9m 47.1M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:28:57.224 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (6m) 24s ago 6m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (6m) 24s ago 6m 18.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (5m) 66s ago 5m 17.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (6m) 66s ago 6m 17.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (114s) 24s ago 11m 506M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (85s) 66s ago 9m 446M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (11m) 24s ago 11m 101M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (9m) 66s ago 9m 67.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (72s) 24s ago 10m 8196k - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (68s) 66s ago 9m 5968k - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (8m) 24s ago 8m 835M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (8m) 24s ago 8m 940M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (8m) 24s ago 8m 749M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (7m) 66s ago 7m 1082M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (7m) 66s ago 7m 774M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:28:57.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (7m) 66s ago 7m 945M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:28:57.226 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (53s) 24s ago 9m 47.3M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2d7006cae0 msgr2=0x7f2d7006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2d7006cae0 0x7f2d7006ef90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009fd0 tx=0x7f2d6c009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 msgr2=0x7f2d84113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d84113630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c8c0 tx=0x7f2d740044c0 comp rx=0 tx=0).stop 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 shutdown_connections 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2d7006cae0 0x7f2d7006ef90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840fb1e0 0x7f2d84113630 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 --2- 172.21.15.29:0/4238191791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d84102c70 0x7f2d84113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 >> 172.21.15.29:0/4238191791 conn(0x7f2d840711a0 msgr2=0x7f2d840fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 shutdown_connections 2023-12-05T13:28:57.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:57.226+0000 7f2d8a140700 1 -- 172.21.15.29:0/4238191791 wait complete. 2023-12-05T13:28:57.631 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T13:28:57.632 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:28:57.632 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-05T13:28:57.941 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:28:58.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:58 smithi052 ceph-mon[121072]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:58.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:58 smithi052 ceph-mon[121072]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:58.786 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:58 smithi029 ceph-mon[112128]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:28:58.786 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:58 smithi029 ceph-mon[112128]: pgmap v55: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:28:58.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 -- 172.21.15.29:0/2591060611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 msgr2=0x7f05e00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:58.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 --2- 172.21.15.29:0/2591060611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e00fbfb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05d0004940 tx=0x7f05d0009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 -- 172.21.15.29:0/2591060611 shutdown_connections 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 --2- 172.21.15.29:0/2591060611 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e00fbfb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 --2- 172.21.15.29:0/2591060611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e0101b00 0x7f05e0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 -- 172.21.15.29:0/2591060611 >> 172.21.15.29:0/2591060611 conn(0x7f05e00719b0 msgr2=0x7f05e0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 -- 172.21.15.29:0/2591060611 shutdown_connections 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.997+0000 7f05e6e11700 1 -- 172.21.15.29:0/2591060611 wait complete. 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e6e11700 1 Processor -- start 2023-12-05T13:28:58.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e6e11700 1 -- start start 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e6e11700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e6e11700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e0101b00 0x7f05e010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e6e11700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e010f290 con 0x7f05e00fbb40 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e6e11700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e010f400 con 0x7f05e0101b00 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e4bad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e4bad700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e010e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56194/0 (socket says 172.21.15.29:56194) 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.998+0000 7f05e4bad700 1 -- 172.21.15.29:0/1148256696 learned_addr learned my addr 172.21.15.29:0/1148256696 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05d7fff700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e0101b00 0x7f05e010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05e4bad700 1 -- 172.21.15.29:0/1148256696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e0101b00 msgr2=0x7f05e010ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05e4bad700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e0101b00 0x7f05e010ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05e4bad700 1 -- 172.21.15.29:0/1148256696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0005040 con 0x7f05e00fbb40 2023-12-05T13:28:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05e4bad700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e010e7a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05dc002a50 tx=0x7f05dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05dc007cc0 con 0x7f05e00fbb40 2023-12-05T13:28:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e0117770 con 0x7f05e00fbb40 2023-12-05T13:28:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05dc00f040 con 0x7f05e00fbb40 2023-12-05T13:28:59.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05dc00d9c0 con 0x7f05e00fbb40 2023-12-05T13:28:59.003 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:58.999+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e0117c80 con 0x7f05e00fbb40 2023-12-05T13:28:59.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.000+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0103fb0 con 0x7f05e00fbb40 2023-12-05T13:28:59.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.001+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f05dc00db20 con 0x7f05e00fbb40 2023-12-05T13:28:59.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.001+0000 7f05d57fa700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f05c806cae0 0x7f05c806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:28:59.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.002+0000 7f05d7fff700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f05c806cae0 0x7f05c806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:28:59.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.002+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f05dc08ba40 con 0x7f05e00fbb40 2023-12-05T13:28:59.005 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.002+0000 7f05d7fff700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f05c806cae0 0x7f05c806ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05e0065e30 tx=0x7f05d0009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:28:59.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.006+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f05dc055e50 con 0x7f05e00fbb40 2023-12-05T13:28:59.219 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.218+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f05e00734d0 con 0x7f05e00fbb40 2023-12-05T13:28:59.223 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.223+0000 7f05d57fa700 1 -- 172.21.15.29:0/1148256696 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f05dc059470 con 0x7f05e00fbb40 2023-12-05T13:28:59.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.225+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f05c806cae0 msgr2=0x7f05c806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:59.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.225+0000 7f05e6e11700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f05c806cae0 0x7f05c806ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05e0065e30 tx=0x7f05d0009e30 comp rx=0 tx=0).stop 2023-12-05T13:28:59.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.225+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 msgr2=0x7f05e010e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:28:59.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.225+0000 7f05e6e11700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e010e7a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05dc002a50 tx=0x7f05dc0046b0 comp rx=0 tx=0).stop 2023-12-05T13:28:59.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 shutdown_connections 2023-12-05T13:28:59.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f05c806cae0 0x7f05c806ef90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:59.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05e00fbb40 0x7f05e010e7a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:59.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 --2- 172.21.15.29:0/1148256696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e0101b00 0x7f05e010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:28:59.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 >> 172.21.15.29:0/1148256696 conn(0x7f05e00719b0 msgr2=0x7f05e00fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:28:59.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 shutdown_connections 2023-12-05T13:28:59.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:28:59.226+0000 7f05e6e11700 1 -- 172.21.15.29:0/1148256696 wait complete. 2023-12-05T13:28:59.557 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:59.557 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:59 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1148256696' entity='client.admin' 2023-12-05T13:28:59.557 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:28:59 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:59.622 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T13:28:59.622 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:28:59.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-05T13:28:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:28:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:59 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1148256696' entity='client.admin' 2023-12-05T13:28:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:28:59 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:28:59.943 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:29:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:00 smithi029 ceph-mon[112128]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:00 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:00 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:00 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:00 smithi052 ceph-mon[121072]: pgmap v56: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:00 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:00 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:00 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:01.513 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 -- 172.21.15.29:0/4239911842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 msgr2=0x7f9e2c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 --2- 172.21.15.29:0/4239911842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c101ed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c004940 tx=0x7f9e1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 -- 172.21.15.29:0/4239911842 shutdown_connections 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 --2- 172.21.15.29:0/4239911842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2c0fbb40 0x7f9e2c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 --2- 172.21.15.29:0/4239911842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c101ed0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 -- 172.21.15.29:0/4239911842 >> 172.21.15.29:0/4239911842 conn(0x7f9e2c0719b0 msgr2=0x7f9e2c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 -- 172.21.15.29:0/4239911842 shutdown_connections 2023-12-05T13:29:01.514 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 -- 172.21.15.29:0/4239911842 wait complete. 2023-12-05T13:29:01.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.513+0000 7f9e32238700 1 Processor -- start 2023-12-05T13:29:01.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e32238700 1 -- start start 2023-12-05T13:29:01.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e32238700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2c0fbb40 0x7f9e2c115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e32238700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e32238700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c116400 con 0x7f9e2c101b00 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e32238700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c10f730 con 0x7f9e2c0fbb40 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2affd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c115db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56212/0 (socket says 172.21.15.29:56212) 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2affd700 1 -- 172.21.15.29:0/2450897902 learned_addr learned my addr 172.21.15.29:0/2450897902 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2b7fe700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2c0fbb40 0x7f9e2c115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2affd700 1 -- 172.21.15.29:0/2450897902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2c0fbb40 msgr2=0x7f9e2c115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2affd700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2c0fbb40 0x7f9e2c115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.514+0000 7f9e2affd700 1 -- 172.21.15.29:0/2450897902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c005040 con 0x7f9e2c101b00 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.515+0000 7f9e2affd700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c115db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9e20002a50 tx=0x7f9e200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.515+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e20007cc0 con 0x7f9e2c101b00 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.515+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c10fa10 con 0x7f9e2c101b00 2023-12-05T13:29:01.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.515+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e2000f040 con 0x7f9e2c101b00 2023-12-05T13:29:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.515+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2000d9c0 con 0x7f9e2c101b00 2023-12-05T13:29:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.515+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c10ff50 con 0x7f9e2c101b00 2023-12-05T13:29:01.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.516+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c103fb0 con 0x7f9e2c101b00 2023-12-05T13:29:01.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.517+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f9e20009070 con 0x7f9e2c101b00 2023-12-05T13:29:01.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.517+0000 7f9e13fff700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f9e1406cae0 0x7f9e1406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:01.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.517+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f9e2008bb10 con 0x7f9e2c101b00 2023-12-05T13:29:01.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.517+0000 7f9e2b7fe700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f9e1406cae0 0x7f9e1406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:01.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.518+0000 7f9e2b7fe700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f9e1406cae0 0x7f9e1406ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c004f90 tx=0x7f9e1c009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:01.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.522+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9e20059910 con 0x7f9e2c101b00 2023-12-05T13:29:01.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.729+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9e2c109bb0 con 0x7f9e2c101b00 2023-12-05T13:29:01.730 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.729+0000 7f9e13fff700 1 -- 172.21.15.29:0/2450897902 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9e200594a0 con 0x7f9e2c101b00 2023-12-05T13:29:01.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f9e1406cae0 msgr2=0x7f9e1406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:01.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f9e1406cae0 0x7f9e1406ef90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c004f90 tx=0x7f9e1c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:01.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 msgr2=0x7f9e2c115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:01.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c115db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9e20002a50 tx=0x7f9e200046b0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 shutdown_connections 2023-12-05T13:29:01.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f9e1406cae0 0x7f9e1406ef90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2c0fbb40 0x7f9e2c115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 --2- 172.21.15.29:0/2450897902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e2c101b00 0x7f9e2c115db0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:01.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 >> 172.21.15.29:0/2450897902 conn(0x7f9e2c0719b0 msgr2=0x7f9e2c0fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:01.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 shutdown_connections 2023-12-05T13:29:01.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:01.732+0000 7f9e32238700 1 -- 172.21.15.29:0/2450897902 wait complete. 2023-12-05T13:29:02.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-05T13:29:02.434 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:29:02.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:02 smithi052 ceph-mon[121072]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:02.786 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:02 smithi029 ceph-mon[112128]: pgmap v57: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 -- 172.21.15.29:0/1378287354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 msgr2=0x7fa870065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 --2- 172.21.15.29:0/1378287354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa870065800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa85c004940 tx=0x7fa85c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 -- 172.21.15.29:0/1378287354 shutdown_connections 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 --2- 172.21.15.29:0/1378287354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa870065800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 --2- 172.21.15.29:0/1378287354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa870102c20 0x7fa870102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 -- 172.21.15.29:0/1378287354 >> 172.21.15.29:0/1378287354 conn(0x7fa8700719b0 msgr2=0x7fa870071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 -- 172.21.15.29:0/1378287354 shutdown_connections 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.546+0000 7fa876efd700 1 -- 172.21.15.29:0/1378287354 wait complete. 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa876efd700 1 Processor -- start 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa876efd700 1 -- start start 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa876efd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa8701136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa876efd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa870102c20 0x7fa870113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa876efd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87010d570 con 0x7fa870065390 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa876efd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87010d6e0 con 0x7fa870102c20 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa874c99700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa8701136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa874c99700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa8701136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56236/0 (socket says 172.21.15.29:56236) 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa874c99700 1 -- 172.21.15.29:0/3571003073 learned_addr learned my addr 172.21.15.29:0/3571003073 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.547+0000 7fa86ffff700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa870102c20 0x7fa870113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa874c99700 1 -- 172.21.15.29:0/3571003073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa870102c20 msgr2=0x7fa870113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa874c99700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa870102c20 0x7fa870113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa874c99700 1 -- 172.21.15.29:0/3571003073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c005040 con 0x7fa870065390 2023-12-05T13:29:03.549 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa874c99700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa8701136b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b790 tx=0x7fa864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86400f6f0 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87010d9c0 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa86400fd00 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8640103a0 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.548+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87010df00 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.549+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700fff40 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.550+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fa86400f850 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.550+0000 7fa86d7fa700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fa86006cae0 0x7fa86006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.550+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa86408baf0 con 0x7fa870065390 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.550+0000 7fa86ffff700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fa86006cae0 0x7fa86006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:03.551 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.551+0000 7fa86ffff700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fa86006cae0 0x7fa86006ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa85c004f90 tx=0x7fa85c009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:03.555 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.555+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa864059a10 con 0x7fa870065390 2023-12-05T13:29:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.763+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fa87004bb80 con 0x7fa870065390 2023-12-05T13:29:03.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.764+0000 7fa86d7fa700 1 -- 172.21.15.29:0/3571003073 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa8640595a0 con 0x7fa870065390 2023-12-05T13:29:03.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fa86006cae0 msgr2=0x7fa86006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:03.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fa86006cae0 0x7fa86006ef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa85c004f90 tx=0x7fa85c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:03.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 msgr2=0x7fa8701136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:03.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa8701136b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b790 tx=0x7fa864009250 comp rx=0 tx=0).stop 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 shutdown_connections 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fa86006cae0 0x7fa86006ef90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa870065390 0x7fa8701136b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 --2- 172.21.15.29:0/3571003073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa870102c20 0x7fa870113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 >> 172.21.15.29:0/3571003073 conn(0x7fa8700719b0 msgr2=0x7fa8700fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 shutdown_connections 2023-12-05T13:29:03.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:03.766+0000 7fa876efd700 1 -- 172.21.15.29:0/3571003073 wait complete. 2023-12-05T13:29:04.170 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-05T13:29:04.477 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:29:04.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:04 smithi052 ceph-mon[121072]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:04.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:04 smithi029 ceph-mon[112128]: pgmap v58: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 -- 172.21.15.29:0/2033752370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 msgr2=0x7f756c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 --2- 172.21.15.29:0/2033752370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c102ff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f755c004940 tx=0x7f755c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 -- 172.21.15.29:0/2033752370 shutdown_connections 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 --2- 172.21.15.29:0/2033752370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c065390 0x7f756c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 --2- 172.21.15.29:0/2033752370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c102ff0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 -- 172.21.15.29:0/2033752370 >> 172.21.15.29:0/2033752370 conn(0x7f756c0719b0 msgr2=0x7f756c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 -- 172.21.15.29:0/2033752370 shutdown_connections 2023-12-05T13:29:05.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.609+0000 7f7572b84700 1 -- 172.21.15.29:0/2033752370 wait complete. 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.610+0000 7f7572b84700 1 Processor -- start 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.610+0000 7f7572b84700 1 -- start start 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.610+0000 7f7572b84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c065390 0x7f756c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.610+0000 7f7572b84700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.610+0000 7f7572b84700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c114220 con 0x7f756c102c20 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.610+0000 7f7572b84700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c10d570 con 0x7f756c065390 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56252/0 (socket says 172.21.15.29:56252) 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 -- 172.21.15.29:0/2668697712 learned_addr learned my addr 172.21.15.29:0/2668697712 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f7570920700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c065390 0x7f756c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 -- 172.21.15.29:0/2668697712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c065390 msgr2=0x7f756c113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:05.612 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c065390 0x7f756c113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 -- 172.21.15.29:0/2668697712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c005040 con 0x7f756c102c20 2023-12-05T13:29:05.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f756bfff700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c113bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7554002a50 tx=0x7f75540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:05.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7554007cc0 con 0x7f756c102c20 2023-12-05T13:29:05.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c10d850 con 0x7f756c102c20 2023-12-05T13:29:05.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f755400f040 con 0x7f756c102c20 2023-12-05T13:29:05.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755400d9c0 con 0x7f756c102c20 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.611+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c10dd90 con 0x7f756c102c20 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.612+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c0fff40 con 0x7f756c102c20 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.613+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f755400db20 con 0x7f756c102c20 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.613+0000 7f75697fa700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f755806cae0 0x7f755806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.613+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f755408ba40 con 0x7f756c102c20 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.613+0000 7f7570920700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f755806cae0 0x7f755806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:05.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.614+0000 7f7570920700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f755806cae0 0x7f755806ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f755c004f90 tx=0x7f755c009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:05.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.618+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f75540598e0 con 0x7f756c102c20 2023-12-05T13:29:05.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.827+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f756c0734d0 con 0x7f756c102c20 2023-12-05T13:29:05.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.827+0000 7f75697fa700 1 -- 172.21.15.29:0/2668697712 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f7554059470 con 0x7f756c102c20 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f755806cae0 msgr2=0x7f755806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f755806cae0 0x7f755806ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f755c004f90 tx=0x7f755c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 msgr2=0x7f756c113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c113bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7554002a50 tx=0x7f75540046b0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 shutdown_connections 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f755806cae0 0x7f755806ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f756c065390 0x7f756c113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 --2- 172.21.15.29:0/2668697712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f756c102c20 0x7f756c113bd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 >> 172.21.15.29:0/2668697712 conn(0x7f756c0719b0 msgr2=0x7f756c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:05.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 shutdown_connections 2023-12-05T13:29:05.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:05.829+0000 7f7572b84700 1 -- 172.21.15.29:0/2668697712 wait complete. 2023-12-05T13:29:06.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:06 smithi029 ceph-mon[112128]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:06.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-05T13:29:06.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:06 smithi052 ceph-mon[121072]: pgmap v59: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:06.533 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 -- 172.21.15.29:0/4172633832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 msgr2=0x7fbac4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/4172633832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac4101f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbac0004940 tx=0x7fbac0009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 -- 172.21.15.29:0/4172633832 shutdown_connections 2023-12-05T13:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/4172633832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac40fbb00 0x7fbac40fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/4172633832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac4101f30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 -- 172.21.15.29:0/4172633832 >> 172.21.15.29:0/4172633832 conn(0x7fbac40f7680 msgr2=0x7fbac40f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:07.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 -- 172.21.15.29:0/4172633832 shutdown_connections 2023-12-05T13:29:07.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.645+0000 7fbacb9b0700 1 -- 172.21.15.29:0/4172633832 wait complete. 2023-12-05T13:29:07.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbacb9b0700 1 Processor -- start 2023-12-05T13:29:07.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbacb9b0700 1 -- start start 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbacb9b0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac40fbb00 0x7fbac410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbacb9b0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac410ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbacb9b0700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac410f1c0 con 0x7fbac4101b60 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbacb9b0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac410f300 con 0x7fbac40fbb00 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac8f4b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac410ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac8f4b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac410ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56272/0 (socket says 172.21.15.29:56272) 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac8f4b700 1 -- 172.21.15.29:0/2019860833 learned_addr learned my addr 172.21.15.29:0/2019860833 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac974c700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac40fbb00 0x7fbac410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:07.648 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac8f4b700 1 -- 172.21.15.29:0/2019860833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac40fbb00 msgr2=0x7fbac410e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac8f4b700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac40fbb00 0x7fbac410e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.646+0000 7fbac8f4b700 1 -- 172.21.15.29:0/2019860833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0005040 con 0x7fbac4101b60 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.647+0000 7fbac8f4b700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac410ec30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbab4002a50 tx=0x7fbab40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.647+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab4007cc0 con 0x7fbac4101b60 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.647+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbab400f040 con 0x7fbac4101b60 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.647+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac4117660 con 0x7fbac4101b60 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.647+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab400d9c0 con 0x7fbac4101b60 2023-12-05T13:29:07.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.647+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac4117b70 con 0x7fbac4101b60 2023-12-05T13:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.648+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac4103f40 con 0x7fbac4101b60 2023-12-05T13:29:07.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.648+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fbab400db20 con 0x7fbac4101b60 2023-12-05T13:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.649+0000 7fbab9ffb700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fbab006cae0 0x7fbab006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.649+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fbab408ba20 con 0x7fbac4101b60 2023-12-05T13:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.649+0000 7fbac974c700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fbab006cae0 0x7fbab006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:07.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.649+0000 7fbac974c700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fbab006cae0 0x7fbab006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbac0004f90 tx=0x7fbac0009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:07.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.654+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbab4055e30 con 0x7fbac4101b60 2023-12-05T13:29:07.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.881+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}) v1 -- 0x7fbac4066460 con 0x7fbab006cae0 2023-12-05T13:29:07.887 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.887+0000 7fbab9ffb700 1 -- 172.21.15.29:0/2019860833 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fbac4066460 con 0x7fbab006cae0 2023-12-05T13:29:07.887 INFO:teuthology.orchestra.run.smithi029.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fbab006cae0 msgr2=0x7fbab006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fbab006cae0 0x7fbab006ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbac0004f90 tx=0x7fbac0009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 msgr2=0x7fbac410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac410ec30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbab4002a50 tx=0x7fbab40046b0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 shutdown_connections 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7fbab006cae0 0x7fbab006ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbac40fbb00 0x7fbac410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 --2- 172.21.15.29:0/2019860833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbac4101b60 0x7fbac410ec30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 >> 172.21.15.29:0/2019860833 conn(0x7fbac40f7680 msgr2=0x7fbac40f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 shutdown_connections 2023-12-05T13:29:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:07.889+0000 7fbacb9b0700 1 -- 172.21.15.29:0/2019860833 wait complete. 2023-12-05T13:29:08.227 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T13:29:08.227 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:29:08.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-05T13:29:08.536 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:29:08.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:08 smithi029 ceph-mon[112128]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:08.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:08.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:08.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:08.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:08.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:08 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:08 smithi052 ceph-mon[121072]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:08 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:09 smithi029 ceph-mon[112128]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:09 smithi029 ceph-mon[112128]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:29:09.718 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:09 smithi029 ceph-mon[112128]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:29:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:09 smithi052 ceph-mon[121072]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:09 smithi052 ceph-mon[121072]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:29:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:09 smithi052 ceph-mon[121072]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-05T13:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.859+0000 7f8117c6b700 1 -- 172.21.15.29:0/4158248622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 msgr2=0x7f8110065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.859+0000 7f8117c6b700 1 --2- 172.21.15.29:0/4158248622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f8110065800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8100004940 tx=0x7f8100009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 -- 172.21.15.29:0/4158248622 shutdown_connections 2023-12-05T13:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 --2- 172.21.15.29:0/4158248622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f8110065800 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 --2- 172.21.15.29:0/4158248622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102c20 0x7f8110102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 -- 172.21.15.29:0/4158248622 >> 172.21.15.29:0/4158248622 conn(0x7f81100719b0 msgr2=0x7f8110071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 -- 172.21.15.29:0/4158248622 shutdown_connections 2023-12-05T13:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 -- 172.21.15.29:0/4158248622 wait complete. 2023-12-05T13:29:09.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.860+0000 7f8117c6b700 1 Processor -- start 2023-12-05T13:29:09.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8117c6b700 1 -- start start 2023-12-05T13:29:09.862 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8117c6b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f81100fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8117c6b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102c20 0x7f81100fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8117c6b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100fc7c0 con 0x7f8110065390 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8117c6b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100fc930 con 0x7f8110102c20 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115a07700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f81100fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115a07700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f81100fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59914/0 (socket says 172.21.15.29:59914) 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115a07700 1 -- 172.21.15.29:0/3278234652 learned_addr learned my addr 172.21.15.29:0/3278234652 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115206700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102c20 0x7f81100fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115a07700 1 -- 172.21.15.29:0/3278234652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102c20 msgr2=0x7f81100fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115a07700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102c20 0x7f81100fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.861+0000 7f8115a07700 1 -- 172.21.15.29:0/3278234652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100005040 con 0x7f8110065390 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.862+0000 7f8115a07700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f81100fbbf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f810c00b790 tx=0x7f810c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.862+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c00f6f0 con 0x7f8110065390 2023-12-05T13:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.862+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f810c00fd00 con 0x7f8110065390 2023-12-05T13:29:09.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.862+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8110119950 con 0x7f8110065390 2023-12-05T13:29:09.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.862+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c0103a0 con 0x7f8110065390 2023-12-05T13:29:09.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.862+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110119e40 con 0x7f8110065390 2023-12-05T13:29:09.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.863+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81100fff40 con 0x7f8110065390 2023-12-05T13:29:09.864 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.863+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f810c00f850 con 0x7f8110065390 2023-12-05T13:29:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.864+0000 7f81067fc700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f80fc06caf0 0x7f80fc06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.864+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f810c08b900 con 0x7f8110065390 2023-12-05T13:29:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.864+0000 7f8115206700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f80fc06caf0 0x7f80fc06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:09.865 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.864+0000 7f8115206700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f80fc06caf0 0x7f80fc06efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81100fd5f0 tx=0x7f8100009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:09.868+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f810c055e30 con 0x7f8110065390 2023-12-05T13:29:10.104 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.104+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81100fd330 con 0x7f80fc06caf0 2023-12-05T13:29:10.105 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.105+0000 7f81067fc700 1 -- 172.21.15.29:0/3278234652 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f81100fd330 con 0x7f80fc06caf0 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f80fc06caf0 msgr2=0x7f80fc06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f80fc06caf0 0x7f80fc06efa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81100fd5f0 tx=0x7f8100009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 msgr2=0x7f81100fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f81100fbbf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f810c00b790 tx=0x7f810c009250 comp rx=0 tx=0).stop 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 shutdown_connections 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f80fc06caf0 0x7f80fc06efa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8110065390 0x7f81100fbbf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 --2- 172.21.15.29:0/3278234652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102c20 0x7f81100fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 >> 172.21.15.29:0/3278234652 conn(0x7f81100719b0 msgr2=0x7f81100fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 shutdown_connections 2023-12-05T13:29:10.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.107+0000 7f8117c6b700 1 -- 172.21.15.29:0/3278234652 wait complete. 2023-12-05T13:29:10.121 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:29:10.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.224+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/2478878318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c102c20 msgr2=0x7f4f9c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.225 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.224+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/2478878318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c102c20 0x7f4f9c102ff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c004940 tx=0x7f4f8c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:10.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/2478878318 shutdown_connections 2023-12-05T13:29:10.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/2478878318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c065390 0x7f4f9c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/2478878318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c102c20 0x7f4f9c102ff0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/2478878318 >> 172.21.15.29:0/2478878318 conn(0x7f4f9c0719b0 msgr2=0x7f4f9c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:10.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/2478878318 shutdown_connections 2023-12-05T13:29:10.226 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/2478878318 wait complete. 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.225+0000 7f4fa2a2a700 1 Processor -- start 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4fa2a2a700 1 -- start start 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4fa2a2a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 0x7f4f9c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4fa2a2a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c102c20 0x7f4f9c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4fa2a2a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c114220 con 0x7f4f9c065390 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4fa2a2a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c10d570 con 0x7f4f9c102c20 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4f9bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 0x7f4f9c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4f9bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 0x7f4f9c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59936/0 (socket says 172.21.15.29:59936) 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4f9bfff700 1 -- 172.21.15.29:0/73255689 learned_addr learned my addr 172.21.15.29:0/73255689 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.226+0000 7f4f9b7fe700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c102c20 0x7f4f9c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f9bfff700 1 -- 172.21.15.29:0/73255689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c102c20 msgr2=0x7f4f9c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f9bfff700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c102c20 0x7f4f9c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f9bfff700 1 -- 172.21.15.29:0/73255689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c005040 con 0x7f4f9c065390 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f9bfff700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 0x7f4f9c113690 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00b3b0 tx=0x7f4f8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8c00e040 con 0x7f4f9c065390 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c10d7f0 con 0x7f4f9c065390 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f8c01c430 con 0x7f4f9c065390 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8c013640 con 0x7f4f9c065390 2023-12-05T13:29:10.229 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.227+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c10dd30 con 0x7f4f9c065390 2023-12-05T13:29:10.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.228+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c0fff40 con 0x7f4f9c065390 2023-12-05T13:29:10.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.229+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f4f8c01c5a0 con 0x7f4f9c065390 2023-12-05T13:29:10.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.229+0000 7f4f98ff9700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f8406cae0 0x7f4f8406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.229+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f4f8c08c820 con 0x7f4f9c065390 2023-12-05T13:29:10.230 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.229+0000 7f4f9b7fe700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f8406cae0 0x7f4f8406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.231 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.230+0000 7f4f9b7fe700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f8406cae0 0x7f4f8406ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c10ef70 tx=0x7f4f9000b040 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:10.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.234+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4f8c05a7f0 con 0x7f4f9c065390 2023-12-05T13:29:10.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.474+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f9c04bc20 con 0x7f4f8406cae0 2023-12-05T13:29:10.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.475+0000 7f4f98ff9700 1 -- 172.21.15.29:0/73255689 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4f9000f040 con 0x7f4f8406cae0 2023-12-05T13:29:10.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f8406cae0 msgr2=0x7f4f8406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f8406cae0 0x7f4f8406ef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c10ef70 tx=0x7f4f9000b040 comp rx=0 tx=0).stop 2023-12-05T13:29:10.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 msgr2=0x7f4f9c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 0x7f4f9c113690 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00b3b0 tx=0x7f4f8c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:10.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 shutdown_connections 2023-12-05T13:29:10.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f4f8406cae0 0x7f4f8406ef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9c065390 0x7f4f9c113690 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 --2- 172.21.15.29:0/73255689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f9c102c20 0x7f4f9c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 >> 172.21.15.29:0/73255689 conn(0x7f4f9c0719b0 msgr2=0x7f4f9c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:10.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 shutdown_connections 2023-12-05T13:29:10.480 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.478+0000 7f4fa2a2a700 1 -- 172.21.15.29:0/73255689 wait complete. 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 -- 172.21.15.29:0/2682054158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c102c70 msgr2=0x7f339c103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/2682054158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c102c70 0x7f339c103040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f338c004940 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 -- 172.21.15.29:0/2682054158 shutdown_connections 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/2682054158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/2682054158 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c102c70 0x7f339c103040 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 -- 172.21.15.29:0/2682054158 >> 172.21.15.29:0/2682054158 conn(0x7f339c0711a0 msgr2=0x7f339c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 -- 172.21.15.29:0/2682054158 shutdown_connections 2023-12-05T13:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.595+0000 7f33a1ccb700 1 -- 172.21.15.29:0/2682054158 wait complete. 2023-12-05T13:29:10.597 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f33a1ccb700 1 Processor -- start 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f33a1ccb700 1 -- start start 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f33a1ccb700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f33a1ccb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339c102c70 0x7f339c0fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f33a1ccb700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0fcf00 con 0x7f339c0fb1e0 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f33a1ccb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0fd070 con 0x7f339c102c70 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f339b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f339b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59960/0 (socket says 172.21.15.29:59960) 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f339b7fe700 1 -- 172.21.15.29:0/4103586352 learned_addr learned my addr 172.21.15.29:0/4103586352 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.596+0000 7f339affd700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339c102c70 0x7f339c0fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f339b7fe700 1 -- 172.21.15.29:0/4103586352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339c102c70 msgr2=0x7f339c0fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.598 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f339b7fe700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339c102c70 0x7f339c0fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f339b7fe700 1 -- 172.21.15.29:0/4103586352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c005040 con 0x7f339c0fb1e0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f339b7fe700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fc3c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b3b0 tx=0x7f338c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c00e040 con 0x7f339c0fb1e0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c119840 con 0x7f339c0fb1e0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f338c01c430 con 0x7f339c0fb1e0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c013640 con 0x7f339c0fb1e0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.597+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c119ca0 con 0x7f339c0fb1e0 2023-12-05T13:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.598+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c0fff10 con 0x7f339c0fb1e0 2023-12-05T13:29:10.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.600+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f338c01c5a0 con 0x7f339c0fb1e0 2023-12-05T13:29:10.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.600+0000 7f3393fff700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f338806cae0 0x7f338806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.601+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f338c08d0d0 con 0x7f339c0fb1e0 2023-12-05T13:29:10.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.601+0000 7f339affd700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f338806cae0 0x7f338806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.601+0000 7f339affd700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f338806cae0 0x7f338806ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f339c0fddc0 tx=0x7f338400b040 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:10.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.604+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f338c0575f0 con 0x7f339c0fb1e0 2023-12-05T13:29:10.715 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:10 smithi029 ceph-mon[112128]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:10.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:10 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:10.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:10 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:10.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:10 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:10.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:10 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:10.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:10 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T13:29:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:10 smithi052 ceph-mon[121072]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:10 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:10 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:10 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:10 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:10 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T13:29:10.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.828+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f339c0fdb70 con 0x7f338806cae0 2023-12-05T13:29:10.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.840+0000 7f3393fff700 1 -- 172.21.15.29:0/4103586352 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f339c0fdb70 con 0x7f338806cae0 2023-12-05T13:29:10.840 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:29:10.840 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (54s) 38s ago 10m 17.7M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (10m) 38s ago 10m 7440k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (9m) 79s ago 9m 7495k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (42s) 38s ago 10m 47.1M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (6m) 38s ago 6m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (6m) 38s ago 6m 18.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (6m) 79s ago 6m 17.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (6m) 79s ago 6m 17.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (2m) 38s ago 11m 506M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (99s) 79s ago 9m 446M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (11m) 38s ago 11m 101M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d8b25bc8bb04 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (9m) 79s ago 9m 67.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc db5d97842b89 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (86s) 38s ago 10m 8196k - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (82s) 79s ago 9m 5968k - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:29:10.841 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (8m) 38s ago 8m 835M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:29:10.842 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (8m) 38s ago 8m 940M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:29:10.842 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (8m) 38s ago 8m 749M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:29:10.842 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (7m) 79s ago 7m 1082M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:29:10.842 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (7m) 79s ago 7m 774M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:29:10.842 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (7m) 79s ago 7m 945M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:29:10.842 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (66s) 38s ago 9m 47.3M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f338806cae0 msgr2=0x7f338806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f338806cae0 0x7f338806ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f339c0fddc0 tx=0x7f338400b040 comp rx=0 tx=0).stop 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 msgr2=0x7f339c0fc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fc3c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b3b0 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 shutdown_connections 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f338806cae0 0x7f338806ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f339c0fb1e0 0x7f339c0fc3c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 --2- 172.21.15.29:0/4103586352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339c102c70 0x7f339c0fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 >> 172.21.15.29:0/4103586352 conn(0x7f339c0711a0 msgr2=0x7f339c0fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 shutdown_connections 2023-12-05T13:29:10.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.842+0000 7f33a1ccb700 1 -- 172.21.15.29:0/4103586352 wait complete. 2023-12-05T13:29:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 -- 172.21.15.29:0/2756624551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 msgr2=0x7f8ac0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 --2- 172.21.15.29:0/2756624551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0102fd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0004940 tx=0x7f8ab0009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 -- 172.21.15.29:0/2756624551 shutdown_connections 2023-12-05T13:29:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 --2- 172.21.15.29:0/2756624551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac01035a0 0x7f8ac00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 --2- 172.21.15.29:0/2756624551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0102fd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 -- 172.21.15.29:0/2756624551 >> 172.21.15.29:0/2756624551 conn(0x7f8ac00f8790 msgr2=0x7f8ac00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 -- 172.21.15.29:0/2756624551 shutdown_connections 2023-12-05T13:29:10.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.954+0000 7f8ac7279700 1 -- 172.21.15.29:0/2756624551 wait complete. 2023-12-05T13:29:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac7279700 1 Processor -- start 2023-12-05T13:29:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac7279700 1 -- start start 2023-12-05T13:29:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac7279700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac7279700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac01035a0 0x7f8ac0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac7279700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac01141e0 con 0x7f8ac0102c00 2023-12-05T13:29:10.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac7279700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac010d4d0 con 0x7f8ac01035a0 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac5015700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac5015700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59978/0 (socket says 172.21.15.29:59978) 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.955+0000 7f8ac5015700 1 -- 172.21.15.29:0/1588829854 learned_addr learned my addr 172.21.15.29:0/1588829854 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac4814700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac01035a0 0x7f8ac0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac5015700 1 -- 172.21.15.29:0/1588829854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac01035a0 msgr2=0x7f8ac0113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac5015700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac01035a0 0x7f8ac0113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac5015700 1 -- 172.21.15.29:0/1588829854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0005040 con 0x7f8ac0102c00 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac5015700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0113610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000b3b0 tx=0x7f8ab0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab000e040 con 0x7f8ac0102c00 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ab000bc50 con 0x7f8ac0102c00 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab0013420 con 0x7f8ac0102c00 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac010d700 con 0x7f8ac0102c00 2023-12-05T13:29:10.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.956+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac010dc40 con 0x7f8ac0102c00 2023-12-05T13:29:10.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.957+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac00fff10 con 0x7f8ac0102c00 2023-12-05T13:29:10.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.958+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f8ab001c430 con 0x7f8ac0102c00 2023-12-05T13:29:10.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.959+0000 7f8ab5ffb700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8aac06cae0 0x7f8aac06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:10.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.959+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f8ab008cab0 con 0x7f8ac0102c00 2023-12-05T13:29:10.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.959+0000 7f8ac4814700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8aac06cae0 0x7f8aac06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:10.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.959+0000 7f8ac4814700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8aac06cae0 0x7f8aac06ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8abc007fd0 tx=0x7f8abc009040 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:10.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:10.964+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8ab008ee60 con 0x7f8ac0102c00 2023-12-05T13:29:11.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.264+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ac010ebf0 con 0x7f8ac0102c00 2023-12-05T13:29:11.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.265+0000 7f8ab5ffb700 1 -- 172.21.15.29:0/1588829854 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8ab005aa60 con 0x7f8ac0102c00 2023-12-05T13:29:11.266 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:11.267 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:29:11.268 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8aac06cae0 msgr2=0x7f8aac06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8aac06cae0 0x7f8aac06ef90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8abc007fd0 tx=0x7f8abc009040 comp rx=0 tx=0).stop 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 msgr2=0x7f8ac0113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0113610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000b3b0 tx=0x7f8ab0009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 shutdown_connections 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f8aac06cae0 0x7f8aac06ef90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ac0102c00 0x7f8ac0113610 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 --2- 172.21.15.29:0/1588829854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ac01035a0 0x7f8ac0113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 >> 172.21.15.29:0/1588829854 conn(0x7f8ac00f8790 msgr2=0x7f8ac00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 shutdown_connections 2023-12-05T13:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.268+0000 7f8ac7279700 1 -- 172.21.15.29:0/1588829854 wait complete. 2023-12-05T13:29:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.383+0000 7f7b7654b700 1 -- 172.21.15.29:0/2714512708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 msgr2=0x7f7b70102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.383+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2714512708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70102ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7b60004940 tx=0x7f7b60009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:11.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.383+0000 7f7b7654b700 1 -- 172.21.15.29:0/2714512708 shutdown_connections 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.383+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2714512708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b70065390 0x7f7b70065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.384+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2714512708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70102ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.384+0000 7f7b7654b700 1 -- 172.21.15.29:0/2714512708 >> 172.21.15.29:0/2714512708 conn(0x7f7b700719b0 msgr2=0x7f7b70071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.384+0000 7f7b7654b700 1 -- 172.21.15.29:0/2714512708 shutdown_connections 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.384+0000 7f7b7654b700 1 -- 172.21.15.29:0/2714512708 wait complete. 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.384+0000 7f7b7654b700 1 Processor -- start 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.384+0000 7f7b7654b700 1 -- start start 2023-12-05T13:29:11.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b7654b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b70065390 0x7f7b70113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:11.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b7654b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:11.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b7654b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70114220 con 0x7f7b70102c20 2023-12-05T13:29:11.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b7654b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7010d570 con 0x7f7b70065390 2023-12-05T13:29:11.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60008/0 (socket says 172.21.15.29:60008) 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 -- 172.21.15.29:0/2501352366 learned_addr learned my addr 172.21.15.29:0/2501352366 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6ffff700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b70065390 0x7f7b70113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 -- 172.21.15.29:0/2501352366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b70065390 msgr2=0x7f7b70113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b70065390 0x7f7b70113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 -- 172.21.15.29:0/2501352366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60005040 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.385+0000 7f7b6f7fe700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70113bd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002a50 tx=0x7f7b640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.386+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b64007cc0 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.386+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7010d850 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.386+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b6400f040 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.386+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b6400d9c0 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.386+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7010dd90 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.387+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b700fff40 con 0x7f7b70102c20 2023-12-05T13:29:11.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.387+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f7b64009070 con 0x7f7b70102c20 2023-12-05T13:29:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.388+0000 7f7b6cff9700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f7b5806cae0 0x7f7b5806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.388+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f7b6408b980 con 0x7f7b70102c20 2023-12-05T13:29:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.388+0000 7f7b6ffff700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f7b5806cae0 0x7f7b5806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:11.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.389+0000 7f7b6ffff700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f7b5806cae0 0x7f7b5806ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b60004f90 tx=0x7f7b60009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:11.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.393+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7b640598a0 con 0x7f7b70102c20 2023-12-05T13:29:11.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.663+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b700734d0 con 0x7f7b70102c20 2023-12-05T13:29:11.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.664+0000 7f7b6cff9700 1 -- 172.21.15.29:0/2501352366 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1803 (secure 0 0 0) 0x7f7b64059430 con 0x7f7b70102c20 2023-12-05T13:29:11.665 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:29:11.665 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:29:11.665 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:11.665 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:29:11.665 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:29:11.666 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:29:11.667 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.668+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f7b5806cae0 msgr2=0x7f7b5806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.668+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f7b5806cae0 0x7f7b5806ef90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b60004f90 tx=0x7f7b60009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.668+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 msgr2=0x7f7b70113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.668+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70113bd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7b64002a50 tx=0x7f7b640046b0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 shutdown_connections 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f7b5806cae0 0x7f7b5806ef90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b70065390 0x7f7b70113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 --2- 172.21.15.29:0/2501352366 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b70102c20 0x7f7b70113bd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 >> 172.21.15.29:0/2501352366 conn(0x7f7b700719b0 msgr2=0x7f7b700fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 shutdown_connections 2023-12-05T13:29:11.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.674+0000 7f7b7654b700 1 -- 172.21.15.29:0/2501352366 wait complete. 2023-12-05T13:29:11.675 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:29:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: Upgrade: Target is version 19.0.0-13-ge6605fb8 (unknown) 2023-12-05T13:29:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a'] 2023-12-05T13:29:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: Upgrade: Setting container_image for all mgr 2023-12-05T13:29:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:11.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:11 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/1588829854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 -- 172.21.15.29:0/4193110710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae41035a0 msgr2=0x7f2ae40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/4193110710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae41035a0 0x7f2ae40fcc10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2acc004940 tx=0x7f2acc009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 -- 172.21.15.29:0/4193110710 shutdown_connections 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/4193110710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae41035a0 0x7f2ae40fcc10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/4193110710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae4102c00 0x7f2ae4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 -- 172.21.15.29:0/4193110710 >> 172.21.15.29:0/4193110710 conn(0x7f2ae40f8790 msgr2=0x7f2ae40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 -- 172.21.15.29:0/4193110710 shutdown_connections 2023-12-05T13:29:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.790+0000 7f2ae91cf700 1 -- 172.21.15.29:0/4193110710 wait complete. 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae91cf700 1 Processor -- start 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae91cf700 1 -- start start 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae91cf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 0x7f2ae406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae91cf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae41035a0 0x7f2ae40704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae91cf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4070af0 con 0x7f2ae4102c00 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae91cf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4070c60 con 0x7f2ae41035a0 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 0x7f2ae406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 0x7f2ae406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60030/0 (socket says 172.21.15.29:60030) 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae2d9d700 1 -- 172.21.15.29:0/1540467313 learned_addr learned my addr 172.21.15.29:0/1540467313 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.791+0000 7f2ae259c700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae41035a0 0x7f2ae40704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2ae2d9d700 1 -- 172.21.15.29:0/1540467313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae41035a0 msgr2=0x7f2ae40704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2ae2d9d700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae41035a0 0x7f2ae40704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2ae2d9d700 1 -- 172.21.15.29:0/1540467313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc005040 con 0x7f2ae4102c00 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2ae2d9d700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 0x7f2ae406ff40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4002a50 tx=0x7f2ad40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad4007cc0 con 0x7f2ae4102c00 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ad400f040 con 0x7f2ae4102c00 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae4119880 con 0x7f2ae4102c00 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad400d9c0 con 0x7f2ae4102c00 2023-12-05T13:29:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.792+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae4119dc0 con 0x7f2ae4102c00 2023-12-05T13:29:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.793+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae41050d0 con 0x7f2ae4102c00 2023-12-05T13:29:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.794+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f2ad400db20 con 0x7f2ae4102c00 2023-12-05T13:29:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.794+0000 7f2adb7fe700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2ad006cae0 0x7f2ad006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.794+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f2ad408b950 con 0x7f2ae4102c00 2023-12-05T13:29:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.794+0000 7f2ae259c700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2ad006cae0 0x7f2ad006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.795+0000 7f2ae259c700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2ad006cae0 0x7f2ad006ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4071940 tx=0x7f2acc009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:11.799+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2ad4055de0 con 0x7f2ae4102c00 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: Upgrade: Target is version 19.0.0-13-ge6605fb8 (unknown) 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a'] 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: Upgrade: Setting container_image for all mgr 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:11.839 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:11.840 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:11.840 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:11.840 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:11 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/1588829854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:12.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.031+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 --> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ae4071680 con 0x7f2ad006cae0 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.032+0000 7f2adb7fe700 1 -- 172.21.15.29:0/1540467313 <== mgr.14708 v2:172.21.15.29:6800/3933945750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2ae4071680 con 0x7f2ad006cae0 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr" 2023-12-05T13:29:12.033 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:29:12.034 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "2/21 daemons upgraded", 2023-12-05T13:29:12.034 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading mon daemons", 2023-12-05T13:29:12.034 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:29:12.034 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:29:12.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2ad006cae0 msgr2=0x7f2ad006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:12.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2ad006cae0 0x7f2ad006ef90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4071940 tx=0x7f2acc009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 msgr2=0x7f2ae406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 0x7f2ae406ff40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4002a50 tx=0x7f2ad40046b0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 shutdown_connections 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f2ad006cae0 0x7f2ad006ef90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ae4102c00 0x7f2ae406ff40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 --2- 172.21.15.29:0/1540467313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae41035a0 0x7f2ae40704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 >> 172.21.15.29:0/1540467313 conn(0x7f2ae40f8790 msgr2=0x7f2ae40fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 shutdown_connections 2023-12-05T13:29:12.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.035+0000 7f2ae91cf700 1 -- 172.21.15.29:0/1540467313 wait complete. 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4205076964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 msgr2=0x7f0dbc065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4205076964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc065800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0db0004940 tx=0x7f0db0009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4205076964 shutdown_connections 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4205076964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc065800 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4205076964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dbc102c20 0x7f0dbc102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4205076964 >> 172.21.15.29:0/4205076964 conn(0x7f0dbc0719b0 msgr2=0x7f0dbc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4205076964 shutdown_connections 2023-12-05T13:29:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.148+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4205076964 wait complete. 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc45a8700 1 Processor -- start 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc45a8700 1 -- start start 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc45a8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc45a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dbc102c20 0x7f0dbc113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc45a8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc1142e0 con 0x7f0dbc065390 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc45a8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc10d610 con 0x7f0dbc102c20 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc2344700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc2344700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60058/0 (socket says 172.21.15.29:60058) 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.149+0000 7f0dc2344700 1 -- 172.21.15.29:0/4233369259 learned_addr learned my addr 172.21.15.29:0/4233369259 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc1b43700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dbc102c20 0x7f0dbc113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc2344700 1 -- 172.21.15.29:0/4233369259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dbc102c20 msgr2=0x7f0dbc113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc2344700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dbc102c20 0x7f0dbc113c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc2344700 1 -- 172.21.15.29:0/4233369259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0005040 con 0x7f0dbc065390 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc2344700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc113750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c810 tx=0x7f0db8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db8012810 con 0x7f0dbc065390 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc10d8f0 con 0x7f0dbc065390 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0db8012e20 con 0x7f0dbc065390 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db800a370 con 0x7f0dbc065390 2023-12-05T13:29:12.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.150+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc10de30 con 0x7f0dbc065390 2023-12-05T13:29:12.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.151+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc0fff40 con 0x7f0dbc065390 2023-12-05T13:29:12.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.152+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 34) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f0db8011780 con 0x7f0dbc065390 2023-12-05T13:29:12.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.152+0000 7f0daeffd700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f0da806cae0 0x7f0da806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:12.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.152+0000 7f0dc1b43700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f0da806cae0 0x7f0da806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:12.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.152+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0db808c1c0 con 0x7f0dbc065390 2023-12-05T13:29:12.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.153+0000 7f0dc1b43700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f0da806cae0 0x7f0da806ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b3b0 tx=0x7f0db0009e30 comp rx=0 tx=0).ready entity=mgr.14708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:12.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.157+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0db805a060 con 0x7f0dbc065390 2023-12-05T13:29:12.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.489+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0dbc04bb80 con 0x7f0dbc065390 2023-12-05T13:29:12.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.490+0000 7f0daeffd700 1 -- 172.21.15.29:0/4233369259 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0db8059bf0 con 0x7f0dbc065390 2023-12-05T13:29:12.492 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_OK 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f0da806cae0 msgr2=0x7f0da806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f0da806cae0 0x7f0da806ef90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b3b0 tx=0x7f0db0009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 msgr2=0x7f0dbc113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc113750 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c810 tx=0x7f0db8004470 comp rx=0 tx=0).stop 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 shutdown_connections 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:6800/3933945750,v1:172.21.15.29:6801/3933945750] conn(0x7f0da806cae0 0x7f0da806ef90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dbc065390 0x7f0dbc113750 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 --2- 172.21.15.29:0/4233369259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dbc102c20 0x7f0dbc113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:12.493 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.492+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 >> 172.21.15.29:0/4233369259 conn(0x7f0dbc0719b0 msgr2=0x7f0dbc0face0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:12.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.493+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 shutdown_connections 2023-12-05T13:29:12.494 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:12.493+0000 7f0dc45a8700 1 -- 172.21.15.29:0/4233369259 wait complete. 2023-12-05T13:29:12.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:12 smithi052 ceph-mon[121072]: Upgrade: Updating mon.smithi029 2023-12-05T13:29:12.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:12 smithi052 ceph-mon[121072]: Deploying daemon mon.smithi029 on smithi029 2023-12-05T13:29:12.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:12 smithi052 ceph-mon[121072]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:12.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:12 smithi052 ceph-mon[121072]: from='client.? 172.21.15.29:0/2501352366' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 systemd[1]: Stopping Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 ceph-mon[112128]: Upgrade: Updating mon.smithi029 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 ceph-mon[112128]: Deploying daemon mon.smithi029 on smithi029 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 ceph-mon[112128]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 ceph-mon[112128]: from='client.? 172.21.15.29:0/2501352366' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[112105]: 2023-12-05T13:29:12.665+0000 7f45d5f4a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi029 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:29:12.792 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[112105]: 2023-12-05T13:29:12.665+0000 7f45d5f4a700 -1 mon.smithi029@0(leader) e2 *** Got Signal Terminated *** 2023-12-05T13:29:13.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:12 smithi029 bash[217207]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029 2023-12-05T13:29:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service: Succeeded. 2023-12-05T13:29:13.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 systemd[1]: Stopped Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:29:13.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 systemd[1]: Starting Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:29:14.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T13:29:14.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev), process ceph-mon, pid 7 2023-12-05T13:29:14.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: pidfile_write: ignore empty --pid-file 2023-12-05T13:29:14.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 bash[217368]: ecad29ebe778dfe7b808cb7930ab740472e9273e718e57c0a9c4d66ebbdf18f2 2023-12-05T13:29:14.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: load: jerasure load: lrc 2023-12-05T13:29:14.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 systemd[1]: Started Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: RocksDB version: 7.9.2 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Git sha 0 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Compile date 2023-12-05 09:15:47 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: DB SUMMARY 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: DB Session ID: QK61GOS53OO6E1ODGCS7 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: CURRENT file: CURRENT 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1171 Bytes 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi029/store.db dir, Total Num: 1, files: 000033.sst 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi029/store.db: 000031.log size: 1859879 ; 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.error_if_exists: 0 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.create_if_missing: 0 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.paranoid_checks: 1 2023-12-05T13:29:14.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.env: 0x56441e4e5a60 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.fs: PosixFileSystem 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.info_log: 0x56441fbcf600 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.statistics: (nil) 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.use_fsync: 0 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_log_file_size: 0 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T13:29:14.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.allow_fallocate: 1 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.use_direct_reads: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.db_log_dir: 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.wal_dir: 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T13:29:14.107 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.write_buffer_manager: 0x56441fb85360 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.unordered_write: 0 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T13:29:14.108 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.row_cache: None 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.wal_filter: None 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.two_write_queues: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.wal_compression: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.atomic_flush: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.log_readahead_size: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T13:29:14.109 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_background_jobs: 2 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_background_compactions: -1 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_subcompactions: 1 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T13:29:14.110 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_open_files: -1 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_background_flushes: -1 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Compression algorithms supported: 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kZSTD supported: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kXpressCompression supported: 0 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kZlibCompression supported: 1 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kSnappyCompression supported: 1 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kLZ4Compression supported: 1 2023-12-05T13:29:14.111 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: kBZip2Compression supported: 0 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi029/store.db/MANIFEST-000015 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.merge_operator: 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_filter: None 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56441fbcf700) 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: cache_index_and_filter_blocks: 1 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T13:29:14.112 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: pin_top_level_index_and_filter: 1 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: index_type: 0 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: data_block_index_type: 0 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: index_shortening: 1 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: checksum: 4 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: no_block_cache: 0 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache: 0x56441fc25090 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache_name: BinnedLRUCache 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache_options: 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: capacity : 536870912 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: num_shard_bits : 4 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: strict_capacity_limit : 0 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: high_pri_pool_ratio: 0.000 2023-12-05T13:29:14.113 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_cache_compressed: (nil) 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: persistent_cache: (nil) 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_size: 4096 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_size_deviation: 10 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_restart_interval: 16 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: index_block_restart_interval: 1 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: metadata_block_size: 4096 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: partition_filters: 0 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: use_delta_encoding: 1 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: filter_policy: bloomfilter 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: whole_key_filtering: 1 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: verify_compression: 0 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: read_amp_bytes_per_bit: 0 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: format_version: 5 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: enable_index_compression: 1 2023-12-05T13:29:14.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: block_align: 0 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: max_auto_readahead_size: 262144 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: prepopulate_block_cache: 0 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: initial_auto_readahead_size: 8192 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: num_file_reads_for_auto_readahead: 2 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression: NoCompression 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.num_levels: 7 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T13:29:14.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T13:29:14.116 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T13:29:14.118 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T13:29:14.119 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.arena_block_size: 1048576 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T13:29:14.120 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.table_properties_collectors: 2023-12-05T13:29:14.121 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.inplace_update_support: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.bloom_locality: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.max_successive_merges: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T13:29:14.122 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.ttl: 2592000 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.enable_blob_files: false 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.min_blob_size: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.blob_file_starting_level: 0 2023-12-05T13:29:14.123 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi029/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12150, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ef87cd41-1d1a-46a8-a762-6a69fbb39610 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782953701782, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782953709623, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1622057, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12151, "largest_seqno": 13623, "table_properties": {"data_size": 1615738, "index_size": 3704, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 15122, "raw_average_key_size": 23, "raw_value_size": 1602549, "raw_average_value_size": 2527, "num_data_blocks": 169, "num_entries": 634, "num_filter_entries": 634, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701782953, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ef87cd41-1d1a-46a8-a762-6a69fbb39610", "db_session_id": "QK61GOS53OO6E1ODGCS7", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782953709757, "job": 1, "event": "recovery_finished"} 2023-12-05T13:29:14.124 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi029/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56441fcc0000 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: DB pointer 0x56441fcac000 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** DB Stats ** 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:29:14.125 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** Compaction Stats [default] ** 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: L0 1/0 1.55 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 354.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: L6 1/0 6.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Sum 2/0 7.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 354.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 354.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** Compaction Stats [default] ** 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 354.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-05T13:29:14.126 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Cumulative compaction: 0.00 GB write, 141.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Interval compaction: 0.00 GB write, 141.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Block cache BinnedLRUCache@0x56441fc25090#7 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T13:29:14.127 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: starting mon.smithi029 rank 0 at public addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] at bind addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi029 fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???) e2 preinit fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).mds e13 new map 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).mds e13 print_map 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: e13 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: legacy client fscid: 1 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Filesystem 'cephfs' (1) 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: fs_name cephfs 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: epoch 11 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:29:14.128 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: tableserver 0 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: root 0 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: session_timeout 60 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: session_autoclose 300 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: max_file_size 1099511627776 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: max_xattr_size 65536 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: required_client_features {} 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: last_failure 0 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: last_failure_osd_epoch 0 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: max_mds 1 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: in 0 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: up {0=14478} 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: failed 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: damaged 2023-12-05T13:29:14.129 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: stopped 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: data_pools [3] 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: metadata_pool 2 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: inline_data disabled 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: balancer 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: bal_rank_mask -1 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: standby_count_wanted 1 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: [mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: Standby daemons: 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: [mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: [mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:14.130 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout: [mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:14.131 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-05T13:29:14.131 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T13:29:14.131 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T13:29:14.131 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T13:29:14.131 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:13 smithi029 ceph-mon[217405]: mon.smithi029@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: mon.smithi029 calling monitor election 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: mon.smithi029 is new leader, mons smithi029,smithi052 in quorum (ranks 0,1) 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: monmap e2: 2 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],smithi052=[v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T13:29:14.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: mgrmap e34: smithi029.eekhlu(active, since 2m), standbys: smithi052.ocazcp 2023-12-05T13:29:14.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: from='mgr.14708 ' entity='' 2023-12-05T13:29:14.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: mgrmap e35: smithi029.eekhlu(active, since 2m), standbys: smithi052.ocazcp 2023-12-05T13:29:14.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:14 smithi052 ceph-mon[121072]: overall HEALTH_OK 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: from='mgr.14708 172.21.15.29:0/600582384' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: mon.smithi029 calling monitor election 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: mon.smithi029 is new leader, mons smithi029,smithi052 in quorum (ranks 0,1) 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: monmap e2: 2 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],smithi052=[v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:29:14.760 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T13:29:14.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: mgrmap e34: smithi029.eekhlu(active, since 2m), standbys: smithi052.ocazcp 2023-12-05T13:29:14.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: from='mgr.14708 ' entity='' 2023-12-05T13:29:14.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: mgrmap e35: smithi029.eekhlu(active, since 2m), standbys: smithi052.ocazcp 2023-12-05T13:29:14.761 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:14 smithi029 ceph-mon[217405]: overall HEALTH_OK 2023-12-05T13:29:22.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-mon[121072]: Standby manager daemon smithi052.ocazcp restarted 2023-12-05T13:29:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-mon[121072]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:29:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:29:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:29:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:29:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-mon[121072]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:29:22.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:22 smithi029 ceph-mon[217405]: Standby manager daemon smithi052.ocazcp restarted 2023-12-05T13:29:22.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:22 smithi029 ceph-mon[217405]: Standby manager daemon smithi052.ocazcp started 2023-12-05T13:29:22.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:22 smithi029 ceph-mon[217405]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/crt"}]: dispatch 2023-12-05T13:29:22.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:22 smithi029 ceph-mon[217405]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T13:29:22.271 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:22 smithi029 ceph-mon[217405]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.ocazcp/key"}]: dispatch 2023-12-05T13:29:22.271 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:22 smithi029 ceph-mon[217405]: from='mgr.? 172.21.15.52:0/2075176122' entity='mgr.smithi052.ocazcp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T13:29:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:22 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052[121026]: 2023-12-05T13:29:22.130+0000 7f7481640700 -1 mon.smithi052@1(peon).osd e48 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: mgrmap e36: smithi029.eekhlu(active, since 2m), standbys: smithi052.ocazcp 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: mgrmap e37: smithi029.eekhlu(active, starting, since 0.00593291s), standbys: smithi052.ocazcp 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: failed to encode map e48 with expected crc 2023-12-05T13:29:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:29:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:29:23.356 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:23 smithi029 ceph-mon[217405]: failed to encode map e48 with expected crc 2023-12-05T13:29:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: mgrmap e36: smithi029.eekhlu(active, since 2m), standbys: smithi052.ocazcp 2023-12-05T13:29:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: Active manager daemon smithi029.eekhlu restarted 2023-12-05T13:29:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: Activating manager daemon smithi029.eekhlu 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: mgrmap e37: smithi029.eekhlu(active, starting, since 0.00593291s), standbys: smithi052.ocazcp 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: failed to encode map e48 with expected crc 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.jdhffk"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi029.pbbvzt"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.nbpymg"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dsxvue"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi029.eekhlu", "id": "smithi029.eekhlu"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr metadata", "who": "smithi052.ocazcp", "id": "smithi052.ocazcp"}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:29:23.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: Manager daemon smithi029.eekhlu is now available 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/mirror_snapshot_schedule"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi029.eekhlu/trash_purge_schedule"}]: dispatch 2023-12-05T13:29:23.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:23 smithi052 ceph-mon[121072]: failed to encode map e48 with expected crc 2023-12-05T13:29:24.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:24 smithi029 ceph-mon[217405]: [05/Dec/2023:13:29:22] ENGINE Bus STARTING 2023-12-05T13:29:24.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:24 smithi029 ceph-mon[217405]: [05/Dec/2023:13:29:22] ENGINE Serving on http://172.21.15.29:8765 2023-12-05T13:29:24.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:24 smithi029 ceph-mon[217405]: [05/Dec/2023:13:29:22] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:29:24.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:24 smithi029 ceph-mon[217405]: [05/Dec/2023:13:29:22] ENGINE Bus STARTED 2023-12-05T13:29:24.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:24 smithi029 ceph-mon[217405]: mgrmap e38: smithi029.eekhlu(active, since 1.01058s), standbys: smithi052.ocazcp 2023-12-05T13:29:24.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:24 smithi029 ceph-mon[217405]: pgmap v3: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:24.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:24 smithi052 ceph-mon[121072]: [05/Dec/2023:13:29:22] ENGINE Bus STARTING 2023-12-05T13:29:24.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:24 smithi052 ceph-mon[121072]: [05/Dec/2023:13:29:22] ENGINE Serving on http://172.21.15.29:8765 2023-12-05T13:29:24.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:24 smithi052 ceph-mon[121072]: [05/Dec/2023:13:29:22] ENGINE Serving on https://172.21.15.29:7150 2023-12-05T13:29:24.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:24 smithi052 ceph-mon[121072]: [05/Dec/2023:13:29:22] ENGINE Bus STARTED 2023-12-05T13:29:24.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:24 smithi052 ceph-mon[121072]: mgrmap e38: smithi029.eekhlu(active, since 1.01058s), standbys: smithi052.ocazcp 2023-12-05T13:29:24.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:24 smithi052 ceph-mon[121072]: pgmap v3: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:25.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:25 smithi029 ceph-mon[217405]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:25.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:25 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:25.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:25 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:25.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:25 smithi052 ceph-mon[121072]: pgmap v4: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:25.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:25 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:25.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:25 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:26.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:26 smithi029 ceph-mon[217405]: mgrmap e39: smithi029.eekhlu(active, since 3s), standbys: smithi052.ocazcp 2023-12-05T13:29:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:26 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:26 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:26.445 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:26 smithi052 ceph-mon[121072]: mgrmap e39: smithi029.eekhlu(active, since 3s), standbys: smithi052.ocazcp 2023-12-05T13:29:26.445 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:26 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:26.445 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:26 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:27.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:27 smithi052 ceph-mon[121072]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:27.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:27 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:27.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:27 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:27.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:27 smithi029 ceph-mon[217405]: pgmap v5: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:27.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:27 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:27.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:27 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:28.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:28 smithi029 ceph-mon[217405]: mgrmap e40: smithi029.eekhlu(active, since 5s), standbys: smithi052.ocazcp 2023-12-05T13:29:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:28 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:28 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:28.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:28 smithi052 ceph-mon[121072]: mgrmap e40: smithi029.eekhlu(active, since 5s), standbys: smithi052.ocazcp 2023-12-05T13:29:28.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:28 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:28.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:28 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:29.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:29 smithi052 ceph-mon[121072]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:29.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:29 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:29.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:29 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:29.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:29 smithi029 ceph-mon[217405]: pgmap v6: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:29.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:29 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:29.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:29 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:30.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:30 smithi029 ceph-mon[217405]: Detected new or changed devices on smithi052 2023-12-05T13:29:30.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:30 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi052 2023-12-05T13:29:31.169 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:31 smithi029 ceph-mon[217405]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-05T13:29:31.169 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:31 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:31.169 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:31 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:31 smithi052 ceph-mon[121072]: pgmap v7: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-05T13:29:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:31 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:31 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:31 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:31.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:31 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:31.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:31 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:31.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:31 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:32.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Detected new or changed devices on smithi029 2023-12-05T13:29:32.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:29:32.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:29:32.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:29:32.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:29:32.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:32.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:32 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T13:29:32.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Detected new or changed devices on smithi029 2023-12-05T13:29:32.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi029:/etc/ceph/ceph.conf 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi052:/etc/ceph/ceph.conf 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: Updating smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:32.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T13:29:33.468 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:33 smithi052 ceph-mon[121072]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-05T13:29:33.468 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:33 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:33.468 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:33 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:33.468 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:33 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:33.468 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:33 smithi052 ceph-mon[121072]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:33.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:33 smithi029 ceph-mon[217405]: pgmap v8: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-05T13:29:33.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:33.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:34.425 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:34 smithi052 ceph-mon[121072]: Upgrade: Updating mon.smithi052 2023-12-05T13:29:34.425 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:34 smithi052 ceph-mon[121072]: Deploying daemon mon.smithi052 on smithi052 2023-12-05T13:29:34.425 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:34 smithi052 systemd[1]: Stopping Ceph mon.smithi052 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:29:34.439 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:34 smithi029 ceph-mon[217405]: Upgrade: Updating mon.smithi052 2023-12-05T13:29:34.440 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:34 smithi029 ceph-mon[217405]: Deploying daemon mon.smithi052 on smithi052 2023-12-05T13:29:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052[121026]: 2023-12-05T13:29:34.422+0000 7f7486e4b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi052 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:29:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052[121026]: 2023-12-05T13:29:34.422+0000 7f7486e4b700 -1 mon.smithi052@1(peon) e2 *** Got Signal Terminated *** 2023-12-05T13:29:35.176 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:34 smithi052 bash[184205]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052 2023-12-05T13:29:35.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi052.service: Succeeded. 2023-12-05T13:29:35.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 systemd[1]: Stopped Ceph mon.smithi052 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:29:35.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 systemd[1]: Starting Ceph mon.smithi052 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:29:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev), process ceph-mon, pid 7 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: pidfile_write: ignore empty --pid-file 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 bash[184356]: 753ffd09473307b6fbe32385d52582b9f9e6217ff9968f447aaecfcc6734f0fa 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: load: jerasure load: lrc 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: RocksDB version: 7.9.2 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Git sha 0 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Compile date 2023-12-05 09:15:47 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: DB SUMMARY 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: DB Session ID: ZPF7S5UUARLWB6RTZ9VN 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: CURRENT file: CURRENT 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T13:29:36.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1096 Bytes 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi052/store.db dir, Total Num: 1, files: 000027.sst 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi052/store.db: 000025.log size: 5644395 ; 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.error_if_exists: 0 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.create_if_missing: 0 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.paranoid_checks: 1 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.env: 0x5652238aba60 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.fs: PosixFileSystem 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.info_log: 0x5652260e3600 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T13:29:36.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.statistics: (nil) 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.use_fsync: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_log_file_size: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.allow_fallocate: 1 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.use_direct_reads: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T13:29:36.226 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.db_log_dir: 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.wal_dir: 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.write_buffer_manager: 0x565226099360 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T13:29:36.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.unordered_write: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.row_cache: None 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.wal_filter: None 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.two_write_queues: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.wal_compression: 0 2023-12-05T13:29:36.228 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.atomic_flush: 0 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.log_readahead_size: 0 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T13:29:36.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_background_jobs: 2 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_background_compactions: -1 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_subcompactions: 1 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T13:29:36.231 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_open_files: -1 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_background_flushes: -1 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Compression algorithms supported: 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kZSTD supported: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kXpressCompression supported: 0 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T13:29:36.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kZlibCompression supported: 1 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kSnappyCompression supported: 1 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kLZ4Compression supported: 1 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: kBZip2Compression supported: 0 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000009 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.merge_operator: 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_filter: None 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T13:29:36.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5652260e3700) 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks: 1 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_top_level_index_and_filter: 1 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_type: 0 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_index_type: 0 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_shortening: 1 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: checksum: 4 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: no_block_cache: 0 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache: 0x565226139090 2023-12-05T13:29:36.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_name: BinnedLRUCache 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_options: 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: capacity : 536870912 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_shard_bits : 4 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: strict_capacity_limit : 0 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: high_pri_pool_ratio: 0.000 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_compressed: (nil) 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: persistent_cache: (nil) 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size: 4096 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size_deviation: 10 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_restart_interval: 16 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_block_restart_interval: 1 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: metadata_block_size: 4096 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: partition_filters: 0 2023-12-05T13:29:36.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: use_delta_encoding: 1 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: filter_policy: bloomfilter 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: whole_key_filtering: 1 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: verify_compression: 0 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: read_amp_bytes_per_bit: 0 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: format_version: 5 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_index_compression: 1 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_align: 0 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_auto_readahead_size: 262144 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: prepopulate_block_cache: 0 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: initial_auto_readahead_size: 8192 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_file_reads_for_auto_readahead: 2 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T13:29:36.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression: NoCompression 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.num_levels: 7 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T13:29:36.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 systemd[1]: Started Ceph mon.smithi052 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T13:29:36.238 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T13:29:36.239 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.arena_block_size: 1048576 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T13:29:36.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.table_properties_collectors: 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.inplace_update_support: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.bloom_locality: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.max_successive_merges: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T13:29:36.241 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.ttl: 2592000 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.enable_blob_files: false 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.min_blob_size: 0 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.blob_file_starting_level: 0 2023-12-05T13:29:36.242 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12400, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 58bc01d4-cd3e-4d5c-b4af-29ba5a2f5463 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782975745507, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782975760978, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3413151, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12405, "largest_seqno": 14573, "table_properties": {"data_size": 3404823, "index_size": 5132, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 20113, "raw_average_key_size": 23, "raw_value_size": 3387102, "raw_average_value_size": 3989, "num_data_blocks": 233, "num_entries": 849, "num_filter_entries": 849, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701782975, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "58bc01d4-cd3e-4d5c-b4af-29ba5a2f5463", "db_session_id": "ZPF7S5UUARLWB6RTZ9VN", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701782975761120, "job": 1, "event": "recovery_finished"} 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi052/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5652261d4000 2023-12-05T13:29:36.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: DB pointer 0x5652261c0000 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** DB Stats ** 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T13:29:36.244 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L0 1/0 3.26 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 560.7 0.01 0.00 1 0.006 0 0 0.0 0.0 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L6 1/0 6.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Sum 2/0 9.37 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 560.7 0.01 0.00 1 0.006 0 0 0.0 0.0 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 560.7 0.01 0.00 1 0.006 0 0 0.0 0.0 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 560.7 0.01 0.00 1 0.006 0 0 0.0 0.0 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.245 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-05T13:29:36.246 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.246 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Flush(GB): cumulative 0.003, interval 0.003 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative compaction: 0.00 GB write, 171.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval compaction: 0.00 GB write, 171.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Block cache BinnedLRUCache@0x565226139090#7 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2023-12-05T13:29:36.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: starting mon.smithi052 rank 1 at public addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] at bind addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi052 fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???) e2 preinit fsid 34f4f484-9370-11ee-95a2-87774f69a715 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).mds e13 new map 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).mds e13 print_map 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: e13 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: legacy client fscid: 1 2023-12-05T13:29:36.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Filesystem 'cephfs' (1) 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: fs_name cephfs 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: epoch 11 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:29:36.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: tableserver 0 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: root 0 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: session_timeout 60 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: session_autoclose 300 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_file_size 1099511627776 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_xattr_size 65536 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: required_client_features {} 2023-12-05T13:29:36.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: last_failure 0 2023-12-05T13:29:36.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: last_failure_osd_epoch 0 2023-12-05T13:29:36.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:36.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_mds 1 2023-12-05T13:29:36.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: in 0 2023-12-05T13:29:36.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: up {0=14478} 2023-12-05T13:29:36.252 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: failed 2023-12-05T13:29:36.252 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: damaged 2023-12-05T13:29:36.252 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: stopped 2023-12-05T13:29:36.252 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_pools [3] 2023-12-05T13:29:36.252 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: metadata_pool 2 2023-12-05T13:29:36.252 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: inline_data disabled 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: balancer 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: bal_rank_mask -1 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: standby_count_wanted 1 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Standby daemons: 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2023-12-05T13:29:36.253 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T13:29:36.254 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:35 smithi052 ceph-mon[184394]: mon.smithi052@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-05T13:29:37.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: pgmap v10: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: overall HEALTH_OK 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: mon.smithi029 calling monitor election 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: mon.smithi052 calling monitor election 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: mon.smithi029 is new leader, mons smithi029,smithi052 in quorum (ranks 0,1) 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: monmap e3: 2 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],smithi052=[v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:29:37.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: mgrmap e40: smithi029.eekhlu(active, since 14s), standbys: smithi052.ocazcp 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: overall HEALTH_OK 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: pgmap v10: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: overall HEALTH_OK 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi029"}]: dispatch 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: mon.smithi029 calling monitor election 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: mon.smithi052 calling monitor election 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: mon.smithi029 is new leader, mons smithi029,smithi052 in quorum (ranks 0,1) 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: monmap e3: 2 mons at {smithi029=[v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0],smithi052=[v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: fsmap cephfs:1 {0=cephfs.smithi029.jdhffk=up:active} 3 up:standby 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: mgrmap e40: smithi029.eekhlu(active, since 14s), standbys: smithi052.ocazcp 2023-12-05T13:29:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: overall HEALTH_OK 2023-12-05T13:29:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:29:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:37.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:38.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:38 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:38.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:38 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:39.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:39 smithi052 ceph-mon[184394]: pgmap v11: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T13:29:39.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:39 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:39.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:39 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:39.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:39 smithi029 ceph-mon[217405]: pgmap v11: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T13:29:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:39 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:39 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:40.660 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:40 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:40.660 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:40 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:40.661 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:40 smithi052 ceph-mon[184394]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T13:29:40.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:40 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:40.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:40 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:40.773 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:40 smithi029 ceph-mon[217405]: pgmap v12: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T13:29:42.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.614+0000 7f026df3d700 1 -- 172.21.15.29:0/901276045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 msgr2=0x7f0268102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.614+0000 7f026df3d700 1 --2- 172.21.15.29:0/901276045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f0268102ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0258004940 tx=0x7f0258009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.614+0000 7f026df3d700 1 -- 172.21.15.29:0/901276045 shutdown_connections 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 --2- 172.21.15.29:0/901276045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0268065390 0x7f0268065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 --2- 172.21.15.29:0/901276045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f0268102ff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 -- 172.21.15.29:0/901276045 >> 172.21.15.29:0/901276045 conn(0x7f02680719b0 msgr2=0x7f0268071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 -- 172.21.15.29:0/901276045 shutdown_connections 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 -- 172.21.15.29:0/901276045 wait complete. 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 Processor -- start 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.615+0000 7f026df3d700 1 -- start start 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f026df3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0268065390 0x7f02680fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:42.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f026df3d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f02680fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f026df3d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680fc6c0 con 0x7f0268102c20 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f026df3d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02680fc830 con 0x7f0268065390 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f02680fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f02680fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40190/0 (socket says 172.21.15.29:40190) 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 -- 172.21.15.29:0/3541001575 learned_addr learned my addr 172.21.15.29:0/3541001575 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f02677fe700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0268065390 0x7f02680fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 -- 172.21.15.29:0/3541001575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0268065390 msgr2=0x7f02680fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0268065390 0x7f02680fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 -- 172.21.15.29:0/3541001575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258005040 con 0x7f0268102c20 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.616+0000 7f0266ffd700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f02680fc130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f025c002a50 tx=0x7f025c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.617+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025c007cc0 con 0x7f0268102c20 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.617+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f025c00f040 con 0x7f0268102c20 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.617+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0268119910 con 0x7f0268102c20 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.617+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025c00d9c0 con 0x7f0268102c20 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.617+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268119d70 con 0x7f0268102c20 2023-12-05T13:29:42.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.618+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02680fff40 con 0x7f0268102c20 2023-12-05T13:29:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.619+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f025c00db20 con 0x7f0268102c20 2023-12-05T13:29:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.619+0000 7f024ffff700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f025006cf80 0x7f025006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.619+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f025c08c8a0 con 0x7f0268102c20 2023-12-05T13:29:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.620+0000 7f02677fe700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f025006cf80 0x7f025006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:42.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.620+0000 7f02677fe700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f025006cf80 0x7f025006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0258004f90 tx=0x7f0258009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:42.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.624+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f025c056690 con 0x7f0268102c20 2023-12-05T13:29:42.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.866+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f026804bb80 con 0x7f025006cf80 2023-12-05T13:29:42.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.868+0000 7f024ffff700 1 -- 172.21.15.29:0/3541001575 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f026804bb80 con 0x7f025006cf80 2023-12-05T13:29:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f025006cf80 msgr2=0x7f025006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f025006cf80 0x7f025006f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0258004f90 tx=0x7f0258009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:42.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 msgr2=0x7f02680fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f02680fc130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f025c002a50 tx=0x7f025c0046b0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 shutdown_connections 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f025006cf80 0x7f025006f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0268065390 0x7f02680fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 --2- 172.21.15.29:0/3541001575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0268102c20 0x7f02680fc130 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 >> 172.21.15.29:0/3541001575 conn(0x7f02680719b0 msgr2=0x7f02680fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 shutdown_connections 2023-12-05T13:29:42.872 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.870+0000 7f026df3d700 1 -- 172.21.15.29:0/3541001575 wait complete. 2023-12-05T13:29:42.885 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:29:42.988 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2636303386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a240fbb40 msgr2=0x7f6a240fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2636303386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a240fbb40 0x7f6a240fbfb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a18004940 tx=0x7f6a18009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2636303386 shutdown_connections 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2636303386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a240fbb40 0x7f6a240fbfb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2636303386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24101b00 0x7f6a24101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2636303386 >> 172.21.15.29:0/2636303386 conn(0x7f6a240f76c0 msgr2=0x7f6a240f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2636303386 shutdown_connections 2023-12-05T13:29:42.989 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.987+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2636303386 wait complete. 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a2a44a700 1 Processor -- start 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a2a44a700 1 -- start start 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a2a44a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a240fbb40 0x7f6a2410e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a2a44a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 0x7f6a2410ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a2a44a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2410f160 con 0x7f6a24101b00 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a2a44a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2410f2a0 con 0x7f6a240fbb40 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 0x7f6a2410ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a237fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 0x7f6a2410ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40204/0 (socket says 172.21.15.29:40204) 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.988+0000 7f6a237fe700 1 -- 172.21.15.29:0/2395670664 learned_addr learned my addr 172.21.15.29:0/2395670664 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a23fff700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a240fbb40 0x7f6a2410e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a237fe700 1 -- 172.21.15.29:0/2395670664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a240fbb40 msgr2=0x7f6a2410e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:42.991 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a237fe700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a240fbb40 0x7f6a2410e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a237fe700 1 -- 172.21.15.29:0/2395670664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18005040 con 0x7f6a24101b00 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a23fff700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a240fbb40 0x7f6a2410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a237fe700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 0x7f6a2410ebd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a18008d80 tx=0x7f6a18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1800e030 con 0x7f6a24101b00 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a18004290 con 0x7f6a24101b00 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1801ce60 con 0x7f6a24101b00 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a241175a0 con 0x7f6a24101b00 2023-12-05T13:29:42.992 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.989+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a24117a60 con 0x7f6a24101b00 2023-12-05T13:29:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.990+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24103fb0 con 0x7f6a24101b00 2023-12-05T13:29:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.991+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f6a1801c690 con 0x7f6a24101b00 2023-12-05T13:29:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.991+0000 7f6a20ff9700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6a0c06cf80 0x7f6a0c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.991+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f6a1808dd20 con 0x7f6a24101b00 2023-12-05T13:29:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.991+0000 7f6a23fff700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6a0c06cf80 0x7f6a0c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:42.993 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.992+0000 7f6a23fff700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6a0c06cf80 0x7f6a0c06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004600 tx=0x7f6a1400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:42.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:42.996+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6a18057ba0 con 0x7f6a24101b00 2023-12-05T13:29:43.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.232+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a24066400 con 0x7f6a0c06cf80 2023-12-05T13:29:43.235 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.233+0000 7f6a20ff9700 1 -- 172.21.15.29:0/2395670664 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6a24066400 con 0x7f6a0c06cf80 2023-12-05T13:29:43.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6a0c06cf80 msgr2=0x7f6a0c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.237 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6a0c06cf80 0x7f6a0c06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004600 tx=0x7f6a1400b040 comp rx=0 tx=0).stop 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 msgr2=0x7f6a2410ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 0x7f6a2410ebd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a18008d80 tx=0x7f6a18009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 shutdown_connections 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6a0c06cf80 0x7f6a0c06f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a240fbb40 0x7f6a2410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 --2- 172.21.15.29:0/2395670664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a24101b00 0x7f6a2410ebd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 >> 172.21.15.29:0/2395670664 conn(0x7f6a240f76c0 msgr2=0x7f6a240f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 shutdown_connections 2023-12-05T13:29:43.238 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.237+0000 7f6a2a44a700 1 -- 172.21.15.29:0/2395670664 wait complete. 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 -- 172.21.15.29:0/1191867403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 msgr2=0x7f81e4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1191867403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4101ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81d4004940 tx=0x7f81d4009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 -- 172.21.15.29:0/1191867403 shutdown_connections 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1191867403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e40fbb40 0x7f81e40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1191867403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4101ed0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 -- 172.21.15.29:0/1191867403 >> 172.21.15.29:0/1191867403 conn(0x7f81e40719b0 msgr2=0x7f81e4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:43.351 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 -- 172.21.15.29:0/1191867403 shutdown_connections 2023-12-05T13:29:43.352 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.349+0000 7f81ea61f700 1 -- 172.21.15.29:0/1191867403 wait complete. 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.350+0000 7f81ea61f700 1 Processor -- start 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.350+0000 7f81ea61f700 1 -- start start 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81ea61f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e40fbb40 0x7f81e4112550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81ea61f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81ea61f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e41130e0 con 0x7f81e4101b00 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81ea61f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e410c410 con 0x7f81e40fbb40 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40224/0 (socket says 172.21.15.29:40224) 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 -- 172.21.15.29:0/1028855134 learned_addr learned my addr 172.21.15.29:0/1028855134 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e3fff700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e40fbb40 0x7f81e4112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:43.353 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 -- 172.21.15.29:0/1028855134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e40fbb40 msgr2=0x7f81e4112550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e40fbb40 0x7f81e4112550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 -- 172.21.15.29:0/1028855134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e4101b00 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.351+0000 7f81e37fe700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4112a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c830 tx=0x7f81d8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.352+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d80106f0 con 0x7f81e4101b00 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.352+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81d8010d00 con 0x7f81e4101b00 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.352+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e410c6f0 con 0x7f81e4101b00 2023-12-05T13:29:43.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.352+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d8012e90 con 0x7f81e4101b00 2023-12-05T13:29:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.352+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e410cc30 con 0x7f81e4101b00 2023-12-05T13:29:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.353+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e4103fb0 con 0x7f81e4101b00 2023-12-05T13:29:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.353+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f81d8010850 con 0x7f81e4101b00 2023-12-05T13:29:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.354+0000 7f81e0ff9700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f81cc06cf80 0x7f81cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.354+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f81d808c2f0 con 0x7f81e4101b00 2023-12-05T13:29:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.354+0000 7f81e3fff700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f81cc06cf80 0x7f81cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.354+0000 7f81e3fff700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f81cc06cf80 0x7f81cc06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b3b0 tx=0x7f81d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:43.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.359+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f81d8059d10 con 0x7f81e4101b00 2023-12-05T13:29:43.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.598+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81e4112220 con 0x7f81cc06cf80 2023-12-05T13:29:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: Reconfiguring mon.smithi029 (monmap changed)... 2023-12-05T13:29:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:43.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:43 smithi029 ceph-mon[217405]: Reconfiguring daemon mon.smithi029 on smithi029 2023-12-05T13:29:43.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.610+0000 7f81e0ff9700 1 -- 172.21.15.29:0/1028855134 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f81e4112220 con 0x7f81cc06cf80 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (87s) 16s ago 10m 17.8M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (11m) 16s ago 11m 7444k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c2941f474a26 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (10m) 4s ago 10m 7486k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc fb1ccfecda40 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (75s) 16s ago 10m 81.4M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (6m) 16s ago 6m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (6m) 16s ago 6m 18.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (6m) 4s ago 6m 18.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (6m) 4s ago 6m 18.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:29:43.612 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (2m) 16s ago 12m 480M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (2m) 4s ago 10m 447M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (30s) 16s ago 12m 31.2M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (8s) 4s ago 10m 27.8M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (118s) 16s ago 11m 15.9M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (115s) 4s ago 10m 17.1M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (9m) 16s ago 9m 838M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (9m) 16s ago 9m 944M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (8m) 16s ago 8m 751M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (8m) 4s ago 8m 1114M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (8m) 4s ago 8m 795M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (7m) 4s ago 7m 974M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:29:43.613 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (99s) 16s ago 10m 53.3M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f81cc06cf80 msgr2=0x7f81cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f81cc06cf80 0x7f81cc06f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b3b0 tx=0x7f81d4009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 msgr2=0x7f81e4112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4112a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c830 tx=0x7f81d8004470 comp rx=0 tx=0).stop 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 shutdown_connections 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f81cc06cf80 0x7f81cc06f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e40fbb40 0x7f81e4112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 --2- 172.21.15.29:0/1028855134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4101b00 0x7f81e4112a90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 >> 172.21.15.29:0/1028855134 conn(0x7f81e40719b0 msgr2=0x7f81e40fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 shutdown_connections 2023-12-05T13:29:43.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.612+0000 7f81ea61f700 1 -- 172.21.15.29:0/1028855134 wait complete. 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: pgmap v13: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: Reconfiguring mon.smithi029 (monmap changed)... 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:43.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:43.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:43 smithi052 ceph-mon[184394]: Reconfiguring daemon mon.smithi029 on smithi029 2023-12-05T13:29:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 -- 172.21.15.29:0/1787329240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 msgr2=0x7f436c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 --2- 172.21.15.29:0/1787329240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c0703b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4368004970 tx=0x7f4368009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:43.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 -- 172.21.15.29:0/1787329240 shutdown_connections 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 --2- 172.21.15.29:0/1787329240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 0x7f436c108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 --2- 172.21.15.29:0/1787329240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c0703b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 -- 172.21.15.29:0/1787329240 >> 172.21.15.29:0/1787329240 conn(0x7f436c0f8790 msgr2=0x7f436c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 -- 172.21.15.29:0/1787329240 shutdown_connections 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.731+0000 7f4373a5e700 1 -- 172.21.15.29:0/1787329240 wait complete. 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.732+0000 7f4373a5e700 1 Processor -- start 2023-12-05T13:29:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.732+0000 7f4373a5e700 1 -- start start 2023-12-05T13:29:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.732+0000 7f4373a5e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c1157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.732+0000 7f4373a5e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 0x7f436c115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.732+0000 7f4373a5e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c116380 con 0x7f436c06ffe0 2023-12-05T13:29:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.732+0000 7f4373a5e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c10f6b0 con 0x7f436c0708f0 2023-12-05T13:29:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c1157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c1157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40244/0 (socket says 172.21.15.29:40244) 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 -- 172.21.15.29:0/3752927877 learned_addr learned my addr 172.21.15.29:0/3752927877 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f4370ff9700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 0x7f436c115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 -- 172.21.15.29:0/3752927877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 msgr2=0x7f436c115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 0x7f436c115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 -- 172.21.15.29:0/3752927877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368005040 con 0x7f436c06ffe0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f4370ff9700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 0x7f436c115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f43717fa700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c1157f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4368004f50 tx=0x7f4368009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436800e040 con 0x7f436c06ffe0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f436800bc10 con 0x7f436c06ffe0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436801c630 con 0x7f436c06ffe0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.733+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c10f930 con 0x7f436c06ffe0 2023-12-05T13:29:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.734+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c10fe70 con 0x7f436c06ffe0 2023-12-05T13:29:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.735+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c1065d0 con 0x7f436c06ffe0 2023-12-05T13:29:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.735+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f4368013420 con 0x7f436c06ffe0 2023-12-05T13:29:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.736+0000 7f4361ffb700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f435806cf80 0x7f435806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.736+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f436808d8b0 con 0x7f436c06ffe0 2023-12-05T13:29:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.736+0000 7f4370ff9700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f435806cf80 0x7f435806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:43.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.736+0000 7f4370ff9700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f435806cf80 0x7f435806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f435c007fd0 tx=0x7f435c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:43.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:43.741+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f436805b120 con 0x7f436c06ffe0 2023-12-05T13:29:44.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.060+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f436c04bb80 con 0x7f436c06ffe0 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.060+0000 7f4361ffb700 1 -- 172.21.15.29:0/3752927877 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f4368013e60 con 0x7f436c06ffe0 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:29:44.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 10, 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 4 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:29:44.063 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f435806cf80 msgr2=0x7f435806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f435806cf80 0x7f435806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f435c007fd0 tx=0x7f435c009040 comp rx=0 tx=0).stop 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 msgr2=0x7f436c1157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c1157f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4368004f50 tx=0x7f4368009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 shutdown_connections 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f435806cf80 0x7f435806f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.062+0000 7f4373a5e700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06ffe0 0x7f436c1157f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.063+0000 7f4373a5e700 1 --2- 172.21.15.29:0/3752927877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f436c0708f0 0x7f436c115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.063+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 >> 172.21.15.29:0/3752927877 conn(0x7f436c0f8790 msgr2=0x7f436c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:44.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.063+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 shutdown_connections 2023-12-05T13:29:44.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.063+0000 7f4373a5e700 1 -- 172.21.15.29:0/3752927877 wait complete. 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 -- 172.21.15.29:0/620840341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 msgr2=0x7fa9b00fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/620840341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b00fbfb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa998004940 tx=0x7fa998009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 -- 172.21.15.29:0/620840341 shutdown_connections 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/620840341 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b00fbfb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/620840341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b0101b00 0x7fa9b0101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 -- 172.21.15.29:0/620840341 >> 172.21.15.29:0/620840341 conn(0x7fa9b00719b0 msgr2=0x7fa9b0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 -- 172.21.15.29:0/620840341 shutdown_connections 2023-12-05T13:29:44.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.180+0000 7fa9b4a67700 1 -- 172.21.15.29:0/620840341 wait complete. 2023-12-05T13:29:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.181+0000 7fa9b4a67700 1 Processor -- start 2023-12-05T13:29:44.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.181+0000 7fa9b4a67700 1 -- start start 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9b4a67700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b01124e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9b4a67700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b0101b00 0x7fa9b0112a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9b4a67700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0113070 con 0x7fa9b00fbb40 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9b4a67700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b010c3a0 con 0x7fa9b0101b00 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b01124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b01124e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40260/0 (socket says 172.21.15.29:40260) 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 -- 172.21.15.29:0/2871026891 learned_addr learned my addr 172.21.15.29:0/2871026891 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9add9b700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b0101b00 0x7fa9b0112a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 -- 172.21.15.29:0/2871026891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b0101b00 msgr2=0x7fa9b0112a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b0101b00 0x7fa9b0112a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 -- 172.21.15.29:0/2871026891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998005040 con 0x7fa9b00fbb40 2023-12-05T13:29:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.182+0000 7fa9ae59c700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b01124e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000eb70 tx=0x7fa9a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.183+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9a0007cc0 con 0x7fa9b00fbb40 2023-12-05T13:29:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.183+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9a000f040 con 0x7fa9b00fbb40 2023-12-05T13:29:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.183+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b010c620 con 0x7fa9b00fbb40 2023-12-05T13:29:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.183+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9a000c9f0 con 0x7fa9b00fbb40 2023-12-05T13:29:44.185 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.183+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b010cb60 con 0x7fa9b00fbb40 2023-12-05T13:29:44.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.184+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b0103fb0 con 0x7fa9b00fbb40 2023-12-05T13:29:44.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.184+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fa9a000cb50 con 0x7fa9b00fbb40 2023-12-05T13:29:44.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.186+0000 7fa9a6ffd700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa99c06cf80 0x7fa99c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.186+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fa9a008bf90 con 0x7fa9b00fbb40 2023-12-05T13:29:44.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.186+0000 7fa9add9b700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa99c06cf80 0x7fa99c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.187 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.186+0000 7fa9add9b700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa99c06cf80 0x7fa99c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa9b010dd80 tx=0x7fa998009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:44.191 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.190+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa9a0059800 con 0x7fa9b00fbb40 2023-12-05T13:29:44.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.452+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa9b0073520 con 0x7fa9b00fbb40 2023-12-05T13:29:44.453 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.453+0000 7fa9a6ffd700 1 -- 172.21.15.29:0/2871026891 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fa9a0059390 con 0x7fa9b00fbb40 2023-12-05T13:29:44.453 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:29:44.453 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:29:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:29:44.455 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:44.456 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa99c06cf80 msgr2=0x7fa99c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa99c06cf80 0x7fa99c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa9b010dd80 tx=0x7fa998009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 msgr2=0x7fa9b01124e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b01124e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000eb70 tx=0x7fa9a000b040 comp rx=0 tx=0).stop 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 shutdown_connections 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa99c06cf80 0x7fa99c06f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9b00fbb40 0x7fa9b01124e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 --2- 172.21.15.29:0/2871026891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b0101b00 0x7fa9b0112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 >> 172.21.15.29:0/2871026891 conn(0x7fa9b00719b0 msgr2=0x7fa9b00faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:44.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 shutdown_connections 2023-12-05T13:29:44.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.455+0000 7fa9b4a67700 1 -- 172.21.15.29:0/2871026891 wait complete. 2023-12-05T13:29:44.458 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:29:44.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 -- 172.21.15.29:0/222785024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 msgr2=0x7f3774101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 --2- 172.21.15.29:0/222785024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774101ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3764004940 tx=0x7f3764009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:44.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 -- 172.21.15.29:0/222785024 shutdown_connections 2023-12-05T13:29:44.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 --2- 172.21.15.29:0/222785024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37740fbb40 0x7f37740fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.578 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 --2- 172.21.15.29:0/222785024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774101ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 -- 172.21.15.29:0/222785024 >> 172.21.15.29:0/222785024 conn(0x7f37740f76c0 msgr2=0x7f37740f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:44.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.577+0000 7f377bb32700 1 -- 172.21.15.29:0/222785024 shutdown_connections 2023-12-05T13:29:44.579 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 -- 172.21.15.29:0/222785024 wait complete. 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 Processor -- start 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 -- start start 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37740fbb40 0x7f37741158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774116450 con 0x7f3774101b00 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f377bb32700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377410f780 con 0x7f37740fbb40 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.578+0000 7f37790cd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37790cd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40268/0 (socket says 172.21.15.29:40268) 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37790cd700 1 -- 172.21.15.29:0/180695482 learned_addr learned my addr 172.21.15.29:0/180695482 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37798ce700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37740fbb40 0x7f37741158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37790cd700 1 -- 172.21.15.29:0/180695482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37740fbb40 msgr2=0x7f37741158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.580 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37790cd700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37740fbb40 0x7f37741158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37790cd700 1 -- 172.21.15.29:0/180695482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764005040 con 0x7f3774101b00 2023-12-05T13:29:44.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.579+0000 7f37790cd700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774115e00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f376800c830 tx=0x7f3768004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:44.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.580+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37680106f0 con 0x7f3774101b00 2023-12-05T13:29:44.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.581+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3768010d00 con 0x7f3774101b00 2023-12-05T13:29:44.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.581+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377410fa60 con 0x7f3774101b00 2023-12-05T13:29:44.581 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.581+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377410ffa0 con 0x7f3774101b00 2023-12-05T13:29:44.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.581+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3768012e90 con 0x7f3774101b00 2023-12-05T13:29:44.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.582+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740fb2c0 con 0x7f3774101b00 2023-12-05T13:29:44.582 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.582+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f3768010850 con 0x7f3774101b00 2023-12-05T13:29:44.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.582+0000 7f37727fc700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f375c06cf80 0x7f375c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.583+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f376808c320 con 0x7f3774101b00 2023-12-05T13:29:44.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.583+0000 7f37798ce700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f375c06cf80 0x7f375c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.583 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.583+0000 7f37798ce700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f375c06cf80 0x7f375c06f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f37640043d0 tx=0x7f3764009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:44.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.587+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3768059ca0 con 0x7f3774101b00 2023-12-05T13:29:44.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:44.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:44.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:44.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:29:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:29:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:44.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:44 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3752927877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi029.eekhlu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:44.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:44 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3752927877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:29:44.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.824+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f377404bb80 con 0x7f375c06cf80 2023-12-05T13:29:44.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.825+0000 7f37727fc700 1 -- 172.21.15.29:0/180695482 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f377404bb80 con 0x7f375c06cf80 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "4/21 daemons upgraded", 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading mon daemons", 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:29:44.826 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f375c06cf80 msgr2=0x7f375c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f375c06cf80 0x7f375c06f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f37640043d0 tx=0x7f3764009e30 comp rx=0 tx=0).stop 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 msgr2=0x7f3774115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774115e00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f376800c830 tx=0x7f3768004470 comp rx=0 tx=0).stop 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 shutdown_connections 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f375c06cf80 0x7f375c06f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37740fbb40 0x7f37741158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 --2- 172.21.15.29:0/180695482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3774101b00 0x7f3774115e00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.827+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 >> 172.21.15.29:0/180695482 conn(0x7f37740f76c0 msgr2=0x7f3774065e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.828+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 shutdown_connections 2023-12-05T13:29:44.829 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.828+0000 7f377bb32700 1 -- 172.21.15.29:0/180695482 wait complete. 2023-12-05T13:29:44.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.946+0000 7f65b8353700 1 -- 172.21.15.29:0/4066984541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0102c20 msgr2=0x7f65b0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.946+0000 7f65b8353700 1 --2- 172.21.15.29:0/4066984541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0102c20 0x7f65b0102ff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009ce0 tx=0x7f65a8004d10 comp rx=0 tx=0).stop 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- 172.21.15.29:0/4066984541 shutdown_connections 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 --2- 172.21.15.29:0/4066984541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65b0065390 0x7f65b0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 --2- 172.21.15.29:0/4066984541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0102c20 0x7f65b0102ff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- 172.21.15.29:0/4066984541 >> 172.21.15.29:0/4066984541 conn(0x7f65b00719b0 msgr2=0x7f65b0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- 172.21.15.29:0/4066984541 shutdown_connections 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- 172.21.15.29:0/4066984541 wait complete. 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 Processor -- start 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- start start 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 0x7f65b00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65b0102c20 0x7f65b00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00fc730 con 0x7f65b0065390 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.947+0000 7f65b8353700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00fc8a0 con 0x7f65b0102c20 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 0x7f65b00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 0x7f65b00fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40284/0 (socket says 172.21.15.29:40284) 2023-12-05T13:29:44.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 -- 172.21.15.29:0/2572059122 learned_addr learned my addr 172.21.15.29:0/2572059122 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:29:44.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 -- 172.21.15.29:0/2572059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65b0102c20 msgr2=0x7f65b00fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:44.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65b0102c20 0x7f65b00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:44.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 -- 172.21.15.29:0/2572059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009940 con 0x7f65b0065390 2023-12-05T13:29:44.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b60ef700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 0x7f65b00fbbf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009360 tx=0x7f65a8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a800e040 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b0119910 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65a8004610 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a8012b70 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.948+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b0119d70 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.949+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b00fff40 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.950+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f65a801c830 con 0x7f65b0065390 2023-12-05T13:29:44.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.950+0000 7f65aeffd700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f659806cf80 0x7f659806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:29:44.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.950+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f65a808e8f0 con 0x7f65b0065390 2023-12-05T13:29:44.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.950+0000 7f65b58ee700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f659806cf80 0x7f659806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:29:44.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.951+0000 7f65b58ee700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f659806cf80 0x7f659806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65b00fd5f0 tx=0x7f65a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:29:44.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:44.955+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f65a8058650 con 0x7f65b0065390 2023-12-05T13:29:45.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.267+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f65b00734d0 con 0x7f65b0065390 2023-12-05T13:29:45.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.268+0000 7f65aeffd700 1 -- 172.21.15.29:0/2572059122 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f65a805bc70 con 0x7f65b0065390 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_OK 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.270+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f659806cf80 msgr2=0x7f659806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.270+0000 7f65b8353700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f659806cf80 0x7f659806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f65b00fd5f0 tx=0x7f65a400b040 comp rx=0 tx=0).stop 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.270+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 msgr2=0x7f65b00fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.270+0000 7f65b8353700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 0x7f65b00fbbf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009360 tx=0x7f65a8004d10 comp rx=0 tx=0).stop 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 shutdown_connections 2023-12-05T13:29:45.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f659806cf80 0x7f659806f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:45.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65b0065390 0x7f65b00fbbf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:45.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 --2- 172.21.15.29:0/2572059122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65b0102c20 0x7f65b00fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:29:45.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 >> 172.21.15.29:0/2572059122 conn(0x7f65b00719b0 msgr2=0x7f65b00fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:29:45.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 shutdown_connections 2023-12-05T13:29:45.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:29:45.271+0000 7f65b8353700 1 -- 172.21.15.29:0/2572059122 wait complete. 2023-12-05T13:29:45.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: Reconfiguring mgr.smithi029.eekhlu (monmap changed)... 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: Reconfiguring daemon mgr.smithi029.eekhlu on smithi029 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2871026891' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:29:45.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:45 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: Reconfiguring mgr.smithi029.eekhlu (monmap changed)... 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: Reconfiguring daemon mgr.smithi029.eekhlu on smithi029 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: pgmap v14: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2871026891' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:45.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:45.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:29:45.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:45 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:46.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: Reconfiguring crash.smithi029 (monmap changed)... 2023-12-05T13:29:46.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: Reconfiguring daemon crash.smithi029 on smithi029 2023-12-05T13:29:46.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:46.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2572059122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:29:46.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:46.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:46.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T13:29:46.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:46 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: Reconfiguring crash.smithi029 (monmap changed)... 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: Reconfiguring daemon crash.smithi029 on smithi029 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2572059122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T13:29:46.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:46 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: Reconfiguring osd.0 (monmap changed)... 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: Reconfiguring daemon osd.0 on smithi029 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T13:29:47.487 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:47 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: Reconfiguring osd.0 (monmap changed)... 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: Reconfiguring daemon osd.0 on smithi029 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: pgmap v15: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T13:29:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:47 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:48.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:48 smithi029 ceph-mon[217405]: Reconfiguring osd.1 (monmap changed)... 2023-12-05T13:29:48.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:48 smithi029 ceph-mon[217405]: Reconfiguring daemon osd.1 on smithi029 2023-12-05T13:29:48.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:48.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:48.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T13:29:48.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:48 smithi052 ceph-mon[184394]: Reconfiguring osd.1 (monmap changed)... 2023-12-05T13:29:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:48 smithi052 ceph-mon[184394]: Reconfiguring daemon osd.1 on smithi029 2023-12-05T13:29:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:48.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T13:29:48.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:49.523 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: Reconfiguring osd.2 (monmap changed)... 2023-12-05T13:29:49.524 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: Reconfiguring daemon osd.2 on smithi029 2023-12-05T13:29:49.524 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:49.524 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:49.524 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:49.524 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.jdhffk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:49.524 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:49 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: Reconfiguring osd.2 (monmap changed)... 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: Reconfiguring daemon osd.2 on smithi029 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: pgmap v16: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.jdhffk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:49 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:50.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:50 smithi029 ceph-mon[217405]: Reconfiguring mds.cephfs.smithi029.jdhffk (monmap changed)... 2023-12-05T13:29:50.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:50 smithi029 ceph-mon[217405]: Reconfiguring daemon mds.cephfs.smithi029.jdhffk on smithi029 2023-12-05T13:29:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:50 smithi052 ceph-mon[184394]: Reconfiguring mds.cephfs.smithi029.jdhffk (monmap changed)... 2023-12-05T13:29:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:50 smithi052 ceph-mon[184394]: Reconfiguring daemon mds.cephfs.smithi029.jdhffk on smithi029 2023-12-05T13:29:51.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: Reconfiguring mds.cephfs.smithi029.pbbvzt (monmap changed)... 2023-12-05T13:29:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.pbbvzt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:51 smithi029 ceph-mon[217405]: Reconfiguring daemon mds.cephfs.smithi029.pbbvzt on smithi029 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: pgmap v17: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: Reconfiguring mds.cephfs.smithi029.pbbvzt (monmap changed)... 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi029.pbbvzt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:51 smithi052 ceph-mon[184394]: Reconfiguring daemon mds.cephfs.smithi029.pbbvzt on smithi029 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: Reconfiguring crash.smithi052 (monmap changed)... 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: Reconfiguring daemon crash.smithi052 on smithi052 2023-12-05T13:29:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:52.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:52.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:52.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: Reconfiguring crash.smithi052 (monmap changed)... 2023-12-05T13:29:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:29:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: Reconfiguring daemon crash.smithi052 on smithi052 2023-12-05T13:29:52.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:29:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:53 smithi052 ceph-mon[184394]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:29:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:29:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:53 smithi029 ceph-mon[217405]: pgmap v18: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.ocazcp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T13:29:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T13:29:53.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: Reconfiguring mgr.smithi052.ocazcp (monmap changed)... 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: Reconfiguring daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: Reconfiguring mgr.smithi052.ocazcp (monmap changed)... 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: Reconfiguring daemon mgr.smithi052.ocazcp on smithi052 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T13:29:54.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: Reconfiguring mon.smithi052 (monmap changed)... 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: Reconfiguring daemon mon.smithi052 on smithi052 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T13:29:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:55 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: Reconfiguring mon.smithi052 (monmap changed)... 2023-12-05T13:29:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: Reconfiguring daemon mon.smithi052 on smithi052 2023-12-05T13:29:55.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: pgmap v19: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:55.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:55.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:55.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T13:29:55.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:55 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:56.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:56 smithi052 ceph-mon[184394]: Reconfiguring osd.3 (monmap changed)... 2023-12-05T13:29:56.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:56 smithi052 ceph-mon[184394]: Reconfiguring daemon osd.3 on smithi052 2023-12-05T13:29:56.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:56 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:56.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:56 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:56.632 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:56 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T13:29:56.633 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:56 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:56.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:56 smithi029 ceph-mon[217405]: Reconfiguring osd.3 (monmap changed)... 2023-12-05T13:29:56.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:56 smithi029 ceph-mon[217405]: Reconfiguring daemon osd.3 on smithi052 2023-12-05T13:29:56.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:56 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:56 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:56 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T13:29:56.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:56 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: Reconfiguring osd.4 (monmap changed)... 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: Reconfiguring daemon osd.4 on smithi052 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T13:29:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:57 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: Reconfiguring osd.4 (monmap changed)... 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: Reconfiguring daemon osd.4 on smithi052 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: pgmap v20: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T13:29:57.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:57 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:58.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:58 smithi052 ceph-mon[184394]: Reconfiguring osd.5 (monmap changed)... 2023-12-05T13:29:58.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:58 smithi052 ceph-mon[184394]: Reconfiguring daemon osd.5 on smithi052 2023-12-05T13:29:58.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:58 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:58.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:58 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:58.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:58 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.nbpymg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:58.655 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:58 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:58.660 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:58 smithi029 ceph-mon[217405]: Reconfiguring osd.5 (monmap changed)... 2023-12-05T13:29:58.661 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:58 smithi029 ceph-mon[217405]: Reconfiguring daemon osd.5 on smithi052 2023-12-05T13:29:58.661 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:58 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:58.661 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:58 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:58.661 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:58 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.nbpymg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:58.661 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:58 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: Reconfiguring mds.cephfs.smithi052.nbpymg (monmap changed)... 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: Reconfiguring daemon mds.cephfs.smithi052.nbpymg on smithi052 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dsxvue", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:59.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:29:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:29:59.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: Reconfiguring mds.cephfs.smithi052.nbpymg (monmap changed)... 2023-12-05T13:29:59.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: Reconfiguring daemon mds.cephfs.smithi052.nbpymg on smithi052 2023-12-05T13:29:59.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: pgmap v21: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:29:59.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:59.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:29:59.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dsxvue", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T13:29:59.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:29:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: Reconfiguring mds.cephfs.smithi052.dsxvue (monmap changed)... 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: Reconfiguring daemon mds.cephfs.smithi052.dsxvue on smithi052 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: overall HEALTH_OK 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:00.716 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:00.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:00.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi029"}]: dispatch 2023-12-05T13:30:00.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi029"}]': finished 2023-12-05T13:30:00.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"}]: dispatch 2023-12-05T13:30:00.717 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"}]': finished 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: Reconfiguring mds.cephfs.smithi052.dsxvue (monmap changed)... 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: Reconfiguring daemon mds.cephfs.smithi052.dsxvue on smithi052 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: overall HEALTH_OK 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:00.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi029"}]: dispatch 2023-12-05T13:30:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi029"}]': finished 2023-12-05T13:30:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"}]: dispatch 2023-12-05T13:30:00.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"}]': finished 2023-12-05T13:30:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:01 smithi029 ceph-mon[217405]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:01 smithi029 ceph-mon[217405]: Upgrade: Setting container_image for all mon 2023-12-05T13:30:01.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:01 smithi052 ceph-mon[184394]: pgmap v22: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:01.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:01 smithi052 ceph-mon[184394]: Upgrade: Setting container_image for all mon 2023-12-05T13:30:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:03 smithi029 ceph-mon[217405]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:03 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:03 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:30:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:03 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:03 smithi052 ceph-mon[184394]: pgmap v23: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:03 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:03 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi029", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:30:03.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:03 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:04.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:04 smithi029 ceph-mon[217405]: Upgrade: Updating crash.smithi029 (1/2) 2023-12-05T13:30:04.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:04 smithi029 ceph-mon[217405]: Deploying daemon crash.smithi029 on smithi029 2023-12-05T13:30:04.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:04 smithi052 ceph-mon[184394]: Upgrade: Updating crash.smithi029 (1/2) 2023-12-05T13:30:04.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:04 smithi052 ceph-mon[184394]: Deploying daemon crash.smithi029 on smithi029 2023-12-05T13:30:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:05 smithi052 ceph-mon[184394]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:05.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:05 smithi029 ceph-mon[217405]: pgmap v24: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:06 smithi052 ceph-mon[184394]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:06.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:06.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:06.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:06 smithi029 ceph-mon[217405]: pgmap v25: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:07.680 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:07 smithi052 ceph-mon[184394]: Upgrade: Updating crash.smithi052 (2/2) 2023-12-05T13:30:07.680 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:07.680 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:30:07.680 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:07.680 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:07 smithi052 ceph-mon[184394]: Deploying daemon crash.smithi052 on smithi052 2023-12-05T13:30:07.680 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:07.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:07 smithi029 ceph-mon[217405]: Upgrade: Updating crash.smithi052 (2/2) 2023-12-05T13:30:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T13:30:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:07 smithi029 ceph-mon[217405]: Deploying daemon crash.smithi052 on smithi052 2023-12-05T13:30:07.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:08 smithi052 ceph-mon[184394]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:08.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:08 smithi029 ceph-mon[217405]: pgmap v26: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:10.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:10 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:10.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:10 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:10.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:10 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:10.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:10 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:10.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:10 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:10.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:10 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:11.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:11 smithi052 ceph-mon[184394]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:11.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:11 smithi029 ceph-mon[217405]: pgmap v27: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:12.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:12 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:12 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:12 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:12 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.497 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:12 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.497 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:12 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.497 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:12 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:12.497 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:12 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:13 smithi029 ceph-mon[217405]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:13 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:13 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:13 smithi052 ceph-mon[184394]: pgmap v28: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:13 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:13 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.036 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:14 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.036 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:14 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.036 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:14 smithi029 ceph-mon[217405]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:15.036 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:14 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.036 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:14 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:14 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:14 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:14 smithi052 ceph-mon[184394]: pgmap v29: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:15.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:14 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:14 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:15.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 -- 172.21.15.29:0/3481928700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83701035a0 msgr2=0x7f83700fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:15.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 --2- 172.21.15.29:0/3481928700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83701035a0 0x7f83700fcc10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8360004940 tx=0x7f8360009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:15.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 -- 172.21.15.29:0/3481928700 shutdown_connections 2023-12-05T13:30:15.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 --2- 172.21.15.29:0/3481928700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83701035a0 0x7f83700fcc10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 --2- 172.21.15.29:0/3481928700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370102c00 0x7f8370102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 -- 172.21.15.29:0/3481928700 >> 172.21.15.29:0/3481928700 conn(0x7f83700f8790 msgr2=0x7f83700faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:15.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 -- 172.21.15.29:0/3481928700 shutdown_connections 2023-12-05T13:30:15.390 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 -- 172.21.15.29:0/3481928700 wait complete. 2023-12-05T13:30:15.392 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.388+0000 7f8377337700 1 Processor -- start 2023-12-05T13:30:15.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f8377337700 1 -- start start 2023-12-05T13:30:15.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f8377337700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 0x7f8370113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f8377337700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83701035a0 0x7f8370113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f8377337700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370114210 con 0x7f8370102c00 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f8377337700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837010d500 con 0x7f83701035a0 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83750d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 0x7f8370113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83750d3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 0x7f8370113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39492/0 (socket says 172.21.15.29:39492) 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83750d3700 1 -- 172.21.15.29:0/508031817 learned_addr learned my addr 172.21.15.29:0/508031817 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83748d2700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83701035a0 0x7f8370113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83750d3700 1 -- 172.21.15.29:0/508031817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83701035a0 msgr2=0x7f8370113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:15.394 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83750d3700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83701035a0 0x7f8370113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.389+0000 7f83750d3700 1 -- 172.21.15.29:0/508031817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360005040 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.390+0000 7f83750d3700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 0x7f8370113680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c8c0 tx=0x7f836c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.390+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836c00a760 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.390+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f836c00ad70 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.390+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837010d7e0 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.390+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836c0113a0 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.390+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837010dcf0 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.391+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8370113330 con 0x7f8370102c00 2023-12-05T13:30:15.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.392+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f836c012400 con 0x7f8370102c00 2023-12-05T13:30:15.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.392+0000 7f8365ffb700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f835c06cf80 0x7f835c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:15.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.392+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f836c08c3e0 con 0x7f8370102c00 2023-12-05T13:30:15.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.392+0000 7f83748d2700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f835c06cf80 0x7f835c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:15.397 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.393+0000 7f83748d2700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f835c06cf80 0x7f835c06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f836000b3b0 tx=0x7f8360009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:15.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.397+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f836c059d60 con 0x7f8370102c00 2023-12-05T13:30:15.631 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.630+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f837004bbf0 con 0x7f835c06cf80 2023-12-05T13:30:15.632 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.631+0000 7f8365ffb700 1 -- 172.21.15.29:0/508031817 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f837004bbf0 con 0x7f835c06cf80 2023-12-05T13:30:15.634 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f835c06cf80 msgr2=0x7f835c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f835c06cf80 0x7f835c06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f836000b3b0 tx=0x7f8360009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 msgr2=0x7f8370113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 0x7f8370113680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c8c0 tx=0x7f836c0044c0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.635 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 shutdown_connections 2023-12-05T13:30:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f835c06cf80 0x7f835c06f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8370102c00 0x7f8370113680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.638 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 --2- 172.21.15.29:0/508031817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83701035a0 0x7f8370113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 >> 172.21.15.29:0/508031817 conn(0x7f83700f8790 msgr2=0x7f83700fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 shutdown_connections 2023-12-05T13:30:15.639 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.634+0000 7f8377337700 1 -- 172.21.15.29:0/508031817 wait complete. 2023-12-05T13:30:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 -- 172.21.15.29:0/1759142404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 msgr2=0x7f72000fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 --2- 172.21.15.29:0/1759142404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f72000fc9a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71fc004940 tx=0x7f71fc009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 -- 172.21.15.29:0/1759142404 shutdown_connections 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 --2- 172.21.15.29:0/1759142404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000fcee0 0x7f7200109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 --2- 172.21.15.29:0/1759142404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f72000fc9a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 -- 172.21.15.29:0/1759142404 >> 172.21.15.29:0/1759142404 conn(0x7f72000719b0 msgr2=0x7f7200071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 -- 172.21.15.29:0/1759142404 shutdown_connections 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.759+0000 7f72080e8700 1 -- 172.21.15.29:0/1759142404 wait complete. 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.760+0000 7f72080e8700 1 Processor -- start 2023-12-05T13:30:15.761 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.760+0000 7f72080e8700 1 -- start start 2023-12-05T13:30:15.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.760+0000 7f72080e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f7200115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:15.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.760+0000 7f72080e8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000fcee0 0x7f7200115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:15.763 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f72080e8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72001163f0 con 0x7f72000fc5d0 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f72080e8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720010f790 con 0x7f72000fcee0 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f7200115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f7200115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39498/0 (socket says 172.21.15.29:39498) 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 -- 172.21.15.29:0/3114183437 learned_addr learned my addr 172.21.15.29:0/3114183437 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205683700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000fcee0 0x7f7200115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 -- 172.21.15.29:0/3114183437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000fcee0 msgr2=0x7f7200115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:15.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000fcee0 0x7f7200115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 -- 172.21.15.29:0/3114183437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc005040 con 0x7f72000fc5d0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f7205e84700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f7200115860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00b3b0 tx=0x7f71fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71fc00e040 con 0x7f72000fc5d0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.761+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71fc01c430 con 0x7f72000fc5d0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.762+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720010fa10 con 0x7f72000fc5d0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.762+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720010ff50 con 0x7f72000fc5d0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.762+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71fc013640 con 0x7f72000fc5d0 2023-12-05T13:30:15.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.763+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e40052e0 con 0x7f72000fc5d0 2023-12-05T13:30:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.763+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f71fc0137a0 con 0x7f72000fc5d0 2023-12-05T13:30:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.764+0000 7f71f67fc700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f71ec06cf80 0x7f71ec06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.764+0000 7f7205683700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f71ec06cf80 0x7f71ec06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.764+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f71fc08ceb0 con 0x7f72000fc5d0 2023-12-05T13:30:15.767 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.764+0000 7f7205683700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f71ec06cf80 0x7f71ec06f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72001109a0 tx=0x7f71f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:15.769 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:15.769+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f71fc05a8e0 con 0x7f72000fc5d0 2023-12-05T13:30:16.042 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.042+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71e4000bf0 con 0x7f71ec06cf80 2023-12-05T13:30:16.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.043+0000 7f71f67fc700 1 -- 172.21.15.29:0/3114183437 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f71e4000bf0 con 0x7f71ec06cf80 2023-12-05T13:30:16.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f71ec06cf80 msgr2=0x7f71ec06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f71ec06cf80 0x7f71ec06f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72001109a0 tx=0x7f71f000b040 comp rx=0 tx=0).stop 2023-12-05T13:30:16.046 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 msgr2=0x7f7200115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f7200115860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00b3b0 tx=0x7f71fc009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:16.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 shutdown_connections 2023-12-05T13:30:16.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f71ec06cf80 0x7f71ec06f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72000fc5d0 0x7f7200115860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 --2- 172.21.15.29:0/3114183437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72000fcee0 0x7f7200115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.045+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 >> 172.21.15.29:0/3114183437 conn(0x7f72000719b0 msgr2=0x7f72000fa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:16.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.046+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 shutdown_connections 2023-12-05T13:30:16.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.046+0000 7f72080e8700 1 -- 172.21.15.29:0/3114183437 wait complete. 2023-12-05T13:30:16.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.160+0000 7f3a0335f700 1 -- 172.21.15.29:0/2465051013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc0fbb40 msgr2=0x7f39fc0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.160+0000 7f3a0335f700 1 --2- 172.21.15.29:0/2465051013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc0fbb40 0x7f39fc0fbfb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f39ec004940 tx=0x7f39ec009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:16.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.160+0000 7f3a0335f700 1 -- 172.21.15.29:0/2465051013 shutdown_connections 2023-12-05T13:30:16.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.160+0000 7f3a0335f700 1 --2- 172.21.15.29:0/2465051013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc0fbb40 0x7f39fc0fbfb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.160+0000 7f3a0335f700 1 --2- 172.21.15.29:0/2465051013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc101b00 0x7f39fc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.160+0000 7f3a0335f700 1 -- 172.21.15.29:0/2465051013 >> 172.21.15.29:0/2465051013 conn(0x7f39fc0719b0 msgr2=0x7f39fc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:16.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.161+0000 7f3a0335f700 1 -- 172.21.15.29:0/2465051013 shutdown_connections 2023-12-05T13:30:16.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.161+0000 7f3a0335f700 1 -- 172.21.15.29:0/2465051013 wait complete. 2023-12-05T13:30:16.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.161+0000 7f3a0335f700 1 Processor -- start 2023-12-05T13:30:16.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.161+0000 7f3a0335f700 1 -- start start 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a0335f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc0fbb40 0x7f39fc112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a0335f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 0x7f39fc112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a0335f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1131d0 con 0x7f39fc101b00 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a0335f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc10c4c0 con 0x7f39fc0fbb40 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 0x7f39fc112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 0x7f39fc112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39518/0 (socket says 172.21.15.29:39518) 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 -- 172.21.15.29:0/3518098066 learned_addr learned my addr 172.21.15.29:0/3518098066 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a010fb700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc0fbb40 0x7f39fc112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 -- 172.21.15.29:0/3518098066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc0fbb40 msgr2=0x7f39fc112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc0fbb40 0x7f39fc112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 -- 172.21.15.29:0/3518098066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec005040 con 0x7f39fc101b00 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a010fb700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc0fbb40 0x7f39fc112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f3a008fa700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 0x7f39fc112b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009360 tx=0x7f39ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:16.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.162+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39ec00e040 con 0x7f39fc101b00 2023-12-05T13:30:16.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.163+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc10c740 con 0x7f39fc101b00 2023-12-05T13:30:16.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.163+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39ec00bc50 con 0x7f39fc101b00 2023-12-05T13:30:16.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.163+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39ec01c630 con 0x7f39fc101b00 2023-12-05T13:30:16.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.163+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc10cc80 con 0x7f39fc101b00 2023-12-05T13:30:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.164+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc1122d0 con 0x7f39fc101b00 2023-12-05T13:30:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.165+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f39ec013420 con 0x7f39fc101b00 2023-12-05T13:30:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.165+0000 7f39f1ffb700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f39e806cf80 0x7f39e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.165+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f39ec08d7b0 con 0x7f39fc101b00 2023-12-05T13:30:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.165+0000 7f3a010fb700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f39e806cf80 0x7f39e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.166 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.166+0000 7f3a010fb700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f39e806cf80 0x7f39e806f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39f8007fd0 tx=0x7f39f8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:16.171 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.171+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f39ec05b020 con 0x7f39fc101b00 2023-12-05T13:30:16.398 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.398+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39fc04bb80 con 0x7f39e806cf80 2023-12-05T13:30:16.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.409+0000 7f39f1ffb700 1 -- 172.21.15.29:0/3518098066 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f39fc04bb80 con 0x7f39e806cf80 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (2m) 3s ago 11m 25.5M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (11s) 3s ago 11m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (7s) 5s ago 10m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (108s) 3s ago 11m 82.1M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (7m) 3s ago 7m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (7m) 3s ago 7m 19.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (7m) 5s ago 7m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (7m) 5s ago 7m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (3m) 3s ago 12m 506M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:30:16.410 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (2m) 5s ago 10m 448M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (62s) 3s ago 12m 53.1M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (40s) 5s ago 10m 40.9M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (2m) 3s ago 11m 16.2M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (2m) 5s ago 10m 17.0M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (10m) 3s ago 10m 840M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f00d3f79bc9e 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (9m) 3s ago 9m 946M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (9m) 3s ago 9m 752M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (9m) 5s ago 9m 1115M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (8m) 5s ago 8m 796M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (8m) 5s ago 8m 975M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:30:16.411 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (2m) 3s ago 11m 59.2M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f39e806cf80 msgr2=0x7f39e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f39e806cf80 0x7f39e806f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39f8007fd0 tx=0x7f39f8009040 comp rx=0 tx=0).stop 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 msgr2=0x7f39fc112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 0x7f39fc112b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009360 tx=0x7f39ec009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 shutdown_connections 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f39e806cf80 0x7f39e806f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39fc0fbb40 0x7f39fc112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 --2- 172.21.15.29:0/3518098066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39fc101b00 0x7f39fc112b80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.411+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 >> 172.21.15.29:0/3518098066 conn(0x7f39fc0719b0 msgr2=0x7f39fc0fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.412+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 shutdown_connections 2023-12-05T13:30:16.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.412+0000 7f3a0335f700 1 -- 172.21.15.29:0/3518098066 wait complete. 2023-12-05T13:30:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 -- 172.21.15.29:0/351440963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1000fbb40 msgr2=0x7fd1000fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 --2- 172.21.15.29:0/351440963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1000fbb40 0x7fd1000fbfb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0004940 tx=0x7fd0f0009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 -- 172.21.15.29:0/351440963 shutdown_connections 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 --2- 172.21.15.29:0/351440963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd1000fbb40 0x7fd1000fbfb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 --2- 172.21.15.29:0/351440963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd100101b00 0x7fd100101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 -- 172.21.15.29:0/351440963 >> 172.21.15.29:0/351440963 conn(0x7fd1000719b0 msgr2=0x7fd100071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 -- 172.21.15.29:0/351440963 shutdown_connections 2023-12-05T13:30:16.526 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.525+0000 7fd107471700 1 -- 172.21.15.29:0/351440963 wait complete. 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd107471700 1 Processor -- start 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd107471700 1 -- start start 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd107471700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1000fbb40 0x7fd10010e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd107471700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 0x7fd10010ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd107471700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10010f180 con 0x7fd100101b00 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd107471700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10010f2f0 con 0x7fd1000fbb40 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd104a0c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 0x7fd10010ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd104a0c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 0x7fd10010ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39534/0 (socket says 172.21.15.29:39534) 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd104a0c700 1 -- 172.21.15.29:0/2844433213 learned_addr learned my addr 172.21.15.29:0/2844433213 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd10520d700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1000fbb40 0x7fd10010e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd104a0c700 1 -- 172.21.15.29:0/2844433213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1000fbb40 msgr2=0x7fd10010e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd104a0c700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1000fbb40 0x7fd10010e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.526+0000 7fd104a0c700 1 -- 172.21.15.29:0/2844433213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0005040 con 0x7fd100101b00 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.527+0000 7fd104a0c700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 0x7fd10010ebd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0000c00 tx=0x7fd0f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.527+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f0021070 con 0x7fd100101b00 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.527+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0f001c400 con 0x7fd100101b00 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.527+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd100117600 con 0x7fd100101b00 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.527+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f000e070 con 0x7fd100101b00 2023-12-05T13:30:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.527+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd100117ab0 con 0x7fd100101b00 2023-12-05T13:30:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.528+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1000734d0 con 0x7fd100101b00 2023-12-05T13:30:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.529+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd0f001c9e0 con 0x7fd100101b00 2023-12-05T13:30:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.529+0000 7fd0f5ffb700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd0ec06cf80 0x7fd0ec06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.530+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fd0f008d6a0 con 0x7fd100101b00 2023-12-05T13:30:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.530+0000 7fd10520d700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd0ec06cf80 0x7fd0ec06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.530+0000 7fd10520d700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd0ec06cf80 0x7fd0ec06f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004600 tx=0x7fd0fc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:16.535 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.534+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd0f0057480 con 0x7fd100101b00 2023-12-05T13:30:16.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.842+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd100065c10 con 0x7fd100101b00 2023-12-05T13:30:16.844 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.843+0000 7fd0f5ffb700 1 -- 172.21.15.29:0/2844433213 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7fd0f005aaa0 con 0x7fd100101b00 2023-12-05T13:30:16.844 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:16.845 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:30:16.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 10, 2023-12-05T13:30:16.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 4 2023-12-05T13:30:16.846 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:30:16.846 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:30:16.846 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.845+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd0ec06cf80 msgr2=0x7fd0ec06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.845+0000 7fd107471700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd0ec06cf80 0x7fd0ec06f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004600 tx=0x7fd0fc00b040 comp rx=0 tx=0).stop 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.845+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 msgr2=0x7fd10010ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.845+0000 7fd107471700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 0x7fd10010ebd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0000c00 tx=0x7fd0f0009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 shutdown_connections 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd0ec06cf80 0x7fd0ec06f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1000fbb40 0x7fd10010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 --2- 172.21.15.29:0/2844433213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd100101b00 0x7fd10010ebd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 >> 172.21.15.29:0/2844433213 conn(0x7fd1000719b0 msgr2=0x7fd1000faa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 shutdown_connections 2023-12-05T13:30:16.847 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.846+0000 7fd107471700 1 -- 172.21.15.29:0/2844433213 wait complete. 2023-12-05T13:30:16.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 -- 172.21.15.29:0/3715502257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a4102c00 msgr2=0x7fe8a4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 --2- 172.21.15.29:0/3715502257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a4102c00 0x7fe8a4102fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe894004940 tx=0x7fe894009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:16.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 -- 172.21.15.29:0/3715502257 shutdown_connections 2023-12-05T13:30:16.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 --2- 172.21.15.29:0/3715502257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a41035a0 0x7fe8a40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 --2- 172.21.15.29:0/3715502257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a4102c00 0x7fe8a4102fd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 -- 172.21.15.29:0/3715502257 >> 172.21.15.29:0/3715502257 conn(0x7fe8a40f8790 msgr2=0x7fe8a40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:16.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 -- 172.21.15.29:0/3715502257 shutdown_connections 2023-12-05T13:30:16.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.961+0000 7fe8a9906700 1 -- 172.21.15.29:0/3715502257 wait complete. 2023-12-05T13:30:16.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a9906700 1 Processor -- start 2023-12-05T13:30:16.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a9906700 1 -- start start 2023-12-05T13:30:16.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a9906700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a4102c00 0x7fe8a4113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a9906700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 0x7fe8a4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a9906700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a41141e0 con 0x7fe8a41035a0 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a9906700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a410d4d0 con 0x7fe8a4102c00 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.962+0000 7fe8a27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 0x7fe8a4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 0x7fe8a4113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39546/0 (socket says 172.21.15.29:39546) 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a27fc700 1 -- 172.21.15.29:0/1991088847 learned_addr learned my addr 172.21.15.29:0/1991088847 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a2ffd700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a4102c00 0x7fe8a4113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a27fc700 1 -- 172.21.15.29:0/1991088847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a4102c00 msgr2=0x7fe8a4113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:16.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a27fc700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a4102c00 0x7fe8a4113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a27fc700 1 -- 172.21.15.29:0/1991088847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894005040 con 0x7fe8a41035a0 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a27fc700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 0x7fe8a4113b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c800 tx=0x7fe898004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89800a760 con 0x7fe8a41035a0 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe89800ad70 con 0x7fe8a41035a0 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a410d760 con 0x7fe8a41035a0 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8980113a0 con 0x7fe8a41035a0 2023-12-05T13:30:16.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.963+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a410dca0 con 0x7fe8a41035a0 2023-12-05T13:30:16.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.965+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a40fff10 con 0x7fe8a41035a0 2023-12-05T13:30:16.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.965+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fe898012400 con 0x7fe8a41035a0 2023-12-05T13:30:16.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.966+0000 7fe88b7fe700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe88c06cf80 0x7fe88c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:16.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.966+0000 7fe8a2ffd700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe88c06cf80 0x7fe88c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:16.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.966+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fe89808c2f0 con 0x7fe8a41035a0 2023-12-05T13:30:16.970 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.966+0000 7fe8a2ffd700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe88c06cf80 0x7fe88c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40f9bd0 tx=0x7fe894009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:16.971 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:16.971+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe898059d10 con 0x7fe8a41035a0 2023-12-05T13:30:17.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.238+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe8a40fc390 con 0x7fe8a41035a0 2023-12-05T13:30:17.239 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.238+0000 7fe88b7fe700 1 -- 172.21.15.29:0/1991088847 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fe8980598a0 con 0x7fe8a41035a0 2023-12-05T13:30:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:30:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:30:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:30:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:30:17.240 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:30:17.241 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:30:17.242 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:17.243 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:17.243 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:17.243 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.240+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe88c06cf80 msgr2=0x7fe88c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.240+0000 7fe8a9906700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe88c06cf80 0x7fe88c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40f9bd0 tx=0x7fe894009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.240+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 msgr2=0x7fe8a4113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.240+0000 7fe8a9906700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 0x7fe8a4113b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c800 tx=0x7fe898004470 comp rx=0 tx=0).stop 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.240+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 shutdown_connections 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.241+0000 7fe8a9906700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe88c06cf80 0x7fe88c06f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.241+0000 7fe8a9906700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8a4102c00 0x7fe8a4113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.241+0000 7fe8a9906700 1 --2- 172.21.15.29:0/1991088847 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8a41035a0 0x7fe8a4113b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.241+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 >> 172.21.15.29:0/1991088847 conn(0x7fe8a40f8790 msgr2=0x7fe8a40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.241+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 shutdown_connections 2023-12-05T13:30:17.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.241+0000 7fe8a9906700 1 -- 172.21.15.29:0/1991088847 wait complete. 2023-12-05T13:30:17.246 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:30:17.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.356+0000 7f4601c0d700 1 -- 172.21.15.29:0/1552831487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 msgr2=0x7f45fc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.356+0000 7f4601c0d700 1 --2- 172.21.15.29:0/1552831487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc101ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45f4004940 tx=0x7f45f4009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:17.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 -- 172.21.15.29:0/1552831487 shutdown_connections 2023-12-05T13:30:17.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 --2- 172.21.15.29:0/1552831487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45fc0fbb40 0x7f45fc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 --2- 172.21.15.29:0/1552831487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc101ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 -- 172.21.15.29:0/1552831487 >> 172.21.15.29:0/1552831487 conn(0x7f45fc0719b0 msgr2=0x7f45fc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:17.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 -- 172.21.15.29:0/1552831487 shutdown_connections 2023-12-05T13:30:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 -- 172.21.15.29:0/1552831487 wait complete. 2023-12-05T13:30:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 Processor -- start 2023-12-05T13:30:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.357+0000 7f4601c0d700 1 -- start start 2023-12-05T13:30:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f4601c0d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45fc0fbb40 0x7f45fc0fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f4601c0d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc0fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f4601c0d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0fe260 con 0x7f45fc101b00 2023-12-05T13:30:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f4601c0d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0fe3d0 con 0x7f45fc0fbb40 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc0fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc0fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39558/0 (socket says 172.21.15.29:39558) 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 -- 172.21.15.29:0/2633584530 learned_addr learned my addr 172.21.15.29:0/2633584530 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45fb7fe700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45fc0fbb40 0x7f45fc0fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 -- 172.21.15.29:0/2633584530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45fc0fbb40 msgr2=0x7f45fc0fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45fc0fbb40 0x7f45fc0fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 -- 172.21.15.29:0/2633584530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4005040 con 0x7f45fc101b00 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45faffd700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc0fdc60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45e400eb40 tx=0x7f45e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.358+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e4007cc0 con 0x7f45fc101b00 2023-12-05T13:30:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.359+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45e400f040 con 0x7f45fc101b00 2023-12-05T13:30:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.359+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc1197d0 con 0x7f45fc101b00 2023-12-05T13:30:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.359+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e400c990 con 0x7f45fc101b00 2023-12-05T13:30:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.359+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc119c30 con 0x7f45fc101b00 2023-12-05T13:30:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.359+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0734d0 con 0x7f45fc101b00 2023-12-05T13:30:17.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.360+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f45e400cc00 con 0x7f45fc101b00 2023-12-05T13:30:17.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.361+0000 7f45f3fff700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f45e806cf80 0x7f45e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:17.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.361+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f45e408c0b0 con 0x7f45fc101b00 2023-12-05T13:30:17.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.361+0000 7f45fb7fe700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f45e806cf80 0x7f45e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:17.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.361+0000 7f45fb7fe700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f45e806cf80 0x7f45e806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f45f4000c00 tx=0x7f45f4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:17.366 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.365+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f45e4055ec0 con 0x7f45fc101b00 2023-12-05T13:30:17.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:17.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:17.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:17.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:17.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi029"}]: dispatch 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi029"}]': finished 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"}]: dispatch 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"}]': finished 2023-12-05T13:30:17.475 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T13:30:17.476 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:17 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2844433213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: pgmap v30: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.511 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi029"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi029"}]': finished 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"}]': finished 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T13:30:17.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:17 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2844433213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:17.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.598+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45fc0fef70 con 0x7f45e806cf80 2023-12-05T13:30:17.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.600+0000 7f45f3fff700 1 -- 172.21.15.29:0/2633584530 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f45fc0fef70 con 0x7f45e806cf80 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "6/21 daemons upgraded", 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:30:17.601 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f45e806cf80 msgr2=0x7f45e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f45e806cf80 0x7f45e806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f45f4000c00 tx=0x7f45f4009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 msgr2=0x7f45fc0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc0fdc60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45e400eb40 tx=0x7f45e400b040 comp rx=0 tx=0).stop 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 shutdown_connections 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f45e806cf80 0x7f45e806f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45fc0fbb40 0x7f45fc0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 --2- 172.21.15.29:0/2633584530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f45fc101b00 0x7f45fc0fdc60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 >> 172.21.15.29:0/2633584530 conn(0x7f45fc0719b0 msgr2=0x7f45fc065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:17.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 shutdown_connections 2023-12-05T13:30:17.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.602+0000 7f4601c0d700 1 -- 172.21.15.29:0/2633584530 wait complete. 2023-12-05T13:30:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 -- 172.21.15.29:0/493617624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fdbf0 msgr2=0x7fd4540fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 --2- 172.21.15.29:0/493617624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fdbf0 0x7fd4540fdfc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd450004940 tx=0x7fd450009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:17.723 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 -- 172.21.15.29:0/493617624 shutdown_connections 2023-12-05T13:30:17.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 --2- 172.21.15.29:0/493617624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4540fe590 0x7fd454106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 --2- 172.21.15.29:0/493617624 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fdbf0 0x7fd4540fdfc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 -- 172.21.15.29:0/493617624 >> 172.21.15.29:0/493617624 conn(0x7fd4540f7680 msgr2=0x7fd4540f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:17.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 -- 172.21.15.29:0/493617624 shutdown_connections 2023-12-05T13:30:17.724 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.717+0000 7fd45b71c700 1 -- 172.21.15.29:0/493617624 wait complete. 2023-12-05T13:30:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd45b71c700 1 Processor -- start 2023-12-05T13:30:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd45b71c700 1 -- start start 2023-12-05T13:30:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd45b71c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4540fdbf0 0x7fd454113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd45b71c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 0x7fd454113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:17.725 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd45b71c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4541141e0 con 0x7fd4540fe590 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd45b71c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45410d4d0 con 0x7fd4540fdbf0 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd458cb7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 0x7fd454113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd458cb7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 0x7fd454113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39576/0 (socket says 172.21.15.29:39576) 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd458cb7700 1 -- 172.21.15.29:0/49862145 learned_addr learned my addr 172.21.15.29:0/49862145 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.718+0000 7fd4594b8700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4540fdbf0 0x7fd454113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd458cb7700 1 -- 172.21.15.29:0/49862145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4540fdbf0 msgr2=0x7fd454113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd458cb7700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4540fdbf0 0x7fd454113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:17.726 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd458cb7700 1 -- 172.21.15.29:0/49862145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450005040 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd458cb7700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 0x7fd454113b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd444002a50 tx=0x7fd4440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd444007cc0 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd44400f040 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45410d760 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44400d9c0 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.719+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45410dca0 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.720+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4541041e0 con 0x7fd4540fe590 2023-12-05T13:30:17.727 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.721+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd44400db20 con 0x7fd4540fe590 2023-12-05T13:30:17.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.721+0000 7fd449ffb700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd44006cf80 0x7fd44006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:17.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.721+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fd44408c1e0 con 0x7fd4540fe590 2023-12-05T13:30:17.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.721+0000 7fd4594b8700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd44006cf80 0x7fd44006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:17.728 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.722+0000 7fd4594b8700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd44006cf80 0x7fd44006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd450009fd0 tx=0x7fd450009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:17.729 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:17.726+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd4440599d0 con 0x7fd4540fe590 2023-12-05T13:30:18.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.030+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd45404bbb0 con 0x7fd4540fe590 2023-12-05T13:30:18.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.031+0000 7fd449ffb700 1 -- 172.21.15.29:0/49862145 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd444059560 con 0x7fd4540fe590 2023-12-05T13:30:18.032 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_OK 2023-12-05T13:30:18.034 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.033+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd44006cf80 msgr2=0x7fd44006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.033+0000 7fd45b71c700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd44006cf80 0x7fd44006f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd450009fd0 tx=0x7fd450009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.033+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 msgr2=0x7fd454113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.033+0000 7fd45b71c700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 0x7fd454113b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd444002a50 tx=0x7fd4440046b0 comp rx=0 tx=0).stop 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 shutdown_connections 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd44006cf80 0x7fd44006f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4540fdbf0 0x7fd454113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 --2- 172.21.15.29:0/49862145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4540fe590 0x7fd454113b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 >> 172.21.15.29:0/49862145 conn(0x7fd4540f7680 msgr2=0x7fd454101360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 shutdown_connections 2023-12-05T13:30:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:18.034+0000 7fd45b71c700 1 -- 172.21.15.29:0/49862145 wait complete. 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: Upgrade: Setting container_image for all crash 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: Upgrade: osd.0 is safe to restart 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1991088847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:18.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:18 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/49862145' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: Upgrade: Setting container_image for all crash 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: Upgrade: osd.0 is safe to restart 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1991088847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:18.479 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:18 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/49862145' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:30:19.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:19 smithi052 ceph-mon[184394]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:19.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:19 smithi052 ceph-mon[184394]: Upgrade: Updating osd.0 2023-12-05T13:30:19.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:19 smithi052 ceph-mon[184394]: Deploying daemon osd.0 on smithi029 2023-12-05T13:30:19.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:19 smithi052 ceph-mon[184394]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:19.528 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:19 smithi029 ceph-mon[217405]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:19.528 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:19 smithi029 ceph-mon[217405]: Upgrade: Updating osd.0 2023-12-05T13:30:19.528 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:19 smithi029 ceph-mon[217405]: Deploying daemon osd.0 on smithi029 2023-12-05T13:30:19.528 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:19 smithi029 ceph-mon[217405]: pgmap v31: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:20.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:20 smithi029 systemd[1]: Stopping Ceph osd.0 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:30:20.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:20 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[135899]: 2023-12-05T13:30:20.473+0000 7ff980fe8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:30:20.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:20 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[135899]: 2023-12-05T13:30:20.473+0000 7ff980fe8700 -1 osd.0 48 *** Got signal Terminated *** 2023-12-05T13:30:20.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:20 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[135899]: 2023-12-05T13:30:20.473+0000 7ff980fe8700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:30:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:21 smithi052 ceph-mon[184394]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:21.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:21 smithi052 ceph-mon[184394]: osd.0 marked itself down and dead 2023-12-05T13:30:21.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:21 smithi029 ceph-mon[217405]: pgmap v32: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:21.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:21 smithi029 ceph-mon[217405]: osd.0 marked itself down and dead 2023-12-05T13:30:22.221 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:21 smithi029 bash[231914]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0 2023-12-05T13:30:22.222 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:30:22.222 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: failed to encode map e49 with expected crc 2023-12-05T13:30:22.222 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: osdmap e49: 6 total, 5 up, 6 in 2023-12-05T13:30:22.222 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]: dispatch 2023-12-05T13:30:22.222 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5]}]: dispatch 2023-12-05T13:30:22.222 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 0]}]: dispatch 2023-12-05T13:30:22.223 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]: dispatch 2023-12-05T13:30:22.223 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]: dispatch 2023-12-05T13:30:22.223 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]: dispatch 2023-12-05T13:30:22.223 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 0, 3, 5]}]: dispatch 2023-12-05T13:30:22.223 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]: dispatch 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: failed to encode map e49 with expected crc 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: osdmap e49: 6 total, 5 up, 6 in 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]: dispatch 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5]}]: dispatch 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 0]}]: dispatch 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]: dispatch 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]: dispatch 2023-12-05T13:30:22.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]: dispatch 2023-12-05T13:30:22.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 0, 3, 5]}]: dispatch 2023-12-05T13:30:22.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]: dispatch 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: pgmap v34: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 0]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 0, 3, 5]}]': finished 2023-12-05T13:30:23.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]': finished 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: osdmap e50: 6 total, 5 up, 6 in 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.355 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: pgmap v34: 65 pgs: 9 stale+active+clean, 56 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2023-12-05T13:30:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]': finished 2023-12-05T13:30:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5]}]': finished 2023-12-05T13:30:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [3, 0]}]': finished 2023-12-05T13:30:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 5]}]': finished 2023-12-05T13:30:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]': finished 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]': finished 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [4, 0, 3, 5]}]': finished 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 0]}]': finished 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: osdmap e50: 6 total, 5 up, 6 in 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: failed to encode map e50 with expected crc 2023-12-05T13:30:23.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:23.852 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:23 smithi029 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.0.service: Succeeded. 2023-12-05T13:30:23.852 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:23 smithi029 systemd[1]: Stopped Ceph osd.0 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:30:23.852 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:23 smithi029 systemd[1]: Starting Ceph osd.0 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:30:24.502 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.567 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: osdmap e51: 6 total, 5 up, 6 in 2023-12-05T13:30:24.567 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.567 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.567 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.568 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.568 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:24 smithi029 ceph-mon[217405]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-05T13:30:24.568 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:24 smithi029 bash[232179]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: osdmap e51: 6 total, 5 up, 6 in 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: failed to encode map e51 with expected crc 2023-12-05T13:30:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:24 smithi052 ceph-mon[184394]: failed to encode map e51 with expected crc 2023-12-05T13:30:25.603 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-osd[232494]: -- 172.21.15.29:0/3389229170 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ed7d051e0 con 0x558ed7cd4c00 2023-12-05T13:30:25.603 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:25 smithi029 bash[232456]: 5bda181e4954ee9789e1a2ee2f08333aa4463565fd43e478d0efb8349f0ca50b 2023-12-05T13:30:25.603 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:25 smithi029 systemd[1]: Started Ceph osd.0 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: pgmap v37: 65 pgs: 6 peering, 16 active+undersized+degraded, 14 active+undersized, 28 active+clean, 1 stale+active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: osdmap e52: 6 total, 5 up, 6 in 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-05T13:30:25.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-mon[217405]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 16 pgs degraded (PG_DEGRADED) 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: pgmap v37: 65 pgs: 6 peering, 16 active+undersized+degraded, 14 active+undersized, 28 active+clean, 1 stale+active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: osdmap e52: 6 total, 5 up, 6 in 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: failed to encode map e52 with expected crc 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-05T13:30:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:25 smithi052 ceph-mon[184394]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 16 pgs degraded (PG_DEGRADED) 2023-12-05T13:30:26.099 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:25 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:30:25.793+0000 7ff12d4bf640 -1 Falling back to public interface 2023-12-05T13:30:26.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:26 smithi029 ceph-mon[217405]: failed to encode map e53 with expected crc 2023-12-05T13:30:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:26 smithi029 ceph-mon[217405]: osdmap e53: 6 total, 5 up, 6 in 2023-12-05T13:30:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:26 smithi029 ceph-mon[217405]: failed to encode map e53 with expected crc 2023-12-05T13:30:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:26 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:26 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:26.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:26 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:26 smithi052 ceph-mon[184394]: failed to encode map e53 with expected crc 2023-12-05T13:30:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:26 smithi052 ceph-mon[184394]: osdmap e53: 6 total, 5 up, 6 in 2023-12-05T13:30:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:26 smithi052 ceph-mon[184394]: failed to encode map e53 with expected crc 2023-12-05T13:30:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:26 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:26 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:26 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:27.249 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:27 smithi029 ceph-mon[217405]: pgmap v40: 65 pgs: 6 peering, 16 active+undersized+degraded, 14 active+undersized, 28 active+clean, 1 stale+active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2023-12-05T13:30:27.249 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:27 smithi029 ceph-mon[217405]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.249 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:27 smithi029 ceph-mon[217405]: osdmap e54: 6 total, 5 up, 6 in 2023-12-05T13:30:27.249 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:27 smithi029 ceph-mon[217405]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.250 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:27 smithi029 ceph-mon[217405]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.250 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:27 smithi029 ceph-mon[217405]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:27 smithi052 ceph-mon[184394]: pgmap v40: 65 pgs: 6 peering, 16 active+undersized+degraded, 14 active+undersized, 28 active+clean, 1 stale+active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2023-12-05T13:30:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:27 smithi052 ceph-mon[184394]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:27 smithi052 ceph-mon[184394]: osdmap e54: 6 total, 5 up, 6 in 2023-12-05T13:30:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:27 smithi052 ceph-mon[184394]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:27 smithi052 ceph-mon[184394]: failed to encode map e54 with expected crc 2023-12-05T13:30:27.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:27 smithi052 ceph-mon[184394]: failed to encode map e54 with expected crc 2023-12-05T13:30:28.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:28 smithi029 ceph-mon[217405]: failed to encode map e55 with expected crc 2023-12-05T13:30:28.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:28 smithi029 ceph-mon[217405]: osdmap e55: 6 total, 5 up, 6 in 2023-12-05T13:30:28.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:28 smithi029 ceph-mon[217405]: failed to encode map e55 with expected crc 2023-12-05T13:30:28.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:28 smithi029 ceph-mon[217405]: failed to encode map e55 with expected crc 2023-12-05T13:30:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:28 smithi052 ceph-mon[184394]: failed to encode map e55 with expected crc 2023-12-05T13:30:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:28 smithi052 ceph-mon[184394]: osdmap e55: 6 total, 5 up, 6 in 2023-12-05T13:30:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:28 smithi052 ceph-mon[184394]: failed to encode map e55 with expected crc 2023-12-05T13:30:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:28 smithi052 ceph-mon[184394]: failed to encode map e55 with expected crc 2023-12-05T13:30:29.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:29 smithi029 ceph-mon[217405]: pgmap v43: 65 pgs: 1 remapped+peering, 27 active+clean, 16 active+undersized+degraded, 6 active+clean+remapped, 14 active+undersized, 1 active+recovering+undersized+remapped; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%); 6/219 objects misplaced (2.740%); 1024 KiB/s, 532 objects/s recovering 2023-12-05T13:30:29.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:29 smithi029 ceph-mon[217405]: failed to encode map e56 with expected crc 2023-12-05T13:30:29.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:29 smithi029 ceph-mon[217405]: osdmap e56: 6 total, 5 up, 6 in 2023-12-05T13:30:29.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:29 smithi029 ceph-mon[217405]: failed to encode map e56 with expected crc 2023-12-05T13:30:29.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:29 smithi029 ceph-mon[217405]: failed to encode map e56 with expected crc 2023-12-05T13:30:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:29 smithi052 ceph-mon[184394]: pgmap v43: 65 pgs: 1 remapped+peering, 27 active+clean, 16 active+undersized+degraded, 6 active+clean+remapped, 14 active+undersized, 1 active+recovering+undersized+remapped; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%); 6/219 objects misplaced (2.740%); 1024 KiB/s, 532 objects/s recovering 2023-12-05T13:30:29.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:29 smithi052 ceph-mon[184394]: failed to encode map e56 with expected crc 2023-12-05T13:30:29.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:29 smithi052 ceph-mon[184394]: osdmap e56: 6 total, 5 up, 6 in 2023-12-05T13:30:29.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:29 smithi052 ceph-mon[184394]: failed to encode map e56 with expected crc 2023-12-05T13:30:29.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:29 smithi052 ceph-mon[184394]: failed to encode map e56 with expected crc 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: failed to encode map e57 with expected crc 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: osdmap e57: 6 total, 5 up, 6 in 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: failed to encode map e57 with expected crc 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:30:30.316+0000 7ff12d4bf640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: failed to encode map e57 with expected crc 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: osdmap e57: 6 total, 5 up, 6 in 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: failed to encode map e57 with expected crc 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:30.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:31.023 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:30 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:30:30.865+0000 7ff12d4bf640 -1 osd.0 48 log_to_monitors true 2023-12-05T13:30:31.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:30:31 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:30:31.302+0000 7ff11e930700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:30:31.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:31 smithi029 ceph-mon[217405]: pgmap v46: 65 pgs: 1 remapped+peering, 27 active+clean, 16 active+undersized+degraded, 6 active+clean+remapped, 14 active+undersized, 1 active+recovering+undersized+remapped; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%); 6/219 objects misplaced (2.740%); 1024 KiB/s, 532 objects/s recovering 2023-12-05T13:30:31.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:31 smithi029 ceph-mon[217405]: from='osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T13:30:31.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:31 smithi052 ceph-mon[184394]: pgmap v46: 65 pgs: 1 remapped+peering, 27 active+clean, 16 active+undersized+degraded, 6 active+clean+remapped, 14 active+undersized, 1 active+recovering+undersized+remapped; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%); 6/219 objects misplaced (2.740%); 1024 KiB/s, 532 objects/s recovering 2023-12-05T13:30:31.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:31 smithi052 ceph-mon[184394]: from='osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T13:30:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:32 smithi029 ceph-mon[217405]: from='osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T13:30:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:32 smithi029 ceph-mon[217405]: failed to encode map e58 with expected crc 2023-12-05T13:30:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:32 smithi029 ceph-mon[217405]: osdmap e58: 6 total, 5 up, 6 in 2023-12-05T13:30:32.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:32 smithi029 ceph-mon[217405]: from='osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:30:32.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:32 smithi052 ceph-mon[184394]: from='osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T13:30:32.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:32 smithi052 ceph-mon[184394]: failed to encode map e58 with expected crc 2023-12-05T13:30:32.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:32 smithi052 ceph-mon[184394]: osdmap e58: 6 total, 5 up, 6 in 2023-12-05T13:30:32.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:32 smithi052 ceph-mon[184394]: from='osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:30:33.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: pgmap v48: 65 pgs: 1 remapped+peering, 27 active+clean, 16 active+undersized+degraded, 6 active+clean+remapped, 14 active+undersized, 1 active+recovering+undersized+remapped; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%); 6/219 objects misplaced (2.740%); 834 KiB/s, 433 objects/s recovering 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: failed to encode map e59 with expected crc 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533] boot 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: osdmap e59: 6 total, 6 up, 6 in 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:30:33.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:33 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: pgmap v48: 65 pgs: 1 remapped+peering, 27 active+clean, 16 active+undersized+degraded, 6 active+clean+remapped, 14 active+undersized, 1 active+recovering+undersized+remapped; 194 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%); 6/219 objects misplaced (2.740%); 834 KiB/s, 433 objects/s recovering 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: failed to encode map e59 with expected crc 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: osd.0 [v2:172.21.15.29:6802/1409984533,v1:172.21.15.29:6803/1409984533] boot 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: osdmap e59: 6 total, 6 up, 6 in 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:33.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:33.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:33.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:30:33.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:33 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:34.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: osdmap e60: 6 total, 6 up, 6 in 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:34.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:34.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-05T13:30:34.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:34 smithi029 ceph-mon[217405]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: osdmap e60: 6 total, 6 up, 6 in 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: failed to encode map e60 with expected crc 2023-12-05T13:30:34.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-05T13:30:34.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:34 smithi052 ceph-mon[184394]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T13:30:35.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: pgmap v51: 65 pgs: 23 peering, 8 remapped+peering, 27 active+clean, 2 active+undersized+degraded, 5 active+undersized; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5/219 objects degraded (2.283%); 0 B/s, 148 objects/s recovering 2023-12-05T13:30:35.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: osdmap e61: 6 total, 6 up, 6 in 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T13:30:35.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:35 smithi029 ceph-mon[217405]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: pgmap v51: 65 pgs: 23 peering, 8 remapped+peering, 27 active+clean, 2 active+undersized+degraded, 5 active+undersized; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5/219 objects degraded (2.283%); 0 B/s, 148 objects/s recovering 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: osdmap e61: 6 total, 6 up, 6 in 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: failed to encode map e61 with expected crc 2023-12-05T13:30:35.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T13:30:35.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:35 smithi052 ceph-mon[184394]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T13:30:36.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:36 smithi029 ceph-mon[217405]: failed to encode map e62 with expected crc 2023-12-05T13:30:36.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:36 smithi029 ceph-mon[217405]: osdmap e62: 6 total, 6 up, 6 in 2023-12-05T13:30:36.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:36 smithi029 ceph-mon[217405]: failed to encode map e62 with expected crc 2023-12-05T13:30:36.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:36 smithi029 ceph-mon[217405]: failed to encode map e62 with expected crc 2023-12-05T13:30:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:36 smithi052 ceph-mon[184394]: failed to encode map e62 with expected crc 2023-12-05T13:30:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:36 smithi052 ceph-mon[184394]: osdmap e62: 6 total, 6 up, 6 in 2023-12-05T13:30:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:36 smithi052 ceph-mon[184394]: failed to encode map e62 with expected crc 2023-12-05T13:30:36.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:36 smithi052 ceph-mon[184394]: failed to encode map e62 with expected crc 2023-12-05T13:30:37.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: pgmap v54: 65 pgs: 23 peering, 8 remapped+peering, 27 active+clean, 2 active+undersized+degraded, 5 active+undersized; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5/219 objects degraded (2.283%); 0 B/s, 181 objects/s recovering 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: osdmap e63: 6 total, 6 up, 6 in 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:37.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: pgmap v54: 65 pgs: 23 peering, 8 remapped+peering, 27 active+clean, 2 active+undersized+degraded, 5 active+undersized; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5/219 objects degraded (2.283%); 0 B/s, 181 objects/s recovering 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: osdmap e63: 6 total, 6 up, 6 in 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: failed to encode map e63 with expected crc 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:37.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:38.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:38 smithi029 ceph-mon[217405]: failed to encode map e64 with expected crc 2023-12-05T13:30:38.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:38 smithi029 ceph-mon[217405]: osdmap e64: 6 total, 6 up, 6 in 2023-12-05T13:30:38.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:38 smithi029 ceph-mon[217405]: failed to encode map e64 with expected crc 2023-12-05T13:30:38.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:38 smithi029 ceph-mon[217405]: failed to encode map e64 with expected crc 2023-12-05T13:30:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:38 smithi052 ceph-mon[184394]: failed to encode map e64 with expected crc 2023-12-05T13:30:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:38 smithi052 ceph-mon[184394]: osdmap e64: 6 total, 6 up, 6 in 2023-12-05T13:30:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:38 smithi052 ceph-mon[184394]: failed to encode map e64 with expected crc 2023-12-05T13:30:38.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:38 smithi052 ceph-mon[184394]: failed to encode map e64 with expected crc 2023-12-05T13:30:39.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: pgmap v57: 65 pgs: 1 peering, 1 remapped+peering, 63 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s, 0 objects/s recovering 2023-12-05T13:30:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T13:30:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded) 2023-12-05T13:30:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: failed to encode map e65 with expected crc 2023-12-05T13:30:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: failed to encode map e65 with expected crc 2023-12-05T13:30:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: osdmap e65: 6 total, 6 up, 6 in 2023-12-05T13:30:39.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:39 smithi029 ceph-mon[217405]: failed to encode map e65 with expected crc 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: pgmap v57: 65 pgs: 1 peering, 1 remapped+peering, 63 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s, 0 objects/s recovering 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded) 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: failed to encode map e65 with expected crc 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: failed to encode map e65 with expected crc 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: osdmap e65: 6 total, 6 up, 6 in 2023-12-05T13:30:39.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:39 smithi052 ceph-mon[184394]: failed to encode map e65 with expected crc 2023-12-05T13:30:41.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:41 smithi029 ceph-mon[217405]: pgmap v59: 65 pgs: 1 peering, 1 remapped+peering, 63 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s, 0 objects/s recovering 2023-12-05T13:30:41.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:41 smithi052 ceph-mon[184394]: pgmap v59: 65 pgs: 1 peering, 1 remapped+peering, 63 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s, 0 objects/s recovering 2023-12-05T13:30:42.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:42 smithi052 ceph-mon[184394]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T13:30:42.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:42 smithi052 ceph-mon[184394]: Cluster is now healthy 2023-12-05T13:30:42.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:42 smithi029 ceph-mon[217405]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T13:30:42.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:42 smithi029 ceph-mon[217405]: Cluster is now healthy 2023-12-05T13:30:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:43 smithi052 ceph-mon[184394]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s, 115 objects/s recovering 2023-12-05T13:30:43.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:43 smithi029 ceph-mon[217405]: pgmap v60: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s, 115 objects/s recovering 2023-12-05T13:30:45.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:44 smithi029 ceph-mon[217405]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s, 179 objects/s recovering 2023-12-05T13:30:45.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:44 smithi052 ceph-mon[184394]: pgmap v61: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s, 179 objects/s recovering 2023-12-05T13:30:47.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:47 smithi052 ceph-mon[184394]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 926 KiB/s, 159 objects/s recovering 2023-12-05T13:30:47.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:47 smithi029 ceph-mon[217405]: pgmap v62: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 926 KiB/s, 159 objects/s recovering 2023-12-05T13:30:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 -- 172.21.15.29:0/3721645033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 msgr2=0x7f76b80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.161 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 --2- 172.21.15.29:0/3721645033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b80fbfb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76a4004940 tx=0x7f76a4009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 -- 172.21.15.29:0/3721645033 shutdown_connections 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 --2- 172.21.15.29:0/3721645033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b80fbfb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 --2- 172.21.15.29:0/3721645033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b8101b00 0x7f76b8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 -- 172.21.15.29:0/3721645033 >> 172.21.15.29:0/3721645033 conn(0x7f76b80719b0 msgr2=0x7f76b8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 -- 172.21.15.29:0/3721645033 shutdown_connections 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.158+0000 7f76bef9b700 1 -- 172.21.15.29:0/3721645033 wait complete. 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bef9b700 1 Processor -- start 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bef9b700 1 -- start start 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bef9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b8113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bef9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b8101b00 0x7f76b8113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bef9b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b810d510 con 0x7f76b80fbb40 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bef9b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b810d680 con 0x7f76b8101b00 2023-12-05T13:30:48.162 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bcd37700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b8113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bcd37700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b8113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43434/0 (socket says 172.21.15.29:43434) 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.159+0000 7f76bcd37700 1 -- 172.21.15.29:0/1453922797 learned_addr learned my addr 172.21.15.29:0/1453922797 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76b7fff700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b8101b00 0x7f76b8113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76bcd37700 1 -- 172.21.15.29:0/1453922797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b8101b00 msgr2=0x7f76b8113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76bcd37700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b8101b00 0x7f76b8113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76bcd37700 1 -- 172.21.15.29:0/1453922797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4005040 con 0x7f76b80fbb40 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76bcd37700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b8113650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00b790 tx=0x7f76ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ac00f770 con 0x7f76b80fbb40 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76ac00fd80 con 0x7f76b80fbb40 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b810d960 con 0x7f76b80fbb40 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ac00d310 con 0x7f76b80fbb40 2023-12-05T13:30:48.163 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.160+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b810dea0 con 0x7f76b80fbb40 2023-12-05T13:30:48.164 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.161+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b80734d0 con 0x7f76b80fbb40 2023-12-05T13:30:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.162+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f76ac010420 con 0x7f76b80fbb40 2023-12-05T13:30:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.162+0000 7f76b57fa700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f76a806cf80 0x7f76a806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.162+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f76ac08c430 con 0x7f76b80fbb40 2023-12-05T13:30:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.162+0000 7f76b7fff700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f76a806cf80 0x7f76a806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.165 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.163+0000 7f76b7fff700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f76a806cf80 0x7f76a806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76b810eef0 tx=0x7f76a4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:48.167 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.167+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f76ac059cc0 con 0x7f76b80fbb40 2023-12-05T13:30:48.407 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.407+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76b810ec30 con 0x7f76a806cf80 2023-12-05T13:30:48.409 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.408+0000 7f76b57fa700 1 -- 172.21.15.29:0/1453922797 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f76b810ec30 con 0x7f76a806cf80 2023-12-05T13:30:48.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f76a806cf80 msgr2=0x7f76a806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f76a806cf80 0x7f76a806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76b810eef0 tx=0x7f76a4009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 msgr2=0x7f76b8113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b8113650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00b790 tx=0x7f76ac009250 comp rx=0 tx=0).stop 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 shutdown_connections 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f76a806cf80 0x7f76a806f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b80fbb40 0x7f76b8113650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 --2- 172.21.15.29:0/1453922797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b8101b00 0x7f76b8113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 >> 172.21.15.29:0/1453922797 conn(0x7f76b80719b0 msgr2=0x7f76b80ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 shutdown_connections 2023-12-05T13:30:48.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.411+0000 7f76bef9b700 1 -- 172.21.15.29:0/1453922797 wait complete. 2023-12-05T13:30:48.424 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:30:48.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:48.666 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 -- 172.21.15.29:0/1877370388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 msgr2=0x7fc780070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 --2- 172.21.15.29:0/1877370388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc780070350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc774004970 tx=0x7fc774009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 -- 172.21.15.29:0/1877370388 shutdown_connections 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 --2- 172.21.15.29:0/1877370388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc780070890 0x7fc780108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 --2- 172.21.15.29:0/1877370388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc780070350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 -- 172.21.15.29:0/1877370388 >> 172.21.15.29:0/1877370388 conn(0x7fc7800f8790 msgr2=0x7fc7800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 -- 172.21.15.29:0/1877370388 shutdown_connections 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 -- 172.21.15.29:0/1877370388 wait complete. 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.528+0000 7fc786ce4700 1 Processor -- start 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc786ce4700 1 -- start start 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc786ce4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc7801157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc786ce4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc780070890 0x7fc780115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.667 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc786ce4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780116370 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc786ce4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78010f6a0 con 0x7fc780070890 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc784a80700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc7801157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc784a80700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc7801157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56448/0 (socket says 172.21.15.29:56448) 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc784a80700 1 -- 172.21.15.29:0/747541905 learned_addr learned my addr 172.21.15.29:0/747541905 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc77ffff700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc780070890 0x7fc780115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc784a80700 1 -- 172.21.15.29:0/747541905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc780070890 msgr2=0x7fc780115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc784a80700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc780070890 0x7fc780115d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.529+0000 7fc784a80700 1 -- 172.21.15.29:0/747541905 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774005040 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.530+0000 7fc784a80700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc7801157e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc774009380 tx=0x7fc774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.530+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77400e040 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.530+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc774004290 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.530+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77401c630 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.530+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78010f920 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.530+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78010fe60 con 0x7fc78006ff80 2023-12-05T13:30:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.531+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780106630 con 0x7fc78006ff80 2023-12-05T13:30:48.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.532+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc77400bc10 con 0x7fc78006ff80 2023-12-05T13:30:48.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.532+0000 7fc77d7fa700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc77006cf80 0x7fc77006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.532+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fc77408d960 con 0x7fc78006ff80 2023-12-05T13:30:48.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.532+0000 7fc77ffff700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc77006cf80 0x7fc77006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.533+0000 7fc77ffff700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc77006cf80 0x7fc77006f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc780111010 tx=0x7fc76c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:48.669 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.537+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc77405b0e0 con 0x7fc78006ff80 2023-12-05T13:30:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:48.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.784+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc78004bbf0 con 0x7fc77006cf80 2023-12-05T13:30:48.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.785+0000 7fc77d7fa700 1 -- 172.21.15.29:0/747541905 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc78004bbf0 con 0x7fc77006cf80 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc77006cf80 msgr2=0x7fc77006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc77006cf80 0x7fc77006f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc780111010 tx=0x7fc76c009ee0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 msgr2=0x7fc7801157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc7801157e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc774009380 tx=0x7fc774009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 shutdown_connections 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc77006cf80 0x7fc77006f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc78006ff80 0x7fc7801157e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 --2- 172.21.15.29:0/747541905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc780070890 0x7fc780115d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 >> 172.21.15.29:0/747541905 conn(0x7fc7800f8790 msgr2=0x7fc7801037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 shutdown_connections 2023-12-05T13:30:48.788 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.787+0000 7fc786ce4700 1 -- 172.21.15.29:0/747541905 wait complete. 2023-12-05T13:30:48.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.900+0000 7f9494df1700 1 -- 172.21.15.29:0/3756990195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fc5d0 msgr2=0x7f94900fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.904 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.900+0000 7f9494df1700 1 --2- 172.21.15.29:0/3756990195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fc5d0 0x7f94900fc9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9480004940 tx=0x7f9480009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 -- 172.21.15.29:0/3756990195 shutdown_connections 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 --2- 172.21.15.29:0/3756990195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fcee0 0x7f9490109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 --2- 172.21.15.29:0/3756990195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fc5d0 0x7f94900fc9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 -- 172.21.15.29:0/3756990195 >> 172.21.15.29:0/3756990195 conn(0x7f94900719b0 msgr2=0x7f9490071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 -- 172.21.15.29:0/3756990195 shutdown_connections 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 -- 172.21.15.29:0/3756990195 wait complete. 2023-12-05T13:30:48.905 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 Processor -- start 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.901+0000 7f9494df1700 1 -- start start 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9494df1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fc5d0 0x7f94901158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9494df1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 0x7f9490115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9494df1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490116450 con 0x7f94900fcee0 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9494df1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949010f780 con 0x7f94900fc5d0 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 0x7f9490115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.906 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 0x7f9490115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56460/0 (socket says 172.21.15.29:56460) 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 -- 172.21.15.29:0/3718825646 learned_addr learned my addr 172.21.15.29:0/3718825646 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948e59c700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fc5d0 0x7f94901158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 -- 172.21.15.29:0/3718825646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fc5d0 msgr2=0x7f94901158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fc5d0 0x7f94901158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 -- 172.21.15.29:0/3718825646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480005040 con 0x7f94900fcee0 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948e59c700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fc5d0 0x7f94901158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f948dd9b700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 0x7f9490115e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9478002a50 tx=0x7f94780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9478007cc0 con 0x7f94900fcee0 2023-12-05T13:30:48.907 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f947800f040 con 0x7f94900fcee0 2023-12-05T13:30:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949010fa60 con 0x7f94900fcee0 2023-12-05T13:30:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9478009540 con 0x7f94900fcee0 2023-12-05T13:30:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.902+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949010ffa0 con 0x7f94900fcee0 2023-12-05T13:30:48.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.904+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94901068c0 con 0x7f94900fcee0 2023-12-05T13:30:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.904+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f94780096a0 con 0x7f94900fcee0 2023-12-05T13:30:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.905+0000 7f9486ffd700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f947c06cf80 0x7f947c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.905+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f947808c3c0 con 0x7f94900fcee0 2023-12-05T13:30:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.905+0000 7f948e59c700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f947c06cf80 0x7f947c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:48.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.905+0000 7f948e59c700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f947c06cf80 0x7f947c06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f948000b3b0 tx=0x7f9480009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:48.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:48.910+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9478059ac0 con 0x7f94900fcee0 2023-12-05T13:30:49.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.132+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9490115590 con 0x7f947c06cf80 2023-12-05T13:30:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.143+0000 7f9486ffd700 1 -- 172.21.15.29:0/3718825646 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9490115590 con 0x7f947c06cf80 2023-12-05T13:30:49.144 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:30:49.144 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (2m) 19s ago 11m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:30:49.144 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (44s) 19s ago 12m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:30:49.144 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (40s) 37s ago 11m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (2m) 19s ago 11m 82.5M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (7m) 19s ago 7m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (7m) 19s ago 7m 19.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (7m) 37s ago 7m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (7m) 37s ago 7m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (3m) 19s ago 13m 509M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (3m) 37s ago 11m 448M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (95s) 19s ago 13m 56.8M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (73s) 37s ago 11m 40.9M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (3m) 19s ago 12m 16.3M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:30:49.145 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (3m) 37s ago 11m 17.0M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (24s) 19s ago 10m 11.7M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (10m) 19s ago 10m 1044M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc d5f62643e0e6 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (9m) 19s ago 9m 776M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (9m) 37s ago 9m 1115M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (9m) 37s ago 9m 796M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (8m) 37s ago 8m 975M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:30:49.146 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (2m) 19s ago 11m 59.3M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:30:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.145+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f947c06cf80 msgr2=0x7f947c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.145+0000 7f9494df1700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f947c06cf80 0x7f947c06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f948000b3b0 tx=0x7f9480009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.145+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 msgr2=0x7f9490115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.145+0000 7f9494df1700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 0x7f9490115e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9478002a50 tx=0x7f94780046b0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 shutdown_connections 2023-12-05T13:30:49.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f947c06cf80 0x7f947c06f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94900fc5d0 0x7f94901158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 --2- 172.21.15.29:0/3718825646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94900fcee0 0x7f9490115e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 >> 172.21.15.29:0/3718825646 conn(0x7f94900719b0 msgr2=0x7f94900fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 shutdown_connections 2023-12-05T13:30:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.146+0000 7f9494df1700 1 -- 172.21.15.29:0/3718825646 wait complete. 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 -- 172.21.15.29:0/4149751415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae00fb1e0 msgr2=0x7fdae00fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 --2- 172.21.15.29:0/4149751415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae00fb1e0 0x7fdae00fb630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdad4004940 tx=0x7fdad4009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 -- 172.21.15.29:0/4149751415 shutdown_connections 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 --2- 172.21.15.29:0/4149751415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae00fb1e0 0x7fdae00fb630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 --2- 172.21.15.29:0/4149751415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae0102c70 0x7fdae0103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 -- 172.21.15.29:0/4149751415 >> 172.21.15.29:0/4149751415 conn(0x7fdae00711a0 msgr2=0x7fdae00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 -- 172.21.15.29:0/4149751415 shutdown_connections 2023-12-05T13:30:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.257+0000 7fdae5133700 1 -- 172.21.15.29:0/4149751415 wait complete. 2023-12-05T13:30:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.258+0000 7fdae5133700 1 Processor -- start 2023-12-05T13:30:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.258+0000 7fdae5133700 1 -- start start 2023-12-05T13:30:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.258+0000 7fdae5133700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae00fb1e0 0x7fdae00fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.258+0000 7fdae5133700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 0x7fdae00fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.258+0000 7fdae5133700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00fcf00 con 0x7fdae0102c70 2023-12-05T13:30:49.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.258+0000 7fdae5133700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00fd070 con 0x7fdae00fb1e0 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 0x7fdae00fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 0x7fdae00fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56470/0 (socket says 172.21.15.29:56470) 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 -- 172.21.15.29:0/2846020578 learned_addr learned my addr 172.21.15.29:0/2846020578 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdaded9d700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae00fb1e0 0x7fdae00fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 -- 172.21.15.29:0/2846020578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae00fb1e0 msgr2=0x7fdae00fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae00fb1e0 0x7fdae00fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 -- 172.21.15.29:0/2846020578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4005040 con 0x7fdae0102c70 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdade59c700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 0x7fdae00fc900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdad400b3b0 tx=0x7fdad4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad400e040 con 0x7fdae0102c70 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdad400bc50 con 0x7fdae0102c70 2023-12-05T13:30:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae0119870 con 0x7fdae0102c70 2023-12-05T13:30:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad4013420 con 0x7fdae0102c70 2023-12-05T13:30:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.259+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae0119cd0 con 0x7fdae0102c70 2023-12-05T13:30:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.260+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae0105050 con 0x7fdae0102c70 2023-12-05T13:30:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.261+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fdad401c430 con 0x7fdae0102c70 2023-12-05T13:30:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.261+0000 7fdac77fe700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdac806cf80 0x7fdac806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.262+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fdad408d340 con 0x7fdae0102c70 2023-12-05T13:30:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.262+0000 7fdaded9d700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdac806cf80 0x7fdac806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.262+0000 7fdaded9d700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdac806cf80 0x7fdac806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004990 tx=0x7fdad0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.266+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdad40570e0 con 0x7fdae0102c70 2023-12-05T13:30:49.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.566+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdae0072cc0 con 0x7fdae0102c70 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.566+0000 7fdac77fe700 1 -- 172.21.15.29:0/2846020578 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fdad405a700 con 0x7fdae0102c70 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:30:49.567 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5, 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 9, 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 5 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:30:49.568 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:30:49.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdac806cf80 msgr2=0x7fdac806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdac806cf80 0x7fdac806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004990 tx=0x7fdad0009ee0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 msgr2=0x7fdae00fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 0x7fdae00fc900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdad400b3b0 tx=0x7fdad4009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 shutdown_connections 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdac806cf80 0x7fdac806f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdae00fb1e0 0x7fdae00fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 --2- 172.21.15.29:0/2846020578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdae0102c70 0x7fdae00fc900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 >> 172.21.15.29:0/2846020578 conn(0x7fdae00711a0 msgr2=0x7fdae00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 shutdown_connections 2023-12-05T13:30:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.569+0000 7fdae5133700 1 -- 172.21.15.29:0/2846020578 wait complete. 2023-12-05T13:30:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:49 smithi029 ceph-mon[217405]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 68 objects/s recovering 2023-12-05T13:30:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:49 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:49 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:49 smithi029 ceph-mon[217405]: Upgrade: osd.1 is safe to restart 2023-12-05T13:30:49.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:49 smithi029 ceph-mon[217405]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 -- 172.21.15.29:0/769049174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1380fbb40 msgr2=0x7ff1380fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 --2- 172.21.15.29:0/769049174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1380fbb40 0x7ff1380fbfb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff128004940 tx=0x7ff128009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 -- 172.21.15.29:0/769049174 shutdown_connections 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 --2- 172.21.15.29:0/769049174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff1380fbb40 0x7ff1380fbfb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 --2- 172.21.15.29:0/769049174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff138101b00 0x7ff138101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 -- 172.21.15.29:0/769049174 >> 172.21.15.29:0/769049174 conn(0x7ff1380719b0 msgr2=0x7ff138071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 -- 172.21.15.29:0/769049174 shutdown_connections 2023-12-05T13:30:49.682 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.681+0000 7ff13c97b700 1 -- 172.21.15.29:0/769049174 wait complete. 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13c97b700 1 Processor -- start 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13c97b700 1 -- start start 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13c97b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1380fbb40 0x7ff1380fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13c97b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 0x7ff1380fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13c97b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380fe260 con 0x7ff138101b00 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13c97b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380fe3d0 con 0x7ff1380fbb40 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff135d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 0x7ff1380fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff135d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 0x7ff1380fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56486/0 (socket says 172.21.15.29:56486) 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff135d9b700 1 -- 172.21.15.29:0/1437712855 learned_addr learned my addr 172.21.15.29:0/1437712855 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff13659c700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1380fbb40 0x7ff1380fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff135d9b700 1 -- 172.21.15.29:0/1437712855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1380fbb40 msgr2=0x7ff1380fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff135d9b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1380fbb40 0x7ff1380fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.684 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.682+0000 7ff135d9b700 1 -- 172.21.15.29:0/1437712855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128005040 con 0x7ff138101b00 2023-12-05T13:30:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.683+0000 7ff135d9b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 0x7ff1380fdc60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff12800b3b0 tx=0x7ff128009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.683+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12800e040 con 0x7ff138101b00 2023-12-05T13:30:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.683+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff12800bc50 con 0x7ff138101b00 2023-12-05T13:30:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.683+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff138119900 con 0x7ff138101b00 2023-12-05T13:30:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.683+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff128013420 con 0x7ff138101b00 2023-12-05T13:30:49.685 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.683+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff138119d60 con 0x7ff138101b00 2023-12-05T13:30:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.684+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1380734d0 con 0x7ff138101b00 2023-12-05T13:30:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.685+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7ff12801c430 con 0x7ff138101b00 2023-12-05T13:30:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.685+0000 7ff12effd700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff12406cf80 0x7ff12406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.685+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7ff12808d340 con 0x7ff138101b00 2023-12-05T13:30:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.685+0000 7ff13659c700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff12406cf80 0x7ff12406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:49.686 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.686+0000 7ff13659c700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff12406cf80 0x7ff12406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff120004990 tx=0x7ff120009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:49.690 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.690+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff1280570e0 con 0x7ff138101b00 2023-12-05T13:30:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:49 smithi052 ceph-mon[184394]: pgmap v63: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 68 objects/s recovering 2023-12-05T13:30:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:49 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:49 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T13:30:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:49 smithi052 ceph-mon[184394]: Upgrade: osd.1 is safe to restart 2023-12-05T13:30:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:49 smithi052 ceph-mon[184394]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:49.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.946+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff138108ab0 con 0x7ff138101b00 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.946+0000 7ff12effd700 1 -- 172.21.15.29:0/1437712855 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7ff12805a700 con 0x7ff138101b00 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:30:49.947 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:30:49.948 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:30:49.949 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:49.950 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:30:49.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff12406cf80 msgr2=0x7ff12406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff12406cf80 0x7ff12406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff120004990 tx=0x7ff120009ee0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 msgr2=0x7ff1380fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 0x7ff1380fdc60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff12800b3b0 tx=0x7ff128009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 shutdown_connections 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff12406cf80 0x7ff12406f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1380fbb40 0x7ff1380fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 --2- 172.21.15.29:0/1437712855 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff138101b00 0x7ff1380fdc60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 >> 172.21.15.29:0/1437712855 conn(0x7ff1380719b0 msgr2=0x7ff138065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 shutdown_connections 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:49.948+0000 7ff13c97b700 1 -- 172.21.15.29:0/1437712855 wait complete. 2023-12-05T13:30:49.953 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 -- 172.21.15.29:0/3888296871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 msgr2=0x7f7930101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 --2- 172.21.15.29:0/3888296871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f7930101f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7920004940 tx=0x7f7920009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 -- 172.21.15.29:0/3888296871 shutdown_connections 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 --2- 172.21.15.29:0/3888296871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79300fbb00 0x7f79300fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 --2- 172.21.15.29:0/3888296871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f7930101f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 -- 172.21.15.29:0/3888296871 >> 172.21.15.29:0/3888296871 conn(0x7f79300f7680 msgr2=0x7f79300f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 -- 172.21.15.29:0/3888296871 shutdown_connections 2023-12-05T13:30:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.062+0000 7f793639c700 1 -- 172.21.15.29:0/3888296871 wait complete. 2023-12-05T13:30:50.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.063+0000 7f793639c700 1 Processor -- start 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.063+0000 7f793639c700 1 -- start start 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.063+0000 7f793639c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79300fbb00 0x7f793010e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f793639c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f793010ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f793639c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793010f240 con 0x7f7930101b60 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f793639c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793010f380 con 0x7f79300fbb00 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f793010ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f793010ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56502/0 (socket says 172.21.15.29:56502) 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 -- 172.21.15.29:0/1530419895 learned_addr learned my addr 172.21.15.29:0/1530419895 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792ffff700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79300fbb00 0x7f793010e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 -- 172.21.15.29:0/1530419895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79300fbb00 msgr2=0x7f793010e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79300fbb00 0x7f793010e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 -- 172.21.15.29:0/1530419895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920005040 con 0x7f7930101b60 2023-12-05T13:30:50.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792f7fe700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f793010ecb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7924002a50 tx=0x7f79240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:50.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7924007cc0 con 0x7f7930101b60 2023-12-05T13:30:50.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79301176e0 con 0x7f7930101b60 2023-12-05T13:30:50.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f792400f040 con 0x7f7930101b60 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.064+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f792400d9c0 con 0x7f7930101b60 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.065+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7930117bf0 con 0x7f7930101b60 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.066+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7930103f40 con 0x7f7930101b60 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.066+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f792400db20 con 0x7f7930101b60 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.066+0000 7f792cff9700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f791806cf80 0x7f791806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.067+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f792408c2b0 con 0x7f7930101b60 2023-12-05T13:30:50.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.067+0000 7f792ffff700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f791806cf80 0x7f791806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:50.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.067+0000 7f792ffff700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f791806cf80 0x7f791806f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f792000b3b0 tx=0x7f7920009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:50.072 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.071+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7924055f20 con 0x7f7930101b60 2023-12-05T13:30:50.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.306+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f793004bc20 con 0x7f791806cf80 2023-12-05T13:30:50.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.308+0000 7f792cff9700 1 -- 172.21.15.29:0/1530419895 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7920008e10 con 0x7f791806cf80 2023-12-05T13:30:50.308 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:30:50.308 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:30:50.308 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:30:50.308 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "7/21 daemons upgraded", 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:30:50.309 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f791806cf80 msgr2=0x7f791806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f791806cf80 0x7f791806f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f792000b3b0 tx=0x7f7920009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 msgr2=0x7f793010ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f793010ecb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7924002a50 tx=0x7f79240046b0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 shutdown_connections 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f791806cf80 0x7f791806f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79300fbb00 0x7f793010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 --2- 172.21.15.29:0/1530419895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7930101b60 0x7f793010ecb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 >> 172.21.15.29:0/1530419895 conn(0x7f79300f7680 msgr2=0x7f79300f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:50.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.310+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 shutdown_connections 2023-12-05T13:30:50.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.311+0000 7f793639c700 1 -- 172.21.15.29:0/1530419895 wait complete. 2023-12-05T13:30:50.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 -- 172.21.15.29:0/2326717284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda0101b00 msgr2=0x7fdda0101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 --2- 172.21.15.29:0/2326717284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda0101b00 0x7fdda0101ed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c004940 tx=0x7fdd9c009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:50.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 -- 172.21.15.29:0/2326717284 shutdown_connections 2023-12-05T13:30:50.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 --2- 172.21.15.29:0/2326717284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda00fbb40 0x7fdda00fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.427 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 --2- 172.21.15.29:0/2326717284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda0101b00 0x7fdda0101ed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 -- 172.21.15.29:0/2326717284 >> 172.21.15.29:0/2326717284 conn(0x7fdda00719b0 msgr2=0x7fdda0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:50.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 -- 172.21.15.29:0/2326717284 shutdown_connections 2023-12-05T13:30:50.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.426+0000 7fdda7504700 1 -- 172.21.15.29:0/2326717284 wait complete. 2023-12-05T13:30:50.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda7504700 1 Processor -- start 2023-12-05T13:30:50.428 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda7504700 1 -- start start 2023-12-05T13:30:50.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda7504700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 0x7fdda0106980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:50.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda7504700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda0101b00 0x7fdda0106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:50.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda7504700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda01074c0 con 0x7fdda00fbb40 2023-12-05T13:30:50.429 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda7504700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda0107630 con 0x7fdda0101b00 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda52a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 0x7fdda0106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda52a0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 0x7fdda0106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56526/0 (socket says 172.21.15.29:56526) 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda52a0700 1 -- 172.21.15.29:0/3745931692 learned_addr learned my addr 172.21.15.29:0/3745931692 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.427+0000 7fdda4a9f700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda0101b00 0x7fdda0106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdda52a0700 1 -- 172.21.15.29:0/3745931692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda0101b00 msgr2=0x7fdda0106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdda52a0700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda0101b00 0x7fdda0106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdda52a0700 1 -- 172.21.15.29:0/3745931692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c005040 con 0x7fdda00fbb40 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdda52a0700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 0x7fdda0106980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00b3b0 tx=0x7fdd9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9c00e040 con 0x7fdda00fbb40 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd9c00bc50 con 0x7fdda00fbb40 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda0119890 con 0x7fdda00fbb40 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9c013420 con 0x7fdda00fbb40 2023-12-05T13:30:50.430 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.428+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda0119cf0 con 0x7fdda00fbb40 2023-12-05T13:30:50.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.429+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda0103fb0 con 0x7fdda00fbb40 2023-12-05T13:30:50.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.430+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fdd9c01c430 con 0x7fdda00fbb40 2023-12-05T13:30:50.431 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.430+0000 7fdd95ffb700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdd8c06cf80 0x7fdd8c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:30:50.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.430+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fdd9c08d3e0 con 0x7fdda00fbb40 2023-12-05T13:30:50.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.430+0000 7fdda4a9f700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdd8c06cf80 0x7fdd8c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:30:50.432 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.431+0000 7fdda4a9f700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdd8c06cf80 0x7fdd8c06f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdda0108380 tx=0x7fdd90009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:30:50.435 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.435+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdd9c0570e0 con 0x7fdda00fbb40 2023-12-05T13:30:50.601 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:50 smithi029 ceph-mon[217405]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:50.601 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:50 smithi029 ceph-mon[217405]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:50.601 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:50 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2846020578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:50.601 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:50 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1437712855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:30:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:50 smithi052 ceph-mon[184394]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:50 smithi052 ceph-mon[184394]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:50 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2846020578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:30:50.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:50 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1437712855' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:30:50.739 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_OK 2023-12-05T13:30:50.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.738+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdda01080c0 con 0x7fdda00fbb40 2023-12-05T13:30:50.739 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.738+0000 7fdd95ffb700 1 -- 172.21.15.29:0/3745931692 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdd9c05a700 con 0x7fdda00fbb40 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdd8c06cf80 msgr2=0x7fdd8c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdd8c06cf80 0x7fdd8c06f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdda0108380 tx=0x7fdd90009ee0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 msgr2=0x7fdda0106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 0x7fdda0106980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00b3b0 tx=0x7fdd9c009e30 comp rx=0 tx=0).stop 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 shutdown_connections 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdd8c06cf80 0x7fdd8c06f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdda00fbb40 0x7fdda0106980 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 --2- 172.21.15.29:0/3745931692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda0101b00 0x7fdda0106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:30:50.741 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 >> 172.21.15.29:0/3745931692 conn(0x7fdda00719b0 msgr2=0x7fdda00fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:30:50.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.740+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 shutdown_connections 2023-12-05T13:30:50.742 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:30:50.741+0000 7fdda7504700 1 -- 172.21.15.29:0/3745931692 wait complete. 2023-12-05T13:30:51.496 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:51 smithi029 ceph-mon[217405]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 58 objects/s recovering 2023-12-05T13:30:51.497 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:51 smithi029 ceph-mon[217405]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:51.497 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:51 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3745931692' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:30:51.497 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:51.497 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T13:30:51.497 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:51 smithi052 ceph-mon[184394]: pgmap v64: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 58 objects/s recovering 2023-12-05T13:30:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:51 smithi052 ceph-mon[184394]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:30:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:51 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3745931692' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:30:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T13:30:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:30:52.281 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:52 smithi029 ceph-mon[217405]: Upgrade: Updating osd.1 2023-12-05T13:30:52.281 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:52 smithi029 ceph-mon[217405]: Deploying daemon osd.1 on smithi029 2023-12-05T13:30:52.281 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:52.281 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:52 smithi052 ceph-mon[184394]: Upgrade: Updating osd.1 2023-12-05T13:30:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:52 smithi052 ceph-mon[184394]: Deploying daemon osd.1 on smithi029 2023-12-05T13:30:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:30:53.547 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:53 smithi029 ceph-mon[217405]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 57 objects/s recovering 2023-12-05T13:30:53.547 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:53 smithi029 systemd[1]: Stopping Ceph osd.1 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:30:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:53 smithi052 ceph-mon[184394]: pgmap v65: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 57 objects/s recovering 2023-12-05T13:30:53.854 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:53 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[145555]: 2023-12-05T13:30:53.545+0000 7f00211f3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:30:53.854 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:53 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[145555]: 2023-12-05T13:30:53.545+0000 7f00211f3700 -1 osd.1 65 *** Got signal Terminated *** 2023-12-05T13:30:53.854 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:53 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[145555]: 2023-12-05T13:30:53.545+0000 7f00211f3700 -1 osd.1 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:30:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:54 smithi029 ceph-mon[217405]: mgrmap e41: smithi029.eekhlu(active, since 91s), standbys: smithi052.ocazcp 2023-12-05T13:30:54.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:54 smithi029 ceph-mon[217405]: osd.1 marked itself down and dead 2023-12-05T13:30:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:54 smithi052 ceph-mon[184394]: mgrmap e41: smithi029.eekhlu(active, since 91s), standbys: smithi052.ocazcp 2023-12-05T13:30:54.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:54 smithi052 ceph-mon[184394]: osd.1 marked itself down and dead 2023-12-05T13:30:55.255 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:55 smithi029 bash[239280]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: pgmap v66: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: osdmap e66: 6 total, 5 up, 6 in 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.565 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:55 smithi029 ceph-mon[217405]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: pgmap v66: 65 pgs: 65 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: osdmap e66: 6 total, 5 up, 6 in 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: failed to encode map e66 with expected crc 2023-12-05T13:30:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:55 smithi052 ceph-mon[184394]: failed to encode map e66 with expected crc 2023-12-05T13:30:56.603 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:56 smithi029 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.1.service: Succeeded. 2023-12-05T13:30:56.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:56 smithi029 systemd[1]: Stopped Ceph osd.1 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:30:56.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:56 smithi029 systemd[1]: Starting Ceph osd.1 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:30:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:56 smithi029 ceph-mon[217405]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:56 smithi029 ceph-mon[217405]: osdmap e67: 6 total, 5 up, 6 in 2023-12-05T13:30:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:56 smithi029 ceph-mon[217405]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:56 smithi029 ceph-mon[217405]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:56 smithi029 ceph-mon[217405]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:56 smithi029 ceph-mon[217405]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:56 smithi052 ceph-mon[184394]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:56 smithi052 ceph-mon[184394]: osdmap e67: 6 total, 5 up, 6 in 2023-12-05T13:30:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:56 smithi052 ceph-mon[184394]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:56 smithi052 ceph-mon[184394]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:56 smithi052 ceph-mon[184394]: failed to encode map e67 with expected crc 2023-12-05T13:30:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:56 smithi052 ceph-mon[184394]: failed to encode map e67 with expected crc 2023-12-05T13:30:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:57 smithi029 ceph-mon[217405]: pgmap v69: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2023-12-05T13:30:57.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-05T13:30:57.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-05T13:30:57.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-05T13:30:57.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-05T13:30:57.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-05T13:30:57.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-05T13:30:57.605 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:57 smithi029 bash[239543]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-05T13:30:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:57 smithi052 ceph-mon[184394]: pgmap v69: 65 pgs: 12 stale+active+clean, 53 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2023-12-05T13:30:58.353 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:58 smithi029 ceph-osd[239872]: -- 172.21.15.29:0/1924936156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5567cd0cf1e0 con 0x5567cd09f000 2023-12-05T13:30:58.353 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:58 smithi029 bash[239834]: 54b9f199069e862586b03644b848d40f3d4d2766893ff006e252a0c19a9b23c8 2023-12-05T13:30:58.353 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:58 smithi029 systemd[1]: Started Ceph osd.1 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:30:58.854 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:30:58 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:30:58.580+0000 7fb622a0b640 -1 Falling back to public interface 2023-12-05T13:30:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:59 smithi052 ceph-mon[184394]: pgmap v70: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 32/219 objects degraded (14.612%) 2023-12-05T13:30:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:30:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:30:59.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:59.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:30:59.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:59 smithi029 ceph-mon[217405]: pgmap v70: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 32/219 objects degraded (14.612%) 2023-12-05T13:30:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:30:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:00.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:00 smithi052 ceph-mon[184394]: Health check failed: Degraded data redundancy: 32/219 objects degraded (14.612%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:00.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:00 smithi029 ceph-mon[217405]: Health check failed: Degraded data redundancy: 32/219 objects degraded (14.612%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:01.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:01 smithi029 ceph-mon[217405]: pgmap v71: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 32/219 objects degraded (14.612%) 2023-12-05T13:31:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:01 smithi052 ceph-mon[184394]: pgmap v71: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s; 32/219 objects degraded (14.612%) 2023-12-05T13:31:03.201 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.201 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.201 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:02 smithi029 ceph-mon[217405]: pgmap v72: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-05T13:31:03.201 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.201 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:02 smithi052 ceph-mon[184394]: pgmap v72: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-05T13:31:03.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:03.462 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:31:03 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:31:03.200+0000 7fb622a0b640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-05T13:31:04.060 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:31:03 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:31:03.832+0000 7fb622a0b640 -1 osd.1 65 log_to_monitors true 2023-12-05T13:31:05.104 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:31:04 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:31:04.780+0000 7fb61367b700 -1 osd.1 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:31:05.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:04 smithi029 ceph-mon[217405]: from='osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T13:31:05.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:04 smithi029 ceph-mon[217405]: pgmap v73: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-05T13:31:05.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:04 smithi052 ceph-mon[184394]: from='osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T13:31:05.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:04 smithi052 ceph-mon[184394]: pgmap v73: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: failed to encode map e68 with expected crc 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: osdmap e68: 6 total, 5 up, 6 in 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:06.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: failed to encode map e68 with expected crc 2023-12-05T13:31:06.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:06.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:06.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:06.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:06.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: failed to encode map e68 with expected crc 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: osdmap e68: 6 total, 5 up, 6 in 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: failed to encode map e68 with expected crc 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:06.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: failed to encode map e68 with expected crc 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260] boot 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: osdmap e69: 6 total, 6 up, 6 in 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:31:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:06 smithi029 ceph-mon[217405]: pgmap v76: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: failed to encode map e68 with expected crc 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: osd.1 [v2:172.21.15.29:6810/3920482260,v1:172.21.15.29:6811/3920482260] boot 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: osdmap e69: 6 total, 6 up, 6 in 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T13:31:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:06 smithi052 ceph-mon[184394]: pgmap v76: 65 pgs: 19 active+undersized, 13 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 32/219 objects degraded (14.612%) 2023-12-05T13:31:08.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: osdmap e70: 6 total, 6 up, 6 in 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: osdmap e70: 6 total, 6 up, 6 in 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: failed to encode map e70 with expected crc 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:08.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:08 smithi029 ceph-mon[217405]: pgmap v78: 65 pgs: 1 peering, 5 active+undersized, 7 active+undersized+degraded, 52 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-05T13:31:09.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:08 smithi052 ceph-mon[184394]: pgmap v78: 65 pgs: 1 peering, 5 active+undersized, 7 active+undersized+degraded, 52 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-05T13:31:10.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:09 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:10.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:09 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:11.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:10 smithi029 ceph-mon[217405]: pgmap v79: 65 pgs: 1 peering, 64 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:11.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:10 smithi052 ceph-mon[184394]: pgmap v79: 65 pgs: 1 peering, 64 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:12.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:11 smithi029 ceph-mon[217405]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2023-12-05T13:31:12.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:11 smithi029 ceph-mon[217405]: Cluster is now healthy 2023-12-05T13:31:12.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:11 smithi052 ceph-mon[184394]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2023-12-05T13:31:12.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:11 smithi052 ceph-mon[184394]: Cluster is now healthy 2023-12-05T13:31:13.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:12 smithi029 ceph-mon[217405]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:13.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:12 smithi052 ceph-mon[184394]: pgmap v80: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:15.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:14 smithi029 ceph-mon[217405]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:14 smithi052 ceph-mon[184394]: pgmap v81: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:17.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:17 smithi052 ceph-mon[184394]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:17.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:17 smithi029 ceph-mon[217405]: pgmap v82: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:18.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:18 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:18 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:19.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:19 smithi029 ceph-mon[217405]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:19.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:19 smithi052 ceph-mon[184394]: pgmap v83: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 -- 172.21.15.29:0/2552274632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 msgr2=0x7feba8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 --2- 172.21.15.29:0/2552274632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8065800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb94004940 tx=0x7feb94009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 -- 172.21.15.29:0/2552274632 shutdown_connections 2023-12-05T13:31:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 --2- 172.21.15.29:0/2552274632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8065800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 --2- 172.21.15.29:0/2552274632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feba8102c20 0x7feba8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 -- 172.21.15.29:0/2552274632 >> 172.21.15.29:0/2552274632 conn(0x7feba80719b0 msgr2=0x7feba8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 -- 172.21.15.29:0/2552274632 shutdown_connections 2023-12-05T13:31:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.866+0000 7febaf13d700 1 -- 172.21.15.29:0/2552274632 wait complete. 2023-12-05T13:31:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaf13d700 1 Processor -- start 2023-12-05T13:31:20.868 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaf13d700 1 -- start start 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaf13d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaf13d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feba8102c20 0x7feba8113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaf13d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba81142c0 con 0x7feba8065390 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaf13d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba810d5f0 con 0x7feba8102c20 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaced9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaced9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34612/0 (socket says 172.21.15.29:34612) 2023-12-05T13:31:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7febaced9700 1 -- 172.21.15.29:0/2333276728 learned_addr learned my addr 172.21.15.29:0/2333276728 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.867+0000 7feba7fff700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feba8102c20 0x7feba8113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7febaced9700 1 -- 172.21.15.29:0/2333276728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feba8102c20 msgr2=0x7feba8113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7febaced9700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feba8102c20 0x7feba8113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7febaced9700 1 -- 172.21.15.29:0/2333276728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94005040 con 0x7feba8065390 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7febaced9700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8113730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb9c002a50 tx=0x7feb9c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9c007cc0 con 0x7feba8065390 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba810d8d0 con 0x7feba8065390 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb9c00f040 con 0x7feba8065390 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9c00d9c0 con 0x7feba8065390 2023-12-05T13:31:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.868+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba810de10 con 0x7feba8065390 2023-12-05T13:31:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.869+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba80fff40 con 0x7feba8065390 2023-12-05T13:31:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.870+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7feb9c00db20 con 0x7feba8065390 2023-12-05T13:31:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.870+0000 7feba57fa700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7feb9806ce70 0x7feb9806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.870+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7feb9c08c050 con 0x7feba8065390 2023-12-05T13:31:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.871+0000 7feba7fff700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7feb9806ce70 0x7feb9806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:20.871 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.871+0000 7feba7fff700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7feb9806ce70 0x7feb9806f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feba810e800 tx=0x7feb94009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:20.876 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:20.876+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7feb9c059970 con 0x7feba8065390 2023-12-05T13:31:21.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.117+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feba804bbf0 con 0x7feb9806ce70 2023-12-05T13:31:21.118 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.118+0000 7feba57fa700 1 -- 172.21.15.29:0/2333276728 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7feba804bbf0 con 0x7feb9806ce70 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7feb9806ce70 msgr2=0x7feb9806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7feb9806ce70 0x7feb9806f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feba810e800 tx=0x7feb94009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 msgr2=0x7feba8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8113730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb9c002a50 tx=0x7feb9c0046b0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 shutdown_connections 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7feb9806ce70 0x7feb9806f320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feba8065390 0x7feba8113730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 --2- 172.21.15.29:0/2333276728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feba8102c20 0x7feba8113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 >> 172.21.15.29:0/2333276728 conn(0x7feba80719b0 msgr2=0x7feba80fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:21.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 shutdown_connections 2023-12-05T13:31:21.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.120+0000 7febaf13d700 1 -- 172.21.15.29:0/2333276728 wait complete. 2023-12-05T13:31:21.134 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.240+0000 7f699bd4d700 1 -- 172.21.15.29:0/3219659043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 msgr2=0x7f6994102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.240+0000 7f699bd4d700 1 --2- 172.21.15.29:0/3219659043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994102ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6990004940 tx=0x7f6990009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 -- 172.21.15.29:0/3219659043 shutdown_connections 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 --2- 172.21.15.29:0/3219659043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994065390 0x7f6994065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 --2- 172.21.15.29:0/3219659043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994102ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 -- 172.21.15.29:0/3219659043 >> 172.21.15.29:0/3219659043 conn(0x7f69940719b0 msgr2=0x7f6994071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:21.242 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 -- 172.21.15.29:0/3219659043 shutdown_connections 2023-12-05T13:31:21.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 -- 172.21.15.29:0/3219659043 wait complete. 2023-12-05T13:31:21.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 Processor -- start 2023-12-05T13:31:21.243 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.241+0000 7f699bd4d700 1 -- start start 2023-12-05T13:31:21.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f699bd4d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994065390 0x7f6994113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f699bd4d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.244 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f699bd4d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6994114220 con 0x7f6994102c20 2023-12-05T13:31:21.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f699bd4d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699410d570 con 0x7f6994065390 2023-12-05T13:31:21.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34638/0 (socket says 172.21.15.29:34638) 2023-12-05T13:31:21.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 -- 172.21.15.29:0/2694941849 learned_addr learned my addr 172.21.15.29:0/2694941849 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:21.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f6999ae9700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994065390 0x7f6994113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.245 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 -- 172.21.15.29:0/2694941849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994065390 msgr2=0x7f6994113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994065390 0x7f6994113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 -- 172.21.15.29:0/2694941849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990005040 con 0x7f6994102c20 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.242+0000 7f69992e8700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994113bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6988002a50 tx=0x7f69880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.243+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6988007cc0 con 0x7f6994102c20 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.243+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f698800f040 con 0x7f6994102c20 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.243+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699410d850 con 0x7f6994102c20 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.243+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f698800d9c0 con 0x7f6994102c20 2023-12-05T13:31:21.246 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.243+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699410dd90 con 0x7f6994102c20 2023-12-05T13:31:21.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.245+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69940fff40 con 0x7f6994102c20 2023-12-05T13:31:21.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.245+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f698800db20 con 0x7f6994102c20 2023-12-05T13:31:21.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.245+0000 7f69867fc700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f698006ce70 0x7f698006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.245+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f698808bf90 con 0x7f6994102c20 2023-12-05T13:31:21.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.245+0000 7f6999ae9700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f698006ce70 0x7f698006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.246+0000 7f6999ae9700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f698006ce70 0x7f698006f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f699000b3b0 tx=0x7f6990009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:21.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.250+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f69880bf2f0 con 0x7f6994102c20 2023-12-05T13:31:21.481 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:21 smithi029 ceph-mon[217405]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:21.481 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:21 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:21.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.487+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f699404bb80 con 0x7f698006ce70 2023-12-05T13:31:21.488 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.488+0000 7f69867fc700 1 -- 172.21.15.29:0/2694941849 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f699404bb80 con 0x7f698006ce70 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f698006ce70 msgr2=0x7f698006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f698006ce70 0x7f698006f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f699000b3b0 tx=0x7f6990009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 msgr2=0x7f6994113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994113bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6988002a50 tx=0x7f69880046b0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 shutdown_connections 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f698006ce70 0x7f698006f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6994065390 0x7f6994113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 --2- 172.21.15.29:0/2694941849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6994102c20 0x7f6994113bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 >> 172.21.15.29:0/2694941849 conn(0x7f69940719b0 msgr2=0x7f69940fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 shutdown_connections 2023-12-05T13:31:21.491 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.490+0000 7f699bd4d700 1 -- 172.21.15.29:0/2694941849 wait complete. 2023-12-05T13:31:21.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 -- 172.21.15.29:0/1734630608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50102c20 msgr2=0x7fdc50102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/1734630608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50102c20 0x7fdc50102ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc40004940 tx=0x7fdc40009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:21.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 -- 172.21.15.29:0/1734630608 shutdown_connections 2023-12-05T13:31:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/1734630608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50065390 0x7fdc50065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/1734630608 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50102c20 0x7fdc50102ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 -- 172.21.15.29:0/1734630608 >> 172.21.15.29:0/1734630608 conn(0x7fdc500719b0 msgr2=0x7fdc50071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 -- 172.21.15.29:0/1734630608 shutdown_connections 2023-12-05T13:31:21.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.608+0000 7fdc55a7d700 1 -- 172.21.15.29:0/1734630608 wait complete. 2023-12-05T13:31:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc55a7d700 1 Processor -- start 2023-12-05T13:31:21.613 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc55a7d700 1 -- start start 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc55a7d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 0x7fdc500fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc55a7d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50102c20 0x7fdc500fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc55a7d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500fc730 con 0x7fdc50065390 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc55a7d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500fc8a0 con 0x7fdc50102c20 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc4f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 0x7fdc500fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc4f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 0x7fdc500fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34654/0 (socket says 172.21.15.29:34654) 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.609+0000 7fdc4f7fe700 1 -- 172.21.15.29:0/242937415 learned_addr learned my addr 172.21.15.29:0/242937415 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:21.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc4effd700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50102c20 0x7fdc500fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc4f7fe700 1 -- 172.21.15.29:0/242937415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50102c20 msgr2=0x7fdc500fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc4f7fe700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50102c20 0x7fdc500fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc4f7fe700 1 -- 172.21.15.29:0/242937415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40005040 con 0x7fdc50065390 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc4effd700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50102c20 0x7fdc500fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc4f7fe700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 0x7fdc500fbbf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000b3b0 tx=0x7fdc40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc4000e040 con 0x7fdc50065390 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc50119910 con 0x7fdc50065390 2023-12-05T13:31:21.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc4000bc50 con 0x7fdc50065390 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc40013420 con 0x7fdc50065390 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.610+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc50119d70 con 0x7fdc50065390 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.611+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc500fff40 con 0x7fdc50065390 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.612+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdc4001c430 con 0x7fdc50065390 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.612+0000 7fdc37fff700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc3806ce60 0x7fdc3806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.612+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fdc4008d0c0 con 0x7fdc50065390 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.613+0000 7fdc4effd700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc3806ce60 0x7fdc3806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.616 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.613+0000 7fdc4effd700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc3806ce60 0x7fdc3806f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009fd0 tx=0x7fdc44009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:21.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.618+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdc40057080 con 0x7fdc50065390 2023-12-05T13:31:21.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:21 smithi052 ceph-mon[184394]: pgmap v84: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:21.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:21 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:21.840 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.840+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc500fd330 con 0x7fdc3806ce60 2023-12-05T13:31:21.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.850+0000 7fdc37fff700 1 -- 172.21.15.29:0/242937415 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdc500fd330 con 0x7fdc3806ce60 2023-12-05T13:31:21.851 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:31:21.851 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (3m) 19s ago 12m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:31:21.851 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (76s) 19s ago 12m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:31:21.851 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (73s) 70s ago 11m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (2m) 19s ago 12m 82.7M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (8m) 19s ago 8m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (8m) 19s ago 8m 19.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (8m) 70s ago 8m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (8m) 70s ago 8m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (4m) 19s ago 13m 511M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (3m) 70s ago 11m 448M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (2m) 19s ago 13m 63.4M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:31:21.852 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (106s) 70s ago 11m 40.9M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (3m) 19s ago 12m 16.4M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (3m) 70s ago 11m 17.0M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (56s) 19s ago 11m 172M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (24s) 19s ago 10m 11.9M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 54b9f199069e 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (10m) 19s ago 10m 790M 1570M 17.2.7-109-g1fd3ca3c e139fc5fd9fc f997f39cb1d9 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (10m) 70s ago 10m 1115M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:31:21.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (9m) 70s ago 9m 796M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:31:21.854 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (9m) 70s ago 9m 975M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:31:21.854 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (3m) 19s ago 12m 59.3M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc3806ce60 msgr2=0x7fdc3806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc3806ce60 0x7fdc3806f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009fd0 tx=0x7fdc44009ee0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 msgr2=0x7fdc500fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 0x7fdc500fbbf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000b3b0 tx=0x7fdc40009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 shutdown_connections 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc3806ce60 0x7fdc3806f310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc50065390 0x7fdc500fbbf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 --2- 172.21.15.29:0/242937415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc50102c20 0x7fdc500fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 >> 172.21.15.29:0/242937415 conn(0x7fdc500719b0 msgr2=0x7fdc500fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 shutdown_connections 2023-12-05T13:31:21.856 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.853+0000 7fdc55a7d700 1 -- 172.21.15.29:0/242937415 wait complete. 2023-12-05T13:31:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 -- 172.21.15.29:0/4003572689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 msgr2=0x7ffab80fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 --2- 172.21.15.29:0/4003572689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab80fdfe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8004940 tx=0x7ffaa8009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 -- 172.21.15.29:0/4003572689 shutdown_connections 2023-12-05T13:31:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 --2- 172.21.15.29:0/4003572689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffab80fe5b0 0x7ffab8106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 --2- 172.21.15.29:0/4003572689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab80fdfe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 -- 172.21.15.29:0/4003572689 >> 172.21.15.29:0/4003572689 conn(0x7ffab80f76c0 msgr2=0x7ffab80f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 -- 172.21.15.29:0/4003572689 shutdown_connections 2023-12-05T13:31:21.975 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.974+0000 7ffabd830700 1 -- 172.21.15.29:0/4003572689 wait complete. 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffabd830700 1 Processor -- start 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffabd830700 1 -- start start 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffabd830700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab8113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffabd830700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffab80fe5b0 0x7ffab8113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffabd830700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8114200 con 0x7ffab80fdc10 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffabd830700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab810d4f0 con 0x7ffab80fe5b0 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.975+0000 7ffab6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab8113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab8113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34668/0 (socket says 172.21.15.29:34668) 2023-12-05T13:31:21.976 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab6ffd700 1 -- 172.21.15.29:0/722122718 learned_addr learned my addr 172.21.15.29:0/722122718 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:21.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab67fc700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffab80fe5b0 0x7ffab8113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab6ffd700 1 -- 172.21.15.29:0/722122718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffab80fe5b0 msgr2=0x7ffab8113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:21.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab6ffd700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffab80fe5b0 0x7ffab8113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:21.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab6ffd700 1 -- 172.21.15.29:0/722122718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8005040 con 0x7ffab80fdc10 2023-12-05T13:31:21.977 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffab6ffd700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab8113630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b3b0 tx=0x7ffaa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa800e040 con 0x7ffab80fdc10 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaa8004290 con 0x7ffab80fdc10 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab810d720 con 0x7ffab80fdc10 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa801c3f0 con 0x7ffab80fdc10 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.976+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab810dc60 con 0x7ffab80fdc10 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.977+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8104200 con 0x7ffab80fdc10 2023-12-05T13:31:21.978 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.978+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ffaa8013820 con 0x7ffab80fdc10 2023-12-05T13:31:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.978+0000 7ffa9f7fe700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ffaa006ce60 0x7ffaa006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.979+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7ffaa808d650 con 0x7ffab80fdc10 2023-12-05T13:31:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.979+0000 7ffab67fc700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ffaa006ce60 0x7ffaa006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:21.979 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.979+0000 7ffab67fc700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ffaa006ce60 0x7ffaa006f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffab810eed0 tx=0x7ffaac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:21.984 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:21.984+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffaa805aff0 con 0x7ffab80fdc10 2023-12-05T13:31:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.293+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffab80fb2c0 con 0x7ffab80fdc10 2023-12-05T13:31:22.294 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.294+0000 7ffa9f7fe700 1 -- 172.21.15.29:0/722122718 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7ffaa805ab80 con 0x7ffab80fdc10 2023-12-05T13:31:22.294 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:31:22.295 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:22.296 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:31:22.296 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 8, 2023-12-05T13:31:22.296 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 6 2023-12-05T13:31:22.296 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:31:22.296 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ffaa006ce60 msgr2=0x7ffaa006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ffaa006ce60 0x7ffaa006f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffab810eed0 tx=0x7ffaac00b040 comp rx=0 tx=0).stop 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 msgr2=0x7ffab8113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab8113630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b3b0 tx=0x7ffaa8009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 shutdown_connections 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ffaa006ce60 0x7ffaa006f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab80fdc10 0x7ffab8113630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 --2- 172.21.15.29:0/722122718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffab80fe5b0 0x7ffab8113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 >> 172.21.15.29:0/722122718 conn(0x7ffab80f76c0 msgr2=0x7ffab8101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 shutdown_connections 2023-12-05T13:31:22.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.296+0000 7ffabd830700 1 -- 172.21.15.29:0/722122718 wait complete. 2023-12-05T13:31:22.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.409+0000 7f1d0030d700 1 -- 172.21.15.29:0/2057324830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 msgr2=0x7f1cf8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.409+0000 7f1d0030d700 1 --2- 172.21.15.29:0/2057324830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8065800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8004940 tx=0x7f1ce8009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:22.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.409+0000 7f1d0030d700 1 -- 172.21.15.29:0/2057324830 shutdown_connections 2023-12-05T13:31:22.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.409+0000 7f1d0030d700 1 --2- 172.21.15.29:0/2057324830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8065800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.409+0000 7f1d0030d700 1 --2- 172.21.15.29:0/2057324830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cf8102c20 0x7f1cf8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.409+0000 7f1d0030d700 1 -- 172.21.15.29:0/2057324830 >> 172.21.15.29:0/2057324830 conn(0x7f1cf80719b0 msgr2=0x7f1cf8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:22.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.410+0000 7f1d0030d700 1 -- 172.21.15.29:0/2057324830 shutdown_connections 2023-12-05T13:31:22.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.410+0000 7f1d0030d700 1 -- 172.21.15.29:0/2057324830 wait complete. 2023-12-05T13:31:22.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.410+0000 7f1d0030d700 1 Processor -- start 2023-12-05T13:31:22.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.410+0000 7f1d0030d700 1 -- start start 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1d0030d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1d0030d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cf8102c20 0x7f1cf8113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1d0030d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf81142c0 con 0x7f1cf8065390 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1d0030d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf810d5f0 con 0x7f1cf8102c20 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34688/0 (socket says 172.21.15.29:34688) 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 -- 172.21.15.29:0/3790686593 learned_addr learned my addr 172.21.15.29:0/3790686593 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfd8a8700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cf8102c20 0x7f1cf8113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 -- 172.21.15.29:0/3790686593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cf8102c20 msgr2=0x7f1cf8113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cf8102c20 0x7f1cf8113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 -- 172.21.15.29:0/3790686593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8005040 con 0x7f1cf8065390 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1cfe0a9700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8113730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4002a50 tx=0x7f1cf40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf4007cc0 con 0x7f1cf8065390 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cf400f040 con 0x7f1cf8065390 2023-12-05T13:31:22.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf4009540 con 0x7f1cf8065390 2023-12-05T13:31:22.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf810d8d0 con 0x7f1cf8065390 2023-12-05T13:31:22.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.411+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf810de10 con 0x7f1cf8065390 2023-12-05T13:31:22.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.413+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf80fff40 con 0x7f1cf8065390 2023-12-05T13:31:22.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.413+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1cf40096a0 con 0x7f1cf8065390 2023-12-05T13:31:22.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.413+0000 7f1ceeffd700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ce406ce60 0x7f1ce406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:22.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.414+0000 7f1cfd8a8700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ce406ce60 0x7f1ce406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:22.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.414+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f1cf408c140 con 0x7f1cf8065390 2023-12-05T13:31:22.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.414+0000 7f1cfd8a8700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ce406ce60 0x7f1ce406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800b3b0 tx=0x7f1ce8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:22.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.418+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1cf4059a60 con 0x7f1cf8065390 2023-12-05T13:31:22.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:22.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: Upgrade: osd.2 is safe to restart 2023-12-05T13:31:22.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T13:31:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:22.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.675+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1cf804bb80 con 0x7f1cf8065390 2023-12-05T13:31:22.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.675+0000 7f1ceeffd700 1 -- 172.21.15.29:0/3790686593 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f1cf40595f0 con 0x7f1cf8065390 2023-12-05T13:31:22.676 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:31:22.676 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:31:22.676 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:31:22.677 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:31:22.678 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:22.679 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ce406ce60 msgr2=0x7f1ce406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ce406ce60 0x7f1ce406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800b3b0 tx=0x7f1ce8009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 msgr2=0x7f1cf8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8113730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4002a50 tx=0x7f1cf40046b0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 shutdown_connections 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ce406ce60 0x7f1ce406f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1cf8065390 0x7f1cf8113730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 --2- 172.21.15.29:0/3790686593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cf8102c20 0x7f1cf8113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 >> 172.21.15.29:0/3790686593 conn(0x7f1cf80719b0 msgr2=0x7f1cf80fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 shutdown_connections 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.678+0000 7f1d0030d700 1 -- 172.21.15.29:0/3790686593 wait complete. 2023-12-05T13:31:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:31:22.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T13:31:22.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: Upgrade: osd.2 is safe to restart 2023-12-05T13:31:22.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T13:31:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:22.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:22.794 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/348195707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 msgr2=0x7fdc641052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/348195707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641052c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc60004940 tx=0x7fdc60009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/348195707 shutdown_connections 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/348195707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc64105890 0x7fdc640fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/348195707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641052c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/348195707 >> 172.21.15.29:0/348195707 conn(0x7fdc640faaa0 msgr2=0x7fdc640fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/348195707 shutdown_connections 2023-12-05T13:31:22.795 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/348195707 wait complete. 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.794+0000 7fdc6c0bf700 1 Processor -- start 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc6c0bf700 1 -- start start 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc6c0bf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc6c0bf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc64105890 0x7fdc64115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc6c0bf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc64116440 con 0x7fdc64104ef0 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc6c0bf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6410f770 con 0x7fdc64105890 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34708/0 (socket says 172.21.15.29:34708) 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 -- 172.21.15.29:0/3953582808 learned_addr learned my addr 172.21.15.29:0/3953582808 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc6965a700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc64105890 0x7fdc64115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 -- 172.21.15.29:0/3953582808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc64105890 msgr2=0x7fdc64115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:22.797 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc64105890 0x7fdc64115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 -- 172.21.15.29:0/3953582808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60005040 con 0x7fdc64104ef0 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.795+0000 7fdc69e5b700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641158b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000b3b0 tx=0x7fdc60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.796+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6000e040 con 0x7fdc64104ef0 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.796+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc60013420 con 0x7fdc64104ef0 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.796+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6410f9f0 con 0x7fdc64104ef0 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.796+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6001c630 con 0x7fdc64104ef0 2023-12-05T13:31:22.798 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.796+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6410ff30 con 0x7fdc64104ef0 2023-12-05T13:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.797+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc64102200 con 0x7fdc64104ef0 2023-12-05T13:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.797+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdc600139c0 con 0x7fdc64104ef0 2023-12-05T13:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.798+0000 7fdc5a7fc700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc5006ce60 0x7fdc5006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.798+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fdc6008d4b0 con 0x7fdc64104ef0 2023-12-05T13:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.798+0000 7fdc6965a700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc5006ce60 0x7fdc5006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:22.799 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.798+0000 7fdc6965a700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc5006ce60 0x7fdc5006f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc641110e0 tx=0x7fdc54009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:22.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:22.803+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdc6005afa0 con 0x7fdc64104ef0 2023-12-05T13:31:23.031 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.030+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc6404bb80 con 0x7fdc5006ce60 2023-12-05T13:31:23.032 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.032+0000 7fdc5a7fc700 1 -- 172.21.15.29:0/3953582808 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdc6404bb80 con 0x7fdc5006ce60 2023-12-05T13:31:23.032 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:31:23.032 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "8/21 daemons upgraded", 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:31:23.033 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:31:23.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.034+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc5006ce60 msgr2=0x7fdc5006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:23.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.034+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc5006ce60 0x7fdc5006f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc641110e0 tx=0x7fdc54009040 comp rx=0 tx=0).stop 2023-12-05T13:31:23.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.034+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 msgr2=0x7fdc641158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:23.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.034+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641158b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000b3b0 tx=0x7fdc60009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:23.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 shutdown_connections 2023-12-05T13:31:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fdc5006ce60 0x7fdc5006f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc64104ef0 0x7fdc641158b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 --2- 172.21.15.29:0/3953582808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc64105890 0x7fdc64115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 >> 172.21.15.29:0/3953582808 conn(0x7fdc640faaa0 msgr2=0x7fdc640fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 shutdown_connections 2023-12-05T13:31:23.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.035+0000 7fdc6c0bf700 1 -- 172.21.15.29:0/3953582808 wait complete. 2023-12-05T13:31:23.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 -- 172.21.15.29:0/4018548548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee84102c00 msgr2=0x7fee84102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 --2- 172.21.15.29:0/4018548548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee84102c00 0x7fee84102fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee74004940 tx=0x7fee74009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 -- 172.21.15.29:0/4018548548 shutdown_connections 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 --2- 172.21.15.29:0/4018548548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee841035a0 0x7fee840fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 --2- 172.21.15.29:0/4018548548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee84102c00 0x7fee84102fd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 -- 172.21.15.29:0/4018548548 >> 172.21.15.29:0/4018548548 conn(0x7fee840f8790 msgr2=0x7fee840faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 -- 172.21.15.29:0/4018548548 shutdown_connections 2023-12-05T13:31:23.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.148+0000 7fee89412700 1 -- 172.21.15.29:0/4018548548 wait complete. 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee89412700 1 Processor -- start 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee89412700 1 -- start start 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee89412700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee84102c00 0x7fee8406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee89412700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 0x7fee84070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee89412700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84070a80 con 0x7fee841035a0 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee89412700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84070bf0 con 0x7fee84102c00 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee827fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 0x7fee84070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:23.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee827fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 0x7fee84070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34734/0 (socket says 172.21.15.29:34734) 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee827fc700 1 -- 172.21.15.29:0/217125595 learned_addr learned my addr 172.21.15.29:0/217125595 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.149+0000 7fee82ffd700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee84102c00 0x7fee8406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee827fc700 1 -- 172.21.15.29:0/217125595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee84102c00 msgr2=0x7fee8406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee827fc700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee84102c00 0x7fee8406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee827fc700 1 -- 172.21.15.29:0/217125595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74005040 con 0x7fee841035a0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee827fc700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 0x7fee84070480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c800 tx=0x7fee78004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee780106f0 con 0x7fee841035a0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee84119870 con 0x7fee841035a0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee78010d00 con 0x7fee841035a0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee780113a0 con 0x7fee841035a0 2023-12-05T13:31:23.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.150+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee84119d50 con 0x7fee841035a0 2023-12-05T13:31:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.151+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee840fff10 con 0x7fee841035a0 2023-12-05T13:31:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.152+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fee78012400 con 0x7fee841035a0 2023-12-05T13:31:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.152+0000 7fee6b7fe700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fee6c06ce70 0x7fee6c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.153+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fee7808c340 con 0x7fee841035a0 2023-12-05T13:31:23.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.153+0000 7fee82ffd700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fee6c06ce70 0x7fee6c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:23.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.153+0000 7fee82ffd700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fee6c06ce70 0x7fee6c06f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee7400b3b0 tx=0x7fee74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:23.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.157+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fee780561b0 con 0x7fee841035a0 2023-12-05T13:31:23.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.455+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fee840fc390 con 0x7fee841035a0 2023-12-05T13:31:23.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.455+0000 7fee6b7fe700 1 -- 172.21.15.29:0/217125595 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fee780597d0 con 0x7fee841035a0 2023-12-05T13:31:23.456 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_OK 2023-12-05T13:31:23.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fee6c06ce70 msgr2=0x7fee6c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:23.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fee6c06ce70 0x7fee6c06f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee7400b3b0 tx=0x7fee74009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:23.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 msgr2=0x7fee84070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:23.458 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 0x7fee84070480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c800 tx=0x7fee78004470 comp rx=0 tx=0).stop 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 shutdown_connections 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fee6c06ce70 0x7fee6c06f320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee84102c00 0x7fee8406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 --2- 172.21.15.29:0/217125595 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee841035a0 0x7fee84070480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.457+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 >> 172.21.15.29:0/217125595 conn(0x7fee840f8790 msgr2=0x7fee840fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.458+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 shutdown_connections 2023-12-05T13:31:23.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:23.458+0000 7fee89412700 1 -- 172.21.15.29:0/217125595 wait complete. 2023-12-05T13:31:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: Upgrade: Updating osd.2 2023-12-05T13:31:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: Deploying daemon osd.2 on smithi029 2023-12-05T13:31:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/722122718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:23 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3790686593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: Upgrade: Updating osd.2 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: Deploying daemon osd.2 on smithi029 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: pgmap v85: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/722122718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:23 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3790686593' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:31:24.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:24 smithi029 ceph-mon[217405]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:24.512 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:24 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/217125595' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:31:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:24 smithi052 ceph-mon[184394]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:24.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:24 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/217125595' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:31:25.555 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:25 smithi029 ceph-mon[217405]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:25.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:25 smithi052 ceph-mon[184394]: pgmap v86: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:25.853 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:25 smithi029 systemd[1]: Stopping Ceph osd.2 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:31:25.853 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:25 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[155199]: 2023-12-05T13:31:25.749+0000 7f4bc33b8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:31:25.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:25 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[155199]: 2023-12-05T13:31:25.749+0000 7f4bc33b8700 -1 osd.2 70 *** Got signal Terminated *** 2023-12-05T13:31:25.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:25 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[155199]: 2023-12-05T13:31:25.749+0000 7f4bc33b8700 -1 osd.2 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:31:26.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:26 smithi029 ceph-mon[217405]: osd.2 marked itself down and dead 2023-12-05T13:31:26.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:26 smithi052 ceph-mon[184394]: osd.2 marked itself down and dead 2023-12-05T13:31:27.103 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:26 smithi029 bash[245923]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2 2023-12-05T13:31:27.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:27 smithi029 ceph-mon[217405]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:27.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:27 smithi029 ceph-mon[217405]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:31:27.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:27 smithi029 ceph-mon[217405]: failed to encode map e71 with expected crc 2023-12-05T13:31:27.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:27 smithi029 ceph-mon[217405]: osdmap e71: 6 total, 5 up, 6 in 2023-12-05T13:31:27.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:27 smithi052 ceph-mon[184394]: pgmap v87: 65 pgs: 65 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:27.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:27 smithi052 ceph-mon[184394]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:31:27.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:27 smithi052 ceph-mon[184394]: failed to encode map e71 with expected crc 2023-12-05T13:31:27.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:27 smithi052 ceph-mon[184394]: osdmap e71: 6 total, 5 up, 6 in 2023-12-05T13:31:28.354 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:28 smithi029 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.2.service: Succeeded. 2023-12-05T13:31:28.354 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:28 smithi029 systemd[1]: Stopped Ceph osd.2 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:31:28.354 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:28 smithi029 systemd[1]: Starting Ceph osd.2 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:31:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:28 smithi029 ceph-mon[217405]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:28 smithi029 ceph-mon[217405]: osdmap e72: 6 total, 5 up, 6 in 2023-12-05T13:31:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:28 smithi029 ceph-mon[217405]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:28 smithi029 ceph-mon[217405]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:28 smithi029 ceph-mon[217405]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:28 smithi052 ceph-mon[184394]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:28 smithi052 ceph-mon[184394]: osdmap e72: 6 total, 5 up, 6 in 2023-12-05T13:31:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:28 smithi052 ceph-mon[184394]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:28 smithi052 ceph-mon[184394]: failed to encode map e72 with expected crc 2023-12-05T13:31:28.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:28 smithi052 ceph-mon[184394]: failed to encode map e72 with expected crc 2023-12-05T13:31:29.317 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:29 smithi029 ceph-mon[217405]: pgmap v90: 65 pgs: 6 active+undersized, 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 39 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2023-12-05T13:31:29.317 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:29 smithi029 ceph-mon[217405]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-05T13:31:29.317 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:29 smithi029 ceph-mon[217405]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:29.317 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-05T13:31:29.318 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-05T13:31:29.318 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-05T13:31:29.318 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-05T13:31:29.318 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-05T13:31:29.318 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-05T13:31:29.318 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246191]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-05T13:31:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:29 smithi052 ceph-mon[184394]: pgmap v90: 65 pgs: 6 active+undersized, 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 39 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2023-12-05T13:31:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:29 smithi052 ceph-mon[184394]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-05T13:31:29.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:29 smithi052 ceph-mon[184394]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:30.103 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 ceph-osd[246506]: -- 172.21.15.29:0/2468196859 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562f721611e0 con 0x562f72131000 2023-12-05T13:31:30.103 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 bash[246468]: 5f43e7285634e7946cabe310b8287be7cf67fdee9731a9e580d1bc5c4439cbf6 2023-12-05T13:31:30.103 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:29 smithi029 systemd[1]: Started Ceph osd.2 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:31:30.603 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:30 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:31:30.314+0000 7fa668d71640 -1 Falling back to public interface 2023-12-05T13:31:31.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:31.114 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:31.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:31.115 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:30 smithi029 ceph-mon[217405]: pgmap v91: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 12 peering, 36 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20/219 objects degraded (9.132%) 2023-12-05T13:31:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:30 smithi052 ceph-mon[184394]: pgmap v91: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 12 peering, 36 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20/219 objects degraded (9.132%) 2023-12-05T13:31:32.520 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:32 smithi029 ceph-mon[217405]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-05T13:31:32.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:32 smithi052 ceph-mon[184394]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-05T13:31:33.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:33 smithi029 ceph-mon[217405]: pgmap v92: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2023-12-05T13:31:33.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:33 smithi052 ceph-mon[184394]: pgmap v92: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2023-12-05T13:31:34.853 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:31:34.573+0000 7fa668d71640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-05T13:31:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-mon[217405]: pgmap v93: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2023-12-05T13:31:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:34 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:34.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:34 smithi052 ceph-mon[184394]: pgmap v93: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 194 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2023-12-05T13:31:34.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:34.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:35.544 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:35 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:31:35.164+0000 7fa668d71640 -1 osd.2 70 log_to_monitors true 2023-12-05T13:31:35.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:35 smithi029 ceph-mon[217405]: from='osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T13:31:35.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:31:35 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:31:35.784+0000 7fa6581de700 -1 osd.2 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:31:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:35 smithi052 ceph-mon[184394]: from='osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T13:31:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:36 smithi029 ceph-mon[217405]: from='osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T13:31:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:36 smithi029 ceph-mon[217405]: osdmap e73: 6 total, 5 up, 6 in 2023-12-05T13:31:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:36 smithi029 ceph-mon[217405]: from='osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:31:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:36 smithi029 ceph-mon[217405]: pgmap v95: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2023-12-05T13:31:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:36 smithi052 ceph-mon[184394]: from='osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T13:31:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:36 smithi052 ceph-mon[184394]: osdmap e73: 6 total, 5 up, 6 in 2023-12-05T13:31:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:36 smithi052 ceph-mon[184394]: from='osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2023-12-05T13:31:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:36 smithi052 ceph-mon[184394]: pgmap v95: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2023-12-05T13:31:37.794 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: failed to encode map e73 with expected crc 2023-12-05T13:31:37.794 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259] boot 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: osdmap e74: 6 total, 6 up, 6 in 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: failed to encode map e73 with expected crc 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: failed to encode map e73 with expected crc 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:37.795 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2023-12-05T13:31:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:37 smithi029 ceph-mon[217405]: osdmap e75: 6 total, 6 up, 6 in 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: failed to encode map e73 with expected crc 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: osd.2 [v2:172.21.15.29:6818/707404259,v1:172.21.15.29:6819/707404259] boot 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: osdmap e74: 6 total, 6 up, 6 in 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: failed to encode map e73 with expected crc 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: failed to encode map e73 with expected crc 2023-12-05T13:31:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2023-12-05T13:31:38.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:37 smithi052 ceph-mon[184394]: osdmap e75: 6 total, 6 up, 6 in 2023-12-05T13:31:39.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:38 smithi029 ceph-mon[217405]: pgmap v98: 65 pgs: 13 active+undersized, 8 active+undersized+degraded, 44 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: failed to encode map e75 with expected crc 2023-12-05T13:31:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:38 smithi052 ceph-mon[184394]: pgmap v98: 65 pgs: 13 active+undersized, 8 active+undersized+degraded, 44 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2023-12-05T13:31:40.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:39 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 24/219 objects degraded (10.959%), 8 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:40.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:39 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 24/219 objects degraded (10.959%), 8 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:41.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:40 smithi029 ceph-mon[217405]: pgmap v99: 65 pgs: 11 active+undersized, 7 active+undersized+degraded, 47 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2023-12-05T13:31:41.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:40 smithi052 ceph-mon[184394]: pgmap v99: 65 pgs: 11 active+undersized, 7 active+undersized+degraded, 47 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2023-12-05T13:31:42.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:42 smithi029 ceph-mon[217405]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/219 objects degraded (9.589%), 7 pgs degraded) 2023-12-05T13:31:42.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:42 smithi029 ceph-mon[217405]: Cluster is now healthy 2023-12-05T13:31:42.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:42 smithi052 ceph-mon[184394]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/219 objects degraded (9.589%), 7 pgs degraded) 2023-12-05T13:31:42.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:42 smithi052 ceph-mon[184394]: Cluster is now healthy 2023-12-05T13:31:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:43 smithi029 ceph-mon[217405]: pgmap v100: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:43 smithi052 ceph-mon[184394]: pgmap v100: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:45.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:44 smithi029 ceph-mon[217405]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:45.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:44 smithi052 ceph-mon[184394]: pgmap v101: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:47.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:47 smithi029 ceph-mon[217405]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:47 smithi052 ceph-mon[184394]: pgmap v102: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:48.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:49 smithi029 ceph-mon[217405]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:49.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:49 smithi052 ceph-mon[184394]: pgmap v103: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:51.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:51 smithi029 ceph-mon[217405]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:51.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:51 smithi052 ceph-mon[184394]: pgmap v104: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:53.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:53 smithi052 ceph-mon[184394]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:53.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:53.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:53.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:53.584 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 -- 172.21.15.29:0/3751325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 msgr2=0x7f4140101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 --2- 172.21.15.29:0/3751325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f4140101ec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f413c004940 tx=0x7f413c009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 -- 172.21.15.29:0/3751325 shutdown_connections 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 --2- 172.21.15.29:0/3751325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41400fbb30 0x7f41400fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 --2- 172.21.15.29:0/3751325 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f4140101ec0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 -- 172.21.15.29:0/3751325 >> 172.21.15.29:0/3751325 conn(0x7f41400f7690 msgr2=0x7f41400f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 -- 172.21.15.29:0/3751325 shutdown_connections 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.583+0000 7f4148358700 1 -- 172.21.15.29:0/3751325 wait complete. 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.584+0000 7f4148358700 1 Processor -- start 2023-12-05T13:31:53.585 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.584+0000 7f4148358700 1 -- start start 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4148358700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41400fbb30 0x7f414010e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4148358700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f414010ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4148358700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414010f150 con 0x7f4140101af0 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4148358700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414010f290 con 0x7f41400fbb30 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f414010ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f414010ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53646/0 (socket says 172.21.15.29:53646) 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 -- 172.21.15.29:0/2866537163 learned_addr learned my addr 172.21.15.29:0/2866537163 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41460f4700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41400fbb30 0x7f414010e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 -- 172.21.15.29:0/2866537163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41400fbb30 msgr2=0x7f414010e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41400fbb30 0x7f414010e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 -- 172.21.15.29:0/2866537163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c005040 con 0x7f4140101af0 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f41458f3700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f414010ebc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f413000eb40 tx=0x7f413000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4130007cc0 con 0x7f4140101af0 2023-12-05T13:31:53.587 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f413000f040 con 0x7f4140101af0 2023-12-05T13:31:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.585+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140117590 con 0x7f4140101af0 2023-12-05T13:31:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.586+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413000c990 con 0x7f4140101af0 2023-12-05T13:31:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.586+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140117aa0 con 0x7f4140101af0 2023-12-05T13:31:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.587+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140103fd0 con 0x7f4140101af0 2023-12-05T13:31:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.587+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f413000caf0 con 0x7f4140101af0 2023-12-05T13:31:53.588 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.588+0000 7f4136ffd700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f412c06ce60 0x7f412c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.588+0000 7f41460f4700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f412c06ce60 0x7f412c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.588+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f413008be20 con 0x7f4140101af0 2023-12-05T13:31:53.589 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.588+0000 7f41460f4700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f412c06ce60 0x7f412c06f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f413c000c00 tx=0x7f413c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:53.593 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.593+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4130055de0 con 0x7f4140101af0 2023-12-05T13:31:53.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:53 smithi029 ceph-mon[217405]: pgmap v105: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:53.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:53.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:31:53.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:53.827 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.826+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4140066400 con 0x7f412c06ce60 2023-12-05T13:31:53.828 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.827+0000 7f4136ffd700 1 -- 172.21.15.29:0/2866537163 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4140066400 con 0x7f412c06ce60 2023-12-05T13:31:53.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f412c06ce60 msgr2=0x7f412c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:53.830 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f412c06ce60 0x7f412c06f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f413c000c00 tx=0x7f413c009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 msgr2=0x7f414010ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f414010ebc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f413000eb40 tx=0x7f413000b040 comp rx=0 tx=0).stop 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 shutdown_connections 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f412c06ce60 0x7f412c06f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41400fbb30 0x7f414010e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 --2- 172.21.15.29:0/2866537163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4140101af0 0x7f414010ebc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 >> 172.21.15.29:0/2866537163 conn(0x7f41400f7690 msgr2=0x7f41400f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 shutdown_connections 2023-12-05T13:31:53.831 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.830+0000 7f4148358700 1 -- 172.21.15.29:0/2866537163 wait complete. 2023-12-05T13:31:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 -- 172.21.15.29:0/1761708177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 msgr2=0x7fcd54101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 --2- 172.21.15.29:0/1761708177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd54101ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd44004940 tx=0x7fcd44009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 -- 172.21.15.29:0/1761708177 shutdown_connections 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 --2- 172.21.15.29:0/1761708177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb40 0x7fcd540fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 --2- 172.21.15.29:0/1761708177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd54101ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 -- 172.21.15.29:0/1761708177 >> 172.21.15.29:0/1761708177 conn(0x7fcd540f76c0 msgr2=0x7fcd540f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 -- 172.21.15.29:0/1761708177 shutdown_connections 2023-12-05T13:31:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.944+0000 7fcd59a62700 1 -- 172.21.15.29:0/1761708177 wait complete. 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd59a62700 1 Processor -- start 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd59a62700 1 -- start start 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd59a62700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb40 0x7fcd5410e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd59a62700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd5410ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd59a62700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5410f150 con 0x7fcd54101b00 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd59a62700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5410f290 con 0x7fcd540fbb40 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd52ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd5410ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd52ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd5410ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53672/0 (socket says 172.21.15.29:53672) 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd52ffd700 1 -- 172.21.15.29:0/556298053 learned_addr learned my addr 172.21.15.29:0/556298053 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.945+0000 7fcd537fe700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb40 0x7fcd5410e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:53.947 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd52ffd700 1 -- 172.21.15.29:0/556298053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb40 msgr2=0x7fcd5410e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd52ffd700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb40 0x7fcd5410e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd52ffd700 1 -- 172.21.15.29:0/556298053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44005040 con 0x7fcd54101b00 2023-12-05T13:31:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd52ffd700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd5410ebc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800eb40 tx=0x7fcd4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd48007cc0 con 0x7fcd54101b00 2023-12-05T13:31:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd4800f040 con 0x7fcd54101b00 2023-12-05T13:31:53.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd54117590 con 0x7fcd54101b00 2023-12-05T13:31:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd4800c990 con 0x7fcd54101b00 2023-12-05T13:31:53.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.946+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd54117aa0 con 0x7fcd54101b00 2023-12-05T13:31:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.947+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54103fb0 con 0x7fcd54101b00 2023-12-05T13:31:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.948+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fcd4800cc00 con 0x7fcd54101b00 2023-12-05T13:31:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.948+0000 7fcd3bfff700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcd3c06ce60 0x7fcd3c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.948+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fcd4808bee0 con 0x7fcd54101b00 2023-12-05T13:31:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.948+0000 7fcd537fe700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcd3c06ce60 0x7fcd3c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:53.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.949+0000 7fcd537fe700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcd3c06ce60 0x7fcd3c06f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000c00 tx=0x7fcd44009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:53.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:53.953+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcd48055e20 con 0x7fcd54101b00 2023-12-05T13:31:54.182 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.182+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd54066400 con 0x7fcd3c06ce60 2023-12-05T13:31:54.183 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.183+0000 7fcd3bfff700 1 -- 172.21.15.29:0/556298053 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcd54066400 con 0x7fcd3c06ce60 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcd3c06ce60 msgr2=0x7fcd3c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcd3c06ce60 0x7fcd3c06f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcd44000c00 tx=0x7fcd44009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 msgr2=0x7fcd5410ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd5410ebc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800eb40 tx=0x7fcd4800b040 comp rx=0 tx=0).stop 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 shutdown_connections 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcd3c06ce60 0x7fcd3c06f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd540fbb40 0x7fcd5410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 --2- 172.21.15.29:0/556298053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd54101b00 0x7fcd5410ebc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 >> 172.21.15.29:0/556298053 conn(0x7fcd540f76c0 msgr2=0x7fcd540f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 shutdown_connections 2023-12-05T13:31:54.186 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.185+0000 7fcd59a62700 1 -- 172.21.15.29:0/556298053 wait complete. 2023-12-05T13:31:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 -- 172.21.15.29:0/3187157585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 msgr2=0x7f786c106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3187157585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c106b70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7858004940 tx=0x7f7858009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 -- 172.21.15.29:0/3187157585 shutdown_connections 2023-12-05T13:31:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3187157585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c106b70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3187157585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f786c0fdb90 0x7f786c0fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 -- 172.21.15.29:0/3187157585 >> 172.21.15.29:0/3187157585 conn(0x7f786c0f7600 msgr2=0x7f786c0f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 -- 172.21.15.29:0/3187157585 shutdown_connections 2023-12-05T13:31:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.299+0000 7f7872e3c700 1 -- 172.21.15.29:0/3187157585 wait complete. 2023-12-05T13:31:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7872e3c700 1 Processor -- start 2023-12-05T13:31:54.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7872e3c700 1 -- start start 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7872e3c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f786c0fdb90 0x7f786c119b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7872e3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c11a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7872e3c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c11a720 con 0x7f786c0fe530 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7872e3c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c113a50 con 0x7f786c0fdb90 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f786bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c11a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f786bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c11a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53682/0 (socket says 172.21.15.29:53682) 2023-12-05T13:31:54.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f786bfff700 1 -- 172.21.15.29:0/3363365626 learned_addr learned my addr 172.21.15.29:0/3363365626 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.300+0000 7f7870bd8700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f786c0fdb90 0x7f786c119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f786bfff700 1 -- 172.21.15.29:0/3363365626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f786c0fdb90 msgr2=0x7f786c119b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f786bfff700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f786c0fdb90 0x7f786c119b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f786bfff700 1 -- 172.21.15.29:0/3363365626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858005040 con 0x7f786c0fe530 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f786bfff700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c11a0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f785800b3b0 tx=0x7f7858009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f785800e040 con 0x7f786c0fe530 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c113cd0 con 0x7f786c0fe530 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7858009af0 con 0x7f786c0fe530 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f785801c3f0 con 0x7f786c0fe530 2023-12-05T13:31:54.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.301+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c114210 con 0x7f786c0fe530 2023-12-05T13:31:54.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.302+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c102170 con 0x7f786c0fe530 2023-12-05T13:31:54.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.303+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f785800bb80 con 0x7f786c0fe530 2023-12-05T13:31:54.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.303+0000 7f78697fa700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f785c06ce60 0x7f785c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:54.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.303+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f785808d640 con 0x7f786c0fe530 2023-12-05T13:31:54.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.303+0000 7f7870bd8700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f785c06ce60 0x7f785c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:54.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.304+0000 7f7870bd8700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f785c06ce60 0x7f785c06f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7860007fd0 tx=0x7f7860009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:54.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.308+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f785805afe0 con 0x7f786c0fe530 2023-12-05T13:31:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:54 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:54 smithi052 ceph-mon[184394]: Upgrade: osd.3 is safe to restart 2023-12-05T13:31:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T13:31:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:54 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:54.531 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.531+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f786c109af0 con 0x7f785c06ce60 2023-12-05T13:31:54.542 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.542+0000 7f78697fa700 1 -- 172.21.15.29:0/3363365626 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f786c109af0 con 0x7f785c06ce60 2023-12-05T13:31:54.542 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:31:54.542 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (3m) 21s ago 13m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:31:54.542 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (109s) 21s ago 13m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (105s) 103s ago 12m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (3m) 21s ago 12m 84.3M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (9m) 21s ago 9m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (8m) 21s ago 8m 19.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (8m) 103s ago 8m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (9m) 103s ago 9m 18.7M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (4m) 21s ago 14m 513M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (4m) 103s ago 12m 448M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (2m) 21s ago 14m 68.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (2m) 103s ago 12m 40.9M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (4m) 21s ago 13m 16.4M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (4m) 103s ago 12m 17.0M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (89s) 21s ago 11m 180M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (56s) 21s ago 11m 124M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 54b9f199069e 2023-12-05T13:31:54.543 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (24s) 21s ago 11m 12.6M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5f43e7285634 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (10m) 103s ago 10m 1115M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c8c00dc7e730 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (10m) 103s ago 10m 796M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (10m) 103s ago 10m 975M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (3m) 21s ago 12m 59.4M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f785c06ce60 msgr2=0x7f785c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f785c06ce60 0x7f785c06f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7860007fd0 tx=0x7f7860009040 comp rx=0 tx=0).stop 2023-12-05T13:31:54.544 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 msgr2=0x7f786c11a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c11a0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f785800b3b0 tx=0x7f7858009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 shutdown_connections 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f785c06ce60 0x7f785c06f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f786c0fdb90 0x7f786c119b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 --2- 172.21.15.29:0/3363365626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f786c0fe530 0x7f786c11a0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 >> 172.21.15.29:0/3363365626 conn(0x7f786c0f7600 msgr2=0x7f786c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 shutdown_connections 2023-12-05T13:31:54.545 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.544+0000 7f7872e3c700 1 -- 172.21.15.29:0/3363365626 wait complete. 2023-12-05T13:31:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:54 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T13:31:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:54 smithi029 ceph-mon[217405]: Upgrade: osd.3 is safe to restart 2023-12-05T13:31:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:31:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T13:31:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:54 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 -- 172.21.15.29:0/744163830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 msgr2=0x7fec580fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 --2- 172.21.15.29:0/744163830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec580fbfb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec4c004940 tx=0x7fec4c009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 -- 172.21.15.29:0/744163830 shutdown_connections 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 --2- 172.21.15.29:0/744163830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec580fbfb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 --2- 172.21.15.29:0/744163830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec58101b00 0x7fec58101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 -- 172.21.15.29:0/744163830 >> 172.21.15.29:0/744163830 conn(0x7fec580719b0 msgr2=0x7fec58071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 -- 172.21.15.29:0/744163830 shutdown_connections 2023-12-05T13:31:54.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.655+0000 7fec6055c700 1 -- 172.21.15.29:0/744163830 wait complete. 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec6055c700 1 Processor -- start 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec6055c700 1 -- start start 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec6055c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec581158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec6055c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec58101b00 0x7fec58115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec6055c700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58116440 con 0x7fec580fbb40 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec6055c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5810f770 con 0x7fec58101b00 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec5e2f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec581158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec5e2f8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec581158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53712/0 (socket says 172.21.15.29:53712) 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec5e2f8700 1 -- 172.21.15.29:0/2917124403 learned_addr learned my addr 172.21.15.29:0/2917124403 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.656+0000 7fec5daf7700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec58101b00 0x7fec58115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec5e2f8700 1 -- 172.21.15.29:0/2917124403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec58101b00 msgr2=0x7fec58115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec5e2f8700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec58101b00 0x7fec58115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec5e2f8700 1 -- 172.21.15.29:0/2917124403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c005040 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec5e2f8700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec581158b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec54002a50 tx=0x7fec540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec54007cc0 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec5400f040 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5810fa50 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5400d9c0 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.657+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5810ff60 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.658+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec580734d0 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.659+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fec5400db60 con 0x7fec580fbb40 2023-12-05T13:31:54.662 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.659+0000 7fec4affd700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fec4406ce60 0x7fec4406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.659+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fec5408b990 con 0x7fec580fbb40 2023-12-05T13:31:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.659+0000 7fec5daf7700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fec4406ce60 0x7fec4406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:54.663 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.660+0000 7fec5daf7700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fec4406ce60 0x7fec4406f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec58110aa0 tx=0x7fec4c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:54.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.664+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fec540592b0 con 0x7fec580fbb40 2023-12-05T13:31:54.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.958+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fec58110e90 con 0x7fec580fbb40 2023-12-05T13:31:54.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.959+0000 7fec4affd700 1 -- 172.21.15.29:0/2917124403 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fec54058e40 con 0x7fec580fbb40 2023-12-05T13:31:54.959 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 3, 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 3 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:31:54.960 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 7, 2023-12-05T13:31:54.961 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 7 2023-12-05T13:31:54.961 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:31:54.961 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fec4406ce60 msgr2=0x7fec4406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fec4406ce60 0x7fec4406f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec58110aa0 tx=0x7fec4c009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 msgr2=0x7fec581158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec581158b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec54002a50 tx=0x7fec540046b0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 shutdown_connections 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fec4406ce60 0x7fec4406f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec580fbb40 0x7fec581158b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 --2- 172.21.15.29:0/2917124403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec58101b00 0x7fec58115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:54.962 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 >> 172.21.15.29:0/2917124403 conn(0x7fec580719b0 msgr2=0x7fec58065430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 shutdown_connections 2023-12-05T13:31:54.963 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:54.961+0000 7fec6055c700 1 -- 172.21.15.29:0/2917124403 wait complete. 2023-12-05T13:31:55.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 -- 172.21.15.29:0/4143076586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 msgr2=0x7f216c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 --2- 172.21.15.29:0/4143076586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c102fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2160004940 tx=0x7f2160009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:55.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 -- 172.21.15.29:0/4143076586 shutdown_connections 2023-12-05T13:31:55.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 --2- 172.21.15.29:0/4143076586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f216c103590 0x7f216c0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 --2- 172.21.15.29:0/4143076586 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c102fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 -- 172.21.15.29:0/4143076586 >> 172.21.15.29:0/4143076586 conn(0x7f216c0f87a0 msgr2=0x7f216c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:55.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 -- 172.21.15.29:0/4143076586 shutdown_connections 2023-12-05T13:31:55.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.074+0000 7f2173169700 1 -- 172.21.15.29:0/4143076586 wait complete. 2023-12-05T13:31:55.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2173169700 1 Processor -- start 2023-12-05T13:31:55.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2173169700 1 -- start start 2023-12-05T13:31:55.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2173169700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2173169700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f216c103590 0x7f216c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2173169700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c070a80 con 0x7f216c102bf0 2023-12-05T13:31:55.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2173169700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c070bf0 con 0x7f216c103590 2023-12-05T13:31:55.077 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2170f05700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2170f05700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53728/0 (socket says 172.21.15.29:53728) 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f2170f05700 1 -- 172.21.15.29:0/2907673618 learned_addr learned my addr 172.21.15.29:0/2907673618 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.075+0000 7f216bfff700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f216c103590 0x7f216c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f2170f05700 1 -- 172.21.15.29:0/2907673618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f216c103590 msgr2=0x7f216c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f2170f05700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f216c103590 0x7f216c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f2170f05700 1 -- 172.21.15.29:0/2907673618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160005040 con 0x7f216c102bf0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f2170f05700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c06ff40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2160009180 tx=0x7f2160009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f216000e040 con 0x7f216c102bf0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2160004290 con 0x7f216c102bf0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c119890 con 0x7f216c102bf0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f216001c3f0 con 0x7f216c102bf0 2023-12-05T13:31:55.078 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.076+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c119cf0 con 0x7f216c102bf0 2023-12-05T13:31:55.079 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.077+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c0fff00 con 0x7f216c102bf0 2023-12-05T13:31:55.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.078+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2160013420 con 0x7f216c102bf0 2023-12-05T13:31:55.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.078+0000 7f21697fa700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f215c06ce60 0x7f215c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.078+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f216008d5f0 con 0x7f216c102bf0 2023-12-05T13:31:55.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.078+0000 7f216bfff700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f215c06ce60 0x7f215c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.080 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.079+0000 7f216bfff700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f215c06ce60 0x7f215c06f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f216c071940 tx=0x7f215800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:55.083 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.083+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f21600575b0 con 0x7f216c102bf0 2023-12-05T13:31:55.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.338+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f216c071680 con 0x7f216c102bf0 2023-12-05T13:31:55.338 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.338+0000 7f21697fa700 1 -- 172.21.15.29:0/2907673618 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f216005abd0 con 0x7f216c102bf0 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:31:55.339 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:31:55.340 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:55.341 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f215c06ce60 msgr2=0x7f215c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f215c06ce60 0x7f215c06f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f216c071940 tx=0x7f215800b040 comp rx=0 tx=0).stop 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 msgr2=0x7f216c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c06ff40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2160009180 tx=0x7f2160009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 shutdown_connections 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f215c06ce60 0x7f215c06f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.342 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f216c102bf0 0x7f216c06ff40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 --2- 172.21.15.29:0/2907673618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f216c103590 0x7f216c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 >> 172.21.15.29:0/2907673618 conn(0x7f216c0f87a0 msgr2=0x7f216c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 shutdown_connections 2023-12-05T13:31:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.341+0000 7f2173169700 1 -- 172.21.15.29:0/2907673618 wait complete. 2023-12-05T13:31:55.343 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:31:55.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 -- 172.21.15.29:0/2905851593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c065390 msgr2=0x7f9d7c065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 --2- 172.21.15.29:0/2905851593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c065390 0x7f9d7c065800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9d64004940 tx=0x7f9d64009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:55.456 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 -- 172.21.15.29:0/2905851593 shutdown_connections 2023-12-05T13:31:55.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 --2- 172.21.15.29:0/2905851593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c065390 0x7f9d7c065800 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 --2- 172.21.15.29:0/2905851593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7c102c20 0x7f9d7c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 -- 172.21.15.29:0/2905851593 >> 172.21.15.29:0/2905851593 conn(0x7f9d7c0719b0 msgr2=0x7f9d7c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:55.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 -- 172.21.15.29:0/2905851593 shutdown_connections 2023-12-05T13:31:55.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.455+0000 7f9d81463700 1 -- 172.21.15.29:0/2905851593 wait complete. 2023-12-05T13:31:55.457 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d81463700 1 Processor -- start 2023-12-05T13:31:55.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d81463700 1 -- start start 2023-12-05T13:31:55.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d81463700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7c065390 0x7f9d7c1135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d81463700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 0x7f9d7c113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d81463700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c114170 con 0x7f9d7c102c20 2023-12-05T13:31:55.459 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d81463700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c10d4a0 con 0x7f9d7c065390 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d727fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 0x7f9d7c113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d727fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 0x7f9d7c113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53746/0 (socket says 172.21.15.29:53746) 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.456+0000 7f9d727fc700 1 -- 172.21.15.29:0/4059771255 learned_addr learned my addr 172.21.15.29:0/4059771255 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d7affd700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7c065390 0x7f9d7c1135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d727fc700 1 -- 172.21.15.29:0/4059771255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7c065390 msgr2=0x7f9d7c1135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d727fc700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7c065390 0x7f9d7c1135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d727fc700 1 -- 172.21.15.29:0/4059771255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d64005040 con 0x7f9d7c102c20 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d727fc700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 0x7f9d7c113b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009180 tx=0x7f9d64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d6400e040 con 0x7f9d7c102c20 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d64013420 con 0x7f9d7c102c20 2023-12-05T13:31:55.460 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c10d720 con 0x7f9d7c102c20 2023-12-05T13:31:55.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d6401c630 con 0x7f9d7c102c20 2023-12-05T13:31:55.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.457+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c10dc60 con 0x7f9d7c102c20 2023-12-05T13:31:55.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.458+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c0fff40 con 0x7f9d7c102c20 2023-12-05T13:31:55.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.459+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9d640139e0 con 0x7f9d7c102c20 2023-12-05T13:31:55.461 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.459+0000 7f9d73fff700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9d6806ce60 0x7f9d6806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.459+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f9d6408d650 con 0x7f9d7c102c20 2023-12-05T13:31:55.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.459+0000 7f9d7affd700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9d6806ce60 0x7f9d6806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.462 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.460+0000 7f9d7affd700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9d6806ce60 0x7f9d6806f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009fd0 tx=0x7f9d6c009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:55.465 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.464+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9d6405aff0 con 0x7f9d7c102c20 2023-12-05T13:31:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:55 smithi029 ceph-mon[217405]: Upgrade: Updating osd.3 2023-12-05T13:31:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:55 smithi029 ceph-mon[217405]: Deploying daemon osd.3 on smithi052 2023-12-05T13:31:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:55 smithi029 ceph-mon[217405]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:55 smithi029 ceph-mon[217405]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:55.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:55 smithi029 ceph-mon[217405]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:55.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:55 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2917124403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:55.647 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:55 smithi052 ceph-mon[184394]: Upgrade: Updating osd.3 2023-12-05T13:31:55.648 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:55 smithi052 ceph-mon[184394]: Deploying daemon osd.3 on smithi052 2023-12-05T13:31:55.648 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:55 smithi052 ceph-mon[184394]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:55.648 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:55 smithi052 ceph-mon[184394]: pgmap v106: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:55.648 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:55 smithi052 ceph-mon[184394]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:55.648 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:55 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2917124403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:31:55.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.696+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d7c04bb80 con 0x7f9d6806ce60 2023-12-05T13:31:55.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.697+0000 7f9d73fff700 1 -- 172.21.15.29:0/4059771255 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9d7c04bb80 con 0x7f9d6806ce60 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "9/21 daemons upgraded", 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T13:31:55.699 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9d6806ce60 msgr2=0x7f9d6806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9d6806ce60 0x7f9d6806f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009fd0 tx=0x7f9d6c009f60 comp rx=0 tx=0).stop 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 msgr2=0x7f9d7c113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 0x7f9d7c113b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009180 tx=0x7f9d64009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 shutdown_connections 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9d6806ce60 0x7f9d6806f310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d7c065390 0x7f9d7c1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 --2- 172.21.15.29:0/4059771255 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9d7c102c20 0x7f9d7c113b20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 >> 172.21.15.29:0/4059771255 conn(0x7f9d7c0719b0 msgr2=0x7f9d7c0fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:55.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 shutdown_connections 2023-12-05T13:31:55.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.700+0000 7f9d81463700 1 -- 172.21.15.29:0/4059771255 wait complete. 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.813+0000 7efde0bef700 1 -- 172.21.15.29:0/2497755247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fcee0 msgr2=0x7efddc109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.813+0000 7efde0bef700 1 --2- 172.21.15.29:0/2497755247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fcee0 0x7efddc109190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efdc4004940 tx=0x7efdc4009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.813+0000 7efde0bef700 1 -- 172.21.15.29:0/2497755247 shutdown_connections 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 --2- 172.21.15.29:0/2497755247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fcee0 0x7efddc109190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 --2- 172.21.15.29:0/2497755247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efddc0fc5d0 0x7efddc0fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 -- 172.21.15.29:0/2497755247 >> 172.21.15.29:0/2497755247 conn(0x7efddc0719b0 msgr2=0x7efddc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 -- 172.21.15.29:0/2497755247 shutdown_connections 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 -- 172.21.15.29:0/2497755247 wait complete. 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 Processor -- start 2023-12-05T13:31:55.815 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.814+0000 7efde0bef700 1 -- start start 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efde0bef700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 0x7efddc115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efde0bef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efddc0fcee0 0x7efddc115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efde0bef700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc1163d0 con 0x7efddc0fc5d0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efde0bef700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc10f700 con 0x7efddc0fcee0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 0x7efddc115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 0x7efddc115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53766/0 (socket says 172.21.15.29:53766) 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 -- 172.21.15.29:0/3176851915 learned_addr learned my addr 172.21.15.29:0/3176851915 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdd1d9b700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efddc0fcee0 0x7efddc115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 -- 172.21.15.29:0/3176851915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efddc0fcee0 msgr2=0x7efddc115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efddc0fcee0 0x7efddc115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 -- 172.21.15.29:0/3176851915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4005040 con 0x7efddc0fc5d0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.815+0000 7efdda59c700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 0x7efddc115840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efdcc002a80 tx=0x7efdcc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.816+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdcc007cc0 con 0x7efddc0fc5d0 2023-12-05T13:31:55.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.816+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc10f9e0 con 0x7efddc0fc5d0 2023-12-05T13:31:55.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.816+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdcc00f040 con 0x7efddc0fc5d0 2023-12-05T13:31:55.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.816+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdcc00da60 con 0x7efddc0fc5d0 2023-12-05T13:31:55.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.816+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc10ff20 con 0x7efddc0fc5d0 2023-12-05T13:31:55.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.817+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc1068c0 con 0x7efddc0fc5d0 2023-12-05T13:31:55.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.817+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7efdcc00dbc0 con 0x7efddc0fc5d0 2023-12-05T13:31:55.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.818+0000 7efdd37fe700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7efdc806ce60 0x7efdc806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:31:55.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.818+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6482+0+0 (secure 0 0 0) 0x7efdcc08c160 con 0x7efddc0fc5d0 2023-12-05T13:31:55.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.818+0000 7efdd1d9b700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7efdc806ce60 0x7efdc806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:31:55.819 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.818+0000 7efdd1d9b700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7efdc806ce60 0x7efdc806f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efddc111070 tx=0x7efdc4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:31:55.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:55.823+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efdcc0599e0 con 0x7efddc0fc5d0 2023-12-05T13:31:56.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.119+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efddc10be70 con 0x7efddc0fc5d0 2023-12-05T13:31:56.120 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.120+0000 7efdd37fe700 1 -- 172.21.15.29:0/3176851915 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efdcc059570 con 0x7efddc0fc5d0 2023-12-05T13:31:56.120 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_OK 2023-12-05T13:31:56.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7efdc806ce60 msgr2=0x7efdc806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7efdc806ce60 0x7efdc806f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efddc111070 tx=0x7efdc4009e30 comp rx=0 tx=0).stop 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 msgr2=0x7efddc115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 0x7efddc115840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efdcc002a80 tx=0x7efdcc0046b0 comp rx=0 tx=0).stop 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 shutdown_connections 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7efdc806ce60 0x7efdc806f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efddc0fc5d0 0x7efddc115840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 --2- 172.21.15.29:0/3176851915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efddc0fcee0 0x7efddc115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 >> 172.21.15.29:0/3176851915 conn(0x7efddc0719b0 msgr2=0x7efddc0fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 shutdown_connections 2023-12-05T13:31:56.123 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:31:56.122+0000 7efde0bef700 1 -- 172.21.15.29:0/3176851915 wait complete. 2023-12-05T13:31:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-mon[184394]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2907673618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:31:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3176851915' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:31:56.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-mon[184394]: osd.3 marked itself down and dead 2023-12-05T13:31:56.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:56 smithi052 systemd[1]: Stopping Ceph osd.3 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:31:56.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[127336]: 2023-12-05T13:31:56.198+0000 7fe4220b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:31:56.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[127336]: 2023-12-05T13:31:56.198+0000 7fe4220b0700 -1 osd.3 75 *** Got signal Terminated *** 2023-12-05T13:31:56.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:56 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[127336]: 2023-12-05T13:31:56.198+0000 7fe4220b0700 -1 osd.3 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:31:56.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:56 smithi029 ceph-mon[217405]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:56 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2907673618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:31:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:56 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3176851915' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:31:56.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:56 smithi029 ceph-mon[217405]: osd.3 marked itself down and dead 2023-12-05T13:31:57.223 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:56 smithi052 bash[196262]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3 2023-12-05T13:31:57.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:57.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:31:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: osdmap e76: 6 total, 5 up, 6 in 2023-12-05T13:31:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:57 smithi029 ceph-mon[217405]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:31:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: pgmap v107: 65 pgs: 65 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:31:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:31:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: osdmap e76: 6 total, 5 up, 6 in 2023-12-05T13:31:57.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: failed to encode map e76 with expected crc 2023-12-05T13:31:57.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:57 smithi052 ceph-mon[184394]: failed to encode map e76 with expected crc 2023-12-05T13:31:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:58 smithi052 ceph-mon[184394]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:58 smithi052 ceph-mon[184394]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:58 smithi052 ceph-mon[184394]: osdmap e77: 6 total, 5 up, 6 in 2023-12-05T13:31:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:58 smithi052 ceph-mon[184394]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:58 smithi052 ceph-mon[184394]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.473 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:58 smithi052 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.3.service: Succeeded. 2023-12-05T13:31:58.473 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:58 smithi052 systemd[1]: Stopped Ceph osd.3 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:31:58.473 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:58 smithi052 systemd[1]: Starting Ceph osd.3 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:31:58.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:58 smithi029 ceph-mon[217405]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:58 smithi029 ceph-mon[217405]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:58 smithi029 ceph-mon[217405]: osdmap e77: 6 total, 5 up, 6 in 2023-12-05T13:31:58.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:58 smithi029 ceph-mon[217405]: failed to encode map e77 with expected crc 2023-12-05T13:31:58.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:58 smithi029 ceph-mon[217405]: failed to encode map e77 with expected crc 2023-12-05T13:31:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:59 smithi052 ceph-mon[184394]: pgmap v110: 65 pgs: 6 active+undersized+degraded, 11 active+undersized, 6 peering, 3 stale+active+clean, 39 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2023-12-05T13:31:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:59 smithi052 ceph-mon[184394]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-05T13:31:59.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:31:59 smithi052 ceph-mon[184394]: Health check failed: Degraded data redundancy: 21/219 objects degraded (9.589%), 6 pgs degraded (PG_DEGRADED) 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-05T13:31:59.474 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196528]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-05T13:31:59.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:59 smithi029 ceph-mon[217405]: pgmap v110: 65 pgs: 6 active+undersized+degraded, 11 active+undersized, 6 peering, 3 stale+active+clean, 39 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2023-12-05T13:31:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:59 smithi029 ceph-mon[217405]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-05T13:31:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:31:59 smithi029 ceph-mon[217405]: Health check failed: Degraded data redundancy: 21/219 objects degraded (9.589%), 6 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:00.223 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 ceph-osd[196818]: -- 172.21.15.52:0/1768527352 <== mon.1 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556587fa31e0 con 0x556587f72c00 2023-12-05T13:32:00.223 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 bash[196780]: 11774d2176132affcc6b1915c6047c554dd4253202b441e788bb2adeca24e6b7 2023-12-05T13:32:00.223 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:31:59 smithi052 systemd[1]: Started Ceph osd.3 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:32:00.711 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:32:00 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:32:00.363+0000 7fab570a1640 -1 Falling back to public interface 2023-12-05T13:32:00.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:00.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:00.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:00 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:00.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:00 smithi052 ceph-mon[184394]: pgmap v111: 65 pgs: 10 active+undersized+degraded, 14 active+undersized, 6 peering, 1 stale+active+clean, 34 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:32:01.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:01.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:01.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:00 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:01.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:00 smithi029 ceph-mon[217405]: pgmap v111: 65 pgs: 10 active+undersized+degraded, 14 active+undersized, 6 peering, 1 stale+active+clean, 34 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:32:03.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:02 smithi052 ceph-mon[184394]: pgmap v112: 65 pgs: 14 active+undersized+degraded, 19 active+undersized, 32 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2023-12-05T13:32:03.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:02 smithi029 ceph-mon[217405]: pgmap v112: 65 pgs: 14 active+undersized+degraded, 19 active+undersized, 32 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2023-12-05T13:32:03.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:03.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:04.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:03 smithi052 ceph-mon[184394]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-05T13:32:04.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:03 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 42/219 objects degraded (19.178%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:04.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:03 smithi029 ceph-mon[217405]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-05T13:32:04.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:03 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 42/219 objects degraded (19.178%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:05.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:04 smithi052 ceph-mon[184394]: pgmap v113: 65 pgs: 14 active+undersized+degraded, 19 active+undersized, 32 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2023-12-05T13:32:05.223 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:32:05 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:32:05.047+0000 7fab570a1640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-05T13:32:05.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:04 smithi029 ceph-mon[217405]: pgmap v113: 65 pgs: 14 active+undersized+degraded, 19 active+undersized, 32 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2023-12-05T13:32:05.973 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:32:05 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:32:05.686+0000 7fab570a1640 -1 osd.3 75 log_to_monitors true 2023-12-05T13:32:06.973 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:32:06.692+0000 7fab4450a700 -1 osd.3 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:32:06.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:06.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:06.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:06.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:32:06.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='osd.3 [v2:172.21.15.52:6800/3322939945,v1:172.21.15.52:6801/3322939945]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-05T13:32:06.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:06 smithi052 ceph-mon[184394]: pgmap v114: 65 pgs: 14 active+undersized+degraded, 19 active+undersized, 32 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2023-12-05T13:32:07.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:07.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='osd.3 [v2:172.21.15.52:6800/3322939945,v1:172.21.15.52:6801/3322939945]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-05T13:32:07.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:06 smithi029 ceph-mon[217405]: pgmap v114: 65 pgs: 14 active+undersized+degraded, 19 active+undersized, 32 active+clean; 194 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2023-12-05T13:32:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:07 smithi052 ceph-mon[184394]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T13:32:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:07 smithi052 ceph-mon[184394]: osdmap e78: 6 total, 5 up, 6 in 2023-12-05T13:32:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:07 smithi052 ceph-mon[184394]: from='osd.3 [v2:172.21.15.52:6800/3322939945,v1:172.21.15.52:6801/3322939945]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:07 smithi052 ceph-mon[184394]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:07.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:08.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:07 smithi029 ceph-mon[217405]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T13:32:08.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:07 smithi029 ceph-mon[217405]: osdmap e78: 6 total, 5 up, 6 in 2023-12-05T13:32:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:07 smithi029 ceph-mon[217405]: from='osd.3 [v2:172.21.15.52:6800/3322939945,v1:172.21.15.52:6801/3322939945]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:07 smithi029 ceph-mon[217405]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:08.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: failed to encode map e78 with expected crc 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: osd.3 [v2:172.21.15.52:6800/3322939945,v1:172.21.15.52:6801/3322939945] boot 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: osdmap e79: 6 total, 6 up, 6 in 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: failed to encode map e78 with expected crc 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: failed to encode map e78 with expected crc 2023-12-05T13:32:08.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:08 smithi052 ceph-mon[184394]: pgmap v117: 65 pgs: 8 peering, 12 active+undersized+degraded, 13 active+undersized, 32 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:09.105 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: failed to encode map e78 with expected crc 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: osd.3 [v2:172.21.15.52:6800/3322939945,v1:172.21.15.52:6801/3322939945] boot 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: osdmap e79: 6 total, 6 up, 6 in 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: failed to encode map e78 with expected crc 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: failed to encode map e78 with expected crc 2023-12-05T13:32:09.106 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:08 smithi029 ceph-mon[217405]: pgmap v117: 65 pgs: 8 peering, 12 active+undersized+degraded, 13 active+undersized, 32 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: osdmap e80: 6 total, 6 up, 6 in 2023-12-05T13:32:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: failed to encode map e80 with expected crc 2023-12-05T13:32:09.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:09 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 36/219 objects degraded (16.438%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:10.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: osdmap e80: 6 total, 6 up, 6 in 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: failed to encode map e80 with expected crc 2023-12-05T13:32:10.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:09 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 36/219 objects degraded (16.438%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:10.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:10 smithi052 ceph-mon[184394]: pgmap v119: 65 pgs: 8 peering, 9 active+undersized+degraded, 11 active+undersized, 37 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/219 objects degraded (12.329%) 2023-12-05T13:32:11.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:10 smithi029 ceph-mon[217405]: pgmap v119: 65 pgs: 8 peering, 9 active+undersized+degraded, 11 active+undersized, 37 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/219 objects degraded (12.329%) 2023-12-05T13:32:12.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:12 smithi029 ceph-mon[217405]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/219 objects degraded (12.329%), 9 pgs degraded) 2023-12-05T13:32:12.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:12 smithi029 ceph-mon[217405]: Cluster is now healthy 2023-12-05T13:32:12.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:12 smithi052 ceph-mon[184394]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/219 objects degraded (12.329%), 9 pgs degraded) 2023-12-05T13:32:12.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:12 smithi052 ceph-mon[184394]: Cluster is now healthy 2023-12-05T13:32:13.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:13 smithi029 ceph-mon[217405]: pgmap v120: 65 pgs: 8 peering, 57 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:13.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:13 smithi052 ceph-mon[184394]: pgmap v120: 65 pgs: 8 peering, 57 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:15.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:14 smithi029 ceph-mon[217405]: pgmap v121: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:14 smithi052 ceph-mon[184394]: pgmap v121: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:17.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:17 smithi029 ceph-mon[217405]: pgmap v122: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:17.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:17 smithi052 ceph-mon[184394]: pgmap v122: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:19.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:19 smithi029 ceph-mon[217405]: pgmap v123: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:19.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:19 smithi052 ceph-mon[184394]: pgmap v123: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:21.577 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:21 smithi052 ceph-mon[184394]: pgmap v124: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:21.577 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:21 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:21.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:21 smithi029 ceph-mon[217405]: pgmap v124: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:21.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:21 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:22.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:22.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: Upgrade: osd.4 is safe to restart 2023-12-05T13:32:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T13:32:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:22.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: Upgrade: osd.4 is safe to restart 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:22.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:23 smithi052 ceph-mon[184394]: Upgrade: Updating osd.4 2023-12-05T13:32:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:23 smithi052 ceph-mon[184394]: Deploying daemon osd.4 on smithi052 2023-12-05T13:32:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:23 smithi052 ceph-mon[184394]: pgmap v125: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:23.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:23 smithi029 ceph-mon[217405]: Upgrade: Updating osd.4 2023-12-05T13:32:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:23 smithi029 ceph-mon[217405]: Deploying daemon osd.4 on smithi052 2023-12-05T13:32:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:23 smithi029 ceph-mon[217405]: pgmap v125: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:23.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:24.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:24 smithi052 systemd[1]: Stopping Ceph osd.4 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:32:24.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:24 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[135280]: 2023-12-05T13:32:24.429+0000 7efc0a70c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:32:24.724 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:24 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[135280]: 2023-12-05T13:32:24.429+0000 7efc0a70c700 -1 osd.4 80 *** Got signal Terminated *** 2023-12-05T13:32:24.724 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:24 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[135280]: 2023-12-05T13:32:24.429+0000 7efc0a70c700 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:32:25.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:24 smithi029 ceph-mon[217405]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:25.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:24 smithi029 ceph-mon[217405]: osd.4 marked itself down and dead 2023-12-05T13:32:25.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:24 smithi052 ceph-mon[184394]: pgmap v126: 65 pgs: 65 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:25.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:24 smithi052 ceph-mon[184394]: osd.4 marked itself down and dead 2023-12-05T13:32:25.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:25 smithi052 bash[203122]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4 2023-12-05T13:32:26.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:25 smithi029 ceph-mon[217405]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:32:26.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:25 smithi029 ceph-mon[217405]: osdmap e81: 6 total, 5 up, 6 in 2023-12-05T13:32:26.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:25 smithi029 ceph-mon[217405]: failed to encode map e81 with expected crc 2023-12-05T13:32:26.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:25 smithi029 ceph-mon[217405]: failed to encode map e81 with expected crc 2023-12-05T13:32:26.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:25 smithi052 ceph-mon[184394]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:32:26.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:25 smithi052 ceph-mon[184394]: osdmap e81: 6 total, 5 up, 6 in 2023-12-05T13:32:26.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:25 smithi052 ceph-mon[184394]: failed to encode map e81 with expected crc 2023-12-05T13:32:26.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:25 smithi052 ceph-mon[184394]: failed to encode map e81 with expected crc 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 -- 172.21.15.29:0/978777093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 msgr2=0x7f5eb0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 --2- 172.21.15.29:0/978777093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0065800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0004940 tx=0x7f5ea0009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 -- 172.21.15.29:0/978777093 shutdown_connections 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 --2- 172.21.15.29:0/978777093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0065800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 --2- 172.21.15.29:0/978777093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0102c20 0x7f5eb0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 -- 172.21.15.29:0/978777093 >> 172.21.15.29:0/978777093 conn(0x7f5eb00719b0 msgr2=0x7f5eb0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 -- 172.21.15.29:0/978777093 shutdown_connections 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.245+0000 7f5eb7534700 1 -- 172.21.15.29:0/978777093 wait complete. 2023-12-05T13:32:26.247 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb7534700 1 Processor -- start 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb7534700 1 -- start start 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb7534700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb7534700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0102c20 0x7f5eb0115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb7534700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0116390 con 0x7f5eb0065390 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb7534700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb010f6c0 con 0x7f5eb0102c20 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb52d0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb52d0700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35558/0 (socket says 172.21.15.29:35558) 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb52d0700 1 -- 172.21.15.29:0/3010180364 learned_addr learned my addr 172.21.15.29:0/3010180364 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:26.248 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.246+0000 7f5eb4acf700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0102c20 0x7f5eb0115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5eb52d0700 1 -- 172.21.15.29:0/3010180364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0102c20 msgr2=0x7f5eb0115d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5eb52d0700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0102c20 0x7f5eb0115d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5eb52d0700 1 -- 172.21.15.29:0/3010180364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0005040 con 0x7f5eb0065390 2023-12-05T13:32:26.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5eb52d0700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0115800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00eb40 tx=0x7f5eac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:26.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eac007cc0 con 0x7f5eb0065390 2023-12-05T13:32:26.249 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5eac00f040 con 0x7f5eb0065390 2023-12-05T13:32:26.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eac00c990 con 0x7f5eb0065390 2023-12-05T13:32:26.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb010f940 con 0x7f5eb0065390 2023-12-05T13:32:26.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.247+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb010fe80 con 0x7f5eb0065390 2023-12-05T13:32:26.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.249+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb00734d0 con 0x7f5eb0065390 2023-12-05T13:32:26.250 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.249+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5eac00caf0 con 0x7f5eb0065390 2023-12-05T13:32:26.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.249+0000 7f5ea5ffb700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5e9c06ce60 0x7f5e9c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.250+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f5eac08be40 con 0x7f5eb0065390 2023-12-05T13:32:26.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.250+0000 7f5eb4acf700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5e9c06ce60 0x7f5e9c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.251 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.250+0000 7f5eb4acf700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5e9c06ce60 0x7f5e9c06f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0111030 tx=0x7f5ea0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:26.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.254+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5eac059890 con 0x7f5eb0065390 2023-12-05T13:32:26.482 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.482+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5eb0110e30 con 0x7f5e9c06ce60 2023-12-05T13:32:26.483 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.483+0000 7f5ea5ffb700 1 -- 172.21.15.29:0/3010180364 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5eb0110e30 con 0x7f5e9c06ce60 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5e9c06ce60 msgr2=0x7f5e9c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5e9c06ce60 0x7f5e9c06f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0111030 tx=0x7f5ea0009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 msgr2=0x7f5eb0115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0115800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00eb40 tx=0x7f5eac00b040 comp rx=0 tx=0).stop 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 shutdown_connections 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5e9c06ce60 0x7f5e9c06f310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5eb0065390 0x7f5eb0115800 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.486 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 --2- 172.21.15.29:0/3010180364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0102c20 0x7f5eb0115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.485+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 >> 172.21.15.29:0/3010180364 conn(0x7f5eb00719b0 msgr2=0x7f5eb00fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:26.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.486+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 shutdown_connections 2023-12-05T13:32:26.487 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.486+0000 7f5eb7534700 1 -- 172.21.15.29:0/3010180364 wait complete. 2023-12-05T13:32:26.498 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 -- 172.21.15.29:0/1704922033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f8101b00 msgr2=0x7f99f8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 --2- 172.21.15.29:0/1704922033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f8101b00 0x7f99f8101ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99e8004940 tx=0x7f99e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 -- 172.21.15.29:0/1704922033 shutdown_connections 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 --2- 172.21.15.29:0/1704922033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f80fbb40 0x7f99f80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 --2- 172.21.15.29:0/1704922033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f8101b00 0x7f99f8101ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 -- 172.21.15.29:0/1704922033 >> 172.21.15.29:0/1704922033 conn(0x7f99f80719b0 msgr2=0x7f99f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 -- 172.21.15.29:0/1704922033 shutdown_connections 2023-12-05T13:32:26.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.598+0000 7f99fd180700 1 -- 172.21.15.29:0/1704922033 wait complete. 2023-12-05T13:32:26.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99fd180700 1 Processor -- start 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99fd180700 1 -- start start 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99fd180700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 0x7f99f8113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99fd180700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f8101b00 0x7f99f8113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99fd180700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f810d500 con 0x7f99f80fbb40 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99fd180700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f810d670 con 0x7f99f8101b00 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99f6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 0x7f99f8113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99f6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 0x7f99f8113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35576/0 (socket says 172.21.15.29:35576) 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.599+0000 7f99f6d9d700 1 -- 172.21.15.29:0/1183618756 learned_addr learned my addr 172.21.15.29:0/1183618756 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99f659c700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f8101b00 0x7f99f8113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99f6d9d700 1 -- 172.21.15.29:0/1183618756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f8101b00 msgr2=0x7f99f8113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99f6d9d700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f8101b00 0x7f99f8113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99f6d9d700 1 -- 172.21.15.29:0/1183618756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8005040 con 0x7f99f80fbb40 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99f6d9d700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 0x7f99f8113640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99e800b3b0 tx=0x7f99e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:26.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e800e040 con 0x7f99f80fbb40 2023-12-05T13:32:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f810d8f0 con 0x7f99f80fbb40 2023-12-05T13:32:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99e800bc50 con 0x7f99f80fbb40 2023-12-05T13:32:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99e8013420 con 0x7f99f80fbb40 2023-12-05T13:32:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.600+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f810de30 con 0x7f99f80fbb40 2023-12-05T13:32:26.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.601+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f80734d0 con 0x7f99f80fbb40 2023-12-05T13:32:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.602+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f99e801c430 con 0x7f99f80fbb40 2023-12-05T13:32:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.602+0000 7f99ef7fe700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f99e406ce60 0x7f99e406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.602+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f99e808d160 con 0x7f99f80fbb40 2023-12-05T13:32:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.602+0000 7f99f659c700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f99e406ce60 0x7f99e406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.603+0000 7f99f659c700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f99e406ce60 0x7f99e406f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f99e0006fd0 tx=0x7f99e0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:26.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.607+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f99e805ab10 con 0x7f99f80fbb40 2023-12-05T13:32:26.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.840+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99f810ec20 con 0x7f99e406ce60 2023-12-05T13:32:26.843 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.841+0000 7f99ef7fe700 1 -- 172.21.15.29:0/1183618756 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f99f810ec20 con 0x7f99e406ce60 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f99e406ce60 msgr2=0x7f99e406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f99e406ce60 0x7f99e406f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f99e0006fd0 tx=0x7f99e0008040 comp rx=0 tx=0).stop 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 msgr2=0x7f99f8113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 0x7f99f8113640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99e800b3b0 tx=0x7f99e8009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 shutdown_connections 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f99e406ce60 0x7f99e406f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99f80fbb40 0x7f99f8113640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 --2- 172.21.15.29:0/1183618756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f8101b00 0x7f99f8113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 >> 172.21.15.29:0/1183618756 conn(0x7f99f80719b0 msgr2=0x7f99f80653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 shutdown_connections 2023-12-05T13:32:26.845 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.844+0000 7f99fd180700 1 -- 172.21.15.29:0/1183618756 wait complete. 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 -- 172.21.15.29:0/3752031485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 msgr2=0x7f9e78101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 --2- 172.21.15.29:0/3752031485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78101ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c004940 tx=0x7f9e6c009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 -- 172.21.15.29:0/3752031485 shutdown_connections 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 --2- 172.21.15.29:0/3752031485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 0x7f9e780fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 --2- 172.21.15.29:0/3752031485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78101ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 -- 172.21.15.29:0/3752031485 >> 172.21.15.29:0/3752031485 conn(0x7f9e78071970 msgr2=0x7f9e78071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 -- 172.21.15.29:0/3752031485 shutdown_connections 2023-12-05T13:32:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.956+0000 7f9e7d848700 1 -- 172.21.15.29:0/3752031485 wait complete. 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.957+0000 7f9e7d848700 1 Processor -- start 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.957+0000 7f9e7d848700 1 -- start start 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.957+0000 7f9e7d848700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 0x7f9e781156b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.957+0000 7f9e7d848700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78115c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.957+0000 7f9e7d848700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e78116280 con 0x7f9e78101ad0 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.957+0000 7f9e7d848700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7810f570 con 0x7f9e780fba90 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78115c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78115c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35598/0 (socket says 172.21.15.29:35598) 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 -- 172.21.15.29:0/1712994962 learned_addr learned my addr 172.21.15.29:0/1712994962 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e76ffd700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 0x7f9e781156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 -- 172.21.15.29:0/1712994962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 msgr2=0x7f9e781156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 0x7f9e781156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 -- 172.21.15.29:0/1712994962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c005040 con 0x7f9e78101ad0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e76ffd700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 0x7f9e781156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e767fc700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78115c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800eb40 tx=0x7f9e6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e68007cc0 con 0x7f9e78101ad0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7810f7a0 con 0x7f9e78101ad0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e6800f040 con 0x7f9e78101ad0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e68009570 con 0x7f9e78101ad0 2023-12-05T13:32:26.960 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.958+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7810fce0 con 0x7f9e78101ad0 2023-12-05T13:32:26.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.960+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e78075970 con 0x7f9e78101ad0 2023-12-05T13:32:26.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.960+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9e680096d0 con 0x7f9e78101ad0 2023-12-05T13:32:26.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.960+0000 7f9e5f7fe700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9e6006ce70 0x7f9e6006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:26.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.960+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f9e6808bfb0 con 0x7f9e78101ad0 2023-12-05T13:32:26.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.961+0000 7f9e76ffd700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9e6006ce70 0x7f9e6006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:26.964 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.961+0000 7f9e76ffd700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9e6006ce70 0x7f9e6006f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009fd0 tx=0x7f9e6c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:26.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:26.965+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9e68059980 con 0x7f9e78101ad0 2023-12-05T13:32:26.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:26 smithi052 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.4.service: Succeeded. 2023-12-05T13:32:26.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:26 smithi052 systemd[1]: Stopped Ceph osd.4 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:32:26.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:26 smithi052 systemd[1]: Starting Ceph osd.4 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:32:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: osdmap e82: 6 total, 5 up, 6 in 2023-12-05T13:32:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: failed to encode map e82 with expected crc 2023-12-05T13:32:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: failed to encode map e82 with expected crc 2023-12-05T13:32:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: failed to encode map e82 with expected crc 2023-12-05T13:32:26.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: failed to encode map e82 with expected crc 2023-12-05T13:32:26.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: failed to encode map e82 with expected crc 2023-12-05T13:32:26.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:26 smithi052 ceph-mon[184394]: pgmap v129: 65 pgs: 3 peering, 4 stale+active+clean, 58 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:27.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: osdmap e82: 6 total, 5 up, 6 in 2023-12-05T13:32:27.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: failed to encode map e82 with expected crc 2023-12-05T13:32:27.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: failed to encode map e82 with expected crc 2023-12-05T13:32:27.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: failed to encode map e82 with expected crc 2023-12-05T13:32:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: failed to encode map e82 with expected crc 2023-12-05T13:32:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: failed to encode map e82 with expected crc 2023-12-05T13:32:27.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:26 smithi029 ceph-mon[217405]: pgmap v129: 65 pgs: 3 peering, 4 stale+active+clean, 58 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:27.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.184+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e7810ff00 con 0x7f9e6006ce70 2023-12-05T13:32:27.198 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.195+0000 7f9e5f7fe700 1 -- 172.21.15.29:0/1712994962 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9e7810ff00 con 0x7f9e6006ce70 2023-12-05T13:32:27.198 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (4m) 53s ago 13m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (2m) 53s ago 13m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (2m) 25s ago 12m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (3m) 53s ago 13m 84.3M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (9m) 53s ago 9m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (9m) 53s ago 9m 19.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (9m) 25s ago 9m 19.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (9m) 25s ago 9m 19.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (5m) 53s ago 14m 513M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (4m) 25s ago 12m 449M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (3m) 53s ago 14m 68.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (2m) 25s ago 12m 51.4M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (4m) 53s ago 13m 16.4M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:32:27.199 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (4m) 25s ago 12m 17.4M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (2m) 53s ago 12m 180M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (89s) 53s ago 11m 124M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 54b9f199069e 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (57s) 53s ago 11m 12.6M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5f43e7285634 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (27s) 25s ago 11m 12.6M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 11774d217613 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (10m) 25s ago 10m 818M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5a27a5c54a01 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (10m) 25s ago 10m 1044M 2594M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 6b607dcf8f7d 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (4m) 53s ago 13m 59.4M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:32:27.200 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9e6006ce70 msgr2=0x7f9e6006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9e6006ce70 0x7f9e6006f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009fd0 tx=0x7f9e6c009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 msgr2=0x7f9e78115c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78115c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800eb40 tx=0x7f9e6800b040 comp rx=0 tx=0).stop 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 shutdown_connections 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f9e6006ce70 0x7f9e6006f320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e780fba90 0x7f9e781156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 --2- 172.21.15.29:0/1712994962 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e78101ad0 0x7f9e78115c30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 >> 172.21.15.29:0/1712994962 conn(0x7f9e78071970 msgr2=0x7f9e780fa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 shutdown_connections 2023-12-05T13:32:27.201 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.197+0000 7f9e7d848700 1 -- 172.21.15.29:0/1712994962 wait complete. 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.309+0000 7f74b6dc1700 1 -- 172.21.15.29:0/261933512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 msgr2=0x7f74b0106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.309+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/261933512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0106c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004970 tx=0x7f74a4009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.309+0000 7f74b6dc1700 1 -- 172.21.15.29:0/261933512 shutdown_connections 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.309+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/261933512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0106c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.309+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/261933512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b00fdc10 0x7f74b00fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.309+0000 7f74b6dc1700 1 -- 172.21.15.29:0/261933512 >> 172.21.15.29:0/261933512 conn(0x7f74b00f7690 msgr2=0x7f74b00f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:27.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.310+0000 7f74b6dc1700 1 -- 172.21.15.29:0/261933512 shutdown_connections 2023-12-05T13:32:27.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.310+0000 7f74b6dc1700 1 -- 172.21.15.29:0/261933512 wait complete. 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.310+0000 7f74b6dc1700 1 Processor -- start 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.310+0000 7f74b6dc1700 1 -- start start 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74b6dc1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b00fdc10 0x7f74b0113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74b6dc1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74b6dc1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0114200 con 0x7f74b00fe5b0 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74b6dc1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b010d4f0 con 0x7f74b00fdc10 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35614/0 (socket says 172.21.15.29:35614) 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 -- 172.21.15.29:0/4092174867 learned_addr learned my addr 172.21.15.29:0/4092174867 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:27.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74b4b5d700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b00fdc10 0x7f74b0113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 -- 172.21.15.29:0/4092174867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b00fdc10 msgr2=0x7f74b0113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b00fdc10 0x7f74b0113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 -- 172.21.15.29:0/4092174867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4005040 con 0x7f74b00fe5b0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74affff700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0113bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004f50 tx=0x7f74a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74a400e040 con 0x7f74b00fe5b0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.311+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b010d720 con 0x7f74b00fe5b0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.312+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74a4013420 con 0x7f74b00fe5b0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.312+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74a401c630 con 0x7f74b00fe5b0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.312+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b010dc60 con 0x7f74b00fe5b0 2023-12-05T13:32:27.313 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.313+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b0104340 con 0x7f74b00fe5b0 2023-12-05T13:32:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.313+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f74a4013a00 con 0x7f74b00fe5b0 2023-12-05T13:32:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.314+0000 7f74ad7fa700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f749806ce70 0x7f749806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.314+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f74a408d5b0 con 0x7f74b00fe5b0 2023-12-05T13:32:27.314 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.314+0000 7f74b4b5d700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f749806ce70 0x7f749806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:27.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.314+0000 7f74b4b5d700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f749806ce70 0x7f749806f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74b00f8e60 tx=0x7f74a0009e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:27.319 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.318+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f74a405af50 con 0x7f74b00fe5b0 2023-12-05T13:32:27.614 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.614+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f74b00647b0 con 0x7f74b00fe5b0 2023-12-05T13:32:27.615 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.614+0000 7f74ad7fa700 1 -- 172.21.15.29:0/4092174867 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f74a405aae0 con 0x7f74b00fe5b0 2023-12-05T13:32:27.615 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:32:27.615 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:32:27.615 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:32:27.615 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:32:27.615 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 4 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5, 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 8 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:32:27.616 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:32:27.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f749806ce70 msgr2=0x7f749806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f749806ce70 0x7f749806f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74b00f8e60 tx=0x7f74a0009e20 comp rx=0 tx=0).stop 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 msgr2=0x7f74b0113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0113bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004f50 tx=0x7f74a4009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 shutdown_connections 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f749806ce70 0x7f749806f320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b00fdc10 0x7f74b0113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 --2- 172.21.15.29:0/4092174867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74b00fe5b0 0x7f74b0113bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 >> 172.21.15.29:0/4092174867 conn(0x7f74b00f7690 msgr2=0x7f74b01014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:27.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 shutdown_connections 2023-12-05T13:32:27.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.617+0000 7f74b6dc1700 1 -- 172.21.15.29:0/4092174867 wait complete. 2023-12-05T13:32:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 -- 172.21.15.29:0/74740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fb1e0 msgr2=0x7f98900fb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 --2- 172.21.15.29:0/74740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fb1e0 0x7f98900fb650 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9880004940 tx=0x7f9880009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 -- 172.21.15.29:0/74740444 shutdown_connections 2023-12-05T13:32:27.732 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 --2- 172.21.15.29:0/74740444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fb1e0 0x7f98900fb650 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 --2- 172.21.15.29:0/74740444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98900fda20 0x7f98900fddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 -- 172.21.15.29:0/74740444 >> 172.21.15.29:0/74740444 conn(0x7f98900711a0 msgr2=0x7f98900715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 -- 172.21.15.29:0/74740444 shutdown_connections 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.729+0000 7f98979bd700 1 -- 172.21.15.29:0/74740444 wait complete. 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f98979bd700 1 Processor -- start 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f98979bd700 1 -- start start 2023-12-05T13:32:27.733 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f98979bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98900fb1e0 0x7f9890115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f98979bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 0x7f9890115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f98979bd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9890116400 con 0x7f98900fda20 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f98979bd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989010f730 con 0x7f98900fb1e0 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f9894f58700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 0x7f9890115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f9894f58700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 0x7f9890115db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35636/0 (socket says 172.21.15.29:35636) 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f9894f58700 1 -- 172.21.15.29:0/1170736284 learned_addr learned my addr 172.21.15.29:0/1170736284 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.730+0000 7f9895759700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98900fb1e0 0x7f9890115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9894f58700 1 -- 172.21.15.29:0/1170736284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98900fb1e0 msgr2=0x7f9890115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9894f58700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98900fb1e0 0x7f9890115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9894f58700 1 -- 172.21.15.29:0/1170736284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880005040 con 0x7f98900fda20 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9894f58700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 0x7f9890115db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f988000b3b0 tx=0x7f9880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988000e040 con 0x7f98900fda20 2023-12-05T13:32:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989010f9b0 con 0x7f98900fda20 2023-12-05T13:32:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f988000bc50 con 0x7f98900fda20 2023-12-05T13:32:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9880013660 con 0x7f98900fda20 2023-12-05T13:32:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.731+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989010fef0 con 0x7f98900fda20 2023-12-05T13:32:27.735 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.732+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9890072cc0 con 0x7f98900fda20 2023-12-05T13:32:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.733+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f988001c430 con 0x7f98900fda20 2023-12-05T13:32:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.733+0000 7f9885ffb700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f987c06ce60 0x7f987c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.733+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f988008d080 con 0x7f98900fda20 2023-12-05T13:32:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.733+0000 7f9895759700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f987c06ce60 0x7f987c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:27.736 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.734+0000 7f9895759700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f987c06ce60 0x7f987c06f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9890065340 tx=0x7f988c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:27.738 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.738+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f988005aa20 con 0x7f98900fda20 2023-12-05T13:32:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:27 smithi052 ceph-mon[184394]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:27 smithi052 ceph-mon[184394]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T13:32:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:27 smithi052 ceph-mon[184394]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:27 smithi052 ceph-mon[184394]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:27.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:27 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/4092174867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:27.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-05T13:32:27.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-05T13:32:27.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-05T13:32:27.974 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-05T13:32:27.974 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-05T13:32:27.974 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-05T13:32:27.974 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:27 smithi052 bash[203390]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-05T13:32:27.995 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.994+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f989004bb80 con 0x7f98900fda20 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.995+0000 7f9885ffb700 1 -- 172.21.15.29:0/1170736284 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f988001ce60 con 0x7f98900fda20 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:32:27.996 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:32:27.997 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:32:27.998 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:32:27.999 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:32:27.999 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:32:27.999 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:32:27.999 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:32:27.999 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:32:27.999 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f987c06ce60 msgr2=0x7f987c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f987c06ce60 0x7f987c06f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9890065340 tx=0x7f988c00b040 comp rx=0 tx=0).stop 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 msgr2=0x7f9890115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 0x7f9890115db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f988000b3b0 tx=0x7f9880009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 shutdown_connections 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f987c06ce60 0x7f987c06f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98900fb1e0 0x7f9890115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 --2- 172.21.15.29:0/1170736284 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98900fda20 0x7f9890115db0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 >> 172.21.15.29:0/1170736284 conn(0x7f98900711a0 msgr2=0x7f98900f9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 shutdown_connections 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:27.997+0000 7f98979bd700 1 -- 172.21.15.29:0/1170736284 wait complete. 2023-12-05T13:32:28.000 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:32:28.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:27 smithi029 ceph-mon[217405]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:28.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:27 smithi029 ceph-mon[217405]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T13:32:28.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:27 smithi029 ceph-mon[217405]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:28.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:27 smithi029 ceph-mon[217405]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:28.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:27 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/4092174867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 -- 172.21.15.29:0/1914028751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0088101b00 msgr2=0x7f0088101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 --2- 172.21.15.29:0/1914028751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0088101b00 0x7f0088101ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0078004940 tx=0x7f0078009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 -- 172.21.15.29:0/1914028751 shutdown_connections 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 --2- 172.21.15.29:0/1914028751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00880fbb40 0x7f00880fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 --2- 172.21.15.29:0/1914028751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0088101b00 0x7f0088101ed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 -- 172.21.15.29:0/1914028751 >> 172.21.15.29:0/1914028751 conn(0x7f00880f76c0 msgr2=0x7f00880f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 -- 172.21.15.29:0/1914028751 shutdown_connections 2023-12-05T13:32:28.112 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.111+0000 7f008d4b4700 1 -- 172.21.15.29:0/1914028751 wait complete. 2023-12-05T13:32:28.113 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.112+0000 7f008d4b4700 1 Processor -- start 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.112+0000 7f008d4b4700 1 -- start start 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.112+0000 7f008d4b4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 0x7f008810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.112+0000 7f008d4b4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0088101b00 0x7f008810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.112+0000 7f008d4b4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008810f1c0 con 0x7f00880fbb40 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.112+0000 7f008d4b4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008810f330 con 0x7f0088101b00 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 0x7f008810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 0x7f008810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35648/0 (socket says 172.21.15.29:35648) 2023-12-05T13:32:28.114 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 -- 172.21.15.29:0/294839021 learned_addr learned my addr 172.21.15.29:0/294839021 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f00867fc700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0088101b00 0x7f008810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 -- 172.21.15.29:0/294839021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0088101b00 msgr2=0x7f008810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0088101b00 0x7f008810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 -- 172.21.15.29:0/294839021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078005040 con 0x7f00880fbb40 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f0086ffd700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 0x7f008810e6f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f007800b3b0 tx=0x7f0078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007800e040 con 0x7f00880fbb40 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0088117660 con 0x7f00880fbb40 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f007801c430 con 0x7f00880fbb40 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0078013640 con 0x7f00880fbb40 2023-12-05T13:32:28.115 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.113+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0088117b20 con 0x7f00880fbb40 2023-12-05T13:32:28.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.114+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0088103fb0 con 0x7f00880fbb40 2023-12-05T13:32:28.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.115+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f007801c5a0 con 0x7f00880fbb40 2023-12-05T13:32:28.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.115+0000 7f006f7fe700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f007006ce60 0x7f007006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:28.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.116+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f007808ce30 con 0x7f00880fbb40 2023-12-05T13:32:28.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.116+0000 7f00867fc700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f007006ce60 0x7f007006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:28.117 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.116+0000 7f00867fc700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f007006ce60 0x7f007006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00880666e0 tx=0x7f007c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:28.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.120+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0078056df0 con 0x7f00880fbb40 2023-12-05T13:32:28.354 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.350+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0088066420 con 0x7f007006ce60 2023-12-05T13:32:28.358 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.351+0000 7f006f7fe700 1 -- 172.21.15.29:0/294839021 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0088066420 con 0x7f007006ce60 2023-12-05T13:32:28.358 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "10/21 daemons upgraded", 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:32:28.359 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f007006ce60 msgr2=0x7f007006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f007006ce60 0x7f007006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00880666e0 tx=0x7f007c00b040 comp rx=0 tx=0).stop 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 msgr2=0x7f008810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 0x7f008810e6f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f007800b3b0 tx=0x7f0078009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 shutdown_connections 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f007006ce60 0x7f007006f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00880fbb40 0x7f008810e6f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 --2- 172.21.15.29:0/294839021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0088101b00 0x7f008810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 >> 172.21.15.29:0/294839021 conn(0x7f00880f76c0 msgr2=0x7f00880f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:28.360 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.353+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 shutdown_connections 2023-12-05T13:32:28.361 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.354+0000 7f008d4b4700 1 -- 172.21.15.29:0/294839021 wait complete. 2023-12-05T13:32:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.465+0000 7fcc1d76a700 1 -- 172.21.15.29:0/3066063219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 msgr2=0x7fcc18106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.465+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/3066063219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18106c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c004940 tx=0x7fcc0c009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:28.466 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 -- 172.21.15.29:0/3066063219 shutdown_connections 2023-12-05T13:32:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/3066063219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18106c50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/3066063219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc180fdc70 0x7fcc180fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 -- 172.21.15.29:0/3066063219 >> 172.21.15.29:0/3066063219 conn(0x7fcc180f76c0 msgr2=0x7fcc180f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 -- 172.21.15.29:0/3066063219 shutdown_connections 2023-12-05T13:32:28.467 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 -- 172.21.15.29:0/3066063219 wait complete. 2023-12-05T13:32:28.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 Processor -- start 2023-12-05T13:32:28.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.466+0000 7fcc1d76a700 1 -- start start 2023-12-05T13:32:28.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc1d76a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc180fdc70 0x7fcc18113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:28.468 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc1d76a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc1d76a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181141f0 con 0x7fcc180fe610 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc1d76a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1810d4e0 con 0x7fcc180fdc70 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43142/0 (socket says 172.21.15.29:43142) 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 -- 172.21.15.29:0/2992340217 learned_addr learned my addr 172.21.15.29:0/2992340217 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc16ffd700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc180fdc70 0x7fcc18113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 -- 172.21.15.29:0/2992340217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc180fdc70 msgr2=0x7fcc18113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc180fdc70 0x7fcc18113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 -- 172.21.15.29:0/2992340217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c005040 con 0x7fcc180fe610 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcc167fc700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18113ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00b3b0 tx=0x7fcc0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.467+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc0c00e040 con 0x7fcc180fe610 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.468+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1810d770 con 0x7fcc180fe610 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.468+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc0c009af0 con 0x7fcc180fe610 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.468+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc0c01c3f0 con 0x7fcc180fe610 2023-12-05T13:32:28.469 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.468+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1810dcb0 con 0x7fcc180fe610 2023-12-05T13:32:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.469+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc18104260 con 0x7fcc180fe610 2023-12-05T13:32:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.469+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fcc0c013800 con 0x7fcc180fe610 2023-12-05T13:32:28.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.470+0000 7fcbff7fe700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcc0006ce60 0x7fcc0006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.470+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fcc0c08d690 con 0x7fcc180fe610 2023-12-05T13:32:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.470+0000 7fcc16ffd700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcc0006ce60 0x7fcc0006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:28.471 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.470+0000 7fcc16ffd700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcc0006ce60 0x7fcc0006f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc180f8f30 tx=0x7fcc0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:28.479 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.474+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcc0c05b030 con 0x7fcc180fe610 2023-12-05T13:32:28.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.778+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcc180fb2c0 con 0x7fcc180fe610 2023-12-05T13:32:28.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.779+0000 7fcbff7fe700 1 -- 172.21.15.29:0/2992340217 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+281 (secure 0 0 0) 0x7fcc0c05abc0 con 0x7fcc180fe610 2023-12-05T13:32:28.780 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 1 pg peering 2023-12-05T13:32:28.780 INFO:teuthology.orchestra.run.smithi029.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-05T13:32:28.780 INFO:teuthology.orchestra.run.smithi029.stdout: osd.4 (root=default,host=smithi052) is down 2023-12-05T13:32:28.780 INFO:teuthology.orchestra.run.smithi029.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2023-12-05T13:32:28.781 INFO:teuthology.orchestra.run.smithi029.stdout: pg 3.9 is stuck peering for 4m, current state peering, last acting [2,5] 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcc0006ce60 msgr2=0x7fcc0006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcc0006ce60 0x7fcc0006f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc180f8f30 tx=0x7fcc0800b040 comp rx=0 tx=0).stop 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 msgr2=0x7fcc18113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18113ba0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00b3b0 tx=0x7fcc0c009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 shutdown_connections 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fcc0006ce60 0x7fcc0006f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc180fdc70 0x7fcc18113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 --2- 172.21.15.29:0/2992340217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc180fe610 0x7fcc18113ba0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 >> 172.21.15.29:0/2992340217 conn(0x7fcc180f76c0 msgr2=0x7fcc181013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 shutdown_connections 2023-12-05T13:32:28.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:28.781+0000 7fcc1d76a700 1 -- 172.21.15.29:0/2992340217 wait complete. 2023-12-05T13:32:28.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1170736284' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:32:28.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: pgmap v130: 65 pgs: 13 active+undersized, 10 active+undersized+degraded, 3 peering, 39 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-05T13:32:28.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:28.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:28.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:28.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:28.974 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2992340217' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:32:28.974 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:28 smithi052 ceph-osd[203702]: -- 172.21.15.52:0/323951848 <== mon.1 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563d84b811e0 con 0x563d84b51000 2023-12-05T13:32:28.975 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:28 smithi052 bash[203664]: 57b9d01f0f36cb002b16373d54afae6cafaa74b70503f193474674a5537884c5 2023-12-05T13:32:28.975 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:28 smithi052 systemd[1]: Started Ceph osd.4 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:32:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1170736284' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:32:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: pgmap v130: 65 pgs: 13 active+undersized, 10 active+undersized+degraded, 3 peering, 39 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30/219 objects degraded (13.699%) 2023-12-05T13:32:29.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:32:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:29.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:28 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2992340217' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:32:29.395 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:29 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:32:29.140+0000 7fa674bc7640 -1 Falling back to public interface 2023-12-05T13:32:30.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:29 smithi029 ceph-mon[217405]: Health check failed: Degraded data redundancy: 30/219 objects degraded (13.699%), 10 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:30.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:29 smithi052 ceph-mon[184394]: Health check failed: Degraded data redundancy: 30/219 objects degraded (13.699%), 10 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:31.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:30 smithi029 ceph-mon[217405]: pgmap v131: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 3 peering, 33 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:31.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:31.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:30 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:30 smithi052 ceph-mon[184394]: pgmap v131: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 3 peering, 33 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:31.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:30 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:32.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:32 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:32.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:32 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:32.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:32 smithi052 ceph-mon[184394]: pgmap v132: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:32 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:32 smithi029 ceph-mon[217405]: pgmap v132: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:33.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:33 smithi029 ceph-mon[217405]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T13:32:33.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:33 smithi052 ceph-mon[184394]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T13:32:33.973 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:33 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:32:33.798+0000 7fa674bc7640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-05T13:32:34.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:32:34.365+0000 7fa674bc7640 -1 osd.4 80 log_to_monitors true 2023-12-05T13:32:35.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: pgmap v133: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='osd.4 [v2:172.21.15.52:6808/3662941009,v1:172.21.15.52:6809/3662941009]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:34 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:35.223 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:32:34.796+0000 7fa663833700 -1 osd.4 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: pgmap v133: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='osd.4 [v2:172.21.15.52:6808/3662941009,v1:172.21.15.52:6809/3662941009]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:32:35.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:35.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:35.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:35.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:35.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:32:35.224 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:34 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:36.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:36.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T13:32:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T13:32:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: failed to encode map e83 with expected crc 2023-12-05T13:32:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: osdmap e83: 6 total, 5 up, 6 in 2023-12-05T13:32:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: from='osd.4 [v2:172.21.15.52:6808/3662941009,v1:172.21.15.52:6809/3662941009]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:36.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:35 smithi029 ceph-mon[217405]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: failed to encode map e83 with expected crc 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: osdmap e83: 6 total, 5 up, 6 in 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: from='osd.4 [v2:172.21.15.52:6808/3662941009,v1:172.21.15.52:6809/3662941009]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:36.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:35 smithi052 ceph-mon[184394]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:32:37.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:32:37.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: failed to encode map e84 with expected crc 2023-12-05T13:32:37.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: osd.4 [v2:172.21.15.52:6808/3662941009,v1:172.21.15.52:6809/3662941009] boot 2023-12-05T13:32:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: osdmap e84: 6 total, 6 up, 6 in 2023-12-05T13:32:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:32:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: failed to encode map e84 with expected crc 2023-12-05T13:32:37.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:36 smithi029 ceph-mon[217405]: pgmap v136: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: failed to encode map e84 with expected crc 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: osd.4 [v2:172.21.15.52:6808/3662941009,v1:172.21.15.52:6809/3662941009] boot 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: osdmap e84: 6 total, 6 up, 6 in 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: failed to encode map e84 with expected crc 2023-12-05T13:32:37.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:36 smithi052 ceph-mon[184394]: pgmap v136: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: osdmap e85: 6 total, 6 up, 6 in 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:38.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: osdmap e85: 6 total, 6 up, 6 in 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: failed to encode map e85 with expected crc 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:38.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:38 smithi029 ceph-mon[217405]: pgmap v138: 65 pgs: 15 peering, 7 active+undersized, 6 active+undersized+degraded, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2023-12-05T13:32:39.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:38 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 36/219 objects degraded (16.438%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:38 smithi052 ceph-mon[184394]: pgmap v138: 65 pgs: 15 peering, 7 active+undersized, 6 active+undersized+degraded, 37 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2023-12-05T13:32:39.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:38 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 36/219 objects degraded (16.438%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:40.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:40 smithi029 ceph-mon[217405]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded) 2023-12-05T13:32:40.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:40 smithi029 ceph-mon[217405]: Cluster is now healthy 2023-12-05T13:32:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:40 smithi052 ceph-mon[184394]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 6 pgs degraded) 2023-12-05T13:32:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:40 smithi052 ceph-mon[184394]: Cluster is now healthy 2023-12-05T13:32:41.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:41 smithi029 ceph-mon[217405]: pgmap v139: 65 pgs: 15 peering, 2 active+undersized, 48 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:41.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:41 smithi052 ceph-mon[184394]: pgmap v139: 65 pgs: 15 peering, 2 active+undersized, 48 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:43.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:43 smithi029 ceph-mon[217405]: pgmap v140: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:43.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:43 smithi052 ceph-mon[184394]: pgmap v140: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:45.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:44 smithi029 ceph-mon[217405]: pgmap v141: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:45.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:44 smithi052 ceph-mon[184394]: pgmap v141: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:47.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:47 smithi029 ceph-mon[217405]: pgmap v142: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:47.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:47 smithi052 ceph-mon[184394]: pgmap v142: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:48.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:48 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:48.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:48 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:49.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:49 smithi029 ceph-mon[217405]: pgmap v143: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:49.722 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:49 smithi052 ceph-mon[184394]: pgmap v143: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:50.462 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:50 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:50.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:50 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:51.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:51 smithi029 ceph-mon[217405]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:51 smithi029 ceph-mon[217405]: Upgrade: osd.5 is safe to restart 2023-12-05T13:32:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:51 smithi029 ceph-mon[217405]: pgmap v144: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T13:32:51.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:51 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:51.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:51 smithi052 ceph-mon[184394]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T13:32:51.654 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:51 smithi052 ceph-mon[184394]: Upgrade: osd.5 is safe to restart 2023-12-05T13:32:51.655 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:51 smithi052 ceph-mon[184394]: pgmap v144: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:51.655 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:51.655 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T13:32:51.655 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:51 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:32:52.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:52 smithi052 ceph-mon[184394]: Upgrade: Updating osd.5 2023-12-05T13:32:52.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:52 smithi052 ceph-mon[184394]: Deploying daemon osd.5 on smithi052 2023-12-05T13:32:52.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:52.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:52.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:52 smithi029 ceph-mon[217405]: Upgrade: Updating osd.5 2023-12-05T13:32:52.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:52 smithi029 ceph-mon[217405]: Deploying daemon osd.5 on smithi052 2023-12-05T13:32:52.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:52.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:32:53.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:53 smithi029 ceph-mon[217405]: pgmap v145: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:53 smithi052 ceph-mon[184394]: pgmap v145: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:53.723 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:53 smithi052 systemd[1]: Stopping Ceph osd.5 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:32:53.724 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:53 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[144192]: 2023-12-05T13:32:53.446+0000 7fed7e375700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:32:53.724 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:53 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[144192]: 2023-12-05T13:32:53.446+0000 7fed7e375700 -1 osd.5 85 *** Got signal Terminated *** 2023-12-05T13:32:53.724 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:53 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[144192]: 2023-12-05T13:32:53.446+0000 7fed7e375700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:32:54.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:54 smithi029 ceph-mon[217405]: osd.5 marked itself down and dead 2023-12-05T13:32:54.722 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:54 smithi052 ceph-mon[184394]: osd.5 marked itself down and dead 2023-12-05T13:32:55.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:54 smithi052 bash[209376]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5 2023-12-05T13:32:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:55 smithi029 ceph-mon[217405]: pgmap v146: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:55 smithi029 ceph-mon[217405]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:32:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:55 smithi029 ceph-mon[217405]: osdmap e86: 6 total, 5 up, 6 in 2023-12-05T13:32:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:55 smithi052 ceph-mon[184394]: pgmap v146: 65 pgs: 65 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2023-12-05T13:32:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:55 smithi052 ceph-mon[184394]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T13:32:55.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:55 smithi052 ceph-mon[184394]: osdmap e86: 6 total, 5 up, 6 in 2023-12-05T13:32:56.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:56 smithi029 ceph-mon[217405]: osdmap e87: 6 total, 5 up, 6 in 2023-12-05T13:32:56.664 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:56 smithi052 ceph-mon[184394]: osdmap e87: 6 total, 5 up, 6 in 2023-12-05T13:32:56.665 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:56 smithi052 systemd[1]: ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.5.service: Succeeded. 2023-12-05T13:32:56.665 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:56 smithi052 systemd[1]: Stopped Ceph osd.5 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:32:56.665 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:56 smithi052 systemd[1]: Starting Ceph osd.5 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:32:57.570 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:57 smithi052 ceph-mon[184394]: pgmap v149: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 11 peering, 5 stale+active+clean, 43 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/219 objects degraded (2.283%) 2023-12-05T13:32:57.570 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:57 smithi052 ceph-mon[184394]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2023-12-05T13:32:57.570 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:57 smithi052 ceph-mon[184394]: Health check failed: Degraded data redundancy: 5/219 objects degraded (2.283%), 3 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-05T13:32:57.571 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:57 smithi052 bash[209641]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-05T13:32:57.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:57 smithi029 ceph-mon[217405]: pgmap v149: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 11 peering, 5 stale+active+clean, 43 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/219 objects degraded (2.283%) 2023-12-05T13:32:57.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:57 smithi029 ceph-mon[217405]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2023-12-05T13:32:57.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:57 smithi029 ceph-mon[217405]: Health check failed: Degraded data redundancy: 5/219 objects degraded (2.283%), 3 pgs degraded (PG_DEGRADED) 2023-12-05T13:32:58.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:58 smithi052 ceph-osd[209960]: -- 172.21.15.52:0/3258319359 <== mon.1 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5609bc5011e0 con 0x5609bc4d1000 2023-12-05T13:32:58.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:58 smithi052 bash[209923]: 2e67e2f4153d090ab3b8b492159f84f1912ecf89313a1016db70e75e03d13afa 2023-12-05T13:32:58.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:58 smithi052 systemd[1]: Started Ceph osd.5 for 34f4f484-9370-11ee-95a2-87774f69a715. 2023-12-05T13:32:58.874 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:32:58 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:32:58.584+0000 7f7e5d10f640 -1 Falling back to public interface 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.905+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/4013277391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 msgr2=0x7f2ec40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.905+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/4013277391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec40fcc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4004940 tx=0x7f2eb4009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/4013277391 shutdown_connections 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/4013277391 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec40fcc10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/4013277391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec4102c00 0x7f2ec4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/4013277391 >> 172.21.15.29:0/4013277391 conn(0x7f2ec40f8790 msgr2=0x7f2ec40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/4013277391 shutdown_connections 2023-12-05T13:32:58.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/4013277391 wait complete. 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 Processor -- start 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- start start 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec4102c00 0x7f2ec41158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec4115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4116440 con 0x7f2ec41035a0 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.906+0000 7f2ecc4d7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec410f770 con 0x7f2ec4102c00 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec4115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec4115df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52040/0 (socket says 172.21.15.29:52040) 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 -- 172.21.15.29:0/2184707016 learned_addr learned my addr 172.21.15.29:0/2184707016 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2eca273700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec4102c00 0x7f2ec41158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 -- 172.21.15.29:0/2184707016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec4102c00 msgr2=0x7f2ec41158b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec4102c00 0x7f2ec41158b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 -- 172.21.15.29:0/2184707016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb4005040 con 0x7f2ec41035a0 2023-12-05T13:32:58.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ec9a72700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec4115df0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009360 tx=0x7f2eb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb400e040 con 0x7f2ec41035a0 2023-12-05T13:32:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2eb400bc50 con 0x7f2ec41035a0 2023-12-05T13:32:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb401c630 con 0x7f2ec41035a0 2023-12-05T13:32:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec410f9f0 con 0x7f2ec41035a0 2023-12-05T13:32:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.907+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec410ff30 con 0x7f2ec41035a0 2023-12-05T13:32:58.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.908+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec40fc390 con 0x7f2ec41035a0 2023-12-05T13:32:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.909+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2eb4013420 con 0x7f2ec41035a0 2023-12-05T13:32:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.909+0000 7f2ebaffd700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2eb006ce70 0x7f2eb006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.910+0000 7f2eca273700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2eb006ce70 0x7f2eb006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.910+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f2eb408d710 con 0x7f2ec41035a0 2023-12-05T13:32:58.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.910+0000 7f2eca273700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2eb006ce70 0x7f2eb006f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009fd0 tx=0x7f2ec0009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:58.915 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:58.915+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2eb405b150 con 0x7f2ec41035a0 2023-12-05T13:32:59.144 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.143+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec404bb80 con 0x7f2eb006ce70 2023-12-05T13:32:59.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.145+0000 7f2ebaffd700 1 -- 172.21.15.29:0/2184707016 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2ec404bb80 con 0x7f2eb006ce70 2023-12-05T13:32:59.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2eb006ce70 msgr2=0x7f2eb006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2eb006ce70 0x7f2eb006f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009fd0 tx=0x7f2ec0009f20 comp rx=0 tx=0).stop 2023-12-05T13:32:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 msgr2=0x7f2ec4115df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec4115df0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009360 tx=0x7f2eb4009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 shutdown_connections 2023-12-05T13:32:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2eb006ce70 0x7f2eb006f320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec4102c00 0x7f2ec41158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.149 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 --2- 172.21.15.29:0/2184707016 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ec41035a0 0x7f2ec4115df0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 >> 172.21.15.29:0/2184707016 conn(0x7f2ec40f8790 msgr2=0x7f2ec4070320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:59.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.147+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 shutdown_connections 2023-12-05T13:32:59.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.148+0000 7f2ecc4d7700 1 -- 172.21.15.29:0/2184707016 wait complete. 2023-12-05T13:32:59.160 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.261+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/2380873655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 msgr2=0x7f4a64102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.261+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/2380873655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a64102fc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004940 tx=0x7f4a54009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.261+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/2380873655 shutdown_connections 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.261+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/2380873655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a64103590 0x7f4a640fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.261+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/2380873655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a64102fc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.261+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/2380873655 >> 172.21.15.29:0/2380873655 conn(0x7f4a640f87a0 msgr2=0x7f4a640fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/2380873655 shutdown_connections 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/2380873655 wait complete. 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 Processor -- start 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 -- start start 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a641136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a64103590 0x7f4a64113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64114290 con 0x7f4a64102bf0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.262+0000 7f4a6c2bd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6410d580 con 0x7f4a64103590 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a641136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a641136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52062/0 (socket says 172.21.15.29:52062) 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 -- 172.21.15.29:0/1317410078 learned_addr learned my addr 172.21.15.29:0/1317410078 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a69858700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a64103590 0x7f4a64113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 -- 172.21.15.29:0/1317410078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a64103590 msgr2=0x7f4a64113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a64103590 0x7f4a64113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 -- 172.21.15.29:0/1317410078 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54005040 con 0x7f4a64102bf0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6a059700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a641136c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a54021070 con 0x7f4a64102bf0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a5401c400 con 0x7f4a64102bf0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5400e070 con 0x7f4a64102bf0 2023-12-05T13:32:59.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6410d7b0 con 0x7f4a64102bf0 2023-12-05T13:32:59.272 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.263+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6410dc40 con 0x7f4a64102bf0 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.264+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a640fc3a0 con 0x7f4a64102bf0 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.265+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4a5401c970 con 0x7f4a64102bf0 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.265+0000 7f4a5affd700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f4a5006ce60 0x7f4a5006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.266+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f4a5408d430 con 0x7f4a64102bf0 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.266+0000 7f4a69858700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f4a5006ce60 0x7f4a5006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.266+0000 7f4a69858700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f4a5006ce60 0x7f4a5006f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a6410ef60 tx=0x7f4a6000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:59.273 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.270+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4a5405add0 con 0x7f4a64102bf0 2023-12-05T13:32:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:59 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:59.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:32:59 smithi052 ceph-mon[184394]: pgmap v150: 65 pgs: 12 active+undersized, 8 active+undersized+degraded, 11 peering, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2023-12-05T13:32:59.497 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.497+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a6410ed10 con 0x7f4a5006ce60 2023-12-05T13:32:59.498 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.498+0000 7f4a5affd700 1 -- 172.21.15.29:0/1317410078 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4a6410ed10 con 0x7f4a5006ce60 2023-12-05T13:32:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.500+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f4a5006ce60 msgr2=0x7f4a5006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.500+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f4a5006ce60 0x7f4a5006f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a6410ef60 tx=0x7f4a6000b040 comp rx=0 tx=0).stop 2023-12-05T13:32:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.500+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 msgr2=0x7f4a641136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.500+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a641136c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a54009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 shutdown_connections 2023-12-05T13:32:59.501 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f4a5006ce60 0x7f4a5006f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a64102bf0 0x7f4a641136c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 --2- 172.21.15.29:0/1317410078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a64103590 0x7f4a64113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 >> 172.21.15.29:0/1317410078 conn(0x7f4a640f87a0 msgr2=0x7f4a640fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:59.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 shutdown_connections 2023-12-05T13:32:59.502 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.501+0000 7f4a6c2bd700 1 -- 172.21.15.29:0/1317410078 wait complete. 2023-12-05T13:32:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:32:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:59 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:32:59.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:32:59 smithi029 ceph-mon[217405]: pgmap v150: 65 pgs: 12 active+undersized, 8 active+undersized+degraded, 11 peering, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2023-12-05T13:32:59.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 -- 172.21.15.29:0/434470594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264065390 msgr2=0x7fc264065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 --2- 172.21.15.29:0/434470594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264065390 0x7fc264065800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc24c004940 tx=0x7fc24c009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 -- 172.21.15.29:0/434470594 shutdown_connections 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 --2- 172.21.15.29:0/434470594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264065390 0x7fc264065800 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 --2- 172.21.15.29:0/434470594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264102c20 0x7fc264102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 -- 172.21.15.29:0/434470594 >> 172.21.15.29:0/434470594 conn(0x7fc2640719b0 msgr2=0x7fc264071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 -- 172.21.15.29:0/434470594 shutdown_connections 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 -- 172.21.15.29:0/434470594 wait complete. 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 Processor -- start 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.614+0000 7fc26a267700 1 -- start start 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc26a267700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264065390 0x7fc264113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc26a267700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 0x7fc264113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc26a267700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264114200 con 0x7fc264102c20 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc26a267700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26410d4f0 con 0x7fc264065390 2023-12-05T13:32:59.618 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 0x7fc264113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 0x7fc264113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52092/0 (socket says 172.21.15.29:52092) 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 -- 172.21.15.29:0/3548559593 learned_addr learned my addr 172.21.15.29:0/3548559593 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc263fff700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264065390 0x7fc264113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 -- 172.21.15.29:0/3548559593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264065390 msgr2=0x7fc264113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264065390 0x7fc264113630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 -- 172.21.15.29:0/3548559593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c005040 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc263fff700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264065390 0x7fc264113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc25bfff700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 0x7fc264113bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc24c000c00 tx=0x7fc24c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc24c021070 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26410d720 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc24c01c400 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.615+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc24c00e070 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.616+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26410dc00 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.616+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2640fff40 con 0x7fc264102c20 2023-12-05T13:32:59.619 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.617+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc24c01c9e0 con 0x7fc264102c20 2023-12-05T13:32:59.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.617+0000 7fc2617fa700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc25006ce60 0x7fc25006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.618+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fc24c08d510 con 0x7fc264102c20 2023-12-05T13:32:59.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.618+0000 7fc263fff700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc25006ce60 0x7fc25006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.620 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.618+0000 7fc263fff700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc25006ce60 0x7fc25006f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc2640fa1c0 tx=0x7fc25400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:59.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.623+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc24c05aeb0 con 0x7fc264102c20 2023-12-05T13:32:59.841 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.840+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc26404bb80 con 0x7fc25006ce60 2023-12-05T13:32:59.851 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.851+0000 7fc2617fa700 1 -- 172.21.15.29:0/3548559593 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fc26404bb80 con 0x7fc25006ce60 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (4m) 86s ago 14m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (2m) 86s ago 14m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (2m) 29s ago 13m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (4m) 86s ago 13m 84.3M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (10m) 86s ago 10m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (10m) 86s ago 10m 19.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (10m) 29s ago 10m 19.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (10m) 29s ago 10m 19.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (5m) 86s ago 15m 513M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (5m) 29s ago 13m 450M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (3m) 86s ago 15m 68.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:32:59.852 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (3m) 29s ago 13m 54.4M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (5m) 86s ago 14m 16.4M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 29s ago 13m 17.5M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (2m) 86s ago 12m 180M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (2m) 86s ago 12m 124M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 54b9f199069e 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (90s) 86s ago 12m 12.6M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5f43e7285634 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (60s) 29s ago 11m 130M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 11774d217613 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (31s) 29s ago 11m 12.6M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 57b9d01f0f36 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 starting - - - 2594M 2023-12-05T13:32:59.853 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (4m) 86s ago 13m 59.4M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:32:59.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc25006ce60 msgr2=0x7fc25006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc25006ce60 0x7fc25006f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc2640fa1c0 tx=0x7fc25400b040 comp rx=0 tx=0).stop 2023-12-05T13:32:59.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 msgr2=0x7fc264113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.854 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 0x7fc264113bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc24c000c00 tx=0x7fc24c009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 shutdown_connections 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fc25006ce60 0x7fc25006f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc264065390 0x7fc264113630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 --2- 172.21.15.29:0/3548559593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc264102c20 0x7fc264113bb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 >> 172.21.15.29:0/3548559593 conn(0x7fc2640719b0 msgr2=0x7fc2640fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 shutdown_connections 2023-12-05T13:32:59.855 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.853+0000 7fc26a267700 1 -- 172.21.15.29:0/3548559593 wait complete. 2023-12-05T13:32:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 -- 172.21.15.29:0/514807746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 msgr2=0x7f6f0c0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 --2- 172.21.15.29:0/514807746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c0fcc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8004940 tx=0x7f6ef8009e30 comp rx=0 tx=0).stop 2023-12-05T13:32:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 -- 172.21.15.29:0/514807746 shutdown_connections 2023-12-05T13:32:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 --2- 172.21.15.29:0/514807746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c0fcc00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 --2- 172.21.15.29:0/514807746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 0x7f6f0c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.965 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 -- 172.21.15.29:0/514807746 >> 172.21.15.29:0/514807746 conn(0x7f6f0c0f87a0 msgr2=0x7f6f0c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:32:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 -- 172.21.15.29:0/514807746 shutdown_connections 2023-12-05T13:32:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.964+0000 7f6f12f28700 1 -- 172.21.15.29:0/514807746 wait complete. 2023-12-05T13:32:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f12f28700 1 Processor -- start 2023-12-05T13:32:59.966 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f12f28700 1 -- start start 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f12f28700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 0x7f6f0c1135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f12f28700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f12f28700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c114150 con 0x7f6f0c103590 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f12f28700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c10d480 con 0x7f6f0c102bf0 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f0bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f0bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c113b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52098/0 (socket says 172.21.15.29:52098) 2023-12-05T13:32:59.967 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f0bfff700 1 -- 172.21.15.29:0/587590581 learned_addr learned my addr 172.21.15.29:0/587590581 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.965+0000 7f6f10cc4700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 0x7f6f0c1135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f0bfff700 1 -- 172.21.15.29:0/587590581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 msgr2=0x7f6f0c1135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f0bfff700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 0x7f6f0c1135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f0bfff700 1 -- 172.21.15.29:0/587590581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8005040 con 0x7f6f0c103590 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f10cc4700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 0x7f6f0c1135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f0bfff700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c113b00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8000c00 tx=0x7f6ef8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef8021070 con 0x7f6f0c103590 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c10d700 con 0x7f6f0c103590 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ef801c400 con 0x7f6f0c103590 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef800e070 con 0x7f6f0c103590 2023-12-05T13:32:59.968 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.966+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c10dbe0 con 0x7f6f0c103590 2023-12-05T13:32:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.967+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c1050c0 con 0x7f6f0c103590 2023-12-05T13:32:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.968+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6ef801c570 con 0x7f6f0c103590 2023-12-05T13:32:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.968+0000 7f6f097fa700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6efc06ce60 0x7f6efc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:32:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.968+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f6ef808d3b0 con 0x7f6f0c103590 2023-12-05T13:32:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.968+0000 7f6f10cc4700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6efc06ce60 0x7f6efc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:32:59.969 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.969+0000 7f6f10cc4700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6efc06ce60 0x7f6efc06f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f00004fd0 tx=0x7f6f0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:32:59.974 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:32:59.973+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6ef805ad50 con 0x7f6f0c103590 2023-12-05T13:33:00.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.267+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f0c04bb80 con 0x7f6f0c103590 2023-12-05T13:33:00.268 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.268+0000 7f6f097fa700 1 -- 172.21.15.29:0/587590581 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+720 (secure 0 0 0) 0x7f6ef805a8e0 con 0x7f6f0c103590 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 5 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:00.269 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:33:00.270 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T13:33:00.270 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 9 2023-12-05T13:33:00.270 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:33:00.270 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:33:00.270 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6efc06ce60 msgr2=0x7f6efc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6efc06ce60 0x7f6efc06f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f00004fd0 tx=0x7f6f0000b040 comp rx=0 tx=0).stop 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 msgr2=0x7f6f0c113b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c113b00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8000c00 tx=0x7f6ef8009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 shutdown_connections 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f6efc06ce60 0x7f6efc06f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c102bf0 0x7f6f0c1135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 --2- 172.21.15.29:0/587590581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f0c103590 0x7f6f0c113b00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 >> 172.21.15.29:0/587590581 conn(0x7f6f0c0f87a0 msgr2=0x7f6f0c0fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 shutdown_connections 2023-12-05T13:33:00.271 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.270+0000 7f6f12f28700 1 -- 172.21.15.29:0/587590581 wait complete. 2023-12-05T13:33:00.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 -- 172.21.15.29:0/43514472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e4101b00 msgr2=0x7f23e4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 --2- 172.21.15.29:0/43514472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e4101b00 0x7f23e4101ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23e0004940 tx=0x7f23e0009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:00.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 -- 172.21.15.29:0/43514472 shutdown_connections 2023-12-05T13:33:00.384 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 --2- 172.21.15.29:0/43514472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e40fbb40 0x7f23e40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 --2- 172.21.15.29:0/43514472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e4101b00 0x7f23e4101ed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 -- 172.21.15.29:0/43514472 >> 172.21.15.29:0/43514472 conn(0x7f23e40f76c0 msgr2=0x7f23e40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 -- 172.21.15.29:0/43514472 shutdown_connections 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.383+0000 7f23ebaca700 1 -- 172.21.15.29:0/43514472 wait complete. 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23ebaca700 1 Processor -- start 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23ebaca700 1 -- start start 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23ebaca700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 0x7f23e410e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23ebaca700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4101b00 0x7f23e410ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23ebaca700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e410f150 con 0x7f23e40fbb40 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23ebaca700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e410f2c0 con 0x7f23e4101b00 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9866700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 0x7f23e410e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9866700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 0x7f23e410e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52112/0 (socket says 172.21.15.29:52112) 2023-12-05T13:33:00.385 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9065700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4101b00 0x7f23e410ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:00.386 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9866700 1 -- 172.21.15.29:0/2318538302 learned_addr learned my addr 172.21.15.29:0/2318538302 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:00.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9065700 1 -- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 msgr2=0x7f23e410e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9065700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 0x7f23e410e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9065700 1 -- 172.21.15.29:0/2318538302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0005040 con 0x7f23e4101b00 2023-12-05T13:33:00.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.384+0000 7f23e9866700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 0x7f23e410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T13:33:00.387 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.385+0000 7f23e9065700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4101b00 0x7f23e410ebc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009fd0 tx=0x7f23d400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.385+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d4004e90 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.385+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e41175f0 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.385+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23d400f040 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.385+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d400c9b0 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.385+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e4117ab0 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.386+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e4103fb0 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.386+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f23d4007cc0 con 0x7f23e4101b00 2023-12-05T13:33:00.388 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.387+0000 7f23da7fc700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f23d006ce60 0x7f23d006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:00.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.387+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f23d408bd50 con 0x7f23e4101b00 2023-12-05T13:33:00.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.387+0000 7f23e9866700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f23d006ce60 0x7f23d006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:00.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.387+0000 7f23e9866700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f23d006ce60 0x7f23d006f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23e0004890 tx=0x7f23e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:00.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.392+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f23d4055c90 con 0x7f23e4101b00 2023-12-05T13:33:00.472 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:00 smithi052 ceph-mon[184394]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:00.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:00 smithi029 ceph-mon[217405]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:00.660 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.660+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23e4066420 con 0x7f23e4101b00 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.660+0000 7f23da7fc700 1 -- 172.21.15.29:0/2318538302 <== mon.1 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f23d40592b0 con 0x7f23e4101b00 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:e13 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 11 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T13:33:00.661 INFO:teuthology.orchestra.run.smithi029.stdout:created 2023-12-05T13:22:48.696752+0000 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2023-12-05T13:23:01.451752+0000 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 60 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2023-12-05T13:33:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=14478} 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 1 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.jdhffk{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.29:6826/858522061,v1:172.21.15.29:6827/858522061] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:33:00.663 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi029.pbbvzt{-1:14494} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.29:6828/3542977531,v1:172.21.15.29:6829/3542977531] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:33:00.664 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.nbpymg{-1:24299} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.52:6824/3151047542,v1:172.21.15.52:6825/3151047542] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:33:00.664 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.cephfs.smithi052.dsxvue{-1:24309} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.52:6826/352543055,v1:172.21.15.52:6827/352543055] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T13:33:00.664 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.662+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f23d006ce60 msgr2=0x7f23d006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.662+0000 7f23ebaca700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f23d006ce60 0x7f23d006f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23e0004890 tx=0x7f23e0009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.662+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4101b00 msgr2=0x7f23e410ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.662+0000 7f23ebaca700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4101b00 0x7f23e410ebc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009fd0 tx=0x7f23d400b040 comp rx=0 tx=0).stop 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 shutdown_connections 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f23d006ce60 0x7f23d006f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23e40fbb40 0x7f23e410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 --2- 172.21.15.29:0/2318538302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23e4101b00 0x7f23e410ebc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 >> 172.21.15.29:0/2318538302 conn(0x7f23e40f76c0 msgr2=0x7f23e40f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 shutdown_connections 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.663+0000 7f23ebaca700 1 -- 172.21.15.29:0/2318538302 wait complete. 2023-12-05T13:33:00.665 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2023-12-05T13:33:00.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 -- 172.21.15.29:0/4246162518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c84101b00 msgr2=0x7f1c84101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 --2- 172.21.15.29:0/4246162518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c84101b00 0x7f1c84101ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c78004940 tx=0x7f1c78009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:00.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 -- 172.21.15.29:0/4246162518 shutdown_connections 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 --2- 172.21.15.29:0/4246162518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c840fbb40 0x7f1c840fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 --2- 172.21.15.29:0/4246162518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c84101b00 0x7f1c84101ed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 -- 172.21.15.29:0/4246162518 >> 172.21.15.29:0/4246162518 conn(0x7f1c840719b0 msgr2=0x7f1c84071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 -- 172.21.15.29:0/4246162518 shutdown_connections 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.776+0000 7f1c8aace700 1 -- 172.21.15.29:0/4246162518 wait complete. 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8aace700 1 Processor -- start 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8aace700 1 -- start start 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8aace700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 0x7f1c840fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8aace700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c84101b00 0x7f1c840fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8aace700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840fe260 con 0x7f1c840fbb40 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8aace700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840fe3d0 con 0x7f1c84101b00 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8886a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 0x7f1c840fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8886a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 0x7f1c840fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52134/0 (socket says 172.21.15.29:52134) 2023-12-05T13:33:00.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c8886a700 1 -- 172.21.15.29:0/1704424408 learned_addr learned my addr 172.21.15.29:0/1704424408 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.777+0000 7f1c83fff700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c84101b00 0x7f1c840fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c8886a700 1 -- 172.21.15.29:0/1704424408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c84101b00 msgr2=0x7f1c840fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c8886a700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c84101b00 0x7f1c840fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c8886a700 1 -- 172.21.15.29:0/1704424408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78005040 con 0x7f1c840fbb40 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c8886a700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 0x7f1c840fd720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c78000c00 tx=0x7f1c78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c78021070 con 0x7f1c840fbb40 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c7801c400 con 0x7f1c840fbb40 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c841198e0 con 0x7f1c840fbb40 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c7800e070 con 0x7f1c840fbb40 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.778+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c84119ce0 con 0x7f1c840fbb40 2023-12-05T13:33:00.781 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.779+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c840734d0 con 0x7f1c840fbb40 2023-12-05T13:33:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.780+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1c7801c970 con 0x7f1c840fbb40 2023-12-05T13:33:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.780+0000 7f1c817fa700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1c7406ce60 0x7f1c7406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.781+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f1c7808dae0 con 0x7f1c840fbb40 2023-12-05T13:33:00.782 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.781+0000 7f1c83fff700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1c7406ce60 0x7f1c7406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:00.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.781+0000 7f1c83fff700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1c7406ce60 0x7f1c7406f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c840ff120 tx=0x7f1c7000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:00.785 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:00.785+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1c78057b50 con 0x7f1c840fbb40 2023-12-05T13:33:01.014 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.014+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c84065b60 con 0x7f1c7406ce60 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.015+0000 7f1c817fa700 1 -- 172.21.15.29:0/1704424408 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1c84065b60 con 0x7f1c7406ce60 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:33:01.016 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "osd", 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "12/21 daemons upgraded", 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": false 2023-12-05T13:33:01.017 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:33:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1c7406ce60 msgr2=0x7f1c7406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1c7406ce60 0x7f1c7406f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c840ff120 tx=0x7f1c7000b040 comp rx=0 tx=0).stop 2023-12-05T13:33:01.021 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 msgr2=0x7f1c840fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 0x7f1c840fd720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1c78000c00 tx=0x7f1c78009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 shutdown_connections 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1c7406ce60 0x7f1c7406f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c840fbb40 0x7f1c840fd720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 --2- 172.21.15.29:0/1704424408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c84101b00 0x7f1c840fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.017+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 >> 172.21.15.29:0/1704424408 conn(0x7f1c840719b0 msgr2=0x7f1c84065450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.018+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 shutdown_connections 2023-12-05T13:33:01.022 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.018+0000 7f1c8aace700 1 -- 172.21.15.29:0/1704424408 wait complete. 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.129+0000 7fd88d2ff700 1 -- 172.21.15.29:0/2815172130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8880fb1e0 msgr2=0x7fd8880fb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.129+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/2815172130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8880fb1e0 0x7fd8880fb630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd870004940 tx=0x7fd870009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 -- 172.21.15.29:0/2815172130 shutdown_connections 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/2815172130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8880fb1e0 0x7fd8880fb630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/2815172130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd888102c70 0x7fd888103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 -- 172.21.15.29:0/2815172130 >> 172.21.15.29:0/2815172130 conn(0x7fd8880711a0 msgr2=0x7fd8880715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 -- 172.21.15.29:0/2815172130 shutdown_connections 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 -- 172.21.15.29:0/2815172130 wait complete. 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 Processor -- start 2023-12-05T13:33:01.131 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.130+0000 7fd88d2ff700 1 -- start start 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd88d2ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8880fb1e0 0x7fd888113560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd88d2ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 0x7fd888113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd88d2ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8881140f0 con 0x7fd888102c70 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd88d2ff700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810d420 con 0x7fd8880fb1e0 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 0x7fd888113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 0x7fd888113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52152/0 (socket says 172.21.15.29:52152) 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 -- 172.21.15.29:0/72779747 learned_addr learned my addr 172.21.15.29:0/72779747 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd886ffd700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8880fb1e0 0x7fd888113560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 -- 172.21.15.29:0/72779747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8880fb1e0 msgr2=0x7fd888113560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8880fb1e0 0x7fd888113560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 -- 172.21.15.29:0/72779747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870005040 con 0x7fd888102c70 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87e7fc700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 0x7fd888113aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd870000c00 tx=0x7fd870009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:01.133 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.131+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd870021070 con 0x7fd888102c70 2023-12-05T13:33:01.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.132+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd87001c400 con 0x7fd888102c70 2023-12-05T13:33:01.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.132+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88810d6a0 con 0x7fd888102c70 2023-12-05T13:33:01.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.132+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87000e070 con 0x7fd888102c70 2023-12-05T13:33:01.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.132+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88810db80 con 0x7fd888102c70 2023-12-05T13:33:01.134 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.133+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888105050 con 0x7fd888102c70 2023-12-05T13:33:01.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.133+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fd87001c970 con 0x7fd888102c70 2023-12-05T13:33:01.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.134+0000 7fd87ffff700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd87406ce60 0x7fd87406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:01.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.134+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fd87008d360 con 0x7fd888102c70 2023-12-05T13:33:01.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.134+0000 7fd886ffd700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd87406ce60 0x7fd87406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:01.135 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.134+0000 7fd886ffd700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd87406ce60 0x7fd87406f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd878009b80 tx=0x7fd87800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:01.139 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.138+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd87005ada0 con 0x7fd888102c70 2023-12-05T13:33:01.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.434+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd888072cc0 con 0x7fd888102c70 2023-12-05T13:33:01.438 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.435+0000 7fd87ffff700 1 -- 172.21.15.29:0/72779747 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+997 (secure 0 0 0) 0x7fd87005fe60 con 0x7fd888102c70 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout:[WRN] OSD_DOWN: 1 osds down 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: osd.5 (root=default,host=smithi052) is down 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2023-12-05T13:33:01.439 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd87406ce60 msgr2=0x7fd87406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:01.440 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd87406ce60 0x7fd87406f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd878009b80 tx=0x7fd87800b040 comp rx=0 tx=0).stop 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 msgr2=0x7fd888113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 0x7fd888113aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd870000c00 tx=0x7fd870009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 shutdown_connections 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fd87406ce60 0x7fd87406f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8880fb1e0 0x7fd888113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 --2- 172.21.15.29:0/72779747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd888102c70 0x7fd888113aa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 >> 172.21.15.29:0/72779747 conn(0x7fd8880711a0 msgr2=0x7fd8880fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 shutdown_connections 2023-12-05T13:33:01.441 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:01.437+0000 7fd88d2ff700 1 -- 172.21.15.29:0/72779747 wait complete. 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: pgmap v151: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/587590581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:01.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:01 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2318538302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:33:01.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:01.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: pgmap v151: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/587590581' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:01.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:01 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2318538302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T13:33:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:02 smithi052 ceph-mon[184394]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:02 smithi052 ceph-mon[184394]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2023-12-05T13:33:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:02 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:02.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:02 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/72779747' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:33:02.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:02 smithi029 ceph-mon[217405]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:02.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:02 smithi029 ceph-mon[217405]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2023-12-05T13:33:02.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:02.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:02 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:02.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:02 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/72779747' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:33:03.477 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:03 smithi052 ceph-mon[184394]: pgmap v152: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:03.477 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:33:03 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:33:03.127+0000 7f7e5d10f640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-05T13:33:03.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:03 smithi029 ceph-mon[217405]: pgmap v152: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:03.973 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:33:03 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:33:03.780+0000 7f7e5d10f640 -1 osd.5 85 log_to_monitors true 2023-12-05T13:33:04.420 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:04 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T13:33:04.420 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:04 smithi029 ceph-mon[217405]: from='osd.5 [v2:172.21.15.52:6816/3875549080,v1:172.21.15.52:6817/3875549080]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:33:04.421 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:04 smithi029 ceph-mon[217405]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:33:04.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:04 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T13:33:04.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:04 smithi052 ceph-mon[184394]: from='osd.5 [v2:172.21.15.52:6816/3875549080,v1:172.21.15.52:6817/3875549080]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:33:04.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:04 smithi052 ceph-mon[184394]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T13:33:05.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:33:04 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:33:04.797+0000 7f7e4dd7f700 -1 osd.5 85 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T13:33:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[217382]: 2023-12-05T13:33:05.153+0000 7f116df08700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T13:33:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: pgmap v153: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:05.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: Upgrade: Setting container_image for all osd 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-05T13:33:05.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-05T13:33:05.607 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: pgmap v154: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.608 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T13:33:05.618 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: osdmap e88: 6 total, 5 up, 6 in 2023-12-05T13:33:05.619 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='osd.5 [v2:172.21.15.52:6816/3875549080,v1:172.21.15.52:6817/3875549080]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:33:05.619 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:33:05.619 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:05 smithi029 ceph-mon[217405]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T13:33:05.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: pgmap v153: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:33:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:33:05.724 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:33:05.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:05.725 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: Upgrade: Setting container_image for all osd 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-05T13:33:05.726 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: pgmap v154: 65 pgs: 18 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:33:05.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:05.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T13:33:05.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: osdmap e88: 6 total, 5 up, 6 in 2023-12-05T13:33:05.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='osd.5 [v2:172.21.15.52:6816/3875549080,v1:172.21.15.52:6817/3875549080]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:33:05.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2023-12-05T13:33:05.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:05 smithi052 ceph-mon[184394]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T13:33:06.605 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:06 smithi029 ceph-mon[217405]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:33:06.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:06 smithi029 ceph-mon[217405]: osd.5 [v2:172.21.15.52:6816/3875549080,v1:172.21.15.52:6817/3875549080] boot 2023-12-05T13:33:06.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:06 smithi029 ceph-mon[217405]: osdmap e89: 6 total, 6 up, 6 in 2023-12-05T13:33:06.606 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:06 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:33:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:06 smithi052 ceph-mon[184394]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T13:33:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:06 smithi052 ceph-mon[184394]: osd.5 [v2:172.21.15.52:6816/3875549080,v1:172.21.15.52:6817/3875549080] boot 2023-12-05T13:33:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:06 smithi052 ceph-mon[184394]: osdmap e89: 6 total, 6 up, 6 in 2023-12-05T13:33:06.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:06 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T13:33:07.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:07 smithi029 ceph-mon[217405]: pgmap v157: 65 pgs: 2 peering, 16 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:07.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:07 smithi029 ceph-mon[217405]: osdmap e90: 6 total, 6 up, 6 in 2023-12-05T13:33:07.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:07.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:07 smithi052 ceph-mon[184394]: pgmap v157: 65 pgs: 2 peering, 16 active+undersized, 13 active+undersized+degraded, 34 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2023-12-05T13:33:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:07 smithi052 ceph-mon[184394]: osdmap e90: 6 total, 6 up, 6 in 2023-12-05T13:33:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:07.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:08.611 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:08 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:08.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:08 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:09.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:09 smithi029 ceph-mon[217405]: pgmap v159: 65 pgs: 9 peering, 13 active+undersized, 9 active+undersized+degraded, 34 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-05T13:33:09.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:09 smithi052 ceph-mon[184394]: pgmap v159: 65 pgs: 9 peering, 13 active+undersized, 9 active+undersized+degraded, 34 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2023-12-05T13:33:10.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:10 smithi029 ceph-mon[217405]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 9 pgs degraded (PG_DEGRADED) 2023-12-05T13:33:10.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:10 smithi052 ceph-mon[184394]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 9 pgs degraded (PG_DEGRADED) 2023-12-05T13:33:11.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:11 smithi029 ceph-mon[217405]: pgmap v160: 65 pgs: 9 peering, 1 active+undersized, 2 active+undersized+degraded, 53 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 4/219 objects degraded (1.826%) 2023-12-05T13:33:11.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:11 smithi052 ceph-mon[184394]: pgmap v160: 65 pgs: 9 peering, 1 active+undersized, 2 active+undersized+degraded, 53 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 4/219 objects degraded (1.826%) 2023-12-05T13:33:12.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:12 smithi029 ceph-mon[217405]: pgmap v161: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:12.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:12 smithi029 ceph-mon[217405]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/219 objects degraded (1.826%), 2 pgs degraded) 2023-12-05T13:33:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:12 smithi052 ceph-mon[184394]: pgmap v161: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:12 smithi052 ceph-mon[184394]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/219 objects degraded (1.826%), 2 pgs degraded) 2023-12-05T13:33:15.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:14 smithi029 ceph-mon[217405]: pgmap v162: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:14 smithi052 ceph-mon[184394]: pgmap v162: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:16.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:16 smithi029 ceph-mon[217405]: pgmap v163: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:16.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:16 smithi052 ceph-mon[184394]: pgmap v163: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:18.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:18 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:18.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:18 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:19.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:19 smithi029 ceph-mon[217405]: pgmap v164: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:19.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:19 smithi052 ceph-mon[184394]: pgmap v164: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:20.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:20 smithi029 ceph-mon[217405]: pgmap v165: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:20.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:20 smithi052 ceph-mon[184394]: pgmap v165: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:23 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:23 smithi029 ceph-mon[217405]: pgmap v166: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:33:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:23 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:23 smithi052 ceph-mon[184394]: pgmap v166: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:25.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:24 smithi029 ceph-mon[217405]: pgmap v167: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:25.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:24 smithi052 ceph-mon[184394]: pgmap v167: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:26.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:26 smithi029 ceph-mon[217405]: pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:26 smithi052 ceph-mon[184394]: pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:28.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:28 smithi029 ceph-mon[217405]: pgmap v169: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:28.972 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:28 smithi052 ceph-mon[184394]: pgmap v169: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:30.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:30 smithi029 ceph-mon[217405]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:30.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:30 smithi052 ceph-mon[184394]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.559+0000 7f213dfe9700 1 -- 172.21.15.29:0/3497659881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21380fbb40 msgr2=0x7f21380fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.559+0000 7f213dfe9700 1 --2- 172.21.15.29:0/3497659881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21380fbb40 0x7f21380fbfb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f212c004940 tx=0x7f212c009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:31.560 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.559+0000 7f213dfe9700 1 -- 172.21.15.29:0/3497659881 shutdown_connections 2023-12-05T13:33:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.559+0000 7f213dfe9700 1 --2- 172.21.15.29:0/3497659881 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21380fbb40 0x7f21380fbfb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.559+0000 7f213dfe9700 1 --2- 172.21.15.29:0/3497659881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101b00 0x7f2138101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.559+0000 7f213dfe9700 1 -- 172.21.15.29:0/3497659881 >> 172.21.15.29:0/3497659881 conn(0x7f21380719b0 msgr2=0x7f2138071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.560+0000 7f213dfe9700 1 -- 172.21.15.29:0/3497659881 shutdown_connections 2023-12-05T13:33:31.561 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.560+0000 7f213dfe9700 1 -- 172.21.15.29:0/3497659881 wait complete. 2023-12-05T13:33:31.562 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.560+0000 7f213dfe9700 1 Processor -- start 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f213dfe9700 1 -- start start 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f213dfe9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380fbb40 0x7f213810e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f213dfe9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 0x7f213810ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f213dfe9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213810f310 con 0x7f2138101b00 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f213dfe9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213810f480 con 0x7f21380fbb40 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f2136ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 0x7f213810ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f2136ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 0x7f213810ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41520/0 (socket says 172.21.15.29:41520) 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f2136ffd700 1 -- 172.21.15.29:0/2243756663 learned_addr learned my addr 172.21.15.29:0/2243756663 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f21377fe700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380fbb40 0x7f213810e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f2136ffd700 1 -- 172.21.15.29:0/2243756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380fbb40 msgr2=0x7f213810e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f2136ffd700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380fbb40 0x7f213810e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.561+0000 7f2136ffd700 1 -- 172.21.15.29:0/2243756663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c005040 con 0x7f2138101b00 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.562+0000 7f2136ffd700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 0x7f213810ecc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f212c009360 tx=0x7f212c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:31.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.562+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212c00e040 con 0x7f2138101b00 2023-12-05T13:33:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.562+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f212c013420 con 0x7f2138101b00 2023-12-05T13:33:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.562+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21381176f0 con 0x7f2138101b00 2023-12-05T13:33:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.562+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212c01c610 con 0x7f2138101b00 2023-12-05T13:33:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.562+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2138117c30 con 0x7f2138101b00 2023-12-05T13:33:31.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.563+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2138103fb0 con 0x7f2138101b00 2023-12-05T13:33:31.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.564+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f212c013590 con 0x7f2138101b00 2023-12-05T13:33:31.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.564+0000 7f211ffff700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f212006ce70 0x7f212006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:31.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.564+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f212c08d590 con 0x7f2138101b00 2023-12-05T13:33:31.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.564+0000 7f21377fe700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f212006ce70 0x7f212006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:31.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.565+0000 7f21377fe700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f212006ce70 0x7f212006f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2128004f40 tx=0x7f212800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:31.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.569+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f212c0574d0 con 0x7f2138101b00 2023-12-05T13:33:31.800 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.799+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f213804bb80 con 0x7f212006ce70 2023-12-05T13:33:31.801 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.801+0000 7f211ffff700 1 -- 172.21.15.29:0/2243756663 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f213804bb80 con 0x7f212006ce70 2023-12-05T13:33:31.803 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f212006ce70 msgr2=0x7f212006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f212006ce70 0x7f212006f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2128004f40 tx=0x7f212800b040 comp rx=0 tx=0).stop 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 msgr2=0x7f213810ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 0x7f213810ecc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f212c009360 tx=0x7f212c009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 shutdown_connections 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f212006ce70 0x7f212006f320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21380fbb40 0x7f213810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 --2- 172.21.15.29:0/2243756663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2138101b00 0x7f213810ecc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 >> 172.21.15.29:0/2243756663 conn(0x7f21380719b0 msgr2=0x7f21380fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 shutdown_connections 2023-12-05T13:33:31.804 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.803+0000 7f213dfe9700 1 -- 172.21.15.29:0/2243756663 wait complete. 2023-12-05T13:33:31.816 INFO:teuthology.orchestra.run.smithi029.stdout:true 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 -- 172.21.15.29:0/1873639268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 msgr2=0x7f59ec102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/1873639268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec102fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59dc004940 tx=0x7f59dc009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 -- 172.21.15.29:0/1873639268 shutdown_connections 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/1873639268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59ec103590 0x7f59ec0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/1873639268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec102fc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 -- 172.21.15.29:0/1873639268 >> 172.21.15.29:0/1873639268 conn(0x7f59ec0f87a0 msgr2=0x7f59ec0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 -- 172.21.15.29:0/1873639268 shutdown_connections 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 -- 172.21.15.29:0/1873639268 wait complete. 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 Processor -- start 2023-12-05T13:33:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.917+0000 7f59f0bb2700 1 -- start start 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59f0bb2700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59f0bb2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59ec103590 0x7f59ec070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59f0bb2700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec070a80 con 0x7f59ec102bf0 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59f0bb2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec070bf0 con 0x7f59ec103590 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41532/0 (socket says 172.21.15.29:41532) 2023-12-05T13:33:31.920 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 -- 172.21.15.29:0/2568243775 learned_addr learned my addr 172.21.15.29:0/2568243775 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59e9d9b700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59ec103590 0x7f59ec070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 -- 172.21.15.29:0/2568243775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59ec103590 msgr2=0x7f59ec070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59ec103590 0x7f59ec070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 -- 172.21.15.29:0/2568243775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc005040 con 0x7f59ec102bf0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59ea59c700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec06ff40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b3b0 tx=0x7f59dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.918+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59dc00e040 con 0x7f59ec102bf0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.919+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59dc00bc50 con 0x7f59ec102bf0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.919+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59dc013420 con 0x7f59ec102bf0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.919+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec119850 con 0x7f59ec102bf0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.919+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec119cb0 con 0x7f59ec102bf0 2023-12-05T13:33:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.920+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec0fff00 con 0x7f59ec102bf0 2023-12-05T13:33:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.920+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f59dc01c430 con 0x7f59ec102bf0 2023-12-05T13:33:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.921+0000 7f59daffd700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f59d406ce60 0x7f59d406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.921+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f59dc08d000 con 0x7f59ec102bf0 2023-12-05T13:33:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.921+0000 7f59e9d9b700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f59d406ce60 0x7f59d406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.921+0000 7f59e9d9b700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f59d406ce60 0x7f59d406f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59ec071940 tx=0x7f59e000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:31.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:31.925+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f59dc057060 con 0x7f59ec102bf0 2023-12-05T13:33:32.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.154+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59ec071680 con 0x7f59d406ce60 2023-12-05T13:33:32.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.155+0000 7f59daffd700 1 -- 172.21.15.29:0/2568243775 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f59ec071680 con 0x7f59d406ce60 2023-12-05T13:33:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.157+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f59d406ce60 msgr2=0x7f59d406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.157+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f59d406ce60 0x7f59d406f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59ec071940 tx=0x7f59e000b040 comp rx=0 tx=0).stop 2023-12-05T13:33:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.157+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 msgr2=0x7f59ec06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:32.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.157+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec06ff40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b3b0 tx=0x7f59dc009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 shutdown_connections 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f59d406ce60 0x7f59d406f310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59ec102bf0 0x7f59ec06ff40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 --2- 172.21.15.29:0/2568243775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59ec103590 0x7f59ec070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 >> 172.21.15.29:0/2568243775 conn(0x7f59ec0f87a0 msgr2=0x7f59ec0fa340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 shutdown_connections 2023-12-05T13:33:32.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:32.158+0000 7f59f0bb2700 1 -- 172.21.15.29:0/2568243775 wait complete. 2023-12-05T13:33:32.170 INFO:teuthology.orchestra.run.smithi029.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-05T13:33:32.581 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch ps' 2023-12-05T13:33:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:32 smithi029 ceph-mon[217405]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:32 smithi029 ceph-mon[217405]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:32.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:32 smithi029 ceph-mon[217405]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:32.886 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:33:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:32 smithi052 ceph-mon[184394]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:32 smithi052 ceph-mon[184394]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:32 smithi052 ceph-mon[184394]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:33.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 -- 172.21.15.29:0/595025072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 msgr2=0x7f2bc8103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:33.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/595025072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc8103040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4004940 tx=0x7f2bc4009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:33.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 -- 172.21.15.29:0/595025072 shutdown_connections 2023-12-05T13:33:33.880 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/595025072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 0x7f2bc80fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/595025072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc8103040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 -- 172.21.15.29:0/595025072 >> 172.21.15.29:0/595025072 conn(0x7f2bc80711a0 msgr2=0x7f2bc80715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 -- 172.21.15.29:0/595025072 shutdown_connections 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.879+0000 7f2bd04a1700 1 -- 172.21.15.29:0/595025072 wait complete. 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bd04a1700 1 Processor -- start 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bd04a1700 1 -- start start 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bd04a1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 0x7f2bc80fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bd04a1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc80fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bd04a1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80fcf00 con 0x7f2bc8102c70 2023-12-05T13:33:33.881 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bd04a1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80fd070 con 0x7f2bc80fb1e0 2023-12-05T13:33:33.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bcda3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc80fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:33.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bcda3c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc80fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41556/0 (socket says 172.21.15.29:41556) 2023-12-05T13:33:33.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bcda3c700 1 -- 172.21.15.29:0/3193474667 learned_addr learned my addr 172.21.15.29:0/3193474667 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:33.882 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bce23d700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 0x7f2bc80fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bcda3c700 1 -- 172.21.15.29:0/3193474667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 msgr2=0x7f2bc80fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.880+0000 7f2bcda3c700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 0x7f2bc80fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bcda3c700 1 -- 172.21.15.29:0/3193474667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4005040 con 0x7f2bc8102c70 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bce23d700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 0x7f2bc80fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bcda3c700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc80fc900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800eb40 tx=0x7f2bb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb8007cc0 con 0x7f2bc8102c70 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2bb800f040 con 0x7f2bc8102c70 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc8119830 con 0x7f2bc8102c70 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb8009570 con 0x7f2bc8102c70 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.881+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc8119c90 con 0x7f2bc8102c70 2023-12-05T13:33:33.883 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.882+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc80fff10 con 0x7f2bc8102c70 2023-12-05T13:33:33.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.883+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2bb80096d0 con 0x7f2bc8102c70 2023-12-05T13:33:33.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.883+0000 7f2bbeffd700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2bb406ce60 0x7f2bb406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:33.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.883+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f2bb808bfe0 con 0x7f2bc8102c70 2023-12-05T13:33:33.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.883+0000 7f2bce23d700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2bb406ce60 0x7f2bb406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:33.884 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.884+0000 7f2bce23d700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2bb406ce60 0x7f2bb406f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400b0d0 tx=0x7f2bc4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:33.888 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:33.888+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2bb8055f20 con 0x7f2bc8102c70 2023-12-05T13:33:34.108 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.107+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bc80fdb00 con 0x7f2bb406ce60 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.118+0000 7f2bbeffd700 1 -- 172.21.15.29:0/3193474667 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f2bc80fdb00 con 0x7f2bb406ce60 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (5m) 2m ago 14m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (3m) 2m ago 14m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (3m) 33s ago 14m 7465k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (5m) 2m ago 14m 84.3M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:33:34.119 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (10m) 2m ago 10m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (10m) 2m ago 10m 19.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (10m) 33s ago 10m 19.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (10m) 33s ago 10m 19.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (6m) 2m ago 15m 513M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (6m) 33s ago 13m 450M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (4m) 2m ago 15m 68.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (3m) 33s ago 13m 53.9M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (5m) 2m ago 14m 16.4M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 33s ago 13m 17.3M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (3m) 2m ago 13m 180M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (2m) 2m ago 13m 124M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 54b9f199069e 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (2m) 2m ago 12m 12.6M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5f43e7285634 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (94s) 33s ago 12m 139M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 11774d217613 2023-12-05T13:33:34.120 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (65s) 33s ago 12m 123M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 57b9d01f0f36 2023-12-05T13:33:34.121 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (36s) 33s ago 11m 11.7M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 2e67e2f4153d 2023-12-05T13:33:34.121 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (5m) 2m ago 14m 59.4M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:33:34.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2bb406ce60 msgr2=0x7f2bb406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:34.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2bb406ce60 0x7f2bb406f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400b0d0 tx=0x7f2bc4009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:34.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 msgr2=0x7f2bc80fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:34.121 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc80fc900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800eb40 tx=0x7f2bb800b040 comp rx=0 tx=0).stop 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 shutdown_connections 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f2bb406ce60 0x7f2bb406f310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bc80fb1e0 0x7f2bc80fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 --2- 172.21.15.29:0/3193474667 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2bc8102c70 0x7f2bc80fc900 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 >> 172.21.15.29:0/3193474667 conn(0x7f2bc80711a0 msgr2=0x7f2bc80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 shutdown_connections 2023-12-05T13:33:34.122 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:34.121+0000 7f2bd04a1700 1 -- 172.21.15.29:0/3193474667 wait complete. 2023-12-05T13:33:34.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch upgrade status' 2023-12-05T13:33:34.807 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:33:35.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:34 smithi029 ceph-mon[217405]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:35.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:34 smithi029 ceph-mon[217405]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:34 smithi052 ceph-mon[184394]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:35.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:34 smithi052 ceph-mon[184394]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 -- 172.21.15.29:0/2759810995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 msgr2=0x7f5bf0065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/2759810995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0065800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5be4004940 tx=0x7f5be4009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 -- 172.21.15.29:0/2759810995 shutdown_connections 2023-12-05T13:33:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/2759810995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0065800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/2759810995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bf0102c20 0x7f5bf0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:35.908 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 -- 172.21.15.29:0/2759810995 >> 172.21.15.29:0/2759810995 conn(0x7f5bf00719b0 msgr2=0x7f5bf0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 -- 172.21.15.29:0/2759810995 shutdown_connections 2023-12-05T13:33:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.907+0000 7f5bf50aa700 1 -- 172.21.15.29:0/2759810995 wait complete. 2023-12-05T13:33:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bf50aa700 1 Processor -- start 2023-12-05T13:33:35.909 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bf50aa700 1 -- start start 2023-12-05T13:33:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bf50aa700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bf50aa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bf0102c20 0x7f5bf0113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bf50aa700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0114100 con 0x7f5bf0065390 2023-12-05T13:33:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bf50aa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf010d4a0 con 0x7f5bf0102c20 2023-12-05T13:33:35.910 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5beed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5beed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41574/0 (socket says 172.21.15.29:41574) 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5beed9d700 1 -- 172.21.15.29:0/1686060235 learned_addr learned my addr 172.21.15.29:0/1686060235 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.908+0000 7f5bee59c700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bf0102c20 0x7f5bf0113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5beed9d700 1 -- 172.21.15.29:0/1686060235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bf0102c20 msgr2=0x7f5bf0113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5beed9d700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bf0102c20 0x7f5bf0113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5beed9d700 1 -- 172.21.15.29:0/1686060235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4005040 con 0x7f5bf0065390 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5beed9d700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0113570 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5be000eb40 tx=0x7f5be000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be0007cc0 con 0x7f5bf0065390 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5be000f040 con 0x7f5bf0065390 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf010d720 con 0x7f5bf0065390 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be000c990 con 0x7f5bf0065390 2023-12-05T13:33:35.911 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.909+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf010dc30 con 0x7f5bf0065390 2023-12-05T13:33:35.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.911+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf00fff40 con 0x7f5bf0065390 2023-12-05T13:33:35.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.911+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5be000cc00 con 0x7f5bf0065390 2023-12-05T13:33:35.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.911+0000 7f5bd77fe700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5bd806ce60 0x7f5bd806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:35.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.911+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f5be008bf20 con 0x7f5bf0065390 2023-12-05T13:33:35.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.911+0000 7f5bee59c700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5bd806ce60 0x7f5bd806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:35.912 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.912+0000 7f5bee59c700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5bd806ce60 0x7f5bd806f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5bf010e7d0 tx=0x7f5be4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:35.917 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:35.916+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5be00bf2f0 con 0x7f5bf0065390 2023-12-05T13:33:36.142 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.141+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bf004bbb0 con 0x7f5bd806ce60 2023-12-05T13:33:36.143 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.143+0000 7f5bd77fe700 1 -- 172.21.15.29:0/1686060235 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f5bf004bbb0 con 0x7f5bd806ce60 2023-12-05T13:33:36.143 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:33:36.143 INFO:teuthology.orchestra.run.smithi029.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-05T13:33:36.143 INFO:teuthology.orchestra.run.smithi029.stdout: "in_progress": true, 2023-12-05T13:33:36.143 INFO:teuthology.orchestra.run.smithi029.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T13:33:36.143 INFO:teuthology.orchestra.run.smithi029.stdout: "services_complete": [ 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr", 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "osd", 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "mon" 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "progress": "12/21 daemons upgraded", 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout: "is_paused": true 2023-12-05T13:33:36.144 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:33:36.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5bd806ce60 msgr2=0x7f5bd806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:36.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5bd806ce60 0x7f5bd806f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5bf010e7d0 tx=0x7f5be4009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:36.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 msgr2=0x7f5bf0113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:36.145 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0113570 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5be000eb40 tx=0x7f5be000b040 comp rx=0 tx=0).stop 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 shutdown_connections 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f5bd806ce60 0x7f5bd806f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bf0065390 0x7f5bf0113570 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 --2- 172.21.15.29:0/1686060235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bf0102c20 0x7f5bf0113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 >> 172.21.15.29:0/1686060235 conn(0x7f5bf00719b0 msgr2=0x7f5bf00fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 shutdown_connections 2023-12-05T13:33:36.146 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:36.145+0000 7f5bf50aa700 1 -- 172.21.15.29:0/1686060235 wait complete. 2023-12-05T13:33:36.588 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph health detail' 2023-12-05T13:33:36.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:36 smithi029 ceph-mon[217405]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:36.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:36 smithi029 ceph-mon[217405]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:36.888 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:33:36.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:36 smithi052 ceph-mon[184394]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:33:36.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:36 smithi052 ceph-mon[184394]: pgmap v173: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:37.745 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:37.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 -- 172.21.15.29:0/3014245304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 msgr2=0x7f71600fbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 --2- 172.21.15.29:0/3014245304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f71600fbdc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7150004940 tx=0x7f7150009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 -- 172.21.15.29:0/3014245304 shutdown_connections 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 --2- 172.21.15.29:0/3014245304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71600fc300 0x7f7160109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 --2- 172.21.15.29:0/3014245304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f71600fbdc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 -- 172.21.15.29:0/3014245304 >> 172.21.15.29:0/3014245304 conn(0x7f71600f76c0 msgr2=0x7f71600f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 -- 172.21.15.29:0/3014245304 shutdown_connections 2023-12-05T13:33:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.993+0000 7f71653a8700 1 -- 172.21.15.29:0/3014245304 wait complete. 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.994+0000 7f71653a8700 1 Processor -- start 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.994+0000 7f71653a8700 1 -- start start 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.994+0000 7f71653a8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f7160115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.994+0000 7f71653a8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71600fc300 0x7f7160115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.994+0000 7f71653a8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160116400 con 0x7f71600fb9f0 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.994+0000 7f71653a8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716010f730 con 0x7f71600fc300 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f7160115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:37.996 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f7160115870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41588/0 (socket says 172.21.15.29:41588) 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 -- 172.21.15.29:0/3420029281 learned_addr learned my addr 172.21.15.29:0/3420029281 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715e7fc700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71600fc300 0x7f7160115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 -- 172.21.15.29:0/3420029281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71600fc300 msgr2=0x7f7160115db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71600fc300 0x7f7160115db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 -- 172.21.15.29:0/3420029281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150005040 con 0x7f71600fb9f0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f715effd700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f7160115870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7150009040 tx=0x7f7150009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715000e040 con 0x7f71600fb9f0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7150013420 con 0x7f71600fb9f0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716010f9b0 con 0x7f71600fb9f0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715001c630 con 0x7f71600fb9f0 2023-12-05T13:33:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.995+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716010fef0 con 0x7f71600fb9f0 2023-12-05T13:33:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.996+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7160106790 con 0x7f71600fb9f0 2023-12-05T13:33:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.997+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7150013970 con 0x7f71600fb9f0 2023-12-05T13:33:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.997+0000 7f71477fe700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f714806ce70 0x7f714806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.997+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f715008d5e0 con 0x7f71600fb9f0 2023-12-05T13:33:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.997+0000 7f715e7fc700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f714806ce70 0x7f714806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:37.998+0000 7f715e7fc700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f714806ce70 0x7f714806f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7154009fd0 tx=0x7f7154009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.002+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f715005b020 con 0x7f71600fb9f0 2023-12-05T13:33:38.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.299+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f716004bb80 con 0x7f71600fb9f0 2023-12-05T13:33:38.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.300+0000 7f71477fe700 1 -- 172.21.15.29:0/3420029281 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7f7150055e60 con 0x7f71600fb9f0 2023-12-05T13:33:38.301 INFO:teuthology.orchestra.run.smithi029.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-05T13:33:38.301 INFO:teuthology.orchestra.run.smithi029.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T13:33:38.301 INFO:teuthology.orchestra.run.smithi029.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-05T13:33:38.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f714806ce70 msgr2=0x7f714806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f714806ce70 0x7f714806f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7154009fd0 tx=0x7f7154009f20 comp rx=0 tx=0).stop 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 msgr2=0x7f7160115870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f7160115870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7150009040 tx=0x7f7150009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 shutdown_connections 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f714806ce70 0x7f714806f320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71600fb9f0 0x7f7160115870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 --2- 172.21.15.29:0/3420029281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71600fc300 0x7f7160115db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 >> 172.21.15.29:0/3420029281 conn(0x7f71600f76c0 msgr2=0x7f71600f8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 shutdown_connections 2023-12-05T13:33:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:38.302+0000 7f71653a8700 1 -- 172.21.15.29:0/3420029281 wait complete. 2023-12-05T13:33:38.580 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:38 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3420029281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:33:38.580 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:38 smithi029 ceph-mon[217405]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:38.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions' 2023-12-05T13:33:38.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:38 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3420029281' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T13:33:38.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:38 smithi052 ceph-mon[184394]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:33:40.063 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 -- 172.21.15.29:0/210150228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 msgr2=0x7f407c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 --2- 172.21.15.29:0/210150228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c106bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4070004940 tx=0x7f4070009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 -- 172.21.15.29:0/210150228 shutdown_connections 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 --2- 172.21.15.29:0/210150228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c106bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 --2- 172.21.15.29:0/210150228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f407c0fdc10 0x7f407c0fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 -- 172.21.15.29:0/210150228 >> 172.21.15.29:0/210150228 conn(0x7f407c0f76c0 msgr2=0x7f407c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 -- 172.21.15.29:0/210150228 shutdown_connections 2023-12-05T13:33:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.063+0000 7f4080907700 1 -- 172.21.15.29:0/210150228 wait complete. 2023-12-05T13:33:40.065 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4080907700 1 Processor -- start 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4080907700 1 -- start start 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4080907700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f407c0fdc10 0x7f407c1136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4080907700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4080907700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c114280 con 0x7f407c0fe5b0 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4080907700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c10d570 con 0x7f407c0fdc10 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4079d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4079d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41084/0 (socket says 172.21.15.29:41084) 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4079d9b700 1 -- 172.21.15.29:0/4159357568 learned_addr learned my addr 172.21.15.29:0/4159357568 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f407a59c700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f407c0fdc10 0x7f407c1136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4079d9b700 1 -- 172.21.15.29:0/4159357568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f407c0fdc10 msgr2=0x7f407c1136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.064+0000 7f4079d9b700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f407c0fdc10 0x7f407c1136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:40.066 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f4079d9b700 1 -- 172.21.15.29:0/4159357568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070005040 con 0x7f407c0fe5b0 2023-12-05T13:33:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f4079d9b700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c113c30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4070009390 tx=0x7f4070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407000e040 con 0x7f407c0fe5b0 2023-12-05T13:33:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c10d7a0 con 0x7f407c0fe5b0 2023-12-05T13:33:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4070004290 con 0x7f407c0fe5b0 2023-12-05T13:33:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407001c3f0 con 0x7f407c0fe5b0 2023-12-05T13:33:40.067 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.065+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c10dce0 con 0x7f407c0fe5b0 2023-12-05T13:33:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.066+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c104200 con 0x7f407c0fe5b0 2023-12-05T13:33:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.067+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4070013800 con 0x7f407c0fe5b0 2023-12-05T13:33:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.067+0000 7f406affd700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f406406ce70 0x7f406406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:33:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.067+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f407008d620 con 0x7f407c0fe5b0 2023-12-05T13:33:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.067+0000 7f407a59c700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f406406ce70 0x7f406406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:33:40.068 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.068+0000 7f407a59c700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f406406ce70 0x7f406406f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f407c0f9f90 tx=0x7f406c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:33:40.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.072+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f407005afc0 con 0x7f407c0fe5b0 2023-12-05T13:33:40.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.371+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f407c0fb2c0 con 0x7f407c0fe5b0 2023-12-05T13:33:40.372 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.371+0000 7f406affd700 1 -- 172.21.15.29:0/4159357568 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f4070004db0 con 0x7f407c0fe5b0 2023-12-05T13:33:40.372 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:33:40.372 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 6 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 10 2023-12-05T13:33:40.373 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:33:40.374 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f406406ce70 msgr2=0x7f406406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f406406ce70 0x7f406406f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f407c0f9f90 tx=0x7f406c00b040 comp rx=0 tx=0).stop 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 msgr2=0x7f407c113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c113c30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4070009390 tx=0x7f4070009e30 comp rx=0 tx=0).stop 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 shutdown_connections 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f406406ce70 0x7f406406f320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f407c0fdc10 0x7f407c1136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 --2- 172.21.15.29:0/4159357568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f407c0fe5b0 0x7f407c113c30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 >> 172.21.15.29:0/4159357568 conn(0x7f407c0f76c0 msgr2=0x7f407c101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 shutdown_connections 2023-12-05T13:33:40.375 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:33:40.374+0000 7f4080907700 1 -- 172.21.15.29:0/4159357568 wait complete. 2023-12-05T13:33:40.671 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:40 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/4159357568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:40.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:40 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/4159357568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:33:40.772 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-05T13:33:41.079 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:33:41.550 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:41 smithi029 ceph-mon[217405]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:41.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:41 smithi052 ceph-mon[184394]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:42.073 INFO:teuthology.orchestra.run.smithi029.stdout:wait for servicemap items w/ changing names to refresh 2023-12-05T13:33:42.437 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'sleep 60' 2023-12-05T13:33:42.739 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:33:42.849 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:42 smithi029 ceph-mon[217405]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:42 smithi052 ceph-mon[184394]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:45.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:44 smithi029 ceph-mon[217405]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:45.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:44 smithi052 ceph-mon[184394]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:46.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:46 smithi029 ceph-mon[217405]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:46.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:46 smithi052 ceph-mon[184394]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:48.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:48 smithi029 ceph-mon[217405]: pgmap v179: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:48.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:48 smithi052 ceph-mon[184394]: pgmap v179: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:50.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:50 smithi029 ceph-mon[217405]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:50.972 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:50 smithi052 ceph-mon[184394]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:52.604 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:52 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:52.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:52 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:33:53.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:53 smithi029 ceph-mon[217405]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:53.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:53 smithi052 ceph-mon[184394]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:55.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:54 smithi029 ceph-mon[217405]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:55.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:54 smithi052 ceph-mon[184394]: pgmap v182: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:56.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:56 smithi029 ceph-mon[217405]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:56.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:56 smithi052 ceph-mon[184394]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:58.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:33:58 smithi029 ceph-mon[217405]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:33:58.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:33:58 smithi052 ceph-mon[184394]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:00.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:00 smithi029 ceph-mon[217405]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:00.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:00 smithi052 ceph-mon[184394]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:02.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:02 smithi029 ceph-mon[217405]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:02.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:02 smithi052 ceph-mon[184394]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:05.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:04 smithi029 ceph-mon[217405]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:05.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:04 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:34:05.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:04 smithi052 ceph-mon[184394]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:05.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:04 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T13:34:06.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:34:06.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:34:06.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:05 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:34:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T13:34:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T13:34:06.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:05 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' 2023-12-05T13:34:07.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:06 smithi029 ceph-mon[217405]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:07.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:06 smithi052 ceph-mon[184394]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:08.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:07 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:08.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:07 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:09.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:08 smithi029 ceph-mon[217405]: pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:09.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:08 smithi052 ceph-mon[184394]: pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:10.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:10 smithi029 ceph-mon[217405]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:10.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:10 smithi052 ceph-mon[184394]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:12.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:12 smithi029 ceph-mon[217405]: pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:12.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:12 smithi052 ceph-mon[184394]: pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:15.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:14 smithi029 ceph-mon[217405]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:15.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:14 smithi052 ceph-mon[184394]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:16.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:16 smithi029 ceph-mon[217405]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:16.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:16 smithi052 ceph-mon[184394]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:18.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:18 smithi029 ceph-mon[217405]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:18.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:18 smithi052 ceph-mon[184394]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:20.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:20 smithi029 ceph-mon[217405]: pgmap v195: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:20.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:20 smithi052 ceph-mon[184394]: pgmap v195: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:22.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:22 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:22.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:22 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:23.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:23 smithi029 ceph-mon[217405]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:23.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:23 smithi052 ceph-mon[184394]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:25.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:24 smithi029 ceph-mon[217405]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:25.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:24 smithi052 ceph-mon[184394]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:26.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:26 smithi029 ceph-mon[217405]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:26.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:26 smithi052 ceph-mon[184394]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:28.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:28 smithi029 ceph-mon[217405]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:28.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:28 smithi052 ceph-mon[184394]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:30.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:30 smithi029 ceph-mon[217405]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:30.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:30 smithi052 ceph-mon[184394]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:32.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:32 smithi029 ceph-mon[217405]: pgmap v201: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:32.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:32 smithi052 ceph-mon[184394]: pgmap v201: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:35.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:34 smithi029 ceph-mon[217405]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:35.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:34 smithi052 ceph-mon[184394]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:36.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:36 smithi029 ceph-mon[217405]: pgmap v203: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:36.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:36 smithi052 ceph-mon[184394]: pgmap v203: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:37.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:37 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:37.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:37 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:38.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:38 smithi029 ceph-mon[217405]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:38.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:38 smithi052 ceph-mon[184394]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:40.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:40 smithi029 ceph-mon[217405]: pgmap v205: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:40.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:40 smithi052 ceph-mon[184394]: pgmap v205: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:42.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:42 smithi029 ceph-mon[217405]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:42.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:42 smithi052 ceph-mon[184394]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:44.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch ps' 2023-12-05T13:34:44.322 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:34:45.080 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:44 smithi029 ceph-mon[217405]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:45.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:44 smithi052 ceph-mon[184394]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 -- 172.21.15.29:0/2111400704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fc5d0 msgr2=0x7f71740fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 --2- 172.21.15.29:0/2111400704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fc5d0 0x7f71740fc9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7164004940 tx=0x7f7164009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 -- 172.21.15.29:0/2111400704 shutdown_connections 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 --2- 172.21.15.29:0/2111400704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71740fcee0 0x7f7174109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 --2- 172.21.15.29:0/2111400704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fc5d0 0x7f71740fc9a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 -- 172.21.15.29:0/2111400704 >> 172.21.15.29:0/2111400704 conn(0x7f71740719b0 msgr2=0x7f7174071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:45.473 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.470+0000 7f7179095700 1 -- 172.21.15.29:0/2111400704 shutdown_connections 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.471+0000 7f7179095700 1 -- 172.21.15.29:0/2111400704 wait complete. 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.471+0000 7f7179095700 1 Processor -- start 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.471+0000 7f7179095700 1 -- start start 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f7179095700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71740fc5d0 0x7f71741158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f7179095700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 0x7f7174115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f7179095700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7174116450 con 0x7f71740fcee0 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f7179095700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717410f780 con 0x7f71740fc5d0 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 0x7f7174115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 0x7f7174115e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34434/0 (socket says 172.21.15.29:34434) 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 -- 172.21.15.29:0/2466772968 learned_addr learned my addr 172.21.15.29:0/2466772968 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:45.474 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f7172d9d700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71740fc5d0 0x7f71741158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:45.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 -- 172.21.15.29:0/2466772968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71740fc5d0 msgr2=0x7f71741158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:45.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71740fc5d0 0x7f71741158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.475 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 -- 172.21.15.29:0/2466772968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164005040 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716a59c700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 0x7f7174115e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f715c002a50 tx=0x7f715c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c007cc0 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.472+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717410fa60 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.473+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f715c00f040 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.473+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f715c00d9c0 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.473+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717410ffa0 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.473+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71741068c0 con 0x7f71740fcee0 2023-12-05T13:34:45.476 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.474+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f715c00db20 con 0x7f71740fcee0 2023-12-05T13:34:45.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.475+0000 7f716bfff700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f716006ce60 0x7f716006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:45.477 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.475+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f715c08c050 con 0x7f71740fcee0 2023-12-05T13:34:45.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.475+0000 7f7172d9d700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f716006ce60 0x7f716006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:45.478 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.475+0000 7f7172d9d700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f716006ce60 0x7f716006f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7164004f90 tx=0x7f7164009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:45.481 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.480+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f715c059970 con 0x7f71740fcee0 2023-12-05T13:34:45.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.705+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 --> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f717410bdc0 con 0x7f716006ce60 2023-12-05T13:34:45.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.716+0000 7f716bfff700 1 -- 172.21.15.29:0/2466772968 <== mgr.34104 v2:172.21.15.29:6800/1764792763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f717410bdc0 con 0x7f716006ce60 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:alertmanager.smithi029 smithi029 *:9093,9094 running (6m) 3m ago 15m 27.6M - 0.25.0 c8568f914cd2 3b164b79936f 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi029 smithi029 running (4m) 3m ago 16m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 d84d2faf8067 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:crash.smithi052 smithi052 running (4m) 105s ago 15m 7465k - 19.0.0-13-ge6605fb8 104f332cd0a9 be46a0260c1f 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:grafana.smithi029 smithi029 *:3000 running (6m) 3m ago 15m 84.3M - 9.4.7 2c41d148cca3 7fea3bb5b8c0 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.jdhffk smithi029 running (11m) 3m ago 11m 10.3G - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c7a50230a7da 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi029.pbbvzt smithi029 running (11m) 3m ago 11m 19.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 46fedd87a8af 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.dsxvue smithi052 running (11m) 105s ago 11m 19.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 164b95ac48e2 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:mds.cephfs.smithi052.nbpymg smithi052 running (11m) 105s ago 11m 19.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 515222e192ff 2023-12-05T13:34:45.718 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi029.eekhlu smithi029 *:8443,9283,8765 running (7m) 3m ago 17m 513M - 19.0.0-13-ge6605fb8 104f332cd0a9 c7f8d8260bc9 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.smithi052.ocazcp smithi052 *:8443,9283,8765 running (7m) 105s ago 15m 450M - 19.0.0-13-ge6605fb8 104f332cd0a9 703f57bfc81d 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi029 smithi029 running (5m) 3m ago 17m 68.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 ecad29ebe778 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:mon.smithi052 smithi052 running (5m) 105s ago 15m 53.9M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 753ffd094733 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi029 smithi029 *:9100 running (7m) 3m ago 16m 16.4M - 1.5.0 0da6a335fe13 798a9280b484 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:node-exporter.smithi052 smithi052 *:9100 running (6m) 105s ago 15m 17.3M - 1.5.0 0da6a335fe13 dae9e1be30f1 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (4m) 3m ago 14m 180M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5bda181e4954 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi029 running (3m) 3m ago 14m 124M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 54b9f199069e 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi029 running (3m) 3m ago 13m 12.6M 1570M 19.0.0-13-ge6605fb8 104f332cd0a9 5f43e7285634 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi052 running (2m) 105s ago 13m 139M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 11774d217613 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (2m) 105s ago 13m 123M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 57b9d01f0f36 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi052 running (107s) 105s ago 12m 11.7M 2594M 19.0.0-13-ge6605fb8 104f332cd0a9 2e67e2f4153d 2023-12-05T13:34:45.719 INFO:teuthology.orchestra.run.smithi029.stdout:prometheus.smithi029 smithi029 *:9095 running (6m) 3m ago 15m 59.4M - 2.43.0 a07b618ecd1d f8284534679a 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f716006ce60 msgr2=0x7f716006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f716006ce60 0x7f716006f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7164004f90 tx=0x7f7164009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 msgr2=0x7f7174115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 0x7f7174115e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f715c002a50 tx=0x7f715c0046b0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 shutdown_connections 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f716006ce60 0x7f716006f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71740fc5d0 0x7f71741158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 --2- 172.21.15.29:0/2466772968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71740fcee0 0x7f7174115e00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 >> 172.21.15.29:0/2466772968 conn(0x7f71740719b0 msgr2=0x7f71740fa8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 shutdown_connections 2023-12-05T13:34:45.722 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:45.719+0000 7f7179095700 1 -- 172.21.15.29:0/2466772968 wait complete. 2023-12-05T13:34:46.113 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions' 2023-12-05T13:34:46.417 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:34:46.853 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:46 smithi029 ceph-mon[217405]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:34:46.854 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:46 smithi029 ceph-mon[217405]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:46.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:46 smithi052 ceph-mon[184394]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T13:34:46.973 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:46 smithi052 ceph-mon[184394]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:47.515 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 -- 172.21.15.29:0/3978649835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0578101b00 msgr2=0x7f0578101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 --2- 172.21.15.29:0/3978649835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0578101b00 0x7f0578101ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0560004940 tx=0x7f0560009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 -- 172.21.15.29:0/3978649835 shutdown_connections 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 --2- 172.21.15.29:0/3978649835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05780fbb40 0x7f05780fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 --2- 172.21.15.29:0/3978649835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0578101b00 0x7f0578101ed0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 -- 172.21.15.29:0/3978649835 >> 172.21.15.29:0/3978649835 conn(0x7f05780719b0 msgr2=0x7f0578071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 -- 172.21.15.29:0/3978649835 shutdown_connections 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.513+0000 7f057edb6700 1 -- 172.21.15.29:0/3978649835 wait complete. 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.514+0000 7f057edb6700 1 Processor -- start 2023-12-05T13:34:47.516 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.514+0000 7f057edb6700 1 -- start start 2023-12-05T13:34:47.517 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057edb6700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 0x7f0578115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057edb6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0578101b00 0x7f0578115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057edb6700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05781163f0 con 0x7f05780fbb40 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057edb6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057810f720 con 0x7f0578101b00 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 0x7f0578115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 0x7f0578115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34448/0 (socket says 172.21.15.29:34448) 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 -- 172.21.15.29:0/353759812 learned_addr learned my addr 172.21.15.29:0/353759812 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f0577fff700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0578101b00 0x7f0578115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 -- 172.21.15.29:0/353759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0578101b00 msgr2=0x7f0578115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0578101b00 0x7f0578115da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 -- 172.21.15.29:0/353759812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560005040 con 0x7f05780fbb40 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057cb52700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 0x7f0578115860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0560009fd0 tx=0x7f0560009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056000e040 con 0x7f05780fbb40 2023-12-05T13:34:47.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f056000bc50 con 0x7f05780fbb40 2023-12-05T13:34:47.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057810f9a0 con 0x7f05780fbb40 2023-12-05T13:34:47.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.515+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0560013ea0 con 0x7f05780fbb40 2023-12-05T13:34:47.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.516+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057810fee0 con 0x7f05780fbb40 2023-12-05T13:34:47.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.517+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05780734d0 con 0x7f05780fbb40 2023-12-05T13:34:47.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.517+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0560013420 con 0x7f05780fbb40 2023-12-05T13:34:47.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.517+0000 7f05757fa700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f056406ce70 0x7f056406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:47.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.518+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f056008d7c0 con 0x7f05780fbb40 2023-12-05T13:34:47.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.518+0000 7f0577fff700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f056406ce70 0x7f056406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:47.520 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.518+0000 7f0577fff700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f056406ce70 0x7f056406f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0578111090 tx=0x7f056800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:47.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.522+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f056005b160 con 0x7f05780fbb40 2023-12-05T13:34:47.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.820+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0578110e40 con 0x7f05780fbb40 2023-12-05T13:34:47.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.821+0000 7f05757fa700 1 -- 172.21.15.29:0/353759812 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f056005acf0 con 0x7f05780fbb40 2023-12-05T13:34:47.822 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: "mon": { 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": { 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": { 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 6 2023-12-05T13:34:47.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: "overall": { 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 10 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout: } 2023-12-05T13:34:47.824 INFO:teuthology.orchestra.run.smithi029.stdout:} 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f056406ce70 msgr2=0x7f056406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f056406ce70 0x7f056406f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0578111090 tx=0x7f056800b040 comp rx=0 tx=0).stop 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 msgr2=0x7f0578115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 0x7f0578115860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0560009fd0 tx=0x7f0560009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 shutdown_connections 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f056406ce70 0x7f056406f320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05780fbb40 0x7f0578115860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:47.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 --2- 172.21.15.29:0/353759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0578101b00 0x7f0578115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:47.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 >> 172.21.15.29:0/353759812 conn(0x7f05780719b0 msgr2=0x7f0578065490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:47.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 shutdown_connections 2023-12-05T13:34:47.826 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:47.823+0000 7f057edb6700 1 -- 172.21.15.29:0/353759812 wait complete. 2023-12-05T13:34:48.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:47 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/353759812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:34:48.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:47 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/353759812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:34:48.296 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-05T13:34:48.599 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/mon.smithi029/config 2023-12-05T13:34:49.076 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:48 smithi029 ceph-mon[217405]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:49.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:48 smithi052 ceph-mon[184394]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:49.697 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 -- 172.21.15.29:0/3036695277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa040fbb30 msgr2=0x7ffa040fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3036695277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa040fbb30 0x7ffa040fbfa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8004940 tx=0x7ff9f8009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 -- 172.21.15.29:0/3036695277 shutdown_connections 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3036695277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa040fbb30 0x7ffa040fbfa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3036695277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa04101af0 0x7ffa04101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 -- 172.21.15.29:0/3036695277 >> 172.21.15.29:0/3036695277 conn(0x7ffa040f7690 msgr2=0x7ffa040f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 -- 172.21.15.29:0/3036695277 shutdown_connections 2023-12-05T13:34:49.698 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.696+0000 7ffa0a511700 1 -- 172.21.15.29:0/3036695277 wait complete. 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa0a511700 1 Processor -- start 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa0a511700 1 -- start start 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa0a511700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa040fbb30 0x7ffa0410e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa0a511700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 0x7ffa0410ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa0a511700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0410f190 con 0x7ffa04101af0 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa0a511700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0410f2d0 con 0x7ffa040fbb30 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa037fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 0x7ffa0410ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa037fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 0x7ffa0410ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33834/0 (socket says 172.21.15.29:33834) 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa037fe700 1 -- 172.21.15.29:0/3976368438 learned_addr learned my addr 172.21.15.29:0/3976368438 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.697+0000 7ffa03fff700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa040fbb30 0x7ffa0410e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa037fe700 1 -- 172.21.15.29:0/3976368438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa040fbb30 msgr2=0x7ffa0410e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:49.700 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa037fe700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa040fbb30 0x7ffa0410e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa037fe700 1 -- 172.21.15.29:0/3976368438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8005040 con 0x7ffa04101af0 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa037fe700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 0x7ffa0410ec00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800b3b0 tx=0x7ff9f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f800e040 con 0x7ffa04101af0 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa041175d0 con 0x7ffa04101af0 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9f8004290 con 0x7ffa04101af0 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f801c3f0 con 0x7ffa04101af0 2023-12-05T13:34:49.701 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.698+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa04117ae0 con 0x7ffa04101af0 2023-12-05T13:34:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.699+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04103fa0 con 0x7ffa04101af0 2023-12-05T13:34:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.700+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff9f8013790 con 0x7ffa04101af0 2023-12-05T13:34:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.700+0000 7ffa00ff9700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff9ec06ce60 0x7ff9ec06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.700+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7ff9f808d5c0 con 0x7ffa04101af0 2023-12-05T13:34:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.700+0000 7ffa03fff700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff9ec06ce60 0x7ff9ec06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:49.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.701+0000 7ffa03fff700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff9ec06ce60 0x7ff9ec06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40041d0 tx=0x7ff9f40043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:49.706 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:49.705+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff9f80574d0 con 0x7ffa04101af0 2023-12-05T13:34:50.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.002+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa040fb290 con 0x7ffa04101af0 2023-12-05T13:34:50.004 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.003+0000 7ffa00ff9700 1 -- 172.21.15.29:0/3976368438 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7ff9f8013420 con 0x7ffa04101af0 2023-12-05T13:34:50.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff9ec06ce60 msgr2=0x7ff9ec06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:50.006 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff9ec06ce60 0x7ff9ec06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40041d0 tx=0x7ff9f40043c0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 msgr2=0x7ffa0410ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 0x7ffa0410ec00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800b3b0 tx=0x7ff9f8009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 shutdown_connections 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7ff9ec06ce60 0x7ff9ec06f310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa040fbb30 0x7ffa0410e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 --2- 172.21.15.29:0/3976368438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa04101af0 0x7ffa0410ec00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 >> 172.21.15.29:0/3976368438 conn(0x7ffa040f7690 msgr2=0x7ffa040f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 shutdown_connections 2023-12-05T13:34:50.007 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.005+0000 7ffa0a511700 1 -- 172.21.15.29:0/3976368438 wait complete. 2023-12-05T13:34:50.018 INFO:teuthology.orchestra.run.smithi029.stdout:false 2023-12-05T13:34:50.354 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:50 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3976368438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:34:50.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:34:50.438 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-05T13:34:50.518 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5d21bd936375425290db261cbdde114a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-05T13:34:50.521 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-05T13:34:50.532 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-05T13:34:50.533 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:34:50.533 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T13:34:50.539 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:50 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3976368438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T13:34:50.564 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-12-05T13:34:50.564 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T13:34:50.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T13:34:50.816 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 -- 172.21.15.29:0/2288339359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 msgr2=0x7f004c0fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:50.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 --2- 172.21.15.29:0/2288339359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c0fccc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0034004940 tx=0x7f0034009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:50.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 -- 172.21.15.29:0/2288339359 shutdown_connections 2023-12-05T13:34:50.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 --2- 172.21.15.29:0/2288339359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c0fccc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 --2- 172.21.15.29:0/2288339359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c102cb0 0x7f004c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 -- 172.21.15.29:0/2288339359 >> 172.21.15.29:0/2288339359 conn(0x7f004c0f87e0 msgr2=0x7f004c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:50.817 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 -- 172.21.15.29:0/2288339359 shutdown_connections 2023-12-05T13:34:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.814+0000 7f005134a700 1 -- 172.21.15.29:0/2288339359 wait complete. 2023-12-05T13:34:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.815+0000 7f005134a700 1 Processor -- start 2023-12-05T13:34:50.818 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.815+0000 7f005134a700 1 -- start start 2023-12-05T13:34:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.815+0000 7f005134a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c102cb0 0x7f004c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f005134a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f005134a700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0709c0 con 0x7f004c103650 2023-12-05T13:34:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f005134a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c070b30 con 0x7f004c102cb0 2023-12-05T13:34:50.820 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33860/0 (socket says 172.21.15.29:33860) 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 -- 172.21.15.29:0/820241790 learned_addr learned my addr 172.21.15.29:0/820241790 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004affd700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c102cb0 0x7f004c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 -- 172.21.15.29:0/820241790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c102cb0 msgr2=0x7f004c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c102cb0 0x7f004c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 -- 172.21.15.29:0/820241790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034005040 con 0x7f004c103650 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f004a7fc700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c070480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0034009360 tx=0x7f0034009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f003400e040 con 0x7f004c103650 2023-12-05T13:34:50.821 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f003400bc50 con 0x7f004c103650 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f003401c630 con 0x7f004c103650 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c070db0 con 0x7f004c103650 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.816+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c119bc0 con 0x7f004c103650 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.817+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c105180 con 0x7f004c103650 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.818+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0034013420 con 0x7f004c103650 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.819+0000 7f00437fe700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f003806ce70 0x7f003806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.819+0000 7f004affd700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f003806ce70 0x7f003806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:50.822 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.819+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f003408d630 con 0x7f004c103650 2023-12-05T13:34:50.823 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.819+0000 7f004affd700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f003806ce70 0x7f003806f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:50.825 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:50.824+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0034057540 con 0x7f004c103650 2023-12-05T13:34:51.035 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.034+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f004c064b80 con 0x7f004c103650 2023-12-05T13:34:51.036 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.035+0000 7f00437fe700 1 -- 172.21.15.29:0/820241790 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16464 (secure 0 0 0) 0x7f003405ab60 con 0x7f004c103650 2023-12-05T13:34:51.037 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:34:51.037 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":90,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","created":"2023-12-05T13:17:36.045441+0000","modified":"2023-12-05T13:33:06.780287+0000","last_up_change":"2023-12-05T13:33:05.778439+0000","last_in_change":"2023-12-05T13:21:41.541471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T13:21:02.367176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T13:22:47.619908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T13:22:48.124625+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc29bb5c-04bc-4518-a111-9d849c4f0d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":59,"up_thru":89,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6803","nonce":1409984533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6805","nonce":1409984533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6809","nonce":1409984533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6807","nonce":1409984533}]},"public_addr":"172.21.15.29:6803/1409984533","cluster_addr":"172.21.15.29:6805/1409984533","heartbeat_back_addr":"172.21.15.29:6809/1409984533","heartbeat_front_addr":"172.21.15.29:6807/1409984533","state":["exists","up"]},{"osd":1,"uuid":"3a6e62e0-e01c-442e-9edc-e84c329ccd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":65,"up_from":69,"up_thru":89,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6811","nonce":3920482260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6813","nonce":3920482260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6817","nonce":3920482260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6815","nonce":3920482260}]},"public_addr":"172.21.15.29:6811/3920482260","cluster_addr":"172.21.15.29:6813/3920482260","heartbeat_back_addr":"172.21.15.29:6817/3920482260","heartbeat_front_addr":"172.21.15.29:6815/3920482260","state":["exists","up"]},{"osd":2,"uuid":"3002b9e9-bd72-42cc-ae96-94d56978a07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":70,"up_from":74,"up_thru":89,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6819","nonce":707404259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6821","nonce":707404259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6825","nonce":707404259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6823","nonce":707404259}]},"public_addr":"172.21.15.29:6819/707404259","cluster_addr":"172.21.15.29:6821/707404259","heartbeat_back_addr":"172.21.15.29:6825/707404259","heartbeat_front_addr":"172.21.15.29:6823/707404259","state":["exists","up"]},{"osd":3,"uuid":"e250cbd9-ad56-4a7b-babf-fdb3cabab073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":75,"up_from":79,"up_thru":89,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6801","nonce":3322939945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6803","nonce":3322939945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6807","nonce":3322939945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6805","nonce":3322939945}]},"public_addr":"172.21.15.52:6801/3322939945","cluster_addr":"172.21.15.52:6803/3322939945","heartbeat_back_addr":"172.21.15.52:6807/3322939945","heartbeat_front_addr":"172.21.15.52:6805/3322939945","state":["exists","up"]},{"osd":4,"uuid":"89646f3e-7cb0-46b5-b821-1fb42aeb152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":33,"last_clean_end":80,"up_from":84,"up_thru":89,"down_at":81,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6809","nonce":3662941009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6811","nonce":3662941009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6815","nonce":3662941009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6813","nonce":3662941009}]},"public_addr":"172.21.15.52:6809/3662941009","cluster_addr":"172.21.15.52:6811/3662941009","heartbeat_back_addr":"172.21.15.52:6815/3662941009","heartbeat_front_addr":"172.21.15.52:6813/3662941009","state":["exists","up"]},{"osd":5,"uuid":"bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":85,"up_from":89,"up_thru":89,"down_at":86,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6817","nonce":3875549080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6819","nonce":3875549080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6823","nonce":3875549080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6821","nonce":3875549080}]},"public_addr":"172.21.15.52:6817/3875549080","cluster_addr":"172.21.15.52:6819/3875549080","heartbeat_back_addr":"172.21.15.52:6823/3875549080","heartbeat_front_addr":"172.21.15.52:6821/3875549080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:18.340381+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:38.341916+0000","dead_epoch":65},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:58.622396+0000","dead_epoch":70},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:17.619538+0000","dead_epoch":75},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:36.860723+0000","dead_epoch":80},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:56.648279+0000","dead_epoch":85}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.7","mappings":[{"from":3,"to":0}]},{"pgid":"2.c","mappings":[{"from":3,"to":5}]},{"pgid":"2.d","mappings":[{"from":3,"to":0}]},{"pgid":"3.6","mappings":[{"from":1,"to":5}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.19","mappings":[{"from":4,"to":0},{"from":3,"to":5}]},{"pgid":"3.1a","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6800/3933945750":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/4179292729":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/2154010871":"2023-12-06T13:25:21.120470+0000","172.21.15.29:0/4099120105":"2023-12-06T13:18:27.235853+0000","172.21.15.52:6829/1600520660":"2023-12-06T13:27:11.745639+0000","172.21.15.29:6801/3933945750":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/4024738148":"2023-12-06T13:29:22.127937+0000","172.21.15.52:6828/1600520660":"2023-12-06T13:27:11.745639+0000","172.21.15.29:0/1614407330":"2023-12-06T13:25:21.120470+0000","172.21.15.29:0/2782816162":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/1756367778":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/3739271483":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/245095326":"2023-12-06T13:25:21.120470+0000","172.21.15.29:0/1009526803":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/2512512522":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1782978356":"2023-12-06T13:25:21.120470+0000","172.21.15.52:0/4242138852":"2023-12-06T13:27:11.745639+0000","172.21.15.29:0/2026205753":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6801/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.52:0/1284572029":"2023-12-06T13:27:11.745639+0000","172.21.15.29:0/599938718":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6800/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.52:0/2098048086":"2023-12-06T13:27:11.745639+0000","172.21.15.29:6801/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1222774540":"2023-12-06T13:29:22.127937+0000","172.21.15.29:6800/382423942":"2023-12-06T13:25:21.120470+0000","172.21.15.29:6801/382423942":"2023-12-06T13:25:21.120470+0000","172.21.15.29:6801/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/3972762513":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/3643035279":"2023-12-06T13:19:21.825199+0000","172.21.15.52:0/2119139219":"2023-12-06T13:27:11.745639+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T13:34:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.037+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f003806ce70 msgr2=0x7f003806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.037+0000 7f005134a700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f003806ce70 0x7f003806f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c009040 comp rx=0 tx=0).stop 2023-12-05T13:34:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.037+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 msgr2=0x7f004c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.037+0000 7f005134a700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c070480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0034009360 tx=0x7f0034009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:51.039 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 shutdown_connections 2023-12-05T13:34:51.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f003806ce70 0x7f003806f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c102cb0 0x7f004c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 --2- 172.21.15.29:0/820241790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f004c103650 0x7f004c070480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 >> 172.21.15.29:0/820241790 conn(0x7f004c0f87e0 msgr2=0x7f004c0fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:51.040 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 shutdown_connections 2023-12-05T13:34:51.041 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.038+0000 7f005134a700 1 -- 172.21.15.29:0/820241790 wait complete. 2023-12-05T13:34:51.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T13:21:02.367176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T13:22:47.619908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T13:22:48.124625+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-05T13:34:51.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T13:34:51.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 -- 172.21.15.29:0/3614324837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb284101ac0 msgr2=0x7fb284101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 --2- 172.21.15.29:0/3614324837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb284101ac0 0x7fb284101e90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb274009ce0 tx=0x7fb274004d10 comp rx=0 tx=0).stop 2023-12-05T13:34:51.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 -- 172.21.15.29:0/3614324837 shutdown_connections 2023-12-05T13:34:51.192 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 --2- 172.21.15.29:0/3614324837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2840fba80 0x7fb2840fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 --2- 172.21.15.29:0/3614324837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb284101ac0 0x7fb284101e90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 -- 172.21.15.29:0/3614324837 >> 172.21.15.29:0/3614324837 conn(0x7fb2840f7600 msgr2=0x7fb2840f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 -- 172.21.15.29:0/3614324837 shutdown_connections 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 -- 172.21.15.29:0/3614324837 wait complete. 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 Processor -- start 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.189+0000 7fb288ed3700 1 -- start start 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb288ed3700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 0x7fb284113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb288ed3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb284101ac0 0x7fb284113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb288ed3700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284113ec0 con 0x7fb2840fba80 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb288ed3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28410d3e0 con 0x7fb284101ac0 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 0x7fb284113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 0x7fb284113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33890/0 (socket says 172.21.15.29:33890) 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 -- 172.21.15.29:0/1695026364 learned_addr learned my addr 172.21.15.29:0/1695026364 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb281d9b700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb284101ac0 0x7fb284113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 -- 172.21.15.29:0/1695026364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb284101ac0 msgr2=0x7fb284113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb284101ac0 0x7fb284113870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 -- 172.21.15.29:0/1695026364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009940 con 0x7fb2840fba80 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb281d9b700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb284101ac0 0x7fb284113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb28259c700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 0x7fb284113330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb274009360 tx=0x7fb274004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27400e040 con 0x7fb2840fba80 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.190+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28410d660 con 0x7fb2840fba80 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.191+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb274004610 con 0x7fb2840fba80 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.191+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb274012b70 con 0x7fb2840fba80 2023-12-05T13:34:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.191+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28410dc20 con 0x7fb2840fba80 2023-12-05T13:34:51.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.191+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb284063ea0 con 0x7fb2840fba80 2023-12-05T13:34:51.196 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.192+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb27401c830 con 0x7fb2840fba80 2023-12-05T13:34:51.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.192+0000 7fb272ffd700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fb26c06ce60 0x7fb26c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.193+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fb27408e760 con 0x7fb2840fba80 2023-12-05T13:34:51.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.193+0000 7fb281d9b700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fb26c06ce60 0x7fb26c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.197 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.193+0000 7fb281d9b700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fb26c06ce60 0x7fb26c06f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb278004600 tx=0x7fb27800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:51.199 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.198+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb27405c080 con 0x7fb2840fba80 2023-12-05T13:34:51.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:51 smithi029 ceph-mon[217405]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:51.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:51 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/820241790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:34:51.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.408+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb284108a40 con 0x7fb2840fba80 2023-12-05T13:34:51.410 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.409+0000 7fb272ffd700 1 -- 172.21.15.29:0/1695026364 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb284108a40 con 0x7fb2840fba80 2023-12-05T13:34:51.410 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-12-05T13:34:51.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fb26c06ce60 msgr2=0x7fb26c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fb26c06ce60 0x7fb26c06f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb278004600 tx=0x7fb27800b040 comp rx=0 tx=0).stop 2023-12-05T13:34:51.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 msgr2=0x7fb284113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 0x7fb284113330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb274009360 tx=0x7fb274004d10 comp rx=0 tx=0).stop 2023-12-05T13:34:51.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 shutdown_connections 2023-12-05T13:34:51.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fb26c06ce60 0x7fb26c06f310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2840fba80 0x7fb284113330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 --2- 172.21.15.29:0/1695026364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb284101ac0 0x7fb284113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 >> 172.21.15.29:0/1695026364 conn(0x7fb2840f7600 msgr2=0x7fb284065850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:51.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 shutdown_connections 2023-12-05T13:34:51.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.411+0000 7fb288ed3700 1 -- 172.21.15.29:0/1695026364 wait complete. 2023-12-05T13:34:51.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T13:34:51.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:51 smithi052 ceph-mon[184394]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:51.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:51 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/820241790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:34:51.563 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 -- 172.21.15.29:0/380093821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 msgr2=0x7f6940102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 --2- 172.21.15.29:0/380093821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f6940102f70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6930004940 tx=0x7f6930009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 -- 172.21.15.29:0/380093821 shutdown_connections 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 --2- 172.21.15.29:0/380093821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 0x7f69400fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 --2- 172.21.15.29:0/380093821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f6940102f70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 -- 172.21.15.29:0/380093821 >> 172.21.15.29:0/380093821 conn(0x7f6940071140 msgr2=0x7f6940071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 -- 172.21.15.29:0/380093821 shutdown_connections 2023-12-05T13:34:51.564 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 -- 172.21.15.29:0/380093821 wait complete. 2023-12-05T13:34:51.565 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 Processor -- start 2023-12-05T13:34:51.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.562+0000 7f6946be8700 1 -- start start 2023-12-05T13:34:51.566 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f6946be8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 0x7f69400fc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f6946be8700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f69400fc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f6946be8700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400fcdc0 con 0x7f6940102ba0 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f6946be8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400fcf00 con 0x7f69400fb160 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f693ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f69400fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f693ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f69400fc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33912/0 (socket says 172.21.15.29:33912) 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f693ffff700 1 -- 172.21.15.29:0/1223712737 learned_addr learned my addr 172.21.15.29:0/1223712737 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f6944984700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 0x7f69400fc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.567 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f693ffff700 1 -- 172.21.15.29:0/1223712737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 msgr2=0x7f69400fc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f693ffff700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 0x7f69400fc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f693ffff700 1 -- 172.21.15.29:0/1223712737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6930005040 con 0x7f6940102ba0 2023-12-05T13:34:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.563+0000 7f6944984700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 0x7f69400fc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:34:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.564+0000 7f693ffff700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f69400fc880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6928002a50 tx=0x7f69280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:51.568 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.564+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6928007cc0 con 0x7f6940102ba0 2023-12-05T13:34:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.564+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69401197a0 con 0x7f6940102ba0 2023-12-05T13:34:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.564+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f692800f040 con 0x7f6940102ba0 2023-12-05T13:34:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.564+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6928009540 con 0x7f6940102ba0 2023-12-05T13:34:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.564+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6940119af0 con 0x7f6940102ba0 2023-12-05T13:34:51.569 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.565+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69400ffe90 con 0x7f6940102ba0 2023-12-05T13:34:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.566+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f69280096a0 con 0x7f6940102ba0 2023-12-05T13:34:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.566+0000 7f693d7fa700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f692c06ce60 0x7f692c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.566+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f692808c140 con 0x7f6940102ba0 2023-12-05T13:34:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.566+0000 7f6944984700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f692c06ce60 0x7f692c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.570 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.567+0000 7f6944984700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f692c06ce60 0x7f692c06f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6930004560 tx=0x7f6930009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:51.572 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.571+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6928055fd0 con 0x7f6940102ba0 2023-12-05T13:34:51.779 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.778+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f69400fd930 con 0x7f6940102ba0 2023-12-05T13:34:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.778+0000 7f693d7fa700 1 -- 172.21.15.29:0/1223712737 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v90) v1 ==== 107+0+11 (secure 0 0 0) 0x7f69280595f0 con 0x7f6940102ba0 2023-12-05T13:34:51.780 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-12-05T13:34:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f692c06ce60 msgr2=0x7f692c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f692c06ce60 0x7f692c06f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6930004560 tx=0x7f6930009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 msgr2=0x7f69400fc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f69400fc880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6928002a50 tx=0x7f69280046b0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 shutdown_connections 2023-12-05T13:34:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f692c06ce60 0x7f692c06f310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69400fb160 0x7f69400fc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 --2- 172.21.15.29:0/1223712737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6940102ba0 0x7f69400fc880 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 >> 172.21.15.29:0/1223712737 conn(0x7f6940071140 msgr2=0x7f69400fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 shutdown_connections 2023-12-05T13:34:51.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.781+0000 7f6946be8700 1 -- 172.21.15.29:0/1223712737 wait complete. 2023-12-05T13:34:51.797 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T13:34:51.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 -- 172.21.15.29:0/4140273274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 msgr2=0x7fa2a8101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/4140273274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8101e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa298004940 tx=0x7fa298009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 -- 172.21.15.29:0/4140273274 shutdown_connections 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/4140273274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a80fc270 0x7fa2a80fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/4140273274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8101e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 -- 172.21.15.29:0/4140273274 >> 172.21.15.29:0/4140273274 conn(0x7fa2a8071140 msgr2=0x7fa2a8071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 -- 172.21.15.29:0/4140273274 shutdown_connections 2023-12-05T13:34:51.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 -- 172.21.15.29:0/4140273274 wait complete. 2023-12-05T13:34:51.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 Processor -- start 2023-12-05T13:34:51.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.932+0000 7fa2b07d9700 1 -- start start 2023-12-05T13:34:51.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2b07d9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a80fc270 0x7fa2a81122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2b07d9700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8112830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2b07d9700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8112e80 con 0x7fa2a8101a50 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2b07d9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a810c3a0 con 0x7fa2a80fc270 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8112830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8112830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33930/0 (socket says 172.21.15.29:33930) 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 -- 172.21.15.29:0/185907513 learned_addr learned my addr 172.21.15.29:0/185907513 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2ae575700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a80fc270 0x7fa2a81122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 -- 172.21.15.29:0/185907513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a80fc270 msgr2=0x7fa2a81122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a80fc270 0x7fa2a81122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 -- 172.21.15.29:0/185907513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298005040 con 0x7fa2a8101a50 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.933+0000 7fa2add74700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8112830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400ead0 tx=0x7fa2a4004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.934+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a400cb90 con 0x7fa2a8101a50 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.934+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2a400ccf0 con 0x7fa2a8101a50 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.934+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a810c620 con 0x7fa2a8101a50 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.934+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a4010810 con 0x7fa2a8101a50 2023-12-05T13:34:51.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.934+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a810cb60 con 0x7fa2a8101a50 2023-12-05T13:34:51.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.935+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a8063ea0 con 0x7fa2a8101a50 2023-12-05T13:34:51.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.935+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa2a4010990 con 0x7fa2a8101a50 2023-12-05T13:34:51.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.936+0000 7fa29effd700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa29406ce70 0x7fa29406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:51.939 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.936+0000 7fa2ae575700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa29406ce70 0x7fa29406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:51.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.936+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fa2a408eb50 con 0x7fa2a8101a50 2023-12-05T13:34:51.940 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.937+0000 7fa2ae575700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa29406ce70 0x7fa29406f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa2980043d0 tx=0x7fa298009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:51.942 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:51.941+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa2a405c4f0 con 0x7fa2a8101a50 2023-12-05T13:34:52.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.151+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa2a8108a00 con 0x7fa2a8101a50 2023-12-05T13:34:52.153 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.152+0000 7fa29effd700 1 -- 172.21.15.29:0/185907513 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v90) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa2a400ce60 con 0x7fa2a8101a50 2023-12-05T13:34:52.153 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-12-05T13:34:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa29406ce70 msgr2=0x7fa29406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.155 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa29406ce70 0x7fa29406f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa2980043d0 tx=0x7fa298009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 msgr2=0x7fa2a8112830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8112830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400ead0 tx=0x7fa2a4004500 comp rx=0 tx=0).stop 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 shutdown_connections 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fa29406ce70 0x7fa29406f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a80fc270 0x7fa2a81122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 --2- 172.21.15.29:0/185907513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8101a50 0x7fa2a8112830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 >> 172.21.15.29:0/185907513 conn(0x7fa2a8071140 msgr2=0x7fa2a80fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:52.156 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 shutdown_connections 2023-12-05T13:34:52.157 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.154+0000 7fa2b07d9700 1 -- 172.21.15.29:0/185907513 wait complete. 2023-12-05T13:34:52.169 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-05T13:34:52.304 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 -- 172.21.15.29:0/3048446227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef8064bb0 msgr2=0x7f1ef8064f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 --2- 172.21.15.29:0/3048446227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef8064bb0 0x7f1ef8064f80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8004940 tx=0x7f1ee8009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 -- 172.21.15.29:0/3048446227 shutdown_connections 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 --2- 172.21.15.29:0/3048446227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ef80654c0 0x7f1ef81090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 --2- 172.21.15.29:0/3048446227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef8064bb0 0x7f1ef8064f80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 -- 172.21.15.29:0/3048446227 >> 172.21.15.29:0/3048446227 conn(0x7f1ef8071970 msgr2=0x7f1ef8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 -- 172.21.15.29:0/3048446227 shutdown_connections 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 -- 172.21.15.29:0/3048446227 wait complete. 2023-12-05T13:34:52.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 Processor -- start 2023-12-05T13:34:52.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.303+0000 7f1efe022700 1 -- start start 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1efe022700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ef8064bb0 0x7f1ef8115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1efe022700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 0x7f1ef8115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1efe022700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8115fc0 con 0x7f1ef80654c0 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1efe022700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef810f520 con 0x7f1ef8064bb0 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 0x7f1ef8115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 0x7f1ef8115970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33938/0 (socket says 172.21.15.29:33938) 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 -- 172.21.15.29:0/3176782310 learned_addr learned my addr 172.21.15.29:0/3176782310 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:52.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef77fe700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ef8064bb0 0x7f1ef8115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 -- 172.21.15.29:0/3176782310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ef8064bb0 msgr2=0x7f1ef8115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ef8064bb0 0x7f1ef8115430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 -- 172.21.15.29:0/3176782310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8005040 con 0x7f1ef80654c0 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1ef6ffd700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 0x7f1ef8115970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00eb40 tx=0x7f1eec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.304+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eec007cc0 con 0x7f1ef80654c0 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.305+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1eec00f040 con 0x7f1ef80654c0 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.305+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef810f7a0 con 0x7f1ef80654c0 2023-12-05T13:34:52.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.305+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eec00c990 con 0x7f1ef80654c0 2023-12-05T13:34:52.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.305+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef810fd60 con 0x7f1ef80654c0 2023-12-05T13:34:52.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.306+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef8106800 con 0x7f1ef80654c0 2023-12-05T13:34:52.310 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.306+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1eec00caf0 con 0x7f1ef80654c0 2023-12-05T13:34:52.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.307+0000 7f1edffff700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ee006ce70 0x7f1ee006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:52.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.307+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f1eec08be40 con 0x7f1ef80654c0 2023-12-05T13:34:52.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.307+0000 7f1ef77fe700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ee006ce70 0x7f1ee006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:52.311 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.307+0000 7f1ef77fe700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ee006ce70 0x7f1ee006f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009fd0 tx=0x7f1ee8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:52.312 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.311+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1eec055e00 con 0x7f1ef80654c0 2023-12-05T13:34:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:52 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1695026364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:34:52.353 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:52 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1223712737' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T13:34:52.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:52 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1695026364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:34:52.474 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:52 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1223712737' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T13:34:52.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.539+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1ef8064730 con 0x7f1ef80654c0 2023-12-05T13:34:52.541 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.540+0000 7f1edffff700 1 -- 172.21.15.29:0/3176782310 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v90) v1 ==== 81+0+1942 (secure 0 0 0) 0x7f1eec0197b0 con 0x7f1ef80654c0 2023-12-05T13:34:52.541 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/3933945750 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4179292729 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2154010871 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4099120105 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:6829/1600520660 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/3933945750 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4024738148 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:52.542 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:6828/1600520660 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1614407330 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2782816162 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1756367778 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3739271483 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/245095326 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1009526803 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2512512522 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:52.543 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1314397446 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1782978356 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/4242138852 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2026205753 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/477452197 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/525299250 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/1284572029 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/599938718 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/525299250 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/2098048086 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1314397446 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1222774540 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/382423942 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/382423942 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/477452197 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3972762513 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3643035279 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:52.546 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/2119139219 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ee006ce70 msgr2=0x7f1ee006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ee006ce70 0x7f1ee006f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009fd0 tx=0x7f1ee8009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 msgr2=0x7f1ef8115970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 0x7f1ef8115970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00eb40 tx=0x7f1eec00b040 comp rx=0 tx=0).stop 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 shutdown_connections 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f1ee006ce70 0x7f1ee006f320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ef8064bb0 0x7f1ef8115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.547 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 --2- 172.21.15.29:0/3176782310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ef80654c0 0x7f1ef8115970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 >> 172.21.15.29:0/3176782310 conn(0x7f1ef8071970 msgr2=0x7f1ef80fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:52.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.542+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 shutdown_connections 2023-12-05T13:34:52.548 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.543+0000 7f1efe022700 1 -- 172.21.15.29:0/3176782310 wait complete. 2023-12-05T13:34:52.548 INFO:teuthology.orchestra.run.smithi029.stderr:listed 33 entries 2023-12-05T13:34:52.558 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-05T13:34:52.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:52.558 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-05T13:34:52.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:34:52.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:52.602 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-05T13:34:52.659 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:34:52.660 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T13:34:52.767 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-12-05T13:34:52.767 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T13:34:52.794 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T13:34:52.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 -- 172.21.15.29:0/3441798668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 msgr2=0x7fe81c0fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 --2- 172.21.15.29:0/3441798668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c0fb530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe80c004940 tx=0x7fe80c009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 -- 172.21.15.29:0/3441798668 shutdown_connections 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 --2- 172.21.15.29:0/3441798668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c0fb530 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 --2- 172.21.15.29:0/3441798668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe81c0fd870 0x7fe81c0fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 -- 172.21.15.29:0/3441798668 >> 172.21.15.29:0/3441798668 conn(0x7fe81c071140 msgr2=0x7fe81c071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 -- 172.21.15.29:0/3441798668 shutdown_connections 2023-12-05T13:34:52.931 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 -- 172.21.15.29:0/3441798668 wait complete. 2023-12-05T13:34:52.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 Processor -- start 2023-12-05T13:34:52.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.929+0000 7fe82409b700 1 -- start start 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe82409b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c1154d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe82409b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe81c0fd870 0x7fe81c115a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe82409b700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c116060 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe82409b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c10f5a0 con 0x7fe81c0fd870 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c1154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c1154d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33954/0 (socket says 172.21.15.29:33954) 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 -- 172.21.15.29:0/3689205778 learned_addr learned my addr 172.21.15.29:0/3689205778 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:52.934 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821636700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe81c0fd870 0x7fe81c115a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 -- 172.21.15.29:0/3689205778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe81c0fd870 msgr2=0x7fe81c115a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe81c0fd870 0x7fe81c115a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 -- 172.21.15.29:0/3689205778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c005040 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe821e37700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c1154d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe818002a50 tx=0x7fe8180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe818007cc0 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe81800f040 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe818009540 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c10f880 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.930+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c10fdc0 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.932+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c106f70 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.932+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe8180096a0 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.936 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.933+0000 7fe8127fc700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe80806ce70 0x7fe80806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:52.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.933+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7fe81808c030 con 0x7fe81c0fb0c0 2023-12-05T13:34:52.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.933+0000 7fe821636700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe80806ce70 0x7fe80806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:52.937 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.933+0000 7fe821636700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe80806ce70 0x7fe80806f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00b3b0 tx=0x7fe80c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:52.938 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:52.937+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe8180599d0 con 0x7fe81c0fb0c0 2023-12-05T13:34:53.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:53 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/185907513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T13:34:53.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:53 smithi029 ceph-mon[217405]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:53.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:53 smithi029 ceph-mon[217405]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:53.104 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:53 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3176782310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T13:34:53.147 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.145+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81c110b90 con 0x7fe81c0fb0c0 2023-12-05T13:34:53.148 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.147+0000 7fe8127fc700 1 -- 172.21.15.29:0/3689205778 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16464 (secure 0 0 0) 0x7fe818059560 con 0x7fe81c0fb0c0 2023-12-05T13:34:53.148 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-12-05T13:34:53.149 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":90,"fsid":"34f4f484-9370-11ee-95a2-87774f69a715","created":"2023-12-05T13:17:36.045441+0000","modified":"2023-12-05T13:33:06.780287+0000","last_up_change":"2023-12-05T13:33:05.778439+0000","last_in_change":"2023-12-05T13:21:41.541471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T13:21:02.367176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T13:22:47.619908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T13:22:48.124625+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc29bb5c-04bc-4518-a111-9d849c4f0d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":59,"up_thru":89,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6803","nonce":1409984533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6805","nonce":1409984533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6809","nonce":1409984533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1409984533},{"type":"v1","addr":"172.21.15.29:6807","nonce":1409984533}]},"public_addr":"172.21.15.29:6803/1409984533","cluster_addr":"172.21.15.29:6805/1409984533","heartbeat_back_addr":"172.21.15.29:6809/1409984533","heartbeat_front_addr":"172.21.15.29:6807/1409984533","state":["exists","up"]},{"osd":1,"uuid":"3a6e62e0-e01c-442e-9edc-e84c329ccd13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":65,"up_from":69,"up_thru":89,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6811","nonce":3920482260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6813","nonce":3920482260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6817","nonce":3920482260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3920482260},{"type":"v1","addr":"172.21.15.29:6815","nonce":3920482260}]},"public_addr":"172.21.15.29:6811/3920482260","cluster_addr":"172.21.15.29:6813/3920482260","heartbeat_back_addr":"172.21.15.29:6817/3920482260","heartbeat_front_addr":"172.21.15.29:6815/3920482260","state":["exists","up"]},{"osd":2,"uuid":"3002b9e9-bd72-42cc-ae96-94d56978a07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":70,"up_from":74,"up_thru":89,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6819","nonce":707404259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6821","nonce":707404259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6825","nonce":707404259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":707404259},{"type":"v1","addr":"172.21.15.29:6823","nonce":707404259}]},"public_addr":"172.21.15.29:6819/707404259","cluster_addr":"172.21.15.29:6821/707404259","heartbeat_back_addr":"172.21.15.29:6825/707404259","heartbeat_front_addr":"172.21.15.29:6823/707404259","state":["exists","up"]},{"osd":3,"uuid":"e250cbd9-ad56-4a7b-babf-fdb3cabab073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":75,"up_from":79,"up_thru":89,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6801","nonce":3322939945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6803","nonce":3322939945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6807","nonce":3322939945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":3322939945},{"type":"v1","addr":"172.21.15.52:6805","nonce":3322939945}]},"public_addr":"172.21.15.52:6801/3322939945","cluster_addr":"172.21.15.52:6803/3322939945","heartbeat_back_addr":"172.21.15.52:6807/3322939945","heartbeat_front_addr":"172.21.15.52:6805/3322939945","state":["exists","up"]},{"osd":4,"uuid":"89646f3e-7cb0-46b5-b821-1fb42aeb152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":33,"last_clean_end":80,"up_from":84,"up_thru":89,"down_at":81,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6809","nonce":3662941009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6811","nonce":3662941009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6815","nonce":3662941009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3662941009},{"type":"v1","addr":"172.21.15.52:6813","nonce":3662941009}]},"public_addr":"172.21.15.52:6809/3662941009","cluster_addr":"172.21.15.52:6811/3662941009","heartbeat_back_addr":"172.21.15.52:6815/3662941009","heartbeat_front_addr":"172.21.15.52:6813/3662941009","state":["exists","up"]},{"osd":5,"uuid":"bdcc6bfc-c5c7-445d-90a5-d11c9e9fbe7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":85,"up_from":89,"up_thru":89,"down_at":86,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6817","nonce":3875549080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6819","nonce":3875549080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6823","nonce":3875549080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3875549080},{"type":"v1","addr":"172.21.15.52:6821","nonce":3875549080}]},"public_addr":"172.21.15.52:6817/3875549080","cluster_addr":"172.21.15.52:6819/3875549080","heartbeat_back_addr":"172.21.15.52:6823/3875549080","heartbeat_front_addr":"172.21.15.52:6821/3875549080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:18.340381+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:38.341916+0000","dead_epoch":65},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:20:58.622396+0000","dead_epoch":70},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:17.619538+0000","dead_epoch":75},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:36.860723+0000","dead_epoch":80},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T13:21:56.648279+0000","dead_epoch":85}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.7","mappings":[{"from":3,"to":0}]},{"pgid":"2.c","mappings":[{"from":3,"to":5}]},{"pgid":"2.d","mappings":[{"from":3,"to":0}]},{"pgid":"3.6","mappings":[{"from":1,"to":5}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.19","mappings":[{"from":4,"to":0},{"from":3,"to":5}]},{"pgid":"3.1a","mappings":[{"from":4,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:6800/3933945750":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/4179292729":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/2154010871":"2023-12-06T13:25:21.120470+0000","172.21.15.29:0/4099120105":"2023-12-06T13:18:27.235853+0000","172.21.15.52:6829/1600520660":"2023-12-06T13:27:11.745639+0000","172.21.15.29:6801/3933945750":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/4024738148":"2023-12-06T13:29:22.127937+0000","172.21.15.52:6828/1600520660":"2023-12-06T13:27:11.745639+0000","172.21.15.29:0/1614407330":"2023-12-06T13:25:21.120470+0000","172.21.15.29:0/2782816162":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/1756367778":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/3739271483":"2023-12-06T13:29:22.127937+0000","172.21.15.29:0/245095326":"2023-12-06T13:25:21.120470+0000","172.21.15.29:0/1009526803":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/2512512522":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1782978356":"2023-12-06T13:25:21.120470+0000","172.21.15.52:0/4242138852":"2023-12-06T13:27:11.745639+0000","172.21.15.29:0/2026205753":"2023-12-06T13:19:21.825199+0000","172.21.15.29:6800/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:6801/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.52:0/1284572029":"2023-12-06T13:27:11.745639+0000","172.21.15.29:0/599938718":"2023-12-06T13:18:00.216177+0000","172.21.15.29:6800/525299250":"2023-12-06T13:19:21.825199+0000","172.21.15.52:0/2098048086":"2023-12-06T13:27:11.745639+0000","172.21.15.29:6801/1314397446":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/1222774540":"2023-12-06T13:29:22.127937+0000","172.21.15.29:6800/382423942":"2023-12-06T13:25:21.120470+0000","172.21.15.29:6801/382423942":"2023-12-06T13:25:21.120470+0000","172.21.15.29:6801/477452197":"2023-12-06T13:18:27.235853+0000","172.21.15.29:0/3972762513":"2023-12-06T13:18:00.216177+0000","172.21.15.29:0/3643035279":"2023-12-06T13:19:21.825199+0000","172.21.15.52:0/2119139219":"2023-12-06T13:27:11.745639+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T13:34:53.150 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe80806ce70 msgr2=0x7fe80806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe80806ce70 0x7fe80806f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00b3b0 tx=0x7fe80c009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 msgr2=0x7fe81c1154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c1154d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe818002a50 tx=0x7fe8180046b0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 shutdown_connections 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7fe80806ce70 0x7fe80806f320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe81c0fb0c0 0x7fe81c1154d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 --2- 172.21.15.29:0/3689205778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe81c0fd870 0x7fe81c115a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.151 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 >> 172.21.15.29:0/3689205778 conn(0x7fe81c071140 msgr2=0x7fe81c0f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 shutdown_connections 2023-12-05T13:34:53.152 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.149+0000 7fe82409b700 1 -- 172.21.15.29:0/3689205778 wait complete. 2023-12-05T13:34:53.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T13:21:02.367176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T13:22:47.619908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T13:22:48.124625+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-05T13:34:53.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T13:34:53.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 -- 172.21.15.29:0/412102197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60241034e0 msgr2=0x7f60240fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 --2- 172.21.15.29:0/412102197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60241034e0 0x7f60240fcb50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6020004940 tx=0x7f6020009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 -- 172.21.15.29:0/412102197 shutdown_connections 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 --2- 172.21.15.29:0/412102197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60241034e0 0x7f60240fcb50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 --2- 172.21.15.29:0/412102197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6024102b40 0x7f6024102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 -- 172.21.15.29:0/412102197 >> 172.21.15.29:0/412102197 conn(0x7f60240f86d0 msgr2=0x7f60240faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 -- 172.21.15.29:0/412102197 shutdown_connections 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.299+0000 7f602b93f700 1 -- 172.21.15.29:0/412102197 wait complete. 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f602b93f700 1 Processor -- start 2023-12-05T13:34:53.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f602b93f700 1 -- start start 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f602b93f700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 0x7f6024113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f602b93f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60241034e0 0x7f60241138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f602b93f700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024113ef0 con 0x7f6024102b40 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f602b93f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602410d410 con 0x7f60241034e0 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f60296db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 0x7f6024113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f60296db700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 0x7f6024113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33978/0 (socket says 172.21.15.29:33978) 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.300+0000 7f60296db700 1 -- 172.21.15.29:0/1638511880 learned_addr learned my addr 172.21.15.29:0/1638511880 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:53.305 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f6028eda700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60241034e0 0x7f60241138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f60296db700 1 -- 172.21.15.29:0/1638511880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60241034e0 msgr2=0x7f60241138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f60296db700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60241034e0 0x7f60241138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f60296db700 1 -- 172.21.15.29:0/1638511880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020005040 con 0x7f6024102b40 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f6028eda700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60241034e0 0x7f60241138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f60296db700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 0x7f6024113360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f601400c830 tx=0x7f6014004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601400a760 con 0x7f6024102b40 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602410d6f0 con 0x7f6024102b40 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f601400ad70 con 0x7f6024102b40 2023-12-05T13:34:53.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60140113a0 con 0x7f6024102b40 2023-12-05T13:34:53.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.301+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602410dcb0 con 0x7f6024102b40 2023-12-05T13:34:53.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.302+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6024105010 con 0x7f6024102b40 2023-12-05T13:34:53.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.303+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6014012400 con 0x7f6024102b40 2023-12-05T13:34:53.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.303+0000 7f6019ffb700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f601006ce60 0x7f601006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:53.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.303+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f601408c360 con 0x7f6024102b40 2023-12-05T13:34:53.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.303+0000 7f6028eda700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f601006ce60 0x7f601006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:53.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.304+0000 7f6028eda700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f601006ce60 0x7f601006f310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6020009fd0 tx=0x7f6020009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:53.309 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.308+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6014059d00 con 0x7f6024102b40 2023-12-05T13:34:53.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:53 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/185907513' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T13:34:53.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:53 smithi052 ceph-mon[184394]: from='mgr.34104 172.21.15.29:0/590835331' entity='mgr.smithi029.eekhlu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T13:34:53.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:53 smithi052 ceph-mon[184394]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:53.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:53 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3176782310' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T13:34:53.518 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.517+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f602410e940 con 0x7f6024102b40 2023-12-05T13:34:53.519 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.518+0000 7f6019ffb700 1 -- 172.21.15.29:0/1638511880 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6014059890 con 0x7f6024102b40 2023-12-05T13:34:53.519 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2023-12-05T13:34:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f601006ce60 msgr2=0x7f601006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f601006ce60 0x7f601006f310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6020009fd0 tx=0x7f6020009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 msgr2=0x7f6024113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 0x7f6024113360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f601400c830 tx=0x7f6014004470 comp rx=0 tx=0).stop 2023-12-05T13:34:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 shutdown_connections 2023-12-05T13:34:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f601006ce60 0x7f601006f310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6024102b40 0x7f6024113360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 --2- 172.21.15.29:0/1638511880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60241034e0 0x7f60241138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 >> 172.21.15.29:0/1638511880 conn(0x7f60240f86d0 msgr2=0x7f60240fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:53.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 shutdown_connections 2023-12-05T13:34:53.523 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.520+0000 7f602b93f700 1 -- 172.21.15.29:0/1638511880 wait complete. 2023-12-05T13:34:53.536 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T13:34:53.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 -- 172.21.15.29:0/3372623533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fdba0 msgr2=0x7f60500fdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 --2- 172.21.15.29:0/3372623533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fdba0 0x7f60500fdf70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f604c004940 tx=0x7f604c009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:53.673 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 -- 172.21.15.29:0/3372623533 shutdown_connections 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 --2- 172.21.15.29:0/3372623533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fe540 0x7f6050106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 --2- 172.21.15.29:0/3372623533 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fdba0 0x7f60500fdf70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 -- 172.21.15.29:0/3372623533 >> 172.21.15.29:0/3372623533 conn(0x7f60500f75f0 msgr2=0x7f60500f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 -- 172.21.15.29:0/3372623533 shutdown_connections 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 -- 172.21.15.29:0/3372623533 wait complete. 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 Processor -- start 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.670+0000 7f6057ba1700 1 -- start start 2023-12-05T13:34:53.674 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f6057ba1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fdba0 0x7f6050113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f6057ba1700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 0x7f60501138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f6057ba1700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050113f10 con 0x7f60500fe540 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f6057ba1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605010d430 con 0x7f60500fdba0 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 0x7f60501138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 0x7f60501138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34004/0 (socket says 172.21.15.29:34004) 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 -- 172.21.15.29:0/2111744654 learned_addr learned my addr 172.21.15.29:0/2111744654 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605593d700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fdba0 0x7f6050113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 -- 172.21.15.29:0/2111744654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fdba0 msgr2=0x7f6050113380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.675 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fdba0 0x7f6050113380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 -- 172.21.15.29:0/2111744654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c005040 con 0x7f60500fe540 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605593d700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fdba0 0x7f6050113380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f605513c700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 0x7f60501138c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f604000c8c0 tx=0x7f60400044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f604000a980 con 0x7f60500fe540 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f604000ce60 con 0x7f60500fe540 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60400113a0 con 0x7f60500fe540 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.671+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605010d710 con 0x7f60500fe540 2023-12-05T13:34:53.676 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.672+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605010dc50 con 0x7f60500fe540 2023-12-05T13:34:53.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.673+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6050104190 con 0x7f60500fe540 2023-12-05T13:34:53.677 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.673+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6040012400 con 0x7f60500fe540 2023-12-05T13:34:53.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.673+0000 7f60467fc700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f603c06ce70 0x7f603c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:53.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.674+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f604008c430 con 0x7f60500fe540 2023-12-05T13:34:53.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.674+0000 7f605593d700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f603c06ce70 0x7f603c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:53.678 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.674+0000 7f605593d700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f603c06ce70 0x7f603c06f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b840 tx=0x7f604c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:53.679 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.678+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6040059dd0 con 0x7f60500fe540 2023-12-05T13:34:53.891 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.889+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6050063ea0 con 0x7f60500fe540 2023-12-05T13:34:53.892 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.890+0000 7f60467fc700 1 -- 172.21.15.29:0/2111744654 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v90) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6040059960 con 0x7f60500fe540 2023-12-05T13:34:53.892 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-12-05T13:34:53.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f603c06ce70 msgr2=0x7f603c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f603c06ce70 0x7f603c06f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b840 tx=0x7f604c009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:53.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 msgr2=0x7f60501138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:53.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 0x7f60501138c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f604000c8c0 tx=0x7f60400044c0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.894 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 shutdown_connections 2023-12-05T13:34:53.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f603c06ce70 0x7f603c06f320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60500fdba0 0x7f6050113380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 --2- 172.21.15.29:0/2111744654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60500fe540 0x7f60501138c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:53.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 >> 172.21.15.29:0/2111744654 conn(0x7f60500f75f0 msgr2=0x7f6050101310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:53.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 shutdown_connections 2023-12-05T13:34:53.895 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:53.892+0000 7f6057ba1700 1 -- 172.21.15.29:0/2111744654 wait complete. 2023-12-05T13:34:53.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T13:34:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 -- 172.21.15.29:0/406441156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 msgr2=0x7f7128102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 --2- 172.21.15.29:0/406441156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f7128102f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7118004940 tx=0x7f7118009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:54.043 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 -- 172.21.15.29:0/406441156 shutdown_connections 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 --2- 172.21.15.29:0/406441156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128064bb0 0x7f7128065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 --2- 172.21.15.29:0/406441156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f7128102f80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 -- 172.21.15.29:0/406441156 >> 172.21.15.29:0/406441156 conn(0x7f7128071970 msgr2=0x7f7128071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 -- 172.21.15.29:0/406441156 shutdown_connections 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.041+0000 7f712ece4700 1 -- 172.21.15.29:0/406441156 wait complete. 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.042+0000 7f712ece4700 1 Processor -- start 2023-12-05T13:34:54.044 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.042+0000 7f712ece4700 1 -- start start 2023-12-05T13:34:54.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.042+0000 7f712ece4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128064bb0 0x7f71280fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:54.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.042+0000 7f712ece4700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f71280fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:54.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.042+0000 7f712ece4700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280fc5b0 con 0x7f7128102bb0 2023-12-05T13:34:54.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.042+0000 7f712ece4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280fc6f0 con 0x7f7128064bb0 2023-12-05T13:34:54.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f71280fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:54.047 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f71280fc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34022/0 (socket says 172.21.15.29:34022) 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 -- 172.21.15.29:0/1835400925 learned_addr learned my addr 172.21.15.29:0/1835400925 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f712ca80700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128064bb0 0x7f71280fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 -- 172.21.15.29:0/1835400925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128064bb0 msgr2=0x7f71280fbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128064bb0 0x7f71280fbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 -- 172.21.15.29:0/1835400925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118005040 con 0x7f7128102bb0 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f7127fff700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f71280fc070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7110002a80 tx=0x7f71100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7110007cc0 con 0x7f7128102bb0 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f711000f040 con 0x7f7128102bb0 2023-12-05T13:34:54.048 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7128119750 con 0x7f7128102bb0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711000da60 con 0x7f7128102bb0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.043+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7128119aa0 con 0x7f7128102bb0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.044+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7128064730 con 0x7f7128102bb0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.045+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f711000dbc0 con 0x7f7128102bb0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.045+0000 7f71257fa700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f711406ce70 0x7f711406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.045+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f711008bfe0 con 0x7f7128102bb0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.045+0000 7f712ca80700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f711406ce70 0x7f711406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:54.049 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.046+0000 7f712ca80700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f711406ce70 0x7f711406f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f711800b3b0 tx=0x7f7118009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:54.051 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.050+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7110055e10 con 0x7f7128102bb0 2023-12-05T13:34:54.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.259+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f7128109ab0 con 0x7f7128102bb0 2023-12-05T13:34:54.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.260+0000 7f71257fa700 1 -- 172.21.15.29:0/1835400925 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v90) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7110059430 con 0x7f7128102bb0 2023-12-05T13:34:54.262 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f711406ce70 msgr2=0x7f711406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f711406ce70 0x7f711406f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f711800b3b0 tx=0x7f7118009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 msgr2=0x7f71280fc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f71280fc070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7110002a80 tx=0x7f71100046b0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 shutdown_connections 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f711406ce70 0x7f711406f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7128064bb0 0x7f71280fbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 --2- 172.21.15.29:0/1835400925 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7128102bb0 0x7f71280fc070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 >> 172.21.15.29:0/1835400925 conn(0x7f7128071970 msgr2=0x7f71280fa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:54.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 shutdown_connections 2023-12-05T13:34:54.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.262+0000 7f712ece4700 1 -- 172.21.15.29:0/1835400925 wait complete. 2023-12-05T13:34:54.276 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:54 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/3689205778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:34:54.276 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:54 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1638511880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:34:54.277 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:54 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/2111744654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T13:34:54.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 -- 172.21.15.29:0/4005334717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 msgr2=0x7f80340fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 --2- 172.21.15.29:0/4005334717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80340fba60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f801c004940 tx=0x7f801c009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 -- 172.21.15.29:0/4005334717 shutdown_connections 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 --2- 172.21.15.29:0/4005334717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80340fba60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 --2- 172.21.15.29:0/4005334717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8034101ac0 0x7f8034101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 -- 172.21.15.29:0/4005334717 >> 172.21.15.29:0/4005334717 conn(0x7f8034071970 msgr2=0x7f8034071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:54.412 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 -- 172.21.15.29:0/4005334717 shutdown_connections 2023-12-05T13:34:54.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 -- 172.21.15.29:0/4005334717 wait complete. 2023-12-05T13:34:54.413 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.410+0000 7f80394bf700 1 Processor -- start 2023-12-05T13:34:54.414 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f80394bf700 1 -- start start 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f80394bf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8034101ac0 0x7f80341133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f80394bf700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80341138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f80394bf700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8034113f40 con 0x7f80341023d0 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f80394bf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803410d460 con 0x7f8034101ac0 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f802a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80341138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f802a7fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80341138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34046/0 (socket says 172.21.15.29:34046) 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f802a7fc700 1 -- 172.21.15.29:0/1450902952 learned_addr learned my addr 172.21.15.29:0/1450902952 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f8032ffd700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8034101ac0 0x7f80341133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:54.415 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f802a7fc700 1 -- 172.21.15.29:0/1450902952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8034101ac0 msgr2=0x7f80341133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f802a7fc700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8034101ac0 0x7f80341133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.411+0000 7f802a7fc700 1 -- 172.21.15.29:0/1450902952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c005040 con 0x7f80341023d0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.412+0000 7f802a7fc700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80341138f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f801c009180 tx=0x7f801c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.412+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f801c00e040 con 0x7f80341023d0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.412+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f801c013420 con 0x7f80341023d0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.412+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803410d6e0 con 0x7f80341023d0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.412+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f801c01c630 con 0x7f80341023d0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.412+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803410dc20 con 0x7f80341023d0 2023-12-05T13:34:54.416 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.413+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8034064730 con 0x7f80341023d0 2023-12-05T13:34:54.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.413+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 41) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f801c0139c0 con 0x7f80341023d0 2023-12-05T13:34:54.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.414+0000 7f802bfff700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f802006ce70 0x7f802006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T13:34:54.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.414+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6482+0+0 (secure 0 0 0) 0x7f801c08d600 con 0x7f80341023d0 2023-12-05T13:34:54.417 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.414+0000 7f8032ffd700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f802006ce70 0x7f802006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T13:34:54.418 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.414+0000 7f8032ffd700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f802006ce70 0x7f802006f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f80240041d0 tx=0x7f80240043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T13:34:54.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.419+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f801c05afa0 con 0x7f80341023d0 2023-12-05T13:34:54.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:54 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/3689205778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T13:34:54.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:54 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1638511880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T13:34:54.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:54 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/2111744654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T13:34:54.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.645+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80341089f0 con 0x7f80341023d0 2023-12-05T13:34:54.647 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.645+0000 7f802bfff700 1 -- 172.21.15.29:0/1450902952 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v90) v1 ==== 81+0+1942 (secure 0 0 0) 0x7f80341089f0 con 0x7f80341023d0 2023-12-05T13:34:54.647 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/3933945750 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4179292729 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2154010871 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4099120105 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:6829/1600520660 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/3933945750 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4024738148 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:6828/1600520660 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:54.648 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1614407330 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2782816162 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1756367778 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3739271483 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/245095326 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1009526803 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2512512522 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1314397446 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:54.649 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1782978356 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/4242138852 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/2026205753 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/477452197 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/525299250 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/1284572029 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/599938718 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/525299250 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/2098048086 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:54.650 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1314397446 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1222774540 2023-12-06T13:29:22.127937+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/382423942 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/382423942 2023-12-06T13:25:21.120470+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/477452197 2023-12-06T13:18:27.235853+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3972762513 2023-12-06T13:18:00.216177+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3643035279 2023-12-06T13:19:21.825199+0000 2023-12-05T13:34:54.651 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.52:0/2119139219 2023-12-06T13:27:11.745639+0000 2023-12-05T13:34:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f802006ce70 msgr2=0x7f802006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f802006ce70 0x7f802006f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f80240041d0 tx=0x7f80240043c0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 msgr2=0x7f80341138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T13:34:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80341138f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f801c009180 tx=0x7f801c009e30 comp rx=0 tx=0).stop 2023-12-05T13:34:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 shutdown_connections 2023-12-05T13:34:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:6800/1764792763,v1:172.21.15.29:6801/1764792763] conn(0x7f802006ce70 0x7f802006f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8034101ac0 0x7f80341133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 --2- 172.21.15.29:0/1450902952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80341023d0 0x7f80341138f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T13:34:54.653 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 >> 172.21.15.29:0/1450902952 conn(0x7f8034071970 msgr2=0x7f80340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T13:34:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 shutdown_connections 2023-12-05T13:34:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:2023-12-05T13:34:54.648+0000 7f80394bf700 1 -- 172.21.15.29:0/1450902952 wait complete. 2023-12-05T13:34:54.654 INFO:teuthology.orchestra.run.smithi029.stderr:listed 33 entries 2023-12-05T13:34:54.663 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-05T13:34:54.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:54.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-05T13:34:54.715 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2023-12-05T13:34:54.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:54.715 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-05T13:34:54.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:54.779 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-12-05T13:34:54.892 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-05T13:34:54.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:54.893 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-05T13:34:54.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:54.942 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-12-05T13:34:55.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:55.019 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2023-12-05T13:34:55.043 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-05T13:34:55.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:55.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-05T13:34:55.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T13:34:55.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2023-12-05T13:34:55.223 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-05T13:34:55.234 INFO:tasks.cephadm:Teardown begin 2023-12-05T13:34:55.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:34:55.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1835400925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T13:34:55.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 ceph-mon[217405]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:55.270 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 ceph-mon[217405]: from='client.? 172.21.15.29:0/1450902952' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T13:34:55.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:34:55.312 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-05T13:34:55.313 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-05T13:34:55.337 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-05T13:34:55.376 INFO:tasks.cephadm:Stopping all daemons... 2023-12-05T13:34:55.376 INFO:tasks.cephadm.mon.smithi029:Stopping mon.smithi029... 2023-12-05T13:34:55.376 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029 2023-12-05T13:34:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:55 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1835400925' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T13:34:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:55 smithi052 ceph-mon[184394]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 781 MiB used, 536 GiB / 536 GiB avail 2023-12-05T13:34:55.473 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:55 smithi052 ceph-mon[184394]: from='client.? 172.21.15.29:0/1450902952' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T13:34:55.603 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 systemd[1]: Stopping Ceph mon.smithi029 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:34:56.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[217382]: 2023-12-05T13:34:55.615+0000 7f1170f0e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi029 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:34:56.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029[217382]: 2023-12-05T13:34:55.615+0000 7f1170f0e700 -1 mon.smithi029@0(leader) e3 *** Got Signal Terminated *** 2023-12-05T13:34:56.103 INFO:journalctl@ceph.mon.smithi029.smithi029.stdout:Dec 05 13:34:55 smithi029 bash[256396]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi029 2023-12-05T13:34:56.193 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi029.service' 2023-12-05T13:34:56.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:34:56.242 INFO:tasks.cephadm.mon.smithi029:Stopped mon.smithi029 2023-12-05T13:34:56.242 INFO:tasks.cephadm.mon.smithi052:Stopping mon.smithi052... 2023-12-05T13:34:56.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi052 2023-12-05T13:34:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:56 smithi052 systemd[1]: Stopping Ceph mon.smithi052 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:34:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:56 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052[184371]: 2023-12-05T13:34:56.484+0000 7fece5778700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi052 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:34:56.723 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:56 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052[184371]: 2023-12-05T13:34:56.484+0000 7fece5778700 -1 mon.smithi052@1(peon) e3 *** Got Signal Terminated *** 2023-12-05T13:34:57.113 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Dec 05 13:34:56 smithi052 bash[215474]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-mon-smithi052 2023-12-05T13:34:57.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@mon.smithi052.service' 2023-12-05T13:34:57.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:34:57.178 INFO:tasks.cephadm.mon.smithi052:Stopped mon.smithi052 2023-12-05T13:34:57.178 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-05T13:34:57.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.0 2023-12-05T13:34:57.603 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:34:57 smithi029 systemd[1]: Stopping Ceph osd.0 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:34:57.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:34:57 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:34:57.402+0000 7ff123337700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:34:57.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:34:57 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:34:57.402+0000 7ff123337700 -1 osd.0 90 *** Got signal Terminated *** 2023-12-05T13:34:57.604 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:34:57 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0[232471]: 2023-12-05T13:34:57.402+0000 7ff123337700 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:35:03.353 INFO:journalctl@ceph.osd.0.smithi029.stdout:Dec 05 13:35:03 smithi029 bash[256551]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-0 2023-12-05T13:35:04.368 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.0.service' 2023-12-05T13:35:04.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:35:04.421 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-05T13:35:04.421 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-05T13:35:04.421 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.1 2023-12-05T13:35:04.656 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:35:04 smithi029 systemd[1]: Stopping Ceph osd.1 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:35:05.045 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:35:04 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:35:04.655+0000 7fb618883700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:35:05.045 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:35:04 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:35:04.655+0000 7fb618883700 -1 osd.1 90 *** Got signal Terminated *** 2023-12-05T13:35:05.045 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:35:04 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1[239849]: 2023-12-05T13:35:04.655+0000 7fb618883700 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:35:10.604 INFO:journalctl@ceph.osd.1.smithi029.stdout:Dec 05 13:35:10 smithi029 bash[256822]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-1 2023-12-05T13:35:11.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.1.service' 2023-12-05T13:35:11.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:35:11.696 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-05T13:35:11.697 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-05T13:35:11.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.2 2023-12-05T13:35:11.940 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:35:11 smithi029 systemd[1]: Stopping Ceph osd.2 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:35:12.353 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:35:11 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:35:11.939+0000 7fa65ebe9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:35:12.354 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:35:11 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:35:11.939+0000 7fa65ebe9700 -1 osd.2 90 *** Got signal Terminated *** 2023-12-05T13:35:12.354 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:35:11 smithi029 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2[246483]: 2023-12-05T13:35:11.939+0000 7fa65ebe9700 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:35:17.854 INFO:journalctl@ceph.osd.2.smithi029.stdout:Dec 05 13:35:17 smithi029 bash[257082]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-2 2023-12-05T13:35:19.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.2.service' 2023-12-05T13:35:19.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:35:19.295 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-05T13:35:19.295 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-05T13:35:19.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.3 2023-12-05T13:35:19.723 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:19 smithi052 systemd[1]: Stopping Ceph osd.3 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:35:19.723 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:19 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:35:19.556+0000 7fab4cf19700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:35:19.723 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:19 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:35:19.556+0000 7fab4cf19700 -1 osd.3 90 *** Got signal Terminated *** 2023-12-05T13:35:19.723 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:19 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:35:19.556+0000 7fab4cf19700 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:35:23.973 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:23 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:35:23.512+0000 7fab45d0d700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.212665+0000 front 2023-12-05T13:35:00.212624+0000 (oldest deadline 2023-12-05T13:35:23.112488+0000) 2023-12-05T13:35:24.973 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:24 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3[196794]: 2023-12-05T13:35:24.551+0000 7fab45d0d700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.212665+0000 front 2023-12-05T13:35:00.212624+0000 (oldest deadline 2023-12-05T13:35:23.112488+0000) 2023-12-05T13:35:25.329 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:25 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:25.023+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:25.723 INFO:journalctl@ceph.osd.3.smithi052.stdout:Dec 05 13:35:25 smithi052 bash[215621]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-3 2023-12-05T13:35:26.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:26 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:26.008+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:26.665 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:26 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:26.273+0000 7fa665036700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.587525+0000 front 2023-12-05T13:35:00.587621+0000 (oldest deadline 2023-12-05T13:35:25.887394+0000) 2023-12-05T13:35:26.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.3.service' 2023-12-05T13:35:26.726 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:35:26.726 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-05T13:35:26.726 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-05T13:35:26.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.4 2023-12-05T13:35:26.964 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:26 smithi052 systemd[1]: Stopping Ceph osd.4 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:35:27.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:27 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:27.017+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:27.225 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:26 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:26.962+0000 7fa66aa3f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:35:27.225 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:26 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:26.962+0000 7fa66aa3f700 -1 osd.4 90 *** Got signal Terminated *** 2023-12-05T13:35:27.225 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:26 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:26.962+0000 7fa66aa3f700 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:35:27.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:27 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:27.238+0000 7fa665036700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.587525+0000 front 2023-12-05T13:35:00.587621+0000 (oldest deadline 2023-12-05T13:35:25.887394+0000) 2023-12-05T13:35:28.473 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:28 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:28.264+0000 7fa665036700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.587525+0000 front 2023-12-05T13:35:00.587621+0000 (oldest deadline 2023-12-05T13:35:25.887394+0000) 2023-12-05T13:35:28.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:28 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:28.038+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:29.296 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:28 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:28.993+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:29.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:29 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:29.295+0000 7fa665036700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.587525+0000 front 2023-12-05T13:35:00.587621+0000 (oldest deadline 2023-12-05T13:35:25.887394+0000) 2023-12-05T13:35:30.327 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:29 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:29.986+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:30.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:30 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:30.326+0000 7fa665036700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.587525+0000 front 2023-12-05T13:35:00.587621+0000 (oldest deadline 2023-12-05T13:35:25.887394+0000) 2023-12-05T13:35:31.369 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:30 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:30.975+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:31.370 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:30 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:30.975+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:31.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:31 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4[203679]: 2023-12-05T13:35:31.368+0000 7fa665036700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.587525+0000 front 2023-12-05T13:35:00.587621+0000 (oldest deadline 2023-12-05T13:35:25.887394+0000) 2023-12-05T13:35:32.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:31 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:31.953+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:32.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:31 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:31.953+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:32.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Dec 05 13:35:32 smithi052 bash[215883]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-4 2023-12-05T13:35:33.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:32 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:32.959+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:33.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:32 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:32.959+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:33.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.4.service' 2023-12-05T13:35:33.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:35:33.784 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-05T13:35:33.785 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-05T13:35:33.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.5 2023-12-05T13:35:33.990 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:33 smithi052 systemd[1]: Stopping Ceph osd.5 for 34f4f484-9370-11ee-95a2-87774f69a715... 2023-12-05T13:35:34.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:33 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:33.989+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:34.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:33 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:33.989+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:34.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:34.036+0000 7f7e52f87700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T13:35:34.473 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:34.036+0000 7f7e52f87700 -1 osd.5 90 *** Got signal Terminated *** 2023-12-05T13:35:34.474 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:34.036+0000 7f7e52f87700 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T13:35:35.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:34.945+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:35.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:34 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:34.945+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:36.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:35 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:35.928+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:36.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:35 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:35.928+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:37.222 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:36 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:36.883+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:37.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:36 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:36.883+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:38.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:37 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:37.897+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:38.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:37 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:37.897+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:38.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:37 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:37.897+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6822 osd.2 since back 2023-12-05T13:35:14.002045+0000 front 2023-12-05T13:35:14.002066+0000 (oldest deadline 2023-12-05T13:35:37.501913+0000) 2023-12-05T13:35:39.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:38 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:38.940+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2023-12-05T13:35:00.700431+0000 front 2023-12-05T13:35:00.700314+0000 (oldest deadline 2023-12-05T13:35:24.200148+0000) 2023-12-05T13:35:39.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:38 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:38.940+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6814 osd.1 since back 2023-12-05T13:35:04.200605+0000 front 2023-12-05T13:35:04.200646+0000 (oldest deadline 2023-12-05T13:35:30.600815+0000) 2023-12-05T13:35:39.223 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:38 smithi052 ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5[209937]: 2023-12-05T13:35:38.940+0000 7f7e4f582700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.29:6822 osd.2 since back 2023-12-05T13:35:14.002045+0000 front 2023-12-05T13:35:14.002066+0000 (oldest deadline 2023-12-05T13:35:37.501913+0000) 2023-12-05T13:35:39.973 INFO:journalctl@ceph.osd.5.smithi052.stdout:Dec 05 13:35:39 smithi052 bash[216145]: ceph-34f4f484-9370-11ee-95a2-87774f69a715-osd-5 2023-12-05T13:35:40.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34f4f484-9370-11ee-95a2-87774f69a715@osd.5.service' 2023-12-05T13:35:40.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T13:35:40.983 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-05T13:35:40.984 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34f4f484-9370-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-05T13:35:57.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34f4f484-9370-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-05T13:36:07.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:36:07.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T13:36:07.706 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-05T13:36:07.708 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/remote/smithi029/crash 2023-12-05T13:36:07.709 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/crash -- . 2023-12-05T13:36:07.751 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-05T13:36:07.751 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now 2023-12-05T13:36:07.754 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/remote/smithi052/crash 2023-12-05T13:36:07.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/crash -- . 2023-12-05T13:36:07.788 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/34f4f484-9370-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-05T13:36:07.788 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2023-12-05T13:36:07.789 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-05T13:36:07.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-05T13:36:07.830 INFO:teuthology.orchestra.run.smithi029.stderr:grep: /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-05T13:36:07.833 INFO:tasks.cephadm:Compressing logs... 2023-12-05T13:36:07.833 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T13:36:07.876 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T13:36:07.908 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-05T13:36:07.908 INFO:teuthology.orchestra.run.smithi029.stderr:: No such file or directory 2023-12-05T13:36:07.908 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mgr.smithi029.eekhlu.log 2023-12-05T13:36:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-05T13:36:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-05T13:36:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mgr.smithi029.eekhlu.log: /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi029.jdhffk.log 2023-12-05T13:36:07.910 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-05T13:36:07.910 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-05T13:36:07.911 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-05T13:36:07.911 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi052.dsxvue.log 2023-12-05T13:36:07.912 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-05T13:36:07.912 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-05T13:36:07.912 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi052.dsxvue.log: /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi052.nbpymg.log 2023-12-05T13:36:07.916 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-05T13:36:07.916 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi052.nbpymg.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mgr.smithi052.ocazcp.log 2023-12-05T13:36:07.916 INFO:teuthology.orchestra.run.smithi052.stderr: 92.2%/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.4.log: -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-05T13:36:07.916 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mgr.smithi052.ocazcp.log: 94.0% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi052.dsxvue.log.gz 2023-12-05T13:36:07.917 INFO:teuthology.orchestra.run.smithi052.stderr: 94.1% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi052.nbpymg.log.gz 2023-12-05T13:36:07.917 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi029.jdhffk.log: /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi029.pbbvzt.log 2023-12-05T13:36:07.918 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi029.pbbvzt.log: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-05T13:36:07.919 INFO:teuthology.orchestra.run.smithi029.stderr: 94.1% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi029.pbbvzt.log.gz 2023-12-05T13:36:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mon.smithi029.log 2023-12-05T13:36:07.919 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-05T13:36:07.922 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-05T13:36:07.922 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mon.smithi052.log 2023-12-05T13:36:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mon.smithi029.log: /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.1.log: 91.0% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-05T13:36:07.927 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.5.log: /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mon.smithi052.log: 91.0% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-05T13:36:07.958 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mgr.smithi052.ocazcp.log.gz 2023-12-05T13:36:08.192 INFO:teuthology.orchestra.run.smithi052.stderr: 92.6% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mon.smithi052.log.gz 2023-12-05T13:36:08.234 INFO:teuthology.orchestra.run.smithi029.stderr: 88.3% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mgr.smithi029.eekhlu.log.gz 2023-12-05T13:36:08.567 INFO:teuthology.orchestra.run.smithi029.stderr: 90.7% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mon.smithi029.log.gz 2023-12-05T13:36:12.326 INFO:teuthology.orchestra.run.smithi052.stderr: 93.5% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-05T13:36:12.779 INFO:teuthology.orchestra.run.smithi029.stderr: 93.6% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-05T13:36:13.285 INFO:teuthology.orchestra.run.smithi029.stderr: 93.5% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-05T13:36:14.019 INFO:teuthology.orchestra.run.smithi052.stderr: 93.5% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-05T13:36:15.239 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-05T13:36:15.241 INFO:teuthology.orchestra.run.smithi052.stderr: 2023-12-05T13:36:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m7.343s 2023-12-05T13:36:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m17.484s 2023-12-05T13:36:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.694s 2023-12-05T13:36:15.601 INFO:teuthology.orchestra.run.smithi029.stderr: 92.8% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-05T13:37:41.028 INFO:teuthology.orchestra.run.smithi029.stderr: 92.9% -- replaced with /var/log/ceph/34f4f484-9370-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi029.jdhffk.log.gz 2023-12-05T13:37:41.030 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-12-05T13:37:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:real 1m33.134s 2023-12-05T13:37:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:user 1m47.976s 2023-12-05T13:37:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m3.824s 2023-12-05T13:37:41.031 INFO:tasks.cephadm:Archiving logs... 2023-12-05T13:37:41.031 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/remote/smithi029/log 2023-12-05T13:37:41.033 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T13:37:56.675 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/remote/smithi052/log 2023-12-05T13:37:56.676 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T13:37:59.195 INFO:tasks.cephadm:Removing cluster... 2023-12-05T13:37:59.196 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34f4f484-9370-11ee-95a2-87774f69a715 --force 2023-12-05T13:37:59.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34f4f484-9370-11ee-95a2-87774f69a715 --force 2023-12-05T13:38:00.376 INFO:tasks.cephadm:Removing cephadm ... 2023-12-05T13:38:00.377 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-05T13:38:00.402 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-05T13:38:00.424 INFO:tasks.cephadm:Teardown complete 2023-12-05T13:38:00.424 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-05T13:38:00.439 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-05T13:38:00.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-05T13:38:00.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-05T13:38:00.554 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-05T13:38:00.565 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-05T13:38:00.565 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T13:38:00.568 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T13:38:00.587 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-12-05T13:38:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:bash: ntpq: command not found 2023-12-05T13:38:00.592 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T13:38:00.593 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-12-05T13:38:00.593 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 +2084us[+2084us] +/- 83ms 2023-12-05T13:38:00.593 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -3118us[-3087us] +/- 76ms 2023-12-05T13:38:00.593 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +1169us[+1169us] +/- 75ms 2023-12-05T13:38:00.593 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:38:00.594 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T13:38:00.595 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-12-05T13:38:00.595 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 30 +2093us[+2101us] +/- 83ms 2023-12-05T13:38:00.595 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -3117us[-3109us] +/- 76ms 2023-12-05T13:38:00.595 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +1173us[+1173us] +/- 75ms 2023-12-05T13:38:00.595 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T13:38:00.596 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-05T13:38:00.607 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-05T13:38:00.607 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-05T13:38:00.617 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-05T13:38:00.751 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-05T13:38:00.865 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T13:38:00.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:38:00.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T13:38:00.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:38:00.942 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-05T13:38:00.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-05T13:38:00.964 INFO:teuthology.task.internal:Duration was 2728.970392 seconds 2023-12-05T13:38:00.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-05T13:38:00.975 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-05T13:38:00.975 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-05T13:38:00.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-05T13:38:01.035 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T13:38:01.038 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T13:38:01.367 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-05T13:38:01.367 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2023-12-05T13:38:01.367 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-05T13:38:01.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2023-12-05T13:38:01.397 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-05T13:38:01.427 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-05T13:38:01.427 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-05T13:38:01.440 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-05T13:38:01.529 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-05T13:38:01.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-05T13:38:01.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-05T13:38:01.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-05T13:38:01.675 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-05T13:38:01.676 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-05T13:38:01.707 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-05T13:38:01.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-05T13:38:01.752 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-05T13:38:01.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-05T13:38:01.785 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2023-12-05T13:38:01.816 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2023-12-05T13:38:01.832 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-05T13:38:01.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:38:01.863 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-05T13:38:01.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T13:38:01.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-05T13:38:01.909 INFO:teuthology.task.internal:Transferring archived files... 2023-12-05T13:38:01.910 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/remote/smithi029 2023-12-05T13:38:01.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T13:38:01.962 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738/remote/smithi052 2023-12-05T13:38:01.962 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T13:38:02.009 INFO:teuthology.task.internal:Removing archive directory... 2023-12-05T13:38:02.010 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-05T13:38:02.012 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-05T13:38:02.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-05T13:38:02.080 INFO:teuthology.task.internal:Not uploading archives. 2023-12-05T13:38:02.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-05T13:38:02.092 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-05T13:38:02.092 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-05T13:38:02.095 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-05T13:38:02.115 INFO:teuthology.orchestra.run.smithi029.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 5 13:38 /home/ubuntu/cephtest 2023-12-05T13:38:02.129 INFO:teuthology.orchestra.run.smithi052.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 5 13:38 /home/ubuntu/cephtest 2023-12-05T13:38:02.131 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-05T13:38:02.144 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-05T13:38:02.169 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T13:38:02.196 DEBUG:teuthology.nuke:shortname: smithi029 2023-12-05T13:38:02.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T13:38:02.220 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 12:41:15.499889', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8u5Xufgsj8kse/lSzXjFlxRJUe03SS4csCqrrA4wscfGtg1jNWu3FFT+BT4Joerd0rPaAmHMx39hENIANfhPw='} 2023-12-05T13:38:02.225 DEBUG:teuthology.nuke:shortname: smithi052 2023-12-05T13:38:02.225 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T13:38:02.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-05_12:39:43-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7477738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 12:41:15.501394', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVRz/esdz98leH1DXsUIhaPR9E13ph7Aa69IvrLLJi2ulcizaNi4zYjElgIHaBcuHZGUcXKT9jOcXKPjlCA/0g='} 2023-12-05T13:38:02.284 INFO:teuthology.orchestra.console.smithi029:Power off 2023-12-05T13:38:02.285 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T13:38:02.312 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-12-05T13:38:02.313 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T13:38:02.337 INFO:teuthology.orchestra.console.smithi052:Power off 2023-12-05T13:38:02.337 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T13:38:02.347 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-12-05T13:38:02.360 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2023-12-05T13:38:02.361 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T13:38:02.387 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-12-05T13:38:06.348 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T13:38:06.388 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T13:38:06.461 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-12-05T13:38:06.502 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2023-12-05T13:38:10.466 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T13:38:10.504 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T13:38:10.577 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-12-05T13:38:10.620 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2023-12-05T13:38:10.679 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-12-05T13:38:10.721 INFO:teuthology.orchestra.console.smithi052:Power off completed 2023-12-05T13:38:10.827 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2728.9703919887543 failure_reason: 'Command failed on smithi029 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34f4f484-9370-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_gabrioux@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5d21bd936375425290db261cbdde114a status: fail success: false 2023-12-05T13:38:10.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T13:38:10.905 INFO:teuthology.run:FAIL